Terminal device, information processing method, and information processing program

Abstract

To provide a terminal device, an information processing method, and an information processing program capable of providing information more suitable to a user.SOLUTION: A terminal device includes a position detection unit, an acquisition unit, a selection unit, and a provision unit. The position detection unit detects a current position of a user. The acquisition unit acquires, from an external device, a place list that is a list of a plurality of places located around the current position by using position information that is information on a position at which accuracy of the current position is reduced detected by the position detection unit. The selection unit selects information on one or more places from information of the plurality of places included in the place list acquired by the acquisition unit based on a context of the user. The provision unit provides information on the one or more places selected by the selection unit to the user.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a terminal device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, there are known techniques for providing users with location information of stores, facilities, etc. For example, Patent Document 1 discloses an information transmission device that acquires location information detected by a terminal device held by a user and transmits location information of stores, facilities, etc. close to the location of the terminal device to the terminal device based on the acquired location information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-032189 Summary of the Invention [Problem to be solved by the invention]

[0004] However, while the above-mentioned conventional technology can provide users with information about the locations of stores, facilities, and the like close to the location of the terminal device, there is room for improvement in providing more suitable information to users.

[0005] The present application has been made in view of the above, and aims to provide a terminal device, an information processing method, and an information processing program that can provide information that is more suitable for the user. [Means for solving the problem]

[0006] A terminal device according to the present application includes a location detection unit, an acquisition unit, a selection unit, and a provision unit. The location detection unit detects the current location of a user. The acquisition unit acquires a location list, which is a list of multiple locations located around the current location, from an external device using location information, which is location information obtained by reducing the accuracy of the current location detected by the location detection unit. The selection unit selects one or more pieces of location information from the multiple pieces of location information included in the location list acquired by the acquisition unit, based on the user's context. The provision unit provides the one or more pieces of location information selected by the selection unit to the user. [Effects of the Invention]

[0007] According to one aspect of the embodiment, it is possible to provide information that is more suitable for the user. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram for explaining an information processing method performed by a terminal device according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an information processing system including a terminal device according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of the acquisition unit of the terminal device according to the embodiment. [Figure 5] FIG. 5 is a flowchart illustrating an example of information processing by the processing unit of the terminal device according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a suggested information providing process performed by the processing unit of the terminal device according to the embodiment. [Figure 7] FIG. 7 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the terminal device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, a terminal device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the terminal device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the embodiments can be appropriately combined as long as the processing content is not contradictory. Furthermore, the same components in the following embodiments will be denoted by the same reference numerals, and duplicated explanations will be omitted.

[0010] [1. An example of information processing] First, an information processing method performed by a terminal device according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an information processing method performed by a terminal device according to an embodiment.

[0011] The terminal device 1 shown in FIG. 1 is, for example, a terminal device that can utilize an AI (Artificial Intelligence) assistant function that supports interactive voice operation, and a user U can control peripheral devices and obtain various information by interacting with the terminal device 1.

[0012] Furthermore, when the user U speaks to the terminal device 1 to obtain information from the information providing device 2, the terminal device 1 transmits information corresponding to the utterance to the information providing device 2. The terminal device 1 can obtain content (for example, various information such as store information, facility information, event information, traffic congestion information, weather forecast, transaction target, news, traffic information, weather, and music) provided from the information providing device 2 via the network N (see FIG. 2) corresponding to the information corresponding to the utterance, and can display the obtained content on the display unit or output it from the speaker. An example of information processing performed by the terminal device 1 will be described below.

[0013] First, the terminal device 1 acquires information about a captured image (step S1). For example, if information about the captured image is stored in the storage unit of the terminal device 1, the processing unit of the terminal device 1 acquires the information about the captured image stored in the storage unit of the terminal device 1.

[0014] The information on the captured image stored in the memory unit of the terminal device 1 includes, for example, information on the captured image captured by the imaging unit of the terminal device 1, information on the captured image (hereinafter sometimes referred to as a captured image) obtained by screenshot processing by the processing unit of the terminal device 1, etc.

[0015] Next, the terminal device 1 learns in advance (step S2) the characteristics of the information of the captured image acquired in step S1 before providing the provided information to the user U. In the processing of step S2, the terminal device 1 determines, for each captured image, the object included in the captured image, the capturing position of the captured image, and the acquisition type of the captured image, for example, based on the information of the captured image, and learns the characteristics of the information of the captured image based on the determination results.

[0016] The terminal device 1 determines, for example, people (e.g., user U, family members of user U, friends of user U, etc.) and objects (e.g., food, stores, facilities, etc.) included in the captured image as objects included in the captured image.

[0017] The captured image information includes image information about the captured image and additional information about the captured image. The image information is information about the captured image itself, including information about each pixel. The additional information is, for example, Exif (Exchangeable Image File Format) information, and includes information about the capture location of the captured image, information about the capture date and time of the captured image, information about the capture direction of the captured image, and information about the manufacturer and model of the imaging device.

[0018] The terminal device 1 determines the imaging position and acquisition type of the captured image based on the additional information of the captured image. Based on the information on the manufacturer and model of the imaging device included in the additional information of the captured image, the terminal device 1 determines the acquisition type of the captured image, such as whether the captured image information acquired in step S1 is an image captured by the imaging unit of the terminal device 1 or a captured image obtained by the processing unit of the terminal device 1.

[0019] Then, the terminal device 1 learns the features of the information in the captured image based on the determined object included in the captured image, the capture position of the captured image, the acquisition type of the captured image, etc. For example, the terminal device 1 learns one or both of the behavior pattern of the user U and the attributes of the user U as the features of the information in the captured image.

[0020] Examples of user U's behavioral patterns include, but are not limited to, places that user U frequently visits (e.g., stores, facilities, or areas), user U's commuting patterns (commuting route, time of day, day of week, etc.), and people accompanying user U when he / she is out and about (attributes of the people accompanying him / her (e.g., children or spouse), time of accompanying, day of week, etc.). Examples of user U's attributes include, but are not limited to, user U's gender, age, family, and interests (e.g., favorite foods).

[0021] The terminal device 1 has, for example, first judgment information indicating judgment conditions for each behavior pattern, and learns the characteristics of the information in the captured image by estimating, based on the first judgment information, a behavior pattern among multiple behavior patterns that satisfies the judgment conditions as the behavior pattern of user U.

[0022] In addition, the terminal device 1 has, for example, second judgment information indicating judgment conditions for each attribute, and learns the characteristics of the information in the captured image by estimating, based on the second judgment information, attributes among the multiple attributes that satisfy the judgment conditions as attributes of the user U.

[0023] The feature of the information of the captured image may be the object (e.g., a person or an object) itself included in the captured image. For example, if the captured image includes an image of pancakes, the feature of the information of the captured image may be the pancakes. Also, if the captured image includes an image of a specific store, the feature of the information of the captured image may be the specific store.

[0024] Next, if the user U wants to know necessary information, for example, the user U makes an utterance to acquire the desired information (step S3). The terminal device 1 accepts the utterance from the user U as a search request and identifies a search target in response to the search request (step S4).

[0025] The terminal device 1 has a voice recognition model and a keyword estimation model. The voice recognition model and the keyword estimation model are, for example, models generated in advance by machine learning. The terminal device 1 uses the voice recognition model to perform voice recognition on utterances from a user U, and uses the keyword estimation model to estimate search keywords.

[0026] For example, the terminal device 1 inputs a speech signal of an utterance from a user U into a speech recognition model, and obtains text information output from the speech recognition model as a speech recognition result. In addition, the terminal device 1 inputs the speech recognition result into a keyword estimation model, and obtains the keyword output from the keyword estimation model as a search keyword.

[0027] For example, if the user U utters "gasoline," the terminal device 1 identifies "gas station" as the search target. Also, if the user U utters "rice ball," the terminal device 1 identifies "convenience store" as the search target.

[0028] Next, the terminal device 1 detects its current position (step S5). For example, the processing unit of the terminal device 1 causes the position detection unit of the terminal device 1 to detect the current position of the terminal device 1. The position detection unit of the terminal device 1 receives, for example, a plurality of positioning signals transmitted from a plurality of positioning satellites in the GNSS (Global Navigation Satellite System), and detects the position of the terminal device 1 based on the received plurality of positioning signals. The processing unit of the terminal device 1 acquires information on the current position detected by the position detection unit of the terminal device 1.

[0029] Next, the terminal device 1 reduces the accuracy of the current location detected in step S5 (step S6). For example, assume that the current location detected in step S5 is the latitude and longitude of the current location, and that the latitude and longitude are indicated to m decimal places, where m is an integer. In this case, the terminal device 1 reduces the accuracy of the current location detected in step S5 by reducing the number of decimal places in the value indicating the latitude and longitude of the current location detected in step S5.

[0030] For example, the terminal device 1 reduces the accuracy of the current location detected in step S5 by setting the value indicating the latitude and longitude of the current location to a value with k decimal places (m>k), where k is an integer. For example, the terminal device 1 can convert the current location detected in step S5 into a value in units of approximately kilometers by setting k=2.

[0031] In this way, the terminal device 1 transmits current location information with reduced accuracy to the information providing device 2, thereby preventing the possibility that the specific current location of the user U will be known by the information providing device 2. Therefore, the terminal device 1 can meet the needs of the user U who does not want their specific current location to be known. Hereinafter, the current location with reduced accuracy in step S6 may be referred to as low-accuracy location information.

[0032] Furthermore, the terminal device 1 can also change the degree of degradation in accuracy of the current location, for example, based on the context of the user U. The context of the user U is, for example, the movement state of the user U, as will be described later. The movement state of the user U includes the movement direction of the user U, the movement speed of the user U, the current location of the user U, etc.

[0033] In step S6, the terminal device 1 can, for example, decrease the accuracy of the current location as the moving speed of the user U increases, or decrease the accuracy of the current location at a degree of decrease according to the moving direction of the user U. Furthermore, in step S6, when the user U's means of transportation is a train, the terminal device 1 can decrease the accuracy of the current location at a higher degree of decrease than when the user U's means of transportation is a car.

[0034] Furthermore, the terminal device 1 can also change the degree of reduction in accuracy of the current location based on the search target identified in step S4. For example, the terminal device 1 reduces the accuracy of the current location detected in step S5 by a degree of reduction according to the search target identified in step S4.

[0035] For example, the terminal device 1 can change the degree of decrease in accuracy of the current location depending on the type of search target, for example, when the search target is a "gas station" or when the search target is a "convenience store."

[0036] The terminal device 1 has information associating the search target with the degree of degradation for each search target, and reduces the accuracy of the current location by the degree of degradation associated with the search target identified in step S4.

[0037] Next, the terminal device 1 transmits an information transmission request including information indicating low-accuracy position information, which is the current position whose accuracy has been reduced in step S6, to the information providing device 2 (step S7).

[0038] Next, when the information providing device 2 receives an information transmission request from the terminal device 1, it transmits to the terminal device 1 provision information including multiple proposal candidate information, which is information on proposal candidates to the user U, based on the low-accuracy location information included in the received information transmission request (step S8).

[0039] For example, based on the low-accuracy location information included in the information transmission request, the information providing device 2 determines information on places (for example, stores or facilities) within a predetermined range centered on the location indicated by the low-accuracy location information as candidate information to be proposed to the user U. The predetermined range is, for example, a range of up to several kilometers or up to 10-odd kilometers centered on the low-accuracy location information, but is not limited to such examples.

[0040] Suggested candidates for user U include various locations such as stores of the location type "gas station," stores of the location type "convenience store," stores of the location type "restaurant," locations of the location type "parking lot," stores of the location type "park," stores of the location type "home improvement center," and facilities of the location type "commercial complex."

[0041] The information providing device 2 transmits to the terminal device 1 information to be provided, which includes multiple pieces of proposal candidate information, which is information on proposal candidates to the determined user U. The information to be provided includes, for example, information on a list of places for each place type. For example, the information to be provided includes various place lists, such as a store list of the place type "gas station," a store list of the place type "convenience store," and a store list of the place type "restaurant."

[0042] Next, when the terminal device 1 receives the provided information transmitted from the information providing device 2, it selects a location list corresponding to the search target identified in step S4 from among the multiple location lists included in the provided information (step S9).

[0043] For example, the terminal device 1 selects a location list that includes information corresponding to the search target identified in step S4 from among multiple location lists included in the provided information. For example, if the search target identified in step S4 is a store type "gas station," the terminal device 1 selects a store list of the store type "gas station." Furthermore, if the search target identified in step S4 is a store type "restaurant," the terminal device 1 selects a store list of the store type "restaurant."

[0044] Next, the terminal device 1 selects, from the location information included in the location list selected in step S9, location information that satisfies a specific condition as suggested information, which is information to be proposed (step S10). The location that satisfies the specific condition is, for example, a location according to the context of the user U, or a location according to the characteristics of the information of the captured image learned in step S2.

[0045] The context of user U is, for example, the movement state of user U, the congestion state on the estimated movement route of user U, the weather condition on the estimated movement route of user U, etc. As described above, the movement state of user U includes the movement direction of user U, the movement speed of user U, the current location of user U, the means of transportation of user U, and the person accompanying user U.

[0046] The movement state of the user U is determined, for example, according to the detection results of a sensor such as a position detection unit provided in the terminal device 1. For example, the terminal device 1 determines the movement direction, movement speed, means of transportation, and accompanying persons of the user U based on the change in the position of the user U detected by the position detection unit.

[0047] The user U's means of transportation is, for example, walking, bicycle, car, etc., and the terminal device 1 determines the user U's means of transportation based on, for example, the moving speed of the user U. Furthermore, the user U's accompanying person is, for example, the user U's child, and the terminal device 1 determines that the user U's accompanying person is the user U's child if, for example, the user U's moving speed is slower than usual.

[0048] Furthermore, the terminal device 1 can acquire, for example, from an external device, the congestion state along the estimated travel route of the user U and the weather condition along the estimated travel route of the user U, based on the current location of the user U detected by the location detection unit. Furthermore, the terminal device 1 can determine, from the travel state of the user U, whether the user U is commuting, shopping, traveling, or the like, as the context of the user U.

[0049] The terminal device 1 can select, for example, location information according to the context as the information to be suggested from among the information of multiple locations shown in the location list including information corresponding to the search target identified in step S4. For example, the terminal device 1 selects, as the information to be suggested, location information within a range according to the context from the current location of the user U.

[0050] For example, the terminal device 1 can set the range according to the context to a range centered on the current location of the user U in the direction of movement of the user U, extending to a position farther than the range in the opposite direction to the direction of movement of the user U. This allows the terminal device 1 to select, as suggested information, information about a location within a range appropriate for the context of the user U.

[0051] Furthermore, the terminal device 1 can widen the range according to the context as the moving speed of the user U increases. This allows the terminal device 1 to select information about places in a range that is suitable for the context of the user U as information to be suggested.

[0052] Furthermore, when the user U travels by car, the terminal device 1 can also set the range to the left of the direction of travel of the user U as the range according to the context. This allows the terminal device 1 to select information about places that are easy for the user U to enter as information to be suggested.

[0053] In addition, if user U's means of transportation is a train, terminal device 1 can determine the direction of travel of the train from user U's direction of movement, and set a predetermined range centered on a station in the direction of travel as the range corresponding to the context.

[0054] The terminal device 1 can also select information about places categorized according to the context as the information to be proposed. For example, the terminal device 1 selects information about places categorized according to one or more of the user U's current location, movement speed, movement direction, and means of transportation as the information to be proposed. For example, the terminal device 1 selects information about places categorized differently depending on whether the user U's means of transportation is walking, car, or train as the information to be proposed. Places categorized according to the context include, for example, places that are easy to reach on foot from the user U's current location, places that are easy to reach by car from the user U's current location, and places that are easy to reach by train from the user U's current location.

[0055] Furthermore, when the search target is a restaurant and a list of restaurants is selected in step S9, if the user U's current location is on a high floor of an apartment building, the terminal device 1 selects, for example, information about restaurants that can deliver food and drink as information to be suggested.

[0056] Furthermore, when the search target is a restaurant and the store list of shoe shops is selected in step S9, if the user U's means of transportation is walking, the terminal device 1 selects, for example, information on sneaker stores as information to be suggested.

[0057] Furthermore, the terminal device 1 can select, as information to be proposed, information on a location that corresponds to the characteristics of the information on the captured image learned in step S2 from the information on the location included in the location list selected in step S9.

[0058] For example, if the characteristics of the information of the captured image learned in step S2 are a store or facility, and the information of the captured image is information of a captured image, the terminal device 1 can select the information of the store or facility learned as a characteristic of the information of the captured image from the information of the locations included in the location list selected in step S9 as the information to be proposed.

[0059] If the information of the captured image is information of a captured image, it is estimated that the stores and facilities included in the captured image are likely to be stores and facilities that the user U would like to visit, and therefore the terminal device 1 can select appropriate suggested items.

[0060] Furthermore, if the captured image information is information about an image captured by the imaging unit of the terminal device 1 and the features of the captured image information learned in step S2 are a store or facility, the terminal device 1 selects as suggested stores or facilities that are different from the aforementioned stores or facilities and that are estimated not to have been visited by the user U. Stores and facilities that are features of the captured image information are examples of places that correspond to the features of the captured image information.

[0061] Furthermore, if the feature of the information of the captured image learned in step S2 is a behavioral pattern of the user U, the terminal device 1 can select, as suggested information, information on a location according to the behavioral pattern of the user U. The behavioral pattern is defined by, for example, the content of the behavior, the time and day of the behavior, the area of ​​the behavior, accompanying persons, etc.

[0062] For example, suppose that the learned behavior pattern of user U is a pattern of eating lunch with children, and the current situation (time period, day of the week, area, etc.) is the same as or close to the situation of eating lunch with children (time period, day of the week, area, etc.). In this case, if the location list selected in step S9 is a list of restaurants, terminal device 1 selects, as a suggestion target, a restaurant that can be visited casually with children from among multiple restaurants included in the list of restaurants.

[0063] Furthermore, when the user U is about to perform a specific action (for example, going to the toilet, smoking a cigarette, drinking water, etc.) or is approaching that time, the terminal device 1 selects, as the information to be suggested, information about a location where the specific action can be performed from among the information about multiple locations shown in the location list selected in step S9.

[0064] Furthermore, if the learned attribute of user U is the user U's favorite food and the location list selected in step S9 is a restaurant list, the terminal device 1 selects as a suggestion target a restaurant that serves the user U's favorite food from among multiple restaurants included in the restaurant list.

[0065] Furthermore, if the learned attribute of user U is a male student in his twenties and the location list selected in step S9 is a list of restaurants, the terminal device 1 selects as suggested restaurants those that are popular among male students in their twenties from among the multiple restaurants included in the list of restaurants.

[0066] The terminal device 1 can select, as the information to be proposed, location information according to the context of the user U and location information according to the characteristics of the information of the captured image. Furthermore, when there is no location information according to the context of the user U, the terminal device 1 can select, as the information to be proposed, location information according to the characteristics of the information of the captured image, or when there is no location information according to the characteristics of the information of the captured image, the terminal device 1 can select, as the information to be proposed, location information according to the context of the user U.

[0067] Next, the terminal device 1 provides the information on the proposal target selected in step S10 as proposal information to the user U (step S11). In step S11, the terminal device 1 outputs the proposal information as voice, or as text or an image.

[0068] In this way, the terminal device 1 acquires a location list (store list or facility list) that is a list of multiple locations (stores and facilities) located around the current location from the information providing device 2 (an example of an external device) using location information that is location information with reduced accuracy of the current location detected by the location detection unit. This makes it difficult for the information providing device 2 to identify the specific location of the user U, and can meet the needs of the user U who does not want their specific current location to be known.

[0069] Furthermore, the terminal device 1 selects one or more pieces of location information from the plurality of pieces of location information included in the location list based on the context of the user U, and provides information on the selected one or more stores to the user U. This allows the terminal device 1 to provide information that is appropriate for the user U's current location.

[0070] Furthermore, the terminal device 1 learns the characteristics of the information of the captured image, selects, from among a plurality of pieces of proposal candidate information, proposal candidate information that corresponds to the learned characteristics of the information of the captured image as proposal information, and provides the selected proposal information to the user U. In this way, the terminal device 1 can provide information that corresponds to the current location of the user U and is more suitable for the user U.

[0071] [2. Information Processing System Configuration] 2 is a diagram showing an example of the configuration of an information processing system including a terminal device 1 according to the embodiment. As shown in FIG. 2, the information processing system 100 according to the embodiment includes the terminal device 1 and an information providing device 2.

[0072] The terminal device 1 and the information providing device 2 are connected to a network N and can transmit and receive information to and from each other via the network N. The network N is a network including, for example, a wide area network (WAN) such as the Internet. Note that the network N is configured to include, for example, a mobile communication system such as 4G (4th Generation) or 5G (5th Generation), but is not limited to such examples.

[0073] Each terminal device 1 is a terminal device operated by a user U who uses a service provided by the information providing device 2, and is, for example, a personal computer, a tablet, a PDA (Personal Digital Assistant), or a smartphone. Note that the terminal device 1 is not limited to the above examples, and may be, for example, a smart watch or a wearable device.

[0074] The information providing device 2 is an information processing device that provides various types of information, and is realized by, for example, a server device or a cloud system, etc. For example, the information providing device 2 is a search server that performs search processing based on a search request transmitted from the terminal device 1, and transmits search results indicating the results of the search processing to the terminal device 1, thereby providing information in response to the search request.

[0075] The information providing device 2 can also provide information regarding transaction subjects in online shopping malls, internet shopping sites, flea market sites, auction sites, reservation sites for travel or restaurants, credit card contract sites, financial product provision sites, etc.

[0076] [3. Terminal Device 1] Fig. 3 is a diagram showing an example of the configuration of the terminal device 1 according to the embodiment. As shown in Fig. 3, the terminal device 1 according to the embodiment includes a communication unit 10, a display unit 11, an operation unit 12, an audio input unit 13, an audio output unit 14, an imaging unit 15, a sensor unit 16, a storage unit 17, and a processing unit 18.

[0077] [3.1. Communication Unit 10] The communication unit 10 is realized by, for example, a network interface card (NIC), etc. The communication unit 10 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the information providing device 2 via the network N.

[0078] [3.2. Display section 11] The display unit 11 is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display.

[0079] [3.3. Operation unit 12] The operation unit 12 includes, for example, a keyboard including keys for inputting letters, numbers, and spaces, an enter key, and arrow keys, a mouse, a power button, etc. When the display unit 11 is a touch panel display device, the operation unit 12 may include a touch panel.

[0080] [3.4. Audio input unit 13] The voice input unit 13 converts a voice signal, which is a signal of the voice uttered by the user U, into a digital signal and outputs the converted digital signal, which is a voice digital signal, as voice information to the processing unit 18. The voice input unit 13 includes, for example, a microphone and an AD (Analog to Digital) converter that converts the voice signal, which is an electrical analog signal output from the microphone, into a digital signal.

[0081] [3.5. Audio output unit 14] The audio output unit 14 includes, for example, a DA (Digital to Analog) converter that converts a digital audio signal, which is audio information output from the processing unit 18, into an analog audio signal, and a speaker that converts the analog audio signal output from the DA converter into sound and outputs it.

[0082] [3.6. Imaging unit 15] The imaging unit 15 is an image sensor (camera) that captures an image of a subject. For example, the imaging unit 15 is a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor. Note that the imaging unit 15 is not limited to a built-in camera, and may be a wireless camera that can communicate with the terminal device 1, an external camera such as a web camera, or the like.

[0083] [3.7. Sensor unit 16] The sensor unit 16 includes a position detection unit 20 and a gyro sensor 21. The position detection unit 20 detects, for example, the position of the terminal device 1, which is the current position of the user U, and outputs information indicating the detected current position of the user U to the processing unit 18. The position detection unit 20 receives multiple positioning signals transmitted from multiple positioning satellites in the GNSS, and detects the current position of the user U based on the received multiple positioning signals.

[0084] The gyro sensor 21 is a sensor that detects the attitude of the terminal device 1, such as tilt and rotation. The sensor unit 16 also includes an acceleration sensor, a geomagnetic sensor, an illuminance sensor, and an atmospheric pressure sensor. The acceleration sensor is a sensor that detects the acceleration of the terminal device 1. The geomagnetic sensor is a sensor that detects geomagnetism. The illuminance sensor is a sensor that detects illuminance that indicates the brightness of the surroundings of the terminal device 1. The atmospheric pressure sensor is a sensor that detects the atmospheric pressure around the terminal device 1.

[0085] [3.8. Storage section 17] The storage unit 17 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0086] Various types of information are stored in the storage unit 17. For example, the storage unit 17 includes information on captured images that are images captured by the imaging unit 15, information on captured images that are captured images obtained by screenshot processing by the processing unit 18, and the like.

[0087] The storage unit 17 also stores information transmitted from the information providing device 2 or other external devices and acquired by the processing unit 18 via the network N and the communication unit 10. The information acquired from the information providing device 2 or other external devices includes, for example, information on captured images that the user U has saved in external storage.

[0088] The memory unit 17 also stores feature information indicating the characteristics of the information of the captured image learned by the processing unit 18, information detected by the sensor unit 16, and audio information and text information corresponding to the speech of the user U.

[0089] [3.9. Processing Unit 18] The processing unit 18 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the terminal device 1 using RAM as a working area.

[0090] The processing unit 18 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The processing unit 18 includes an acquisition unit 30, a learning unit 31, a reception unit 32, an identification unit 33, a determination unit 34, a selection unit 35, and a provision unit 36.

[0091] [3.9.1. Acquisition part 30] The acquisition unit 30 acquires various types of information. The acquisition unit 30 acquires various types of information from the storage unit 17. The acquisition unit 30 acquires the detection results of the sensor unit 16 and stores the acquired detection results in the storage unit 17.

[0092] The acquisition unit 30 can receive various types of information from an external information processing device via the communication unit 10. The acquisition unit 30 stores in the storage unit 17 the various types of information received from the external information processing device.

[0093] The acquisition unit 30 also transmits an information transmission request to the information providing device 2 via the communication unit 10 and the network N, and receives provided information transmitted from the information providing device 2 in response to the information transmission request via the network N and the communication unit 10. The information transmission request includes location information, which is information about a location obtained by reducing the accuracy of the current location detected by the location detection unit 20.

[0094] 4 is a diagram illustrating an example of the configuration of the acquisition unit 30 of the terminal device 1 according to the embodiment. As illustrated in FIG. 4, the acquisition unit 30 includes an image information acquisition unit 40 and a provided information acquisition unit 41. The image information acquisition unit 40 acquires information about a captured image. For example, the image information acquisition unit 40 acquires information about a captured image stored in the storage unit 17.

[0095] The information on the captured image stored in the memory unit 17 is, for example, information on the captured image by the imaging unit 15, information on the captured image which is the captured image obtained by screenshot processing by the processing unit 18, etc., but it may also be information on the captured image obtained by an application installed on the terminal device 1 (for example, an SNS (Social Networking Service) application).

[0096] The provided information acquisition unit 41 transmits an information transmission request to the information providing device 2 via the communication unit 10 and the network N, and receives provided information transmitted from the information providing device 2 in response to the information transmission request via the network N and the communication unit 10.

[0097] The provided information acquisition unit 41 generates low-accuracy location information, which is location information obtained by reducing the accuracy of the current location detected by the location detection unit 20, and transmits an information transmission request including the generated low-accuracy location information to the information providing device 2. When the information providing device 2 receives an information transmission request from the terminal device 1, it transmits provided information including multiple pieces of proposal candidate information, which are information on proposal candidates to the user U, to the terminal device 1, based on the low-accuracy location information included in the received information transmission request.

[0098] For example, assume that the current location detected by the location detection unit 20 is the latitude and longitude of the current location, and that the latitude and longitude are expressed to m decimal places, where m is an integer. In this case, the provided information acquisition unit 41 reduces the number of decimal places in the value indicating the latitude and longitude of the current location detected by the location detection unit 20, thereby reducing the accuracy of the current location detected by the location detection unit 20.

[0099] For example, the provided information acquisition unit 41 reduces the accuracy of the current location detected by the location detection unit 20 by converting the value indicating the latitude and longitude of the current location to k decimal places (m>k), where k is an integer. For example, by setting k=2, the provided information acquisition unit 41 can convert the current location detected by the location detection unit 20 into a value in units of approximately kilometers.

[0100] In this way, the provided information acquisition unit 41 transmits an information transmission request including low-accuracy location information, which is information on the current location with reduced accuracy, to the information providing device 2, thereby preventing the possibility that the specific current location of the user U will be known by the information providing device 2. Therefore, the terminal device 1 can meet the needs of the user U who does not want his specific current location to be known.

[0101] For example, based on the low-accuracy location information included in the information transmission request, the information providing device 2 determines information on places (for example, stores or facilities) within a predetermined range centered on the location indicated by the low-accuracy location information as candidate information to be proposed to the user U. The predetermined range is, for example, a range of up to several kilometers or up to 10-odd kilometers centered on the low-accuracy location information, but is not limited to such examples.

[0102] Suggested candidates for user U include various locations such as stores of the location type "gas station," stores of the location type "convenience store," stores of the location type "restaurant," locations of the location type "parking lot," stores of the location type "park," stores of the location type "home improvement center," and facilities of the location type "commercial complex."

[0103] The information providing device 2 transmits to the terminal device 1 information to be provided, which includes multiple pieces of proposal candidate information, which are information on proposal candidates to the determined user U. The information to be provided includes information on a list of places for each place type. For example, the information to be provided includes various place lists, such as a store list of the place type "gas station," a store list of the place type "convenience store," and a store list of the place type "restaurant."

[0104] The provided information acquisition unit 41 can reduce the accuracy of the current location detected by the location detection unit 20, for example, based on at least one of the context of the user U determined by the determination unit 34 and the search target identified by the identification unit 33.

[0105] For example, the provided information acquisition unit 41 changes the degree of deterioration in the accuracy of the current location detected by the location detection unit 20 based on the context of the user U. The context of the user U is, for example, the movement state of the user U, as will be described later. The movement state of the user U includes the movement direction of the user U, the movement speed of the user U, the current location of the user U, etc.

[0106] For example, the provided information acquisition unit 41 can decrease the accuracy of the current location as the moving speed of the user U increases, or can decrease the accuracy of the current location at a degree of decrease depending on the moving direction of the user U. Furthermore, when the user U's means of transportation is a train, the provided information acquisition unit 41 can decrease the accuracy of the current location at a higher degree of decrease than when the user U's means of transportation is a car.

[0107] Furthermore, the provided information acquisition unit 41 can change the degree of reduction in the accuracy of the current location detected by the location detection unit 20, based on the search target identified by the identification unit 33. For example, the provided information acquisition unit 41 reduces the accuracy of the current location detected by the location detection unit 20 by a degree of reduction according to the search target identified by the identification unit 33.

[0108] The provided information acquisition unit 41 has information associating the search target with a degree of degradation for each search target, and reduces the accuracy of the current location by the degree of degradation associated with the search target identified by the identification unit 33.

[0109] The provided information acquisition unit 41 can change the degree of decrease in accuracy of the current location detected by the location detection unit 20, for example, when the search target is a "gas station" and when the search target is a "convenience store."

[0110] In addition, the provided information acquisition unit 41 has information indicating the degree of degradation for each combination of user U's context and search target, and can also reduce the accuracy of the current location by a degree of degradation corresponding to the combination of user U's context determined by the determination unit 34 and the search target identified by the identification unit 33.

[0111] [3.9.2. Learning Section 31] The learning unit 31 learns in advance the features of the information of the captured image acquired by the image information acquisition unit 40 before providing the provided information to the user U. Hereinafter, the features of the information of the captured image may be referred to as image information features.

[0112] For example, the learning unit 31 determines the object contained in the captured image, the capture position of the captured image, and the type of acquisition of the captured image based on the information of the captured image acquired by the image information acquisition unit 40, and learns the image information features based on the determination results.

[0113] The learning unit 31 determines, for example, people (e.g., user U, user U's family, user U's friends, etc.) and objects (e.g., food, stores, facilities, etc.) included in the captured image as objects included in the captured image.

[0114] The captured image information is, for example, file information in a format with an extension such as "JPEG," "HEIC," or "mp4," and includes image information of the captured image and additional information of the captured image. The image information is information about the captured image itself, including information about each pixel. The additional information is, for example, Exif information, and includes information about the capture location of the captured image, information about the capture date and time of the captured image, information about the capture direction of the captured image, and information about the manufacturer and model of the imaging device.

[0115] The learning unit 31 determines the imaging position and acquisition type of the captured image based on the additional information of the captured image. Based on information on the manufacturer and model of the imaging device included in the additional information of the captured image, the learning unit 31 determines the acquisition type of the captured image, such as whether the captured image whose information is acquired by the image information acquisition unit 40 is an image acquired by the imaging unit 15 or a captured image acquired by the processing unit 18.

[0116] Then, the learning unit 31 learns image information features based on the determined object included in the captured image, the capturing position of the captured image, the acquisition type of the captured image, etc. For example, the learning unit 31 learns one or both of the behavior pattern of the user U and the attributes of the user U as image information features.

[0117] Examples of user U's behavioral patterns include, but are not limited to, places that user U frequently visits (e.g., stores, facilities, or areas), user U's commuting patterns (commuting route, time of day, day of week, etc.), and people accompanying user U when he / she is out and about (attributes of the people accompanying him / her (e.g., children or spouse), time of accompanying, day of week, etc.). Examples of user U's attributes include, but are not limited to, user U's gender, age, family, and interests (e.g., favorite foods).

[0118] The learning unit 31 has, for example, first judgment information indicating judgment conditions for each behavioral pattern, and learns image information features by estimating, based on the first judgment information, a behavioral pattern among multiple behavioral patterns that satisfies the judgment conditions as the behavioral pattern of user U.

[0119] In addition, the learning unit 31 has, for example, second judgment information that indicates judgment conditions for each attribute, and learns image information features by estimating, based on the second judgment information, attributes among multiple attributes that satisfy the judgment conditions as attributes of user U.

[0120] The learning unit 31 has a learning model that, for example, takes information about a captured image as input and outputs information indicating the behavioral patterns and attributes of user U, and can also learn image information features by using such a learning model to estimate the behavioral patterns and attributes of user U.

[0121] The learning model is generated by machine learning using a neural network such as a convolutional neural network, for example. However, without being limited to this example, the learning model may be generated using machine learning using a learning algorithm such as linear regression, nonlinear regression, logistic regression, or a support vector machine instead of a neural network.

[0122] The image information feature may be an object (e.g., a person or an object) itself included in the captured image. For example, if the captured image includes an image of pancakes, the image information feature may be the pancakes. Also, if the captured image includes an image of a specific store, the image information feature may be the specific store.

[0123] [3.9.3. Reception Unit 32] The reception unit 32 receives a search request from the user U. For example, the reception unit 32 receives an utterance from the user U as a search request. Furthermore, when an operation by the user U on the operation unit 12 is an operation for specifying a search target, the reception unit 32 receives such an operation as a search request.

[0124] The reception unit 32 receives an utterance from the user U based on the voice information output from the voice input unit 13. For example, when the user U performs a specific operation using the operation unit 12, the reception unit 32 receives an utterance from the user U made after the operation.

[0125] Furthermore, when the user U utters a specific keyword, the reception unit 32 can also receive subsequent utterances from the user U. Whether or not the user U uttered a specific keyword is determined by voice recognition of the voice information output from the voice input unit 13.

[0126] The reception unit 32 has a speech recognition function that converts speech information output from the speech input unit 13 in response to speech by the user U into text information. The speech recognition function is performed using a speech recognition model. The reception unit 32 inputs the speech information output from the speech input unit 13 in response to speech by the user U into the speech recognition model, and obtains text information output from the speech recognition model as the speech recognition result.

[0127] [3.9.4. Specification part 33] The specifying unit 33 specifies a search target based on the search request received by the receiving unit 32. The specifying unit 33 specifies a search target based on the speech recognition result obtained by the receiving unit 32.

[0128] The specifying unit 33 has a keyword estimation model, inputs text information, which is the speech recognition result obtained by the receiving unit 32, to the keyword estimation model, and obtains keywords output from the keyword estimation model as search keywords.

[0129] For example, when the utterance from the user U is "gasoline," the specifying unit 33 specifies "gas station" as the search target. Also, when the utterance from the user U is "rice ball," the specifying unit 33 specifies "convenience store" as the search target.

[0130] The specifying unit 33 can also use the text information, which is the speech recognition result obtained by the receiving unit 32, as the search target as it is.

[0131] The identification unit 33 can also identify the attributes of the user U based on the voice received by the reception unit 32. The identification unit 33 has an attribute identification function that identifies the attributes of the user U from, for example, voice information output from the voice input unit 13 in response to an utterance by the user U, and identifies the attributes of the user U based on the voice received by the reception unit 32.

[0132] For example, the identification unit 33 identifies the gender, age, etc. of the user U from the frequency of the voice received by the reception unit 32. The identification unit 33 has, for example, an attribute identification model, inputs voice information output from the voice input unit 13 in response to the speech of the user U into the attribute identification model, and obtains an identification result of the attribute of the user U output from the attribute identification model.

[0133] In addition, the identification unit 33 can determine the stride length of the user U based on the number of steps of the user U detected by the sensor unit 16 and the distance traveled by the user U, and can also identify the gender and age of the user U based on the determined stride length of the user U.

[0134] [3.9.5. Judgment unit 34] The determination unit 34 determines the context of the user U based on the detection result by the sensor unit 16.

[0135] The context of user U is, for example, the movement state of user U, the congestion state on the estimated movement route of user U, the weather condition on the estimated movement route of user U, etc. As described above, the movement state of user U includes the movement direction of user U, the movement speed of user U, the current location of user U, the means of transportation of user U, and the person accompanying user U.

[0136] The movement state of the user U is determined according to the detection result by the sensor unit 16. For example, the determination unit 34 determines the movement direction, movement speed, means of transportation, and accompanying person of the user U based on the change in the position of the user U detected by the position detection unit 20.

[0137] The user U's means of transportation is, for example, walking, bicycle, car, etc., and the determination unit 34 determines the user U's means of transportation based on, for example, the movement speed of the user U. Furthermore, the user U's accompanying person is, for example, the user U's child, and the determination unit 34 determines that the user U's accompanying person is the user U's child, for example, when the user U's movement speed is slower than usual.

[0138] Furthermore, the determination unit 34 can acquire, for example, from an external device, the congestion state along the estimated travel route of the user U and the weather condition along the estimated travel route of the user U, based on the current location of the user U detected by the location detection unit 20. Furthermore, the determination unit 34 can determine, from the travel state of the user U, whether the user U is commuting, shopping, traveling, or the like, as the context of the user U.

[0139] In addition, instead of or in addition to the position detection unit 20, the determination unit 34 can also determine the context of the user U based on at least one of a gyro sensor 21, an acceleration sensor, a geomagnetic sensor, an illuminance sensor, and an atmospheric pressure sensor.

[0140] For example, the determination unit 34 can determine that the user U's means of transportation is an automobile and that the user U is traveling through a tunnel, based on the detection result by the position detection unit 20 and the detection result by the illuminance sensor.

[0141] Furthermore, the determination unit 34 can determine, for example, based on the detection results by the position detection unit 20 and the detection results by the air pressure sensor, that if the current location of user U is the location of an apartment building and the air pressure detected by the air pressure sensor is high, that user U is located on a high floor of the apartment building.

[0142] [3.9.6. Selection unit 35] The selection unit 35 selects proposal candidate information that is information on a location corresponding to the search target identified by the identification unit 33 from among a plurality of pieces of proposal candidate information included in the provided information acquired by the provided information acquisition unit 41. The proposal candidate information is, for example, a location list.

[0143] For example, the selection unit 35 selects a location list including information corresponding to the search target identified by the identification unit 33 from among a plurality of pieces of proposal candidate information included in the provided information. For example, if the search target identified by the identification unit 33 is a store type "gas station," the selection unit 35 selects a store list of the store type "gas station." Furthermore, if the search target identified by the identification unit 33 is a store type "restaurant," the selection unit 35 selects a store list of the store type "restaurant."

[0144] The selection unit 35 selects one or more location information as suggested information from the selected location list, which is a list of locations selected based on the search target identified by the identification unit 33, using at least one of the context of the user U determined by the determination unit 34, the attributes of the user U identified by the identification unit 33, and the image information features learned by the learning unit 31.

[0145] For example, the selection unit 35 selects information on one or more locations from information on multiple locations included in the selected store list based on the context of the user U determined by the determination unit 34. For example, the selection unit 35 selects information on one or more locations within a range from the current location according to the context from information on multiple locations included in the selected store list.

[0146] For example, the selection unit 35 can set the range according to the context to a range centered on the current location of the user U in the direction of movement of the user U, extending to a position farther than the range in the direction opposite to the direction of movement of the user U. This allows the selection unit 35 to select, as suggested information, information about locations within a range appropriate for the context of the user U.

[0147] Furthermore, the selection unit 35 can widen the range according to the context as the moving speed of the user U increases. This allows the selection unit 35 to select information about places in a range that is suitable for the context of the user U as information to be suggested.

[0148] Furthermore, when the user U's means of transportation is a car, the selection unit 35 can also set the range to the left of the direction of movement of the user U as the range according to the context. This allows the selection unit 35 to select information about places that are easy for the user U to enter as information to be suggested.

[0149] In addition, if user U's means of transportation is a train, the selection unit 35 can determine the direction of travel of the train from the direction of user U's movement, and set a predetermined range centered on a station in the direction of travel as the range corresponding to the context.

[0150] The selection unit 35 can also select locations by category according to the context as the proposal target. The selection unit 35 selects, for example, information about locations by category according to one or more of the user U's current location, movement speed, movement direction, and means of transportation as the proposal target information. For example, the selection unit 35 selects, as the proposal target information, information about locations by category that differ depending on whether the user U's means of transportation is walking, car, or train. Locations by category according to the context include, for example, locations that are easy to reach on foot from the user U's current location, locations that are easy to reach by car from the user U's current location, and locations that are easy to reach by train from the user U's current location.

[0151] In addition, when the search target is a restaurant and a list of restaurants is selected as the selection location list, if the user U's current location is on an upper floor of an apartment building, the selection unit 35 selects restaurants that can deliver food and drink as suggested targets.

[0152] Furthermore, when the search target is a restaurant and a list of shoe shops is selected as the selected location list, if the user U's means of transportation is walking, the selection unit 35 selects, for example, sneaker stores as suggested targets.

[0153] Furthermore, the selection unit 35 selects, as information to be proposed, one or more pieces of location information corresponding to the image information features learned by the learning unit 31 from the plurality of pieces of location information included in the selected location list. In this way, the selection unit 35 can select, as proposed information, proposal candidate information corresponding to the image information features learned by the learning unit 31 from the plurality of pieces of proposal candidate information included in the provided information acquired by the provided information acquisition unit 41.

[0154] For example, when the image information feature is a store or facility and the information of the captured image corresponding to the image information feature is information of a captured image, the selection unit 35 can select the information of the store or facility that has been learned as the image information feature from the information of the locations included in the selected location list as the information to be proposed.

[0155] If the information of the captured image is information of a captured image, it is estimated that the stores and facilities included in the captured image are likely to be stores and facilities that user U would like to visit, and therefore the selection unit 35 can select appropriate information to be suggested.

[0156] Furthermore, when the captured image information is information about an image captured by the imaging unit 15 of the terminal device 1 and the image information feature is a store or facility, the selection unit 35 selects as suggested stores or facilities that are different from the captured image information and that are estimated not to have been visited by the user U. Stores and facilities whose image information feature is a store or facility are examples of places that correspond to the feature of the captured image information.

[0157] Furthermore, when the image information feature is a behavioral pattern of the user U, the selection unit 35 can select, as the information to be suggested, location information according to the behavioral pattern of the user U. The behavioral pattern is defined, for example, by the content of the behavior, the time and day of the behavior, the area of ​​the behavior, the accompanying person, etc.

[0158] For example, suppose that the learned behavioral pattern of user U is a pattern of eating lunch with children, and the current situation (time period, day of the week, area, etc.) is the same as or close to the situation of eating lunch with children (time period, day of the week, area, etc.). In this case, if the selected location list is a list of restaurants, the selection unit 35 selects, as a suggested restaurant, a restaurant that can be visited casually with children from among multiple restaurants included in the list of restaurants.

[0159] In addition, when the user U is about to perform a specific action (for example, going to the toilet, smoking a cigarette, drinking water, etc.) or is approaching that time, the selection unit 35 selects information about a location where the specific action can be performed from the information about multiple locations shown in the selected location list as the information to be suggested.

[0160] Furthermore, if the learned attribute of user U is the user U's favorite food and the selected location list is a list of restaurants, the selection unit 35 selects information about a restaurant that serves the user U's favorite food from among multiple restaurants included in the list of restaurants as information to be suggested.

[0161] Furthermore, if the learned attribute of user U is a male student in his twenties and the selected location list is a list of restaurants, the selection unit 35 selects, as a suggested target, a restaurant that is popular among male students in their twenties from among the multiple restaurants included in the list of restaurants.

[0162] In addition, the selection unit 35 can also select, as proposed information, proposal candidate information corresponding to the image information characteristics from among a plurality of proposal candidate information included in the provided information acquired by the provided information acquisition unit 41, which has been narrowed down based on the context of user U determined by the determination unit 34.

[0163] For example, the selection unit 35 can narrow down the information on multiple locations within a range from the current location according to the context from the information on multiple locations included in the selected store list, and select information on locations according to the image information characteristics from the narrowed down information on multiple locations as suggested information, which is information to be suggested.

[0164] Furthermore, the selection unit 35 can select one or more pieces of location information from among the plurality of pieces of location information that correspond to the attributes of the user U and the context of the user U identified by the identification unit 33. For example, the selection unit 35 can narrow down the plurality of pieces of location information included in the selected store list to pieces of location information that are within a range from the current location according to the context of the user U, and select, from the narrowed down plurality of pieces of location information, piece of location information that corresponds to the attributes of the user U as suggested information that is information to be suggested.

[0165] For example, suppose the selected store list is a list of stores selling sneakers in Ikebukuro, the context of user U indicates a state of walking in Ikebukuro, and the attribute of user U identified by the identification unit 33 is female. In this case, the selection unit 35 selects, as suggested information, information about the store selling women's sneakers that is closest to the current location of user U among the stores selling sneakers in Ikebukuro.

[0166] Furthermore, the selection unit 35 can select, as the information to be proposed, location information according to the context of the user U and location information according to the characteristics of the information of the captured image. Furthermore, when there is no location information according to the context of the user U, the selection unit 35 can select, as the information to be proposed, location information according to the characteristics of the information of the captured image, or when there is no location information according to the characteristics of the information of the captured image, select, as the information to be proposed, location information according to the context of the user U.

[0167] In addition, the selection unit 35 can, for example, when the operation mode is the first mode, select location information corresponding to the context of the user U as the information to be suggested, and when the operation mode is the second mode, select location information corresponding to the characteristics of the information in the captured image as the information to be suggested.

[0168] The operation mode can be set in the terminal device 1 by, for example, a user U of the terminal device 1. Furthermore, the terminal device 1 can also switch the operation mode depending on, for example, the search target identified by the identification unit 33. For example, when the search target is "gas station," the selection unit 35 can select a suggested target in the first mode, and when the search target is "lunch," the selection unit 35 can select a suggested target in the second mode.

[0169] [3.9.7.Providing Department 36] The providing unit 36 ​​provides the user U with the proposed information, which is information on one or more places selected by the selecting unit 35 as proposed locations, by transmitting the proposed information to the terminal device 1 of the user U.

[0170] The providing unit 36 ​​provides the proposed information to the user U by displaying the proposed information on the display unit 11. The providing unit 36 ​​can also provide the proposed information to the user U by outputting the proposed information as sound from the audio output unit 14.

[0171] [4. Processing Procedure] Next, a procedure of information processing by the processing unit 18 of the terminal device 1 according to the embodiment will be described. Fig. 5 is a flowchart showing an example of information processing by the processing unit 18 of the terminal device 1 according to the embodiment.

[0172] 5, the processing unit 18 of the terminal device 1 determines whether or not it is time to learn (step S100). In the process of step S100, the processing unit 18 determines that it is time to learn, for example, every time the number of pieces of information about captured images newly added to the storage unit 17 becomes equal to or greater than a threshold value.

[0173] When the processing unit 18 determines that it is time to learn (step S100: Yes), it learns the features of the information in the captured image (step S101). When the processing in step S101 is completed or when it determines that it is not time to learn (step S100: No), the processing unit 18 determines whether the user U has spoken (step S102).

[0174] When it is determined that the user U has spoken (step S102: Yes), the processing unit 18 performs suggested information providing processing (step S103). The processing in step S103 is the processing in steps S110 to S118 shown in FIG. 6, and will be described in detail later.

[0175] When the processing of step S103 is completed or when it is determined that the user U has not spoken (step S102: No), the processing unit 18 determines whether or not the end time has arrived (step S104). The processing unit 18 determines that the end time has arrived, for example, when the power of the terminal device 1 is turned off or when it is determined that an end operation has been performed by operating the operation unit 12 of the terminal device 1.

[0176] If the processing unit 18 determines that the end timing has not arrived (step S104: No), it transitions the processing to step S100, and if it determines that the end timing has arrived (step S104: Yes), it terminates the processing shown in Figure 5.

[0177] 6 is a flowchart showing an example of a suggested information providing process by the processing unit 18 of the terminal device 1 according to the embodiment. As shown in FIG. 6, the processing unit 18 receives an utterance from the user U as a search request (step S110). Then, the processing unit 18 identifies a search target based on the search request received in step S110 (step S111).

[0178] Furthermore, the processing unit 18 causes the position detection unit 20 to detect the current position (step S112). Then, the processing unit 18 reduces the accuracy of the current position detected by the position detection unit 20 in step S112 (step S113).

[0179] Furthermore, the processing unit 18 transmits an information transmission request including information indicating low-accuracy position information, which is the current position whose accuracy has been reduced in step S113, to the information providing device 2 (step S114). Then, the processing unit 18 acquires the provided information transmitted from the information providing device 2 in response to the information transmission request (step S115).

[0180] Next, the processing unit 18 selects a location list corresponding to the search target identified in step S111 from the plurality of location lists indicated in the provided information acquired in step S115 (step S116).

[0181] Next, the processing unit 18 selects one or more pieces of location information as information to be proposed from the location list selected in step S116 based on at least one of the context and image information features of the user U (step S117). Then, the processing unit 18 provides the user U with proposed information, which is the information to be proposed selected in step S117 (step S118), and ends the processing shown in FIG.

[0182] [5. Modifications] In the above example, the provided information acquisition unit 41 can also acquire provided information that includes information other than location information as information of proposal candidates. For example, the provided information acquisition unit 41 can transmit, to the information providing device 2, an information transmission request that includes information of the search target identified by the identification unit 33 but does not include location information.

[0183] In this case, when the information providing device 2 receives an information transmission request from the terminal device 1, it transmits to the terminal device 1 provided information including a plurality of pieces of information corresponding to the search target as proposal candidate information, which is information on candidates to be proposed to the user U, based on information on the search target included in the received information transmission request. The selection unit 35 selects, from the plurality of pieces of proposal candidate information included in the provided information acquired by the provided information acquisition unit 41, proposal candidate information corresponding to the image information features learned by the learning unit 31 as proposed information.

[0184] The information transmission request may include information on the context of the user U determined by the determination unit 34, instead of or in addition to the information on the search target identified by the identification unit 33. In this case, based on the information on the search target and the information on the context of the user U included in the received information transmission request, provision information including multiple pieces of information corresponding to the search target is transmitted to the terminal device 1 as proposal candidate information, which is information on proposal candidates to the user U.

[0185] Furthermore, the information on the captured image may include, as additional information, the detection result of the sensor unit 16 when capturing an image by the imaging unit 15. In this case, the learning unit 31 can further use the detection result of the sensor unit 16 to learn the image information features.

[0186] Furthermore, the information providing device 2 can determine, as candidate information for proposal to the user U, location information within a range corresponding to the number of digits of the value indicated by the user's low-precision location. For example, if the value indicated by the user's low-precision location is a value up to two decimal places, the information providing device 2 determines, as candidate information for proposal to the user U, location information within a range indicated from the user's low-precision location to one decimal place.

[0187] In the above example, the provided information is described as including, for example, information on a location list for each location type, but is not limited to such an example, and for example, the provided information may include various types of information.

[0188] In addition, in the above examples, stores and facilities were given as examples of locations, but the location may also be a location where an event is held, a campsite, a beach, a lake, a mountain, or any other type of location.

[0189] [6. Hardware Configuration] The terminal device 1 according to the embodiment described above is realized by a computer 80 configured as shown in Fig. 7, for example. The terminal device 1 will be described below as an example. Fig. 7 is a hardware configuration diagram showing an example of a computer 80 that realizes the functions of the terminal device 1 according to the embodiment. The computer 80 has a CPU 81, a RAM 82, a ROM (Read Only Memory) 83, an HDD (Hard Disk Drive) 84, a communication interface (I / F) 85, an input / output interface (I / F) 86, and a media interface (I / F) 87.

[0190] The CPU 81 operates and controls each part based on programs stored in the ROM 83 or the HDD 84. The ROM 83 stores a boot program executed by the CPU 81 when the computer 80 starts up, programs that depend on the hardware of the computer 80, and the like.

[0191] The HDD 84 stores programs executed by the CPU 81, data used by such programs, etc. The communication interface 85 receives data from other devices via the network N (see FIG. 2) and sends it to the CPU 81, and transmits data generated by the CPU 81 to other devices via the network N.

[0192] The CPU 81 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 86. The CPU 81 acquires data from the input devices via the input / output interface 86. The CPU 81 also outputs generated data to the output devices via the input / output interface 86.

[0193] The media interface 87 reads a program or data stored in a recording medium 88 and provides it to the CPU 81 via the RAM 82. The CPU 81 loads the program or data from the recording medium 88 onto the RAM 82 via the media interface 87 and executes the loaded program. The recording medium 88 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0194] For example, when the computer 80 functions as the terminal device 1 according to the embodiment, the CPU 81 of the computer 80 executes a program loaded onto the RAM 82, thereby realizing the functions of the processing unit 18. In addition, the HDD 84 stores data in the storage unit 17. The CPU 81 of the computer 80 reads and executes these programs from a recording medium 88, but as another example, these programs may be acquired from another device via the network N.

[0195] [7. Other] Furthermore, among the processes described in the above embodiments, some of the processes described as being performed automatically can also be performed manually. Alternatively, all or some of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0196] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0197] 3 may be held in a storage server or the like, rather than being held by each device. In this case, each device obtains various pieces of information by accessing the storage server.

[0198] [8. Effects] As described above, the terminal device 1 according to the embodiment includes a location detection unit 20, an acquisition unit 30, a selection unit 35, and a provision unit 36. The location detection unit 20 detects the current location of the user U. The acquisition unit 30 acquires a location list, which is a list of multiple locations located around the current location, from the information providing device 2 (an example of an external device) using location information, which is information on the current location detected by the location detection unit 20 with reduced accuracy. The selection unit 35 selects one or more pieces of location information from the multiple pieces of location information included in the location list acquired by the acquisition unit 30, based on the context of the user U. The provision unit 36 ​​provides the user U with the information on the one or more places selected by the selection unit 35. This allows the terminal device 1 to provide the user U with information according to the user U's current location and more suitable for the user U in accordance with the user U's context. Furthermore, because the terminal device 1 transmits the current location information with reduced accuracy to the information providing device 2, it is possible to meet the needs of the user U who does not want their specific current location to be known.

[0199] The terminal device 1 also includes a sensor unit 16 having one or more sensors including a position detection unit 20, and a determination unit 34 that determines the context of the user U based on the detection result by the sensor unit 16. The selection unit 35 selects one or more pieces of location information from among the plurality of pieces of location information based on the context determined by the determination unit 34. This allows the terminal device 1 to provide information that is appropriate for the user U according to the user U's current location and the user U's context.

[0200] Furthermore, the selection unit 35 selects one or more pieces of location information from the plurality of pieces of location information, each piece of location information being within a range from the current location according to the context. This allows the terminal device 1 to provide information according to the current location of the user U and more suitable for the user U according to the user U's context.

[0201] The selection unit 35 also selects one or more pieces of location information according to the type of context from among the plurality of pieces of location information, thereby enabling the terminal device 1 to provide information according to the current location of the user U and more suitable for the user U according to the user U's context.

[0202] The terminal device 1 also includes a reception unit 32 that receives a search request from the user U, and an identification unit 33 that identifies a search target based on the search request received by the reception unit 32. The selection unit 35 selects, from the plurality of pieces of location information, one or more pieces of location information that correspond to the search target identified by the identification unit 33 and that correspond to the context. This allows the terminal device 1 to provide the user U with information that corresponds to the current location of the user U and is more suitable for the user U in accordance with the search request and the user U's context.

[0203] Furthermore, the selection unit 35 selects one or more pieces of location information according to the context from among the plurality of pieces of location information corresponding to the search target identified by the identification unit 33. This allows the terminal device 1 to provide information according to the current location of the user U that is more suitable for the user U according to the search request and the context of the user U.

[0204] Furthermore, the identification unit 33 identifies the attributes of the user U based on the voice received by the reception unit 32. The selection unit 35 selects one or more pieces of location information from among a plurality of pieces of location information according to the attributes and context of the user U identified by the identification unit 33. This allows the terminal device 1 to provide information according to the current location of the user U that is more suitable for the user U according to the search request and the context of the user U.

[0205] In addition, the acquisition unit 30 acquires a location list from the information providing device 2 (an example of an external device) using location information in which the accuracy of the current location detected by the location detection unit 20 has been reduced to a degree of reduction according to the search target.

[0206] In addition, the acquisition unit 30 acquires a location list from the information providing device 2 (an example of an external device) using, as location information, location information in which the accuracy of the current location detected by the location detection unit 20 has been reduced to a degree of reduction according to the context.

[0207] The above describes the embodiments of the present application in detail based on the drawings, but this is merely an example, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.

[0208] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0209] 1. Terminal equipment 2 Information provision device 10. Communications Department 11 Display section 12 Control section 13 Audio input section 14 Audio output section 15 Imaging unit 16 Sensor section 17 Memory section 18 Processing section 20 Position detection unit 21 Gyro sensor 30 Acquisition Department 31 Learning Department 32 Reception Department 33 Specific part 34 Judgment section 35 Selection section 36 Providing Department 40 Image information acquisition unit 41 Provided information acquisition department 100 Information Processing Systems N Network U User

Claims

1. A reception unit that receives a search request from a user; an identification unit that identifies a search target based on the search request; a location detection unit that detects the current location of the user; an acquisition unit that acquires from an external device a location list that is a list of multiple locations located around the current location using location information that is location information in which the accuracy of the current location has been reduced in accordance with the user's movement pattern, which is the user's context; a selection unit that selects one or more pieces of location information corresponding to the search target and corresponding to the user's movement pattern from the plurality of pieces of location information included in the location list; a providing unit that provides information about the one or more locations to the user. A terminal device characterized by:

2. A reception unit that receives a search request from a user; an identification unit that identifies a search target based on the search request; a location detection unit that detects the current location of the user; an acquisition unit that acquires, from an external device, a location list that is a list of multiple locations located around the current location using location information that is location information in which the accuracy of the current location has been reduced by a degree of reduction corresponding to the search target; a selection unit that selects one or more pieces of location information corresponding to the search target and corresponding to the user's context from the plurality of pieces of location information included in the location list; a providing unit that provides information about the one or more locations to the user. A terminal device characterized by:

3. a sensor unit having one or more sensors including the position detection unit; a determination unit that determines the context based on a detection result by the sensor unit, The selection unit Selecting the one or more pieces of location information from the plurality of pieces of location information based on the context determined by the determination unit.

3. The terminal device according to claim 1 or 2.

4. The selection unit Selecting information about a place within a range from the current location according to the context from among the plurality of pieces of information about the place as information about the one or more places.

4. The terminal device according to claim 3.

5. The selection unit Selecting location information by category according to the context from among the plurality of location information as the one or more location information.

4. The terminal device according to claim 3.

6. The selection unit Selecting, from among the plurality of pieces of location information corresponding to the search target identified by the identification unit, location information according to the context as the one or more pieces of location information.

3. The terminal device according to claim 1 or 2.

7. The identification unit Identifying attributes of the user based on the voice received by the reception unit; The selection unit Selecting location information according to the attribute of the user and the context identified by the identification unit as the one or more location information from among the plurality of location information.

3. The terminal device according to claim 1 or 2.

8. An information processing method executed by a terminal device, a receiving step of receiving a search request from a user; a specifying step of specifying a search target based on the search request; a location detection step of detecting a current location of the user; an acquisition step of acquiring from an external device a location list that is a list of multiple locations located around the current location using location information that is location information in which the accuracy of the current location has been reduced in accordance with the user's movement pattern, which is the user's context; a selection step of selecting, from the plurality of pieces of place information included in the place list, one or more pieces of place information corresponding to the search target and corresponding to the user's movement pattern; and providing information about the one or more locations to the user.

1. An information processing method comprising:

9. An information processing method executed by a terminal device, comprising: a receiving step of receiving a search request from a user; a specifying step of specifying a search target based on the search request; a location detection step of detecting a current location of the user; an acquisition step of acquiring from an external device a location list that is a list of multiple locations located around the current location using location information that is location information in which the accuracy of the current location has been reduced by a degree of reduction according to the search target; a selection step of selecting one or more pieces of location information corresponding to the search target and corresponding to the user's context from the plurality of pieces of location information included in the location list; and providing information about the one or more locations to the user.

1. An information processing method comprising:

10. A reception procedure for receiving a search request from a user; a step of identifying a search target based on the search request; a location detection step for detecting a current location of the user; an acquisition step of acquiring from an external device a location list that is a list of multiple locations located around the current location using location information that is location information in which the accuracy of the current location has been reduced in accordance with the user's movement pattern, which is the user's context; a selection step of selecting, as one or more pieces of location information corresponding to the search target and corresponding to the user's movement pattern, from the plurality of pieces of location information included in the location list; and causing the terminal device to execute a provision procedure for providing information on the one or more locations to the user. An information processing program characterized by:

11. A reception procedure for receiving a search request from a user; a step of identifying a search target based on the search request; a location detection step for detecting a current location of the user; an acquisition step of acquiring, from an external device, a location list that is a list of multiple locations located around the current location using location information that is location information in which the accuracy of the current location has been reduced by a degree of reduction according to the search target; a selection step of selecting one or more pieces of location information corresponding to the search target and corresponding to the user's context from the plurality of pieces of location information included in the location list; and causing the terminal device to execute a provision procedure for providing information on the one or more locations to the user. An information processing program characterized by:

Images