Infotainment device and operating method thereof

Abstract

This invention provides an infotainment system and a method for operating the same. [Solution] An infotainment device operation method according to one embodiment may include an operation to input a user's utterance about a place into a model and extract context information. The method may include an operation to obtain a search condition for identifying the place based on the context information. The method may include an operation to provide a response to the user based on the search condition and the user's place visit history.

Description

Technical Field

[0001] The present disclosure relates to an infotainment device and an operating method thereof.

Background Art

[0002] An infotainment device is installed in a vehicle and can search various places for a user riding in the vehicle and provide information about the places. The place search system provided by a conventional infotainment device depends on a method of matching a user input (e.g., click, speech) with a keyword, and has a disadvantage that when the user input is in natural language, a specific context cannot be grasped.

[0003] In addition to general navigation, vehicles or mobile navigation systems have been developed to provide personalized services for each user.

[0004] The above-described background art is what the inventor possessed or acquired in the process of deriving the disclosure content of the present application, and is not necessarily prior art publicly disclosed to the general public before the present application.

Summary of the Invention

Problems to be Solved by the Invention

[0005] One embodiment can provide a technique for obtaining a search condition for identifying a place based on context information extracted by inputting a user's utterance regarding a place into a model.

[0006] One embodiment can provide a technique for providing a response to a user based on a search condition and the user's place visit history.

[0007] However, the technical challenges are not limited to those mentioned above, and other technical challenges may exist. [Means for solving the problem]

[0008] An infotainment device operation method according to one embodiment may include an operation to input a user's utterance about a place into a model and extract context information. The method may include an operation to obtain a search condition for identifying the place based on the context information. The method may include an operation to provide a response to the user based on the search condition and the user's place visit history.

[0009] The context information may include time information, regional information, and category information of the location, all of which may be included in the utterance.

[0010] The aforementioned acquisition operation may include an operation to set a time range included in the search conditions based on the time information.

[0011] The provided operation may include an operation to extract at least one place candidate from the places included in the place visit history that corresponds to the search criteria. The provided operation may include an operation to generate a summary of the at least one place candidate. The provided operation may include an operation to provide the summary and information about the at least one place candidate as the response.

[0012] The location visit history may include the location of the place visited by the user, the date and time of the user's visit to the place, and the frequency of the user's visit to the place.

[0013] The electronic device may include a memory containing instructions and a processor electrically connected to the memory for executing the instructions. When the instructions are executed by the at least one processor, the device may input a user's utterance about a place into a model, extract context information, obtain search conditions for identifying the place based on the context information, and provide a response to the user based on the search conditions and the user's place visit history.

[0014] The context information may include time information, regional information, and category information of the location, all of which may be included in the utterance.

[0015] When the instruction is executed by the at least one processor, the device can set the time range included in the search condition based on the time information.

[0016] When the instruction is executed by the at least one processor, the device can extract at least one place candidate from the places included in the place visit history that corresponds to the search criteria, generate a summary of the at least one place candidate, and provide the summary and information about the at least one place candidate as the response.

[0017] The location visit history may include the location of the place visited by the user, the date and time of the user's visit to the place, and the frequency of the user's visit to the place. [Brief explanation of the drawing]

[0018] [Figure 1] This is a diagram illustrating an infotainment device according to one embodiment. [Figure 2] This is a diagram illustrating the operation of obtaining search conditions according to one embodiment. [Figure 3] This is a diagram illustrating the operation of obtaining search conditions according to one embodiment. [Figure 4] This is a diagram illustrating the operation of extracting location candidates according to one embodiment. [Figure 5] This figure illustrates the operation of obtaining a summary of location candidates according to one embodiment. [Figure 6] This is a flowchart illustrating a method according to one embodiment. [Figure 7] This is a diagram illustrating the operation of an infotainment device according to one embodiment. [Figure 8] This is a flowchart illustrating a method according to one embodiment. [Figure 9] This is a schematic block diagram of an electronic device according to one embodiment. [Modes for carrying out the invention]

[0019] Specific structural or functional descriptions regarding embodiments are disclosed merely for illustrative purposes and can be realized in various forms. Therefore, the actually realized form is not limited only to the disclosed specific embodiments, and the scope of this specification includes modifications, equivalents, or alternatives included in the technical idea described in the embodiments.

[0020] Terms such as first or second can be used to describe various components, but these terms must be interpreted only for the purpose of distinguishing one component from another. For example, the first component can be named the second component, and similarly, the second component can also be named the first component.

[0021] [[ID=I2]]When a component is referred to as "connected to" another component, it should be understood that it can be directly connected to or connected to the other component, but there may be other components in between.

[0022] Singular expressions include plural expressions unless the context clearly indicates a different meaning. In this specification, terms such as "including" or "having" are used to specify the existence of the described features, numbers, steps, operations, components, parts, or combinations thereof, and it should be understood that they do not preclude the existence or addition possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0023] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those with ordinary knowledge in the relevant technical field. Terms defined in commonly used dictionaries, for example, should be interpreted as consistent with the meaning they have in the context of the related technology, and should not be interpreted as an ideal or overly formal meaning unless clearly defined in this specification.

[0024] The embodiments will be described in detail below with reference to the attached drawings. In the description with reference to the attached drawings, identical components will be given the same reference numerals regardless of the reference numerals in the drawings, and redundant explanations of them will be omitted.

[0025] Figure 1 is a diagram illustrating an infotainment device according to one embodiment.

[0026] Referring to Figure 1, according to one embodiment, the infotainment system 10 may include an infotainment device 100, a user 110, and / or a server 130. Infotainment is a portmanteau of information and entertainment, and can mean a new form of service that combines information and entertainment. The infotainment device 100 is installed in a vehicle (for example, a vehicle in which a user 110 is riding) and can provide various information and entertainment functions to the vehicle's users (for example, the driver and / or passengers, including user 110). For example, the infotainment device 100 can provide the vehicle with navigation and services linked to a mobile device (for example, a smartphone) (for example, services such as a telephone application), enabling user 110 to use the services provided to the vehicle. The infotainment device 100 can provide the vehicle with information acquired through the server 130. For example, the infotainment system 100 can acquire and provide to the vehicle real-time information such as traffic information, surrounding facility information, real-time weather information, and weather forecasts via the server 130. A vehicle means a vehicle that transports things and / or people, and can include, for example, automobiles, trains, ships, boats, aircraft, kick scooters, and / or bicycles. The infotainment system 100 can provide the vehicle 110 with various entertainment functions such as audio streaming, video playback, social networking services (SNS), internet search, and gameplay. For example, the infotainment system 100 can provide the user 110 with entertainment functions stored in the infotainment system 100 or external multimedia content acquired via the server 130.

[0027] According to one embodiment, the infotainment device 100 can perform a personalized search function. The infotainment device 100 can output a response in response to the user 110's utterance and control the functions of the vehicle. The infotainment device 100 can use a generative model (e.g., model 200 in Figure 2) to generate a response to the user 110's utterance and / or a command to control at least some functions of the vehicle. The generative model can include an on-device generative model contained within the infotainment device 100 or a cloud generative model located outside the infotainment device 100 (e.g., on a server 130). For example, the infotainment device 100 can input the user 110's utterance into an on-device generative model contained within the infotainment device 100 and provide a response to the user 110. For example, the infotainment device 100 can transmit the user's utterance to the server 130 and receive a response generated through a cloud-generated model from the server 130.

[0028] According to one embodiment, a vehicle in which a user 110 can ride, a server 130, and an infotainment device 100 can communicate using a network (not shown). For example, the network can include a local area network (LAN), a wide area network (WAN), a value-added network (VAN), a mobile radio communication network, a satellite communication network, and combinations thereof. The network is a comprehensive data communication network that enables the vehicle, the server 130, and the infotainment device 100 to communicate smoothly with each other, and may include wired internet, wireless internet, and mobile wireless communication networks. The wireless communication network may include, but is not limited to, wireless LAN (Wi-Fi), Bluetooth, Bluetooth low energy, Zigbee, WFD (Wi-Fi Direct), UWB (ultra-wideband), infrared communication (IrDA, infrared Data Association), NFC (Near Field Communication), etc.

[0029] Figures 2 and 3 illustrate the operation of obtaining search conditions according to one embodiment.

[0030] Referring to Figure 2, according to one embodiment, an infotainment device (e.g., infotainment device 100 in Figure 1) can receive (or acquire) a user's utterance (e.g., user 110 in Figure 1). The infotainment device 100 can receive the user's utterance about a place. The infotainment device 100 can input the user's utterance about a place into a model 200. The model 200 may be a large language model (LLM) that has learned the sentence structure, vocabulary, and / or contextual relationships contained in the user's utterance. For example, the infotainment device 100 can input the user's imperative utterance about a place (e.g., "Tell me the business hours of the Yangzhou cafe I often went to last month.") into the model 200.

[0031] According to one embodiment, the infotainment device 100 can input a user 210's command utterance related to a place (for example, "Please tell me the business hours of the Yangzhou cafe I often went to last month") into the model 200 and extract context information. The context information may include time information, regional information including the place, and / or category information of the place. The context information may further include visit frequency for the place.

[0032] According to one embodiment, the infotainment device 100 can acquire search conditions 250 for identifying a place based on extracted context information. The search conditions 250 may be conditions for extracting one or more place candidates (for example, place candidate 450 in Figure 4) that correspond to the search conditions 250 from among the places included in the user 210's place visit history. The infotainment device 100 can acquire search conditions 250 that correspond to the user 210's command utterance regarding a place (for example, "Tell me the business information for the Yangzhou cafe I often went to last month."). For example, the infotainment device 100 can set the search range for the date of the visit to "last month". As another example, the infotainment device 100 can set the visited place to "Yangzhou". As yet another example, the infotainment device 100 can set the category information of the place to "cafe". As yet another example, the infotainment device 100 can set the visit frequency for a location to "five or more times within the search range of dates." The visit frequency for a location can be changed based on the search range of dates visited to the location, and is not fixed. The search conditions 250 set by the infotainment device 100 may include, but are not limited to, "last month," "Yangzhou," "cafe," and / or "five or more times," and the number of search conditions 250 may increase or decrease based on the user 210's utterances.

[0033] Referring to Figure 3, according to one embodiment, an infotainment device (for example, the infotainment device 100 in Figure 1) can receive utterances from a user 310 (for example, user 210 in Figure 2) regarding a place. The infotainment device 100 can input the user 310's utterances regarding a place into a model 300 (for example, model 200 in Figure 2). For example, the infotainment device 100 can input a question-type utterance from user 210 regarding a place (for example, "Which restaurant did we go to last Christmas?") into the model 300.

[0034] According to one embodiment, the infotainment device 100 can input a user's question-type utterance about a place (for example, "Which restaurant did we go to last Christmas?") into the model 300 and extract context information. For example, the infotainment device 100 can extract the time information "last Christmas" included in the utterance. As another example, the infotainment device 100 can extract the category information of the place, "restaurant".

[0035] According to one embodiment, the infotainment device 100 can set a time range included in the search condition 350 (for example, the search condition 250 in Figure 2) based on time information included in the user 310's utterance regarding location. For example, the infotainment device 100 can set the time range corresponding to the time information included in the utterance, "the other day at Christmas," to "December 25th of last year." The infotainment device 100 can convert natural language obtained from the user 310 into appropriate search conditions 350. By converting natural language obtained from the user 310 into appropriate search conditions 350, the infotainment device 100 can intuitively and easily obtain information regarding location.

[0036] According to one embodiment, the infotainment device 100 can acquire search conditions 350 for identifying a place based on extracted context information. The infotainment device 100 can acquire search conditions 350 corresponding to a user's question-type utterance about a place (for example, "Which restaurant did I go to last Christmas?"). For example, the infotainment device 100 can set the search range for the date the place was visited to "December 25th last year," which is the time range corresponding to the time information included in the utterance, "last Christmas." As another example, the infotainment device 100 can set the category information of the place to "restaurant." The number of search conditions 350 may be less than the number of search conditions 250 described in Figure 2.

[0037] Figure 4 is a diagram illustrating the operation of extracting location candidates according to one embodiment.

[0038] Referring to Figure 4, according to one embodiment, an infotainment device 400 (for example, the infotainment device 100 in Figure 1) can acquire (or receive) search conditions 410 (for example, search conditions 250 in Figure 2 or search conditions 350 in Figure 3). The search conditions 410 may be transmitted (or transmitted) from a model (for example, model 200 in Figure 2 or model 300 in Figure 3).

[0039] According to one embodiment, the infotainment device 400 can acquire a location visit history 430. The location visit history 430 may include the location of places visited by the user (for example, user 110 in Figure 1) and the visit frequency of user 110 to those places. The location visit history 430 may be the location visit history of the vehicle in which the infotainment device 400 is installed. The location visit history 430 may also be the location visit history of user 110, linked to the location information of a terminal (not shown) used by user 110. The infotainment device 400 can acquire (or receive) the location visit history 430 from a server (for example, server 130 in Figure 1).

[0040] According to one embodiment, the infotainment device 400 can provide a response to user 110 based on search conditions 410 and user 110's place visit history. The infotainment device 400 can extract at least one place candidate 450 from the places included in the place visit history 430 that corresponds to the search conditions 410. For example, the infotainment device 400 can extract at least one place candidate 450 that corresponds to the time range "December 25th of last year" and the place category information "restaurant" included in the search conditions 410. The at least one place candidate 450 may include one or more restaurants visited on December 25th of last year.

[0041] According to one embodiment, the infotainment device 400 can extract an ID value for at least one place candidate 450 corresponding to the search condition 410 from among the places included in the place visit history 430.

[0042] According to one embodiment, the infotainment device 400 can transmit a place candidate 450 selected by the user 110 from among at least one place candidate 450 to the place visit history 430. The infotainment device 400 can learn the user 110's place visit pattern by storing the place candidate 450 selected by the user 110 from among at least one place candidate 450 in the server 130. The infotainment device 400 may use a separate training model to learn the user 110's place visit pattern. The separate training model may be different from the model (e.g., model 200 in Figure 2, model 300 in Figure 3, model 500 in Figure 5). The training model for learning the user 110's place visit pattern may include a neural network, and the neural network (or artificial neural network) may include statistical learning algorithms that mimic biological nerves in machine learning and cognitive science. A neural network can refer to any model in which artificial neurons (nodes) that form a network through synaptic connections change the strength of their synaptic connections through learning, thereby possessing problem-solving capabilities. Neurons in a neural network can include combinations of weights or viruses. A neural network can include one or more layers, each consisting of one or more neurons or nodes. By changing the weights of the neurons through learning, a neural network can infer results from any given input. Neural networks can include deep neural networks.Neural networks include CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), perceptron, multilayer perceptron, FF (Feed Forward), RBF (Radial Basis Network), DFF (Deep Feed Forward), LSTM (Long Short Term Memory), GRU (Gated Recurrent Unit), AE (Auto Encoder), VAE (Variational Auto Encoder), DAE (Denoising Auto Encoder), SAE (Sparse Auto Encoder), MC (Markov Chain), HN (Hopfield Network), BM (Boltzmann Machine), RBM (Restricted Boltzmann Machine), DBN (Deep Belief Network), DCN (Deep Convolutional Network), DN (Deconvolutional Network), DCIGN (Deep Convolutional Inverse Graphics Network), GAN (Generative Adversarial Network), and LSM (Liquid This may include State Machines, ELMs (Extreme Learning Machines), ESNs (Echo State Networks), DRNs (Deep Residual Networks), DNCs (Differentiable Neural Computers), NTMs (Neural Turning Machines), CNs (Capsule Networks), KNs (Kohonen Networks), VGGs (Visual Geometry Groups) networks, and ANs (Attention Networks). The infotainment device 400 can provide the user 110 with the best possible response by learning the user 110's place visit pattern.

[0043] Figure 5 is a diagram illustrating the process of obtaining a summary of location candidates according to one embodiment.

[0044] Referring to Figure 5, according to one embodiment, an infotainment device 400 (for example, the infotainment device 100 in Figure 1) can generate a summary 510 about at least one place candidate 450. For example, the infotainment device 400 can input at least one place candidate 450 into model 500 to generate a summary 510 about at least one place candidate 450. The generated summary 510 may consist of snippet sentences. Note that model 500 may be the same model as the models described with reference to Figures 1 to 4 (for example, model 200 in Figure 2, model 300 in Figure 3). For example, model 500 may be a different model from model 200 (for example, a sentence summarization model).

[0045] According to one embodiment, the infotainment device 400 can obtain information about at least one place candidate 450. For example, the infotainment device 400 can search for at least one place candidate 450 in a search engine and obtain information about at least one place candidate 450. The infotainment device 400 can input an ID value for at least one place candidate 450 into a search engine and obtain information about at least one place candidate 450. The search engine may be installed in a navigation system included in the infotainment device 400. The source from which the infotainment device 400 obtains information about at least one place candidate 450 is not limited to a search engine, but may be obtained from a server (for example, server 130 in Figure 1). The infotainment device 400 can provide information regarding the summary 510 and / or at least one location candidate 450 generated from the model 500 as a response. The infotainment device 400 can provide the information regarding the summary 510 and / or at least one location candidate 450 generated from the model 500 in one or more ways, namely voice and text. For example, if the infotainment device 400 determines that providing the information regarding the summary 510 and / or at least one location candidate 450 generated from the model 500 would take longer than a certain amount of time, it can provide the information to the user in text.

[0046] Figure 6 is a flowchart illustrating a method according to one embodiment.

[0047] Referring to Figure 6, according to one embodiment, operations 610 to 670 may be operations performed by the infotainment device of Figure 1 (for example, the infotainment device 100 of Figure 1), which was described with reference to Figures 1 to 9.

[0048] According to one embodiment, operations 610 to 670 can be understood to be performed by the processor (e.g., processor 910 in Figure 9) of the infotainment device 100 (e.g., electronic device 900 in Figure 9) described with reference to Figure 1.

[0049] In operation 610, the infotainment device 100 can acquire user utterances (for example, user 110 in Figure 1). The infotainment device 100 can receive user utterances about place.

[0050] In operation 620, the infotainment device 100 can input user 110's utterances about place into a model (for example, model 200 in Figure 2) and extract context information.

[0051] In operation 630, the infotainment device 100 can obtain search conditions (for example, search condition 410 in Figure 4) for identifying a location based on the extracted context information.

[0052] In operation 640, the infotainment device 100 can extract at least one place candidate 450 corresponding to the search condition 410 from the places included in the place visit history (for example, the place visit history 430 in Figure 4). It can determine whether or not there is at least one place candidate 450 corresponding to the search condition 410 among the places included in the place visit history (for example, the place visit history 430 in Figure 4).

[0053] In operation 650, the infotainment device 100 can recommend at least one place candidate 450 to the user 110, in response to determining that there is at least one place candidate 450 corresponding to the search condition 410 among the places included in the place visit history 430.

[0054] In operation 660, the infotainment device 100, in response to determining that there is no place candidate 450 corresponding to the search condition 410 among the places included in the place visit history 430, can obtain at least one place candidate 450 from the search engine. In this case, the at least one place candidate 450 obtained from the search engine may be a place candidate that does not correspond to the search condition 410. The infotainment device 100 can obtain information about at least one place candidate 450 from the search engine.

[0055] In operation 670, the infotainment device 100 can generate a summary (e.g., summary 510 in Figure 5) about at least one place candidate 450. For example, the infotainment device 100 can input the summary 510 about at least one place candidate 450 into a model (e.g., model 500 in Figure 5) to generate the summary 510 about at least one place candidate 450. The infotainment device 100 can obtain information about at least one place candidate 450 from a search engine. For example, the infotainment device 100 can search for at least one place candidate 450 from a search engine and obtain information about at least one place candidate 450 as a search result. The infotainment device 100 can provide the user 110 with the summary 510 about at least one place candidate 450 and the information about at least one place candidate 450 as a search result.

[0056] Operations 610 through 670 are performed sequentially, but are not limited to this order. For example, two or more operations may be performed in parallel.

[0057] Figure 7 is a diagram illustrating the operation of an infotainment device according to one embodiment.

[0058] Referring to Figure 7, according to one embodiment, in response to determining that at least one location candidate (e.g., location candidate 450 in Figure 4) exists among the locations included in the location visit history (e.g., location visit history 430 in Figure 4) that corresponds to the search condition (e.g., search condition 410 in Figure 4), the infotainment device 700 can recommend at least one location candidate 450 to the user (e.g., user 110 in Figure 1). For example, "Atigee Itabashi Station Store" could be at least one location candidate 450. The series of operations by which the infotainment device 700 obtains the search condition 410 based on the user 110's utterance (e.g., "Which cafe did I go to last month?") may be substantially identical to the operations performed by the infotainment devices described with reference to Figures 1 to 6 (e.g., infotainment device 100 in Figure 1, infotainment device 400 in Figure 4). Further explanations that would be redundant are omitted.

[0059] According to one embodiment, the infotainment device 700 can input at least one place candidate 450 into a model (e.g., model 500 in Figure 5) to generate a summary (e.g., summary 510 in Figure 5) about at least one place candidate 450. For example, the infotainment device 700 can input "Atije Pangyo Station" into model 500 to generate a summary about "Atije Pangyo Station". The infotainment device 700 can provide the user 110 with the summary about "Atije Pangyo Station". For example, the infotainment device 700 can provide the user 110 with the summary about "Atije Pangyo Station", which is "The cafe the user visited last month was Atije Pangyo Station". As another example, the infotainment device 700 can provide the user 110 with "Last month, the user visited Atije Pangyo Station in Baekgyeong-dong, Bundang-gu, Seongnam-si, Gyeonggi-do". As another example, the infotainment device 700 could provide user 110 with the following: "The cafes you visited last month are as follows: Atigee Itabashi Station branch was visited on XX / XX / 2024." The infotainment device 700 could use Model 500 to provide one of several summaries about at least one location candidate 450. Even if user 110's utterance is the same, the summary 510 generated from Model 500 and provided by the infotainment device 700 may be different from before.

[0060] According to one embodiment, the infotainment device 700 can mark a location corresponding to at least one location candidate 450 on a map displayed on the GUI (graphical user interface) of the infotainment device 700. The infotainment device 700 can mark a location on the map that corresponds to the location candidate that is determined to be the most relevant among the at least one location candidate 450. For example, the infotainment device 700 can mark "Atije Itabashi Station Store" on the map displayed on the infotainment device 700.

[0061] According to one embodiment, the infotainment device 700 can display information about at least one location candidate 450 corresponding to an ID value. For example, the information about at least one location candidate 450 may include the address of at least one location candidate 450. The infotainment device 700 can display the address of "Atije Itabashi Station Store" on the GUI (graphical user interface) of the infotainment device 700.

[0062] According to one embodiment, the infotainment device 700 can provide the user 110 with not only a summary of at least one place candidate 450, but also other functions. For example, the infotainment device 700 can generate a question asking whether or not to search for a route to at least one place candidate 450. The infotainment device 700 can input at least one place candidate 450 into the model 500 to generate a question asking whether or not to search for a route to at least one place candidate 450, and provide the question to the user 110. For example, the infotainment device 700 can provide the user 110 with a question such as, "Shall I guide you to Atigee Itabashi Station store?"

[0063] Figure 8 is a flowchart illustrating a method according to one embodiment.

[0064] Referring to Figure 8, according to one embodiment, operations 810 to 850 may be operations performed by the infotainment device 100 shown in Figure 1, which was described with reference to Figures 1 to 9.

[0065] According to one embodiment, operations 810 to 850 can be understood to be performed by the processor (e.g., processor 910 in Figure 9) of the infotainment device 100 (e.g., electronic device 900 in Figure 9) described with reference to Figure 1.

[0066] In operation 810, the infotainment device 100 can input a user's utterance about a place (for example, user 110 in Figure 1) into a model (for example, model 200 in Figure 2) and extract context information.

[0067] In operation 830, the infotainment device 100 can acquire search conditions (for example, search condition 250 in Figure 2) for identifying a location based on context information.

[0068] In operation 850, the infotainment device 100 can provide a response to user 110 based on the search criteria 250 and user 110's location visit history (for example, location visit history 430 in Figure 4).

[0069] Operations 810 to 850 are performed sequentially, but are not limited to this order. For example, two or more operations may be performed in parallel.

[0070] Figure 9 is a schematic block diagram of an electronic device according to one embodiment.

[0071] Referring to Figure 9, according to one embodiment, the electronic device 900 (for example, the infotainment device 100 in Figure 1) may include a memory 930 and a processor 910.

[0072] Memory 930 can store instructions (or programs) that can be executed by the processor 910. For example, the instructions may include instructions for performing the operations of the processor 910 and / or the operations of each configuration of the processor 910.

[0073] The memory 930 may include one or more computer-readable storage media. The memory 930 may also include non-volatile memory elements (e.g., magnetic hard disk, optical disk, floppy disk, flash memory, EPROM (electrically programmable memories), EEPROM (electrically erasable and programmable)).

[0074] Memory 930 may be a non-transitory medium. The term "non-transitory" may indicate that the recording medium is not realized by a carrier wave or propagated signal. However, the term "non-transitory" should not be interpreted as meaning that memory 930 is immobile.

[0075] The processor 910 can process data stored in memory 930. The processor 910 can execute computer-readable code (e.g., software) and instructions triggered by the processor 910 that are stored in memory 930.

[0076] The processor 910 may be a data processing device implemented in hardware, having a circuit with a physical structure for performing desired operations. For example, the desired operations may include code or instructions contained in a program.

[0077] For example, data processing devices implemented in hardware can include microprocessors, central processing units, processor cores, multi-core processors, multiprocessors, ASICs (Application-Specific Integrated Circuits), and FPGAs (Field Programmable Gate Arrays).

[0078] The processor 710 can cause the electronic device 900 to perform one or more operations by executing code and / or instructions stored in the memory 730. The operations performed by the electronic device 900 may be substantially identical to those performed by the infotainment device 100 as described with reference to Figures 1 to 9. Further explanation is omitted.

[0079] The embodiments described above can be implemented using hardware components, software components, and / or combinations of hardware and software components. For example, the apparatus, methods, and components described in the embodiments can be implemented using a general-purpose computer or a special-purpose computer, such as a processor, controller, ALU (arithmetic logic unit), digital signal processor, microcomputer, FPGA (field programmable gate array), PLU (programmable logic unit), microprocessor, or any other device capable of executing and responding to instructions. The processing device can run an operating system (OS) and software applications run on the OS. The processing device can also access, store, manipulate, process, and generate data in response to software execution. For convenience of understanding, it has sometimes been described that only one processing device is used, but a person with ordinary skill in the art will see that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as a parallel processor, are also possible.

[0080] Software can include computer programs, code, instructions, or a combination of one or more of these, which can configure a processing unit to operate as desired, or which can instruct the processing unit independently or collectively. Software and / or data can be permanently or temporarily embodied in a certain type of machine, component, physical device, virtual device, computer recording medium or device, or transmitted signal wave, in order to be interpreted by a processing unit or to provide instructions or data to a processing unit. Software can also be distributed across a network of computer systems and stored or executed in a distributed manner. Software and data can be stored on computer-readable recording media.

[0081] The methods according to the embodiments can be implemented in the form of program instructions performed by various computer means and can be recorded on computer-readable media. Computer-readable media can store program instructions, data files, data structures, etc., individually or in combination. The program instructions recorded on the media may be specially designed and configured for the embodiments, or they may be publicly known and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floppy disks; and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, and flash memory. Examples of program instructions include not only machine code generated by compilers, but also high-level language code that can be executed by a computer using an interpreter or the like.

[0082] The hardware devices described above can be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

[0083] As described above, the embodiments have been illustrated with limited drawings, but a person with ordinary skill in the art can apply various technical modifications and variations thereto. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or assembled in a different manner than described, or substituted or replaced by other components or equivalents, and still the appropriate results may be achieved.

[0084] Therefore, other implementations, other embodiments, and equivalents to the claims described below also fall under the scope of the claims.

Claims

1. A method for operating an infotainment system, The process of inputting user utterances related to location into a model and extracting context information; An operation (obtaining) to obtain search conditions for identifying the location based on the context information; and Providing an action to provide a response to the user based on the search conditions and the user's place visit history. Methods that include...

2. The aforementioned context information is, The time information included in the utterance, the regional information including the location, and the category information of the location. The method according to claim 1, including the method described in claim 1.

3. The aforementioned acquired action is, Based on the aforementioned time information, the operation sets the time range included in the search conditions. The method according to claim 2, including the method described in claim 2.

4. The operation provided above is, An operation to extract at least one place candidate that corresponds to the search criteria from among the places included in the aforementioned place visit history; An operation to generate a summary of at least one location candidate; and An operation that provides the summary and information about the at least one location candidate as the response. The method according to claim 1, including the method described in claim 1.

5. The history of visits to the aforementioned locations is, The location of the place visited by the user, the date and time of the user's visit to the place, and the visit frequency of the user to the place. The method according to claim 1, including the method described in claim 1.

6. An electronic device, Memory containing instructions; and A processor electrically connected to the memory and for executing the instructions. Includes, When the instruction is executed by the at least one processor, the device will, The user's utterances regarding place are input into the model, and context information is extracted. Based on the aforementioned contextual information, a search condition for identifying the location is obtained. An electronic device that provides a response to a user based on the search conditions and the user's place visit history.

7. The aforementioned context information is, The time information included in the utterance, the regional information including the location, and the category information of the location. The electronic device according to claim 6, including the electronic device according to claim 6.

8. When the instruction is executed by the at least one processor, the device will, The electronic device according to claim 7, wherein the time range included in the search conditions is set based on the aforementioned time information.

9. When the instruction is executed by the at least one processor, the device will, From the locations included in the aforementioned location visit history, extract at least one location candidate that corresponds to the aforementioned search criteria. A summary is generated for at least one of the aforementioned location candidates. The electronic device according to claim 6, which provides the summary and information relating to at least one location candidate as the response.

10. The history of visits to the aforementioned locations is, The location of the place visited by the user, the date and time of the user's visit to the place, and the visit frequency of the user to the place. The electronic device according to claim 6, including the electronic device according to claim 6.

11. A computer program stored on a computer-readable recording medium, which, in combination with hardware, causes to perform the method according to any one of claims 1 to 5.

Images