Infotainment device and method of operation thereof

Abstract

An operation method for an infotainment device according to one embodiment may include extracting context information by inputting user utterances about a place into a model. The method may include obtaining search conditions for identifying the place based on the context information. The method may also include providing a response to the user based on the search conditions and the user's place visit history.

Description

Technical Field

[0001] The following disclosure relates to an infotainment device and its operating method. Background Technology

[0002] Infotainment systems installed in vehicles allow users to search for various locations or provide information about those locations. Existing location search systems rely on matching user input (e.g., clicks or words) with keywords, which has the drawback of failing to recognize the specific context when users input natural language.

[0003] Currently, an in-vehicle or mobile navigation system is under development, designed to provide personalized services and universal navigation functions for each user.

[0004] The above background technology was acquired or learned by the inventors during the development of this invention, and should not be construed as necessarily being known technology disclosed before the application for this invention. Summary of the Invention

[0005] Technical problems to be solved

[0006] One embodiment may provide a technique for obtaining search conditions for identifying locations by extracting context information based on a user’s voice input model about a location.

[0007] One embodiment may provide a technique for providing a response to a user based on search criteria and the user's place visit history.

[0008] However, the technical problems are not limited to those mentioned above; other technical problems may also exist.

[0009] Technical methods for solving problems

[0010] An operating method for an infotainment device according to one embodiment may include extracting context information by inputting user utterances about a place into a model. The method may include obtaining search conditions for identifying the place based on the context information. The method may also include providing a response to the user based on the search conditions and the user's place visit history.

[0011] The contextual information may include: time information contained in the discourse, regional information containing the location, and category information of the location.

[0012] The acquisition operation may include the following operation: setting the time range included in the search conditions based on the time information.

[0013] The provisioning operation may include extracting at least one place candidate corresponding to the search criteria from the locations included in the location access history. The provisioning operation may include generating a summary of the at least one place candidate. The provisioning operation may include providing the summary and information about the at least one place candidate as the response.

[0014] The location visit history may include: the location of the location visited by the user, the date and time of the user's visit, and the frequency of the user's visits to the location.

[0015] The electronic device may include: a memory that includes instructions; and a processor electrically connected to the memory and executing the instructions. When the at least one processor executes the instructions, the electronic device may perform the following operations: extracting contextual information by inputting user utterances about a location into a model, obtaining search criteria for identifying the location based on the contextual information, and providing a response to the user based on the search criteria and the user's location access history.

[0016] The context information may include: time information contained in the utterance, regional information containing the location, and category information of the location.

[0017] When the at least one processor executes the instruction, the electronic device may perform the following operation: setting the time range included in the search criteria based on the time information.

[0018] When the at least one processor executes the instructions, the electronic device may perform the following operations: extract at least one location candidate corresponding to the search criteria from the locations contained in the location access history, generate a summary of the at least one location candidate, and provide the summary and the sum of the at least one location candidate as the response.

[0019] The location access history may include: the location of the location visited by the user, the date and time of the user's visit to the location, and the frequency of the user's visit to the location. Attached Figure Description

[0020] Figure 1 The accompanying drawing illustrates an infotainment device according to one embodiment.

[0021] Figure 2 and Figure 3 The accompanying drawing illustrates the operation of obtaining search criteria according to one embodiment.

[0022] Figure 4 The accompanying drawing illustrates the operation of extracting location candidates according to one embodiment.

[0023] Figure 5 The accompanying drawing illustrates the operation of obtaining a summary of location candidates according to one embodiment.

[0024] Figure 6 This is a flowchart illustrating a method according to one embodiment.

[0025] Figure 7 The accompanying drawing illustrates the operation of an infotainment device according to one embodiment.

[0026] Figure 8 This is a flowchart illustrating a method according to one embodiment.

[0027] Figure 9 This is a schematic block diagram of an electronic device according to one embodiment. Detailed Implementation

[0028] The specific structural or functional descriptions of the disclosed embodiments are for illustrative purposes only, and various modifications can be made to the embodiments. Therefore, the embodiments are not limited or restricted to the specific form of disclosure, and all variations, equivalents, or substitutions of the embodiments are included within the scope of the claims.

[0029] Furthermore, in the description of various components, terms such as "first" or "second" may be used, which are used only to distinguish one constituent element from another. For example, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

[0030] When a constituent element is described as being “connected” to another constituent element, it should be understood that the constituent element can be directly connected to or attached to the other constituent element, or that the other constituent element is “connected” to the constituent elements.

[0031] Unless otherwise specified in the text, singular expressions include plural meanings. In this specification, terms such as "comprising" or "having" are used to indicate the presence of the features, numbers, steps, operations, constituent elements, accessories, or combinations thereof described in the specification, and do not exclude the presence of one or more other features, numbers, steps, operations, constituent elements, accessories, or combinations thereof, or additional functions.

[0032] Unless otherwise defined, all terms used herein, including technical or scientific terms, shall have the ordinary meaning as understood by one of ordinary skill in the art. Terms that are commonly used and are identical to their dictionary definitions shall be understood to have a meaning consistent with the general content of the relevant art, and shall not be overly idealized or interpreted as having a formal meaning unless expressly stated in this application.

[0033] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Furthermore, in the description with reference to the drawings, the same reference numerals are used for the same constituent elements, and repeated descriptions thereof are omitted.

[0034] Figure 1 The accompanying drawing illustrates an infotainment device according to one embodiment.

[0035] Reference Figure 1According to one embodiment, the infotainment system 10 may include an infotainment device 100, a user 110, and / or a server 130. Infotainment is a compound word combining information and entertainment, referring to a new type of service that combines information and entertainment. The infotainment device 100 may be installed in a vehicle (e.g., the vehicle in which user 110 is riding) and may provide various information and entertainment functions to vehicle users (e.g., user 110, including the driver and / or fellow passengers). For example, the infotainment device 100 may provide the vehicle with navigation and services for connecting to mobile devices (e.g., smartphones) (e.g., mobile applications, etc.) and allow user 110 to use these services. The infotainment device 100 may also provide the vehicle with information obtained through the server 130. For example, the infotainment device 100 may obtain real-time traffic information, surrounding facility information, real-time weather information, and weather forecasts through the server 130 and provide the obtained information to the vehicle. Vehicles can refer to means of transportation that transport goods and / or people, such as cars, trains, ships, airplanes, scooters, and / or bicycles. Infotainment device 100 can provide vehicle 110 with various entertainment functions, such as audio streaming, video playback, social network services (SNS), internet search, and games. For example, infotainment device 100 can provide user 110 with entertainment functions stored on its own or external multimedia content obtained through server 130.

[0036] According to one embodiment, the infotainment device 100 can perform personalized search functions. The infotainment device 100 can output responses or control vehicle functions based on the utterance of the user 110. The infotainment device 100 can use generative models (e.g., Figure 2 The generative model (model 200) generates commands for responding to the user 110's speech and / or controlling at least some functions of the vehicle. The generative model can include an on-device generative model built into the infotainment device 100 or a cloud generative model located outside the infotainment device 100 (e.g., server 130). For example, the infotainment device 100 can input the user 110's speech into the on-device generative model built into the infotainment device 100 and provide the generated response to the user 110. Alternatively, the infotainment device 100 can transmit the user 110's speech to server 130 and receive the response generated by the cloud generative model from server 130.

[0037] According to one embodiment, the vehicle ridden by user 110, server 130, and infotainment device 100 can communicate via a network (not shown). For example, the network may include a Local Area Network (LAN), a Wide Area Network (WAN), a Value Added Network (VAN), a mobile radio communication network, a satellite communication network, and combinations thereof. The network is a comprehensive data communication network that enables the vehicle, server 130, and infotainment device 100 to communicate smoothly with each other, and may include wired internet, wireless internet, and mobile wireless communication networks. Furthermore, the wireless communication network may include, but is not limited to, wireless local area networks (e.g., Wi-Fi), Bluetooth, Bluetooth Low Energy, Zigbee, Wi-Fi Direct (WFD), ultra-wideband (UWB), infrared communication (Infrared Data Association (IrDA)), near field communication (NFC), etc.

[0038] Figure 2 and Figure 3 The accompanying drawing illustrates the operation of obtaining search criteria according to one embodiment.

[0039] Reference Figure 2 According to one embodiment, an infotainment device (e.g., Figure 1 The infotainment device 100 can receive (or acquire) information from user 210 (e.g., Figure 1 The infotainment device 100 can receive the speech of user 210 regarding a location. The infotainment device 100 can input the speech of user 210 regarding a location into model 200. Model 200 can be a large language model (LLM), in which the relationships between sentence structure, vocabulary, and / or context within user speech can be learned. For example, the infotainment device 100 can input a command from user 210 regarding a location (e.g., “Tell me the opening hours of the Yangzhou coffee shop I frequented last month”) into model 200.

[0040] According to one embodiment, the infotainment device 100 can input a command utterance from a user 210 regarding a location (e.g., “Tell me the opening hours of the Yangzhou coffee shop I frequented last month”) into the model 200 to extract contextual information. The contextual information may include time information contained in the utterance, regional information containing the location, and / or category information of the location. The contextual information may also include the frequency of visits to the location.

[0041] According to one embodiment, the infotainment device 100 can obtain search criteria 250 for identifying locations based on extracted context information. Search criteria 250 can be used to extract at least one place candidate corresponding to search criteria 250 from locations included in the user 210's location access history (e.g., ...). Figure 4 The infotainment device 100 can acquire search criteria 250 corresponding to the user 210's command utterance regarding a location (e.g., "Tell me the business information of the Yangzhou coffee shop I frequented last month"). For example, the infotainment device 100 can set the search range for the visit date of the location to "last month". In another example, the infotainment device 100 can set the visit location to "Yangzhou". In another example, the infotainment device 100 can set the category information of the location to "coffee shop". In another example, the infotainment device 100 can set the visit frequency of the location to "visited more than five times within the search date range". The visit frequency of the location may vary depending on the search range of the visit date and may not be fixed. The search criteria 250 set by the infotainment device 100 may include, but are not limited to, "last month", "Yangzhou", "coffee shop" and / or "more than five times", and the number of search criteria 250 may increase or decrease according to the user 210's utterance.

[0042] Reference Figure 3 According to one embodiment, an infotainment device (e.g., Figure 1 The infotainment device 100 can receive information from a user 310 at a location (e.g., Figure 2 The infotainment device 100 can input the speech of user 310 (210) about the location into model 300 (e.g., user 210). Figure 2 In model 200. For example, infotainment device 100 can input query-type utterances from user 210 about locations (e.g., “Which restaurant did I go to for Christmas last year?”) into model 300.

[0043] According to one embodiment, the infotainment device 100 can input a query uttered by a user 210 regarding a location (e.g., “Which restaurant did I go to last Christmas?”) into the model 300 to extract contextual information. For example, the infotainment device 100 can extract time information contained in the utterance, namely “last Christmas”. In another example, the infotainment device 100 can extract category information about the location, namely “restaurant”.

[0044] According to one embodiment, the infotainment device 100 may set search criteria 350 based on time information contained in the speech of a user 310 regarding a location (e.g., Figure 2 The time range included in the search criteria 250. For example, the infotainment device 100 can set the time range corresponding to the time information "last Christmas" contained in the utterance to "December 25th of last year". The infotainment device 100 can convert the natural language obtained from the user 310 into the corresponding search criteria 350. The infotainment device 100 can intuitively and conveniently obtain information about locations by converting the natural language obtained from the user 310 into the corresponding search criteria 350.

[0045] According to one embodiment, the infotainment device 100 can obtain search criteria 350 for identifying locations based on extracted contextual information. The infotainment device 100 can obtain search criteria 350 corresponding to a query uttered by a user 310 regarding a location (e.g., "Which restaurant did I go to last Christmas?"). For example, the infotainment device 100 can set the search scope for the date of the visit to "December 25th of last year," corresponding to the time information contained in the utterance, i.e., "last Christmas." For example, the infotainment device 100 can set the category information of the location to "restaurant." Figure 2 The number of search criteria 350 can be reduced compared to the number of search criteria 250 described in the text.

[0046] Figure 4 The accompanying drawing illustrates the operation of extracting location candidates according to one embodiment.

[0047] Reference Figure 4 According to one embodiment, the infotainment device 400 (e.g., Figure 1 The infotainment device 100 can acquire (or receive) search conditions 410 (e.g., Figure 2 Search criteria 250 or Figure 3 Search condition 350). Search condition 410 can be derived from the model (e.g., Figure 2 Model 200 or Figure 3 Model 300) transmission (or provision).

[0048] According to one embodiment, the infotainment device 400 can obtain a location access history 430. The location access history 430 may include user (e.g., ...) Figure 1 The location access history 430 can be the location access history of a vehicle equipped with the infotainment device 400, and can be the location access history of the user 110. The location access history 430 is associated with the location information of the terminal (not shown) used by the user 110, and can be the location access history of the user 110. The infotainment device 400 can access the location access history from a server (e.g., Figure 1 Server 130) retrieves (or receives) location access history 430.

[0049] According to one embodiment, the infotainment device 400 can provide a response to the user 110 based on search criteria 410 and the user 110's location access history 430. The infotainment device 400 can extract at least one location candidate 450 corresponding to the search criteria 410 from the locations included in the location access history 430. For example, the infotainment device 400 can extract at least one location candidate 450 corresponding to the time range "December 25th of last year" and the location category information "restaurant" included in the search criteria 410. At least one location candidate 450 may include one or more restaurants that the user visited on December 25th of last year.

[0050] According to one embodiment, the infotainment device 400 can extract the identifier (ID) value of at least one location candidate 450 corresponding to the search condition 410 from the locations included in the location access history 430.

[0051] According to one embodiment, the infotainment device 400 can transmit location candidates 450 selected by user 110 from at least one location candidate 450 to a location visit history 430. The infotainment device 400 can learn the user 110's place visit pattern by storing the location candidates 450 selected by user 110 from at least one location candidate 450 in a server 130. The infotainment device 400 can use a separate learning model to learn the user 110's place visit pattern. The separate learning model can be combined with a model (e.g., Figure 2 Model 200 Figure 3 Model 300 and Figure 5This differs from model 500. The learning model used to learn user 110's location access patterns may include neural networks, and neural networks (or artificial neural networks) may include statistical learning algorithms that simulate biological neurons in machine learning and cognitive science. A neural network can refer to a model in which artificial neurons (nodes) form a network by combining synapses and learn to change the strength of synaptic connections, thereby possessing the ability to solve problems. Neurons in a neural network may contain combinations of weights or biases. A neural network may contain more than one layer, each containing more than one neuron or node. A neural network can learn to change the weights of neurons, thereby inferring results from predetermined inputs. Neural networks may include deep neural networks (DNNs). Neural networks can include: Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Perceptrons, Multilayer Perceptrons (MLP), Feedforward Networks (FF), Radial Basis Function Networks (RBF), Deep Feedforward Networks (DFF), Long Short-Term Memory Networks (LSTM), Gated Recurrent Units (GRU), Autoencoders (AE), Variational Autoencoders (VAE), Denoising Autoencoders (DAE), Sparse Autoencoders (SAE), Markov Chains (MC), Hopfield Networks (HN), Boltzmann Machines (BM), Restricted Boltzmann Machines (RBM), Deep Belief Networks (DBN), Deep Convolutional Networks (DCN), Deconvolutional Networks (DN), Deep Convolutional Inverse Graph Networks (DCIGN), Generative Adversarial Networks (GAN), Liquid Machines (LSM), Extreme Learning Machines (ELM), Echo State Networks (ESN), Deep Residual Networks (DRN), Differentiable Neural Computers (DNC), Neural Turing Machines (NTM), Capsule Networks (CN), Kohonen Networks (KN), and Attention Networks (AN). The infotainment device 400 can provide the best response to user 110 by learning the user 110's place visit pattern.

[0052] Figure 5 The accompanying drawing illustrates the operation of obtaining a summary of location candidates according to one embodiment.

[0053] Reference Figure 5 According to one embodiment, the infotainment device 400 (e.g., Figure 1 The infotainment device 100 can generate a summary 510 of at least one location candidate 450. For example, the infotainment device 400 can input at least one location candidate 450 into a model 500 to generate a summary 510 of at least one location candidate 450. The generated summary 510 may contain snippet sentences. It should be noted that the model 500 can be compared with a reference... Figures 1 to 4The described model (e.g., Figure 2 Model 200 and Figure 3 Model 500 is the same as, but not limited to, Model 200. For example, Model 500 may be a different model than Model 200 (e.g., a sentence summarization model).

[0054] According to one embodiment, the infotainment device 400 can obtain information about at least one location candidate 450. For example, the infotainment device 400 can use a search engine to search for at least one location candidate 450 and obtain information about it. The infotainment device 400 can obtain information about at least one location candidate 450 by inputting the ID value of at least one location candidate 450 into the search engine. The search engine can be installed in a navigation system included in the infotainment device 400. The source from which the infotainment device 400 obtains information about at least one location candidate 450 is not necessarily limited to a search engine; it can also be from a server (e.g., Figure 1 The information is obtained from server 130. The infotainment device 400 may provide information on a summary 510 generated by model 500 and / or at least one location candidate 450 in response. The infotainment device 400 may provide the information on the summary 510 generated by model 500 and / or at least one location candidate 450 in one or more ways, such as voice and text. For example, when the infotainment device 400 provides the information on the summary 510 generated by model 500 and / or at least one location candidate 450 to the user via voice, it may provide it to the user via text in response to determining that a certain amount of time is needed.

[0055] Figure 6 This is a flowchart illustrating a method according to one embodiment.

[0056] Reference Figure 6 According to one embodiment, operations 610 to 670 can be performed by reference to... Figures 1 to 9 The infotainment device (e.g., Figure 1 The infotainment device 100 is used for execution.

[0057] According to one embodiment, operations 610 to 670 can be performed by reference. Figure 1 The infotainment device 100 (e.g., Figure 9 The processor of the electronic device 900 (e.g., Figure 9 The processor 910 executes the commands.

[0058] In operation 610, the infotainment device 100 can acquire user (e.g., Figure 1 The infotainment device 100 can receive the speech of user 110 (who is located in the specified location).

[0059] In operation 620, the infotainment device 100 can input the speech of the user 110 regarding the location into the model (e.g., Figure 2 In Model 200, contextual information is extracted.

[0060] In operation 630, the infotainment device 100 may obtain search criteria for identifying locations based on extracted contextual information (e.g., Figure 4 Search criteria 410).

[0061] In operation 640, the infotainment device 100 can access historical records from a location (e.g., Figure 4 The infotainment device 100 can extract at least one location candidate 450 corresponding to search condition 410 from the locations included in the location visit history (430). Figure 4 Does the location access history (430) contain at least one location candidate (450) that corresponds to search condition (410)?

[0062] In operation 650, infotainment device 100 may recommend at least one location candidate 450 to user 110 in response to determining that at least one location candidate 450 corresponding to search condition 410 exists in the locations included in location access history 430.

[0063] In operation 660, the infotainment device 100 may, in response to determining that at least one location candidate 450 corresponding to search condition 410 does not exist in the locations included in the location access history 430, retrieve at least one location candidate 450 from a search engine. In this case, the at least one location candidate 450 retrieved from the search engine may not correspond to search condition 410. The infotainment device 100 may retrieve information about the at least one location candidate 450 from the search engine.

[0064] In operation 670, the infotainment device 100 may generate a summary of at least one location candidate 450 (e.g., Figure 5 Summary 510). For example, infotainment device 100 can input summary 510 of at least one location candidate 450 into the model (e.g., summary 510). Figure 5In model 500, a summary 510 of at least one location candidate 450 is generated. The infotainment device 100 can obtain information about the at least one location candidate 450 from a search engine. For example, the infotainment device 100 can search for at least one location candidate 450 from a search engine and obtain information about the at least one location candidate 450 as a search result. The infotainment device 100 can provide the user 110 with the summary 510 of the at least one location candidate 450 and the information about the at least one location candidate 450 as a search result.

[0065] Operations 610 to 670 can be performed sequentially, but the embodiments are not limited thereto. For example, two or more operations can be performed in parallel.

[0066] Figure 7 The accompanying drawing illustrates the operation of an infotainment device according to one embodiment.

[0067] Reference Figure 7 According to one embodiment, the infotainment device 700 (e.g., Figure 4 The infotainment device 400) responds to determining the location access history (e.g., Figure 4 The locations included in the location visit history (430) contain locations that match the search criteria (e.g., Figure 4 At least one location candidate corresponding to search condition 410 (e.g., Figure 4 The 450 location candidates can be presented to users (e.g., Figure 1 User 110) is recommended at least one location candidate 450. For example, “Artisee Banqiao Station Branch” could be at least one location candidate 450. The infotainment device 700 performs a series of operations to obtain search criteria 410 based on user 110’s utterance (e.g., “Where is the coffee shop I went to last month?”), which can be compared with references Figures 1 to 6 The infotainment devices described in the document (e.g., Figure 1 Infotainment device 100 and Figure 4 The operation performed by the infotainment device 400 is essentially the same. Therefore, it will not be described again here.

[0068] According to one embodiment, the infotainment device 700 can input at least one location candidate 450 into a model (e.g., Figure 5 In model 500), to generate a summary of at least one location candidate 450 (e.g., Figure 5(Summary 510). For example, the infotainment device 700 can input "Artisee Pangyo Station Branch" into the model 500 to generate a summary of "Artisee Pangyo Station Branch". The infotainment device 700 can provide the summary of "Artisee Pangyo Station Branch" to the user 110. For example, the infotainment device 700 can provide the user 110 with the summary "The coffee shop visited by the user last month was the Artisee Pangyo Station Branch", i.e., "Artisee Pangyo Station Branch". Another example, the infotainment device 700 can provide the user 110 with the summary "Last month, the user visited the Artisee Pangyo Station Branch located in Baekhyeon-dong, Bundang-gu, Seongnam-si, Gyeonggi-do". Another example, the infotainment device 700 can provide the user 110 with the summary "The coffee shop visited by the user last month is as follows: The user visited the Artisee Pangyo Station Branch on [Date]". The infotainment device 700 can use the model 500 to provide various summary information for at least one location candidate 450. Even if the user 110 utters the same words, the summary 510 generated by model 500 and provided by infotainment device 700 may be different from the previous one.

[0069] According to one embodiment, the infotainment device 700 may mark locations corresponding to at least one location candidate 450 on a map displayed on its graphical user interface (GUI). The infotainment device 700 may mark locations on the map that are considered to correspond to the most relevant location candidate among the at least one location candidate 450. For example, the infotainment device 700 may mark "Artisee Banqiao Station Branch" on its displayed map.

[0070] According to one embodiment, the infotainment device 700 may display information about at least one location candidate 450 corresponding to an ID value. For example, the information about the at least one location candidate 450 may include the address of the location candidate 450. The infotainment device 700 may display the address of "Artisee Banqiao Station Branch" on its GUI.

[0071] According to one embodiment, in addition to providing summary information on at least one location candidate 450, the infotainment device 700 can also provide other functions to the user 110. For example, the infotainment device 700 can generate a question asking whether the user wants to search for routes to at least one location candidate 450. The infotainment device 700 can input at least one location candidate 450 into the model 500, generate a question asking whether the user wants to search for routes to at least one location candidate 450, and provide the question to the user 110. For example, the infotainment device 700 can provide the user 110 with a question such as "Do you need me to guide you to the Artisee Banqiao Station branch?"

[0072] Figure 8 This is a flowchart illustrating a method according to one embodiment.

[0073] Reference Figure 8 According to one embodiment, operations 810 to 850 can be performed by reference. Figures 1 to 9 The aforementioned Figure 1 The infotainment device 100 is executed.

[0074] According to one embodiment, operations 810 to 850 can be performed by reference. Figure 1 The infotainment device 100 (e.g., Figure 9 The processor of the electronic device 900 (e.g., Figure 9 The processor 910 executes the commands.

[0075] In operation 810, the infotainment device 100 can display information about the location of the user (e.g., ...). Figure 1 User 110's utterance is input into the model (e.g., Figure 2 In Model 200, contextual information is extracted.

[0076] In operation 830, the infotainment device 100 may obtain search criteria for identifying locations based on contextual information (e.g., Figure 2 Search criteria 250).

[0077] In operation 850, the infotainment device 100 can access the user's location history (e.g., based on search criteria 250 and the user's location access history) according to search criteria 250. Figure 4 The location access history (430) provides a response to user 110.

[0078] Operations 810 to 850 can be executed sequentially, but the embodiments are not limited thereto. For example, two or more operations can be executed in parallel.

[0079] Figure 9 This is a schematic block diagram of an electronic device according to one embodiment.

[0080] Reference Figure 9 According to one embodiment, electronic device 900 (e.g., Figure 1 The infotainment device 100 may include a memory 930 and a processor 910.

[0081] The memory 930 may store instructions (or programs) executable by the processor 910. For example, the instructions may include instructions for performing operations of the processor 910 and / or the operations of the various components of the processor 910.

[0082] The memory 930 may include one or more computer-readable storage media. The memory 930 may include non-volatile storage elements (e.g., magnetic hard disks, optical disks, floppy disks, flash memory, electrically programmable read-only memory (EPROM), and electrically erasable programmable read-only memory (EEPROM)).

[0083] The memory 930 may be a non-transitory medium. The term "non-transitory" may indicate that the storage medium is not implemented in the form of a carrier wave or propagating signal. However, the term "non-transitory" should not be interpreted as the memory 930 being non-removable.

[0084] Processor 910 can process data stored in memory 930. Processor 910 can execute computer-readable code (e.g., software) stored in memory 930 as well as instructions triggered by processor 910.

[0085] The processor 910 can be a data processing device implemented in hardware by circuits having a physical structure that performs desired operations. For example, the desired operations may include code or instructions included in a program.

[0086] For example, hardware-implemented data processing devices may include microprocessors, central processing units, processor cores, multi-core processors, multiprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), etc.

[0087] The processor 910 can cause the electronic device 900 to perform more than one operation by executing code and / or instructions stored in the memory 930. The operations performed by the electronic device 900 can be related to... Figures 1 to 9 The operation performed by the infotainment device 100 described herein is essentially the same. Therefore, it will not be repeated here.

[0088] The embodiments described above can be implemented using hardware components, software components, and / or combinations of hardware and software components. For example, the apparatus and components described in the embodiments can be implemented using, for example, a processor, controller, arithmetic logic unit (ALU), digital signal processor, microcomputer, field-programmable array (FPA), programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions, and can be embodied using more than one general-purpose computer or special-purpose computer. The processing device can execute an operating system (OS) and more than one application software running within said operating system. Furthermore, the processing device responds to the execution of the software, thereby accessing, storing, manipulating, processing, and generating data. For ease of understanding, the description is presented as having only one processing device, but those skilled in the art will understand that a processing device can include multiple processing elements and / or multiple types of processing elements. For example, a processing device can include multiple processors or one processor and one controller. Furthermore, it can also include other processing configurations similar to parallel processors.

[0089] Software can include computer programs, code, instructions, or a combination of more than one of these, enabling a processing device to operate in a desired manner, or to command the processing device individually or collectively. To interpret or provide commands or data to the processing device, the software and / or data can be permanently or temporarily embodied in any type of device, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave. Software is distributed across a network-connected computer system and can be stored or executed in a distributed manner. Software and data can be stored on more than one computer read / write storage medium.

[0090] The method according to the embodiments is embodied in the form of program instructions executable by various computer means and recorded in a computer read / write medium. The computer read / write medium may include program instructions, data files, data structures, etc., individually or in combination. The program instructions recorded on the medium may be instructions specifically designed and configured to implement the embodiments, or instructions that can be used by a person skilled in the art of computer software based on commonly known methods. The computer read / write recording medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floppy disks; and hardware devices specifically configured to store and execute program instructions, such as read-only memory (ROM), random access memory (RAM), and flash memory. Examples of program instructions include not only machine language code generated by a compiler, but also high-level language code executable by a computer using an interpreter or similar means.

[0091] The hardware device described above can be configured to act as one or more software modules to perform the operations of the embodiments described above, and vice versa.

[0092] In summary, the embodiments have been described with reference to the limited accompanying drawings. Those skilled in the art can make various modifications and variations based on the description. For example, appropriate results can be obtained by performing the described techniques in a different order than the described methods, and / or by combining or integrating the described constituent elements in a different manner than the described methods, or by replacing or substituting them with other constituent elements or equivalents.

[0093] Therefore, other embodiments, other implementations, and equivalents of the claims are all within the scope of the appended claims.

Claims

1. A method for operating an infotainment device, characterized in that, Includes the following operations: Contextual information is extracted by inputting user utterances about the location into the model; Based on the context information, search criteria for identifying the location are obtained; as well as A response is provided to the user based on the search criteria and the user's location access history.

2. The method according to claim 1, characterized in that, The context information includes: The discourse contains time information, regional information of the location, and category information of the location.

3. The method according to claim 2, characterized in that, The acquisition operation includes the following operations: The search criteria are set to include a time range based on the time information.

4. The method according to claim 1, characterized in that, The provisioning operation includes the following operations: Extract at least one candidate location corresponding to the search criteria from the locations contained in the location visit history; Generate a summary of the at least one candidate location; and The response provides the summary and information on the at least one location candidate.

5. The method according to claim 1, characterized in that, The location visit history includes: The location of the place visited by the user, the date and time of the user's visit to the place, and the frequency of the user's visit to the place.

6. An electronic device, characterized in that, include: Memory, which includes instructions; and A processor, which is electrically connected to the memory and executes the instructions, Wherein, when the at least one processor executes the instruction, the electronic device performs the following operations: Contextual information is extracted by inputting user utterances about the location into the model. Based on the context information, search criteria for identifying the location are obtained. A response is provided to the user based on the search criteria and the user's location access history.

7. The electronic device according to claim 6, characterized in that, The context information includes: The discourse contains time information, regional information of the location, and category information of the location.

8. The electronic device according to claim 7, characterized in that, When the at least one processor executes the instruction, the electronic device performs the following operations: The search criteria are set based on the time information, including the time range.

9. The electronic device according to claim 6, characterized in that, When the at least one processor executes the instruction, the electronic device performs the following operations: Extract at least one candidate location corresponding to the search criteria from the locations contained in the location visit history. Generate a summary of the at least one candidate location. The response provides the summary and information on the at least one location candidate.

10. The electronic device according to claim 6, characterized in that, The location visit history includes: The location of the place visited by the user, the date and time of the user's visit to the location, and the frequency of the user's visit to the location.

11. A computer program stored on a computer-readable recording medium for performing the method of any one of claims 1 to 5 in conjunction with hardware.

Images