Vehicle control apparatus and method thereof

Abstract

The invention discloses a vehicle control apparatus and a method thereof. The vehicle control device may include: a speech recognition unit; an input unit; a display unit; the memory is used for storing at least one instruction (instructions); and a control unit that is operatively connected to the speech recognition unit, the input unit, the display unit, and the memory. When the command is executed by the control unit, the vehicle control device can receive a voice input relating to a specified function of a vehicle from a user through the voice recognition unit, and provide at least one user interface relating to the specified function by the display unit. When an operation command related to the specified function is received by the input unit, an operation corresponding to the operation command is executed.

Description

Technical Field

[0001] The present invention relates to a vehicle control device and method thereof, and more particularly, to the following technology: utilizing at least one user interface device configured in an area inside a vehicle (e.g., an area of ​​a steering wheel) to provide function-related information based on user voice recognition, and when receiving user input for at least one user interface device from the user, intuitively providing the user with functions corresponding to the user input. Background Art

[0002] With the development of technology, users can receive various functions in the vehicle. For example, the user can receive at least one of the air conditioning function, the seat control function, the multimedia function, or any combination of these functions based on the control of various control devices installed in the vehicle.

[0003] For example, the vehicle control device can control at least one of the position, state, or any combination thereof of the seat based on a user input to a seat control device disposed in an area within the vehicle.

[0004] For example, the vehicle control device is able to control at least one of temperature and / or humidity adjustment, door opening and closing, window opening and closing, air conditioning and / or heater turning on (ON) / off (OFF), or any combination thereof based on user input to an air conditioning control device configured in an area within the vehicle.

[0005] For example, the vehicle control device can display various multimedia contents or provide audio services to the user based on a user input to a multimedia function control device disposed in an area within the vehicle.

[0006] However, as the functions that can be provided to users in a vehicle become more diverse, it is sometimes difficult to install control devices for controlling multiple functions in the vehicle. For example, the space in the vehicle where control devices (such as buttons) can be installed is limited, so the more functions that can be provided, the more difficult it is to ensure installation space. In addition, in the internal area of ​​the vehicle, the area that can be easily operated by the user is limited, and there are restrictions on configuring multiple control devices corresponding to various functions in the limited area. In addition, there is a problem that the more control devices that need to be configured, the higher the production cost. Summary of the invention

[0007] An embodiment of the present invention provides a vehicle control device and method thereof as follows: a voice input received from a user is recognized, and at least one display device (eg, a display) is used to provide the user with a user interface related to a function identified based on the voice input recognition result.

[0008] One embodiment of the present invention provides the following vehicle control device and method: utilizing a display unit and / or input unit configured in an area within the vehicle that is easily operated by the user (e.g., an area of ​​the steering wheel) to provide the user with a user interface related to various functions.

[0009] One embodiment of the present invention provides the following vehicle control device and method: after a user interface related to a function corresponding to a user's intention is displayed through a display unit, when a user input is received from a user through an input unit, an action command corresponding to the user input is identified, and an operation corresponding to the action command is performed, thereby providing a function that meets the user's intention.

[0010] The technical problems of the present invention are not limited to the technical problems mentioned above, and those skilled in the art can clearly understand other technical problems not mentioned from the following description.

[0011] A vehicle control device according to an embodiment of the present invention may include: a voice recognition unit; an input unit; a display unit; a memory storing at least one instruction; and a control unit operatively connected to the voice recognition unit, the input unit, the display unit, and the memory. For example, the instructions may be configured such that, when executed by the control unit, the vehicle control device receives voice input related to a designated function of the vehicle from a user through the voice recognition unit, provides at least one user interface related to the designated function using the display unit, and performs an action corresponding to the action command when an action command related to the designated function is received through the input unit.

[0012] According to an embodiment, it can be configured that at least one of the display unit, the input unit, or any combination thereof is configured in at least one area of ​​a steering wheel of the vehicle.

[0013] Based on one embodiment, the above-mentioned instruction can be configured to, when executed by the above-mentioned control unit, enable the above-mentioned vehicle control device to execute: identifying the above-mentioned operation corresponding to the above-mentioned action command, and transmitting the above-mentioned action command to a designated function providing device capable of executing the above-mentioned operation in at least one function providing device configured in the above-mentioned self-vehicle.

[0014] Based on one embodiment, the above-mentioned instruction can be configured to, when executed by the above-mentioned control unit, enable the above-mentioned vehicle control device to execute: based on the voice recognition processing result of the above-mentioned voice input, identify the above-mentioned designated function among the multiple functions provided by the above-mentioned self-vehicle, and determine whether the above-mentioned designated function can be executed by the above-mentioned control unit.

[0015] Based on one embodiment, the above-mentioned instructions can be configured to, when executed by the above-mentioned control unit, enable the above-mentioned vehicle control device to execute: when the above-mentioned designated function can be executed by the above-mentioned control unit: through the above-mentioned display unit, display the above-mentioned at least one user interface related to the above-mentioned designated function, and when receiving the above-mentioned touch input to the above-mentioned at least one user interface, the user input to the above-mentioned input unit, or the above-mentioned action command based on at least one of any combination thereof, execute the above-mentioned operation corresponding to the above-mentioned action command.

[0016] According to an embodiment, it can be configured that, when the designated function cannot be executed by the control unit: the display unit displays guidance information related to at least one external device that can provide the designated function.

[0017] According to an embodiment, the input unit may include an input device, and the input device includes at least one of at least one button, a steering wheel button, a touch screen, or any combination thereof.

[0018] Based on one embodiment, the above-mentioned instructions can be configured to, when executed by the above-mentioned control unit, enable the above-mentioned vehicle control device to perform the following steps: based on at least one of a single click, a double click, multiple clicks, a long press, a touch slide, a rotation input, a first touch input of a specified pattern, a second touch input with a touch area larger than a specified size, or any combination thereof, the above-mentioned operation corresponding to the above-mentioned action command is identified.

[0019] A vehicle control method based on an embodiment of the present invention may include the following steps: a step in which a control unit receives voice input related to a designated function of the vehicle from a user through a voice recognition unit; a step in which the control unit uses a display unit to provide at least one user interface related to the designated function; and a step in which the control unit, when receiving an action command related to the designated function through an input unit, executes an operation corresponding to the action command.

[0020] According to an embodiment, it can be configured that at least one of the display unit, the input unit, or any combination thereof is configured in at least one area of ​​a steering wheel of the vehicle.

[0021] Based on one embodiment, when the control unit receives the action command related to the specified function through the input unit, the step of executing the operation (action) corresponding to the action command may also include: the step of the control unit identifying the operation corresponding to the action command; and the step of the control unit transmitting the action command to a specified function providing device among at least one function providing device configured in the self-vehicle and capable of executing the operation.

[0022] Based on one embodiment, the step of the control unit using the display unit to provide at least one user interface related to the specified function may also include: the control unit identifying the specified function among the multiple functions provided by the self-vehicle based on the voice recognition processing result of the voice input; and the control unit determining whether the specified function can be executed by the control unit.

[0023] Based on one embodiment, the step in which the control unit determines whether the specified function can be executed through the control unit may also include: when the specified function can be executed through the control unit, the control unit displays the at least one user interface related to the specified function through the display unit; and the control unit, when receiving the action command based on at least one of the touch input to the at least one user interface, the user input to the input unit, or any combination thereof, executes the operation corresponding to the action command.

[0024] Based on one embodiment, the step in which the control unit determines whether the specified function can be executed through the control unit may also include: when the specified function cannot be executed through the control unit, the control unit displays guidance information related to at least one external device that can provide the specified function through the display unit.

[0025] Based on one embodiment, when the control unit receives the action command related to the specified function through the input unit, the step of executing the operation corresponding to the action command may also include: the control unit identifies the operation corresponding to the action command based on at least one of a single click, double click, multiple clicks, long press, touch slide, rotation input, a first touch input of a specified pattern, a second touch input of a touch area larger than a specified size, or any combination thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 1 is a block diagram showing components of a vehicle control device according to an embodiment of the present invention.

[0027] Figure 2 1 is a conceptual diagram showing a configuration example of at least a part of a vehicle control device according to an embodiment of the present invention.

[0028] Figure 3 1 is a block diagram showing components of a vehicle control device according to an embodiment of the present invention.

[0029] Figure 4 This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0030] Figure 5 This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0031] Figure 6 This is an operation sequence diagram of a vehicle control device according to one embodiment of the present invention.

[0032] Figure 7a This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0033] Figure 7b This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0034] Figure 8 This is an operation sequence diagram of a vehicle control device according to one embodiment of the present invention.

[0035] Fig. 9 A computing system related to a vehicle control method according to an embodiment of the present invention is shown.

[0036] With regard to the description of the drawings, the same or similar reference numerals may be used for the same or similar elements. DETAILED DESCRIPTION

[0037] Hereinafter, various embodiments of the present invention will be described in detail with reference to the exemplary drawings. It should be noted that when attaching reference numerals to the elements of the various drawings, the same reference numerals are attached as much as possible for the same elements even if they are shown in different drawings. In addition, when describing the embodiments of the present invention, detailed descriptions of related well-known features or functions will be omitted so as not to unnecessarily obscure the gist of the present invention.

[0038] When describing the elements of the embodiments of the present invention, terms such as first, second, A, B, (a), (b) etc. are used. Such terms are only used to distinguish one element from another element, and the nature, order or sequence of the corresponding elements, etc. are not limited by these terms. In addition, unless otherwise defined, all terms used herein (including technical terms or scientific terms) have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs. These terms as defined in commonly used dictionaries should be interpreted as having the same meaning as the contextual meaning of the relevant technical field, and should not be interpreted as having idealized or overly formalized meanings, unless clearly defined as having such meanings in this application.

[0039] In the following, reference is made to Figures 1 to 9 , the embodiments of the present invention are described in detail.

[0040] Figure 1 1 is a block diagram showing components of a vehicle control device according to an embodiment of the present invention.

[0041] According to an embodiment, the vehicle control device 100 may include at least one of a voice recognition unit 110 , an input unit 120 , a display unit 130 , a control unit 140 , a memory 150 , or any combination thereof. Figure 1 The structure of the vehicle control device 100 shown is only an example, and the embodiments of the present invention are not limited to this. For example, the vehicle control device 100 may also include Figure 1 The multiple elements shown (for example, at least one of an output portion, a communication portion, a driving portion, an interface portion, or any combination thereof).

[0042] According to one embodiment, although the input unit 120 and the display unit 130 are shown as physically separated separate blocks, according to one embodiment of the present invention, the input unit 120 and the display unit 130 can also be connected through one module (for example: Figure 2 This is achieved by configuring a module in the right area 290 of the steering wheel 250.

[0043] According to an embodiment, the speech recognition unit 110 is capable of receiving and / or recognizing various types of audio inputs including speech inputs.

[0044] For example, the voice recognition unit 110 can receive and / or recognize commands and / or data used by elements of the vehicle control device 100 (eg, the control unit 140 ) from outside the vehicle control device 100 (eg, a user).

[0045] For example, the speech recognition unit 110 may include a microphone. As an example, the speech recognition unit 110 can receive and / or recognize a speech input uttered by a user. The speech input of the user received and / or recognized by the speech recognition unit 110 can be processed by the control unit 140.

[0046] According to an embodiment, the input unit 120 can receive and / or recognize commands and / or data used by components of the vehicle control device 100 (eg, the control unit 140 ) from outside the vehicle control device 100 (eg, a user).

[0047] For example, the input unit 120 may include various types of input devices. As an example, the input unit 120 may include an input device including at least one button (or key), a steering wheel button, a touch screen, or any combination thereof.

[0048] For example, the input unit 120 may be disposed in at least one area of ​​a steering wheel of the vehicle, but this is merely an example and the embodiments of the present invention are not limited thereto.

[0049] For example, the input unit 120 can receive various types of user inputs from the user. As an example, the input unit 120 can receive at least one of a single click, a double click, multiple clicks (Multi-tap), a long press (long press), a touch slide, a rotation input, a first touch input of a specified pattern, a second touch input having a touch area larger than a specified size, or any combination thereof for at least one of the above-mentioned multiple input devices.

[0050] As an example, a single click may include a touch input (or pressure input) having one contact point on the surface of the input device.

[0051] As an example, a double-click may include a touch input (or, pressure input) having two contact points on the surface of the input device.

[0052] As an example, multiple clicks may include a touch input (or a pressure input) having at least three contact points on the surface of the input device.

[0053] As an example, the long press may include an input in which a touch input (or a pressure input) is applied on the surface of the input device for longer than a designated time.

[0054] As an example, the touch slide may include applying a touch (or pressure) input to a plurality of consecutive contact points on at least a portion of a plurality of regions (eg, a display region) of an input device.

[0055] As an example, the rotation input may include an input that rotates a portion of the input device in a specified direction.

[0056] As an example, the first touch input of the designated pattern may include a touch input (or a pressure input) having only a contact point with respect to a designated area among a plurality of areas of the input device.

[0057] As an example, the second touch input having a touch area larger than a specified size may include a touch input (or a pressure input) having a contact point with an area larger than a set size among a plurality of areas of the input device.

[0058] For example, the control unit 140 can identify an operation corresponding to the motion command based on at least one of the type, size, direction, input area, or any combination thereof of the user input input to the input unit 120 .

[0059] According to an embodiment, the display unit 130 can visually provide various information to the outside of the vehicle control device 100 (eg, a user).

[0060] For example, the display unit 130 may include at least one of a display, a holographic imaging device, a projector, a control circuit for controlling a corresponding device, or any combination thereof.

[0061] For example, the display unit 130 may be disposed in at least a region of a steering wheel of the vehicle, but this is merely an example and the embodiments of the present invention are not limited thereto.

[0062] For example, the display unit 130 and the input unit 120 can also be substantially implemented by one module. As an example, at least a portion of the display unit 130 (eg, a touch display) can include at least a portion of the input unit 120 .

[0063] For example, the display unit 130 may include at least one of a touch sensor configured to sense a touch, a pressure sensor configured to measure a magnitude of a force generated by a touch, or any combination thereof.

[0064] According to an embodiment, the control unit 140 can be operatively connected to the speech recognition unit 110, the input unit 120, the display unit 130, and the memory 150. For example, the control unit 140 can control the operation of the speech recognition unit 110, the input unit 120, the display unit 130, and / or the memory 150.

[0065] For example, the control unit 140 can receive a voice input related to a designated function of the own vehicle from the user through the voice recognition unit 110 .

[0066] As an example, the control unit 140 is able to receive, through the voice recognition unit 110, a voice input (e.g., "help me turn up the volume") from a user riding in the vehicle to execute a request for a specified function (e.g., a multimedia function) among various functions provided by the vehicle, including a specific operation (e.g., increasing the volume).

[0067] As an example, the control portion 140 performs various types of voice recognition processing on the voice input, and can identify a designated function from among a plurality of functions provided by the vehicle (eg, a multimedia function and / or a seat control function) based on the voice recognition processing result.

[0068] As one example, the control unit 140 can determine whether a designated function identified based on a result of a speech recognition process on a speech input can be executed under the control of the control unit 140 (or the vehicle control device 100 ).

[0069] For example, the control unit 140 can provide at least one user interface related to a designated function using the display unit 130 .

[0070] As an example, in the case where the designated function can be executed by the control unit 140, the control unit 140 can display at least one user interface related to the designated function through the display unit 130. In this case, the at least one user interface can include various information related to the designated function (e.g., multimedia function) (e.g., content information, whether to play, whether to play repeatedly, settings, mute, volume control, time information, next content and / or previous content information, or at least one of any combination thereof).

[0071] As an example, when the designated function cannot be executed by the control unit 140, the control unit 140 can display guidance information related to at least one external device that can provide the designated function through the display unit 130. At this time, the guidance information includes location information of at least one external device that can provide the designated function (for example, at least one input device (or button) configured outside the vehicle control device 100).

[0072] For example, the control unit 140 can receive an action command related to a designated function through the input unit 120 and perform an operation (action) corresponding to the action command.

[0073] As an example, the control unit 140 can receive various types of user inputs through the input unit 120 and can identify a motion command corresponding to the user input.

[0074] When the user input is a rotation input, for example, the control unit 140 can identify the action command as increasing the volume or decreasing the volume based on the case where the designated function is a multimedia function, or identify the action command as at least one of the heating function on / off, ventilation function on / off, seat front control, seat rear control, or any combination thereof based on the case where the designated function is a seat control function.

[0075] In the case where the user input is a pressure input to an area of ​​the input unit 120, for example, the control unit 140 can identify the action command as at least one of play, pause, next content play, previous content play, volume increase, volume decrease, or any combination thereof based on the case where the designated function is a multimedia function, or identify the action command as at least one of increase in temperature and / or ventilation intensity, decrease in temperature and / or ventilation intensity, or any combination thereof based on the case where the designated function is a seat control function.

[0076] The above-mentioned action command identification action is only an example, and the embodiments of the present invention are not limited thereto. For example, the action command corresponding to the user input can be changed by the user's setting. The history records related to the action command before and after the change can be stored in the memory 150.

[0077] As an example, after identifying the motion command, the control unit 140 performs an operation corresponding to the motion command, thereby enabling provision of a function that meets the user's intention.

[0078] According to an embodiment, the memory 150 can store commands or data. For example, the memory 150 can store one or more instructions so that when executed by the control unit 140, the vehicle control device 100 performs various actions.

[0079] For example, the memory 150 can be implemented by the control part 140 and a chipset. The control part 140 can include at least one of a communication processor or a modem.

[0080] For example, the memory 150 can store information related to the status and / or operation of multiple components of the vehicle (e.g., at least one of the ECU (Engine Control Unit), the voice recognition unit 110, the input unit 120, the display unit 130, the control unit 140, or any combination thereof).

[0081] For example, the memory 150 can store various information related to the vehicle control device 100. As one example, the memory 150 can store information related to the operation history of the control unit 140.

[0082] Figure 1 The components of the vehicle control device 100 shown are merely examples, and the embodiments of the present invention are not limited thereto. For example, the vehicle control device 100 may further include a communication unit (not shown).

[0083] According to one embodiment, the communication unit can establish a communication channel (e.g., a wireless communication channel) with the vehicle control device 100 and an external device (e.g., an external control device for controlling functions provided by the vehicle) and support the execution of communication through the established communication channel. For example, the communication unit can operate independently of the control unit 140 (e.g., an application processor) and can include (support) one or more communication processors for direct communication (e.g., wired) or wireless communication.

[0084] For example, the communication unit can include a wireless communication module (for example, a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (for example, a LAN (local area network) communication module or a power line communication module). The corresponding communication module among these communication modules can communicate with an external device through a first network (for example, a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (for example, a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (for example, a LAN or WAN)) included in the network. Such multiple types of communication modules can be integrated into one component (for example, a single chip) or can be implemented by multiple independent components (for example, multiple chips). In addition, the communication unit can also be implemented together with the control unit 140 through a single chip.

[0085] For example, the communication unit can transmit and receive various data based on communication with an external device.

[0086] As an example, the vehicle control device 100 (or the control unit 140) can determine whether it is possible to perform an operation (for example, play, pause, lower the volume, increase the volume, play the next song, play the previous song, turn on / off the heating function, turn on / off the ventilation function, increase the temperature and / or ventilation intensity, reduce the temperature and / or ventilation intensity, control the front of the seat, control the back of the seat, or at least one of any combination thereof) corresponding to the action command input from the user to the vehicle control device 100 through the input unit 120. When it is determined that the operation corresponding to the action command (or the specified function identified by the user input) cannot be performed, the vehicle control device 100 can use the communication unit to transmit the action command to an external device that can perform the operation (or the specified function).

[0087] Figure 2 1 is a conceptual diagram showing a configuration example of at least a part of a vehicle control device according to an embodiment of the present invention.

[0088] According to one embodiment, a vehicle control device (eg: Figure 1 The vehicle control device 100 may include an input unit (e.g.: Figure 1 Input unit 120) and / or display unit (for example: Figure 1 display unit 130).

[0089] According to an embodiment, the vehicle control device may include a portion of various elements inside the vehicle and / or an input unit and / or a display unit arranged in a designated area.

[0090] For example, the input unit and / or the display unit can be arranged in at least one area of ​​a steering wheel 250 of the vehicle.

[0091] Reference Figure 2 According to one embodiment, the input unit and / or the display unit can be configured in the right area 290 when the user observes the steering wheel 250.

[0092] The right area 290 of the steering wheel 250 can be configured with a portion of multiple elements of a vehicle control device including at least one display, at least one input device (for example, at least one button (or key), steering wheel button, touch screen, or at least one of any combination thereof), or at least one of any combination thereof.

[0093] Figure 3 1 is a block diagram showing components of a vehicle control device according to an embodiment of the present invention.

[0094] According to one embodiment, the vehicle control device 300 (for example: Figure 1The vehicle control device 100 may include a speech recognition unit 310 (for example: Figure 1 The speech recognition unit 110), the interface unit 320 (for example: Figure 1 The input unit 120 and / or the display unit 130), the control unit 340 (for example: Figure 1 at least one of the control unit 140), the execution unit 345, or any combination thereof.

[0095] Can use the above pair Figure 1 Instead of Figure 3 The components shown are Figure 1 Description of elements identical and / or similar elements.

[0096] For example, the interface portion 320 can be defined as Figure 1 The input unit 120 and the display unit 130 are implemented as a module together as an element (for example, configured in Figure 2 A module of the right area 290 of the steering wheel 250), but the embodiments of the present invention are not limited to this.

[0097] Although the control unit 340 and the execution unit 345 are shown as physically separated blocks, the control unit 340 and the execution unit 345 according to an embodiment of the present invention can be implemented by a single module (or a chipset). In other words, the operation of the control unit 340 and / or the operation of the execution unit 345 described below can be implemented by a single structure (e.g., Figure 1 140) to execute.

[0098] According to an embodiment, the vehicle control device 300 can receive a voice input from a user through the voice recognition unit 310 .

[0099] According to one embodiment, the vehicle control device 300 can identify a designated function corresponding to the user's intention among a plurality of functions provided by the vehicle utilization control unit 340 based on the reception of the voice input.

[0100] For example, when a user issues a voice input such as "air conditioning control function", it is able to identify a specified function (for example, air conditioning control function) from among multiple functions provided by the vehicle (for example, air conditioning control function, multimedia control function, light control function, seat control function, or at least one of any combination thereof).

[0101] According to an embodiment, the control unit 340 can control the interface unit 320 (or Figure 1 The display unit 130) visually and / or audibly provides at least one user interface related to a designated function to the user.

[0102] According to an embodiment, the control unit 340 can control the interface unit 320 (or Figure 1 The input unit 120) is used to receive action commands related to the specified function.

[0103] For example, the action command may include a control signal identified based on at least one of a user's touch input to at least one user interface, a touch input (or a pressure input) to a portion of the interface portion 320 (or a button), or any combination thereof.

[0104] According to an embodiment, the control unit 340 can identify the operation corresponding to the motion command through the execution unit 345 , and after generating a control signal based on the identification result, the execution unit 345 can execute the operation.

[0105] For example, when receiving a voice input such as “air conditioning control function” from the user through the voice recognition unit 310 , the control unit 340 can identify the air conditioning control function as a designated function among a plurality of functions provided by the own vehicle.

[0106] For example, the control part 340 can visually and / or auditorily provide at least one user interface related to the air-conditioning control function to the user through the interface part 320 .

[0107] For example, when the control unit 340 receives user input (for example, touch input (or pressure input) to a designated button) including an action command (for example, increasing the volume) through the interface unit 320, it can perform an operation corresponding to the action command (for example, increasing the volume of the content being played) through the execution unit 345.

[0108] Figure 4 This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0109] Referring to reference numeral S410, according to one embodiment, a vehicle control device (eg, Figure 1 The vehicle control device 100) is capable of receiving voice input from a user.

[0110] Referring to reference numeral S420 , according to an embodiment, the vehicle control device can perform various methods of voice recognition processing on a voice input, and can discern a designated function based on a voice recognition processing result.

[0111] For example, the vehicle control device can identify a designated function among a plurality of functions that the vehicle can provide based on the result of the voice recognition processing.

[0112] Referring to reference numeral S430, according to one embodiment, the vehicle control device can be configured on a steering wheel 450 (eg: Figure 2 The right side area 490 of the steering wheel 250 (for example: Figure 2 The interface portion of the right area 490) (for example: Figure 3 For example, when the vehicle control device receives an action command based on an input to the interface portion (e.g., at least one of a touch input to at least a portion of the interface portion, a user input to at least one button included in the interface portion, or any combination thereof), the vehicle control device can perform an operation corresponding to the action command.

[0113] For example, the input to the interface part may include input to an input device including at least one button included in the interface part, a steering wheel button, a touch screen, or any combination thereof.

[0114] For example, input to the interface portion may include at least one of a single click, a double click, multiple clicks, a long press, a touch slide, a rotation input, a first touch input of a specified pattern, a second touch input having a touch area larger than a specified size, or any combination thereof.

[0115] Figure 5 This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0116] According to one embodiment, a vehicle control device (eg: Figure 1 The vehicle control device 100) can be connected through the interface part (for example: Figure 1 The display unit 130 and / or the interface unit 320) displays at least one user interface, or is capable of receiving a user input from a user.

[0117] Referring to reference numeral 510 , according to one embodiment, the vehicle control device can display at least one user interface related to a designated function through a display screen 540 of a display unit 590 included in the interface unit.

[0118] For example, when the designated function is identified as a multimedia control function, at least one user interface may include at least one of content information, whether to play or not, whether to play repeatedly or not, settings, mute, volume control, time information, next content and / or previous content information, or any combination thereof.

[0119] Referring to reference numeral 520 , according to one embodiment, the vehicle control device can receive a user input including an action command from a user through at least one input device included in the input unit of the interface unit.

[0120] Figure 6 This is an operation sequence diagram of a vehicle control device according to one embodiment of the present invention.

[0121] According to one embodiment, a vehicle control device (eg: Figure 1The vehicle control device 100) is capable of executing Figure 6 For example, a vehicle control device includes multiple components (e.g.: Figure 1 At least one of the speech recognition unit 110, the input unit 120, the display unit 130, the control unit 140, the memory 150 or any combination thereof) can be set to perform Figure 6 action.

[0122] In the following embodiments, although the actions from S610 to S650 can be performed sequentially, they do not have to be performed sequentially. For example, the order of the actions can be changed, or at least two actions can be performed in parallel. Figure 6 , the contents corresponding to or repeated with the above contents will be briefly described or omitted.

[0123] According to an embodiment, the vehicle control device can receive a voice input from a user ( S610 ).

[0124] According to one embodiment, the vehicle control device can determine whether the function corresponding to the voice input (or the operation corresponding to the motion command) can be executed through the control of the vehicle control device (S620).

[0125] For example, when the function corresponding to the voice input (or the operation corresponding to the motion command) can be executed by the vehicle control device (for example: step S620-yes), the vehicle control device can execute step S630.

[0126] For example, when the function corresponding to the voice input (or the operation corresponding to the motion command) cannot be executed by the vehicle control device (for example: step S620-No), the vehicle control device can execute step S635.

[0127] According to an embodiment, the vehicle control device can provide a user interface related to a function corresponding to the voice input using a display unit ( S630 ).

[0128] According to an embodiment, the vehicle control device can provide information of the input device related to the function corresponding to the voice input using the display unit (S635).

[0129] For example, when the vehicle control device determines that the vehicle control device cannot execute a specified function identified based on user input and the operations included in the specified function, the vehicle control device can use a display unit to provide guidance information (for example, location information of at least one external device) related to at least one external device (or external button) that can provide (or execute) the specified function.

[0130] According to an embodiment, the vehicle control device can receive an action command related to a function from a user by using an input unit ( S640 ).

[0131] According to an embodiment, the vehicle control device can perform an operation corresponding to the motion command ( S650 ).

[0132] Figure 7a This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0133] According to one embodiment, a vehicle control device (eg: Figure 1 The vehicle control device 100) can be connected through the interface part (for example: Figure 1 The display unit 130 and / or the interface unit 320) is used to display at least one user interface, or to receive user input from a user.

[0134] Referring to reference numeral 711 , according to one embodiment, the vehicle control device can display at least one user interface related to a designated function through a display screen 741 of a display unit 791 included in the interface unit.

[0135] For example, when the designated function is identified as a multimedia control function, at least one user interface can include at least one of content information, whether to play or not, whether to play repeatedly or not, settings, mute, volume control, time information, next content and / or previous content information or any combination thereof.

[0136] Referring to reference numeral 721 , according to one embodiment, the vehicle control device can receive a user input including a motion command from a user through at least one input device included in the input unit of the interface unit.

[0137] For example, the vehicle control device can receive user input to at least one of the first button 722-1, the second button 724-1, the third button 726-1, the fourth button 728-1, the center button 751, the steering wheel buttons, or any combination thereof included in the input portion.

[0138] For example, when the designated function is identified as a multimedia control function, the user input to the first button 722-1 and the third button 726-1 respectively include action commands corresponding to increasing the volume and decreasing the volume, and the user input to the second button 724-1 and the fourth button 728-1 can respectively include action commands corresponding to playing the next content and playing the previous content.

[0139] For example, in the case where the designated function is identified as a multimedia control function, the user input to the center button 751 can include an action command corresponding to content play or pause.

[0140] For example, when the designated function is identified as a multimedia control function, the rotation input 731 of the steering wheel button may include an action command corresponding to increasing or decreasing the volume. The vehicle control device may determine one of the action commands according to the direction of the rotation input 731 .

[0141] Figure 7b This is a conceptual diagram of the operation of a vehicle control device according to an embodiment of the present invention.

[0142] According to one embodiment, a vehicle control device (eg: Figure 1 The vehicle control device 100) can be connected through the interface part (for example: Figure 1 The display unit 130 and / or the interface unit 320) is used to display at least one user interface, or to receive user input from a user.

[0143] Referring to reference numeral 712 , according to one embodiment, the vehicle control device can display at least one user interface related to a designated function through a display screen 742 of a display unit 792 included in the interface unit.

[0144] For example, when the designated function is identified as a seat control function, at least one user interface can include at least one of the seat's type, style, position, status, controllable structure, control direction, control type, or any combination thereof.

[0145] Referring to reference numeral 722 , according to one embodiment, the vehicle control device can receive a user input including an action command from a user through at least one input device included in the input unit of the interface unit.

[0146] For example, the vehicle control device can receive user input to at least one of the first button 722-2, the second button 724-2, the third button 726-2, the fourth button 728-2, the center button 752, the steering wheel buttons, or any combination thereof included in the input portion. Figure 7b The input components shown may be substantially the same as Figure 7a The components shown have the same structure.

[0147] For example, when the designated function is identified as a seat control function, the user input to the first button 722-2 and the fourth button 728-2 may include action commands corresponding to the front seat control, and the user input to the second button 724-2 and the third button 726-3 may include action commands corresponding to the rear seat control.

[0148] For example, when the designated function is identified as a seat control function, the user input to the center button 752 may include an action command corresponding to the ON / OFF of a heating or ventilation function related to the seat.

[0149] For example, when the designated function is identified as a seat control function, the rotation input 732 of the steering wheel button may include an action command corresponding to at least one of increasing the temperature and / or ventilation intensity, decreasing the temperature and / or ventilation intensity, or any combination thereof. The vehicle control device can determine one of the action commands according to the direction of the rotation input 732.

[0150] Figure 8 This is an operation sequence diagram of a vehicle control device according to one embodiment of the present invention.

[0151] According to one embodiment, a vehicle control device (eg: Figure 1 The vehicle control device 100) is capable of executing Figure 8 For example, a vehicle control device includes multiple components (e.g.: Figure 1 At least one of the speech recognition unit 110, the input unit 120, the display unit 130, the control unit 140, the memory 150 or any combination thereof) can be set to perform Figure 8 action.

[0152] In the following embodiments, although the actions from S810 to S830 can be performed sequentially, they do not have to be performed sequentially. For example, the order of the actions can be changed, or at least two actions can be performed in parallel. Figure 8 , the contents corresponding to or repeated with the above contents will be briefly described or omitted.

[0153] According to an embodiment, the vehicle control device can receive a voice input related to a designated function of the vehicle from a user through a voice recognition unit ( S810 ).

[0154] According to an embodiment, the vehicle control device can provide at least one user interface related to a designated function using a display unit ( S820 ).

[0155] For example, the vehicle control device can identify a specific function among a plurality of functions provided by the vehicle based on a result of a speech recognition process on a speech input, and can provide at least one user interface related to the identified specific function to a user through a display unit.

[0156] According to an embodiment, when the vehicle control device receives an action command related to a designated function through an input unit, it is possible to perform an operation (action) corresponding to the action command (S830).

[0157] For example, the vehicle control device identifies an operation corresponding to an action command based on a user input to an input unit, and executes the identified operation, thereby being able to achieve a function execution result that meets the user's intention.

[0158] Fig. 9 A computing system related to a vehicle control method according to an embodiment of the present invention is shown.

[0159] Reference Fig. 9 The computing system 1000 related to the vehicle control method may include at least one processor 1100 , a memory 1300 , a user interface input device 1400 , a user interface output device 1500 , a storage device 1600 , and a network interface 1700 connected via a bus 1200 .

[0160] The processor 1100 may be a central processing unit (CPU) or a semiconductor device that performs processing for commands stored in the memory 1300 and / or the storage device 1600. The memory 1300 and the storage device 1600 may include various volatile or non-volatile storage media. For example, the memory 1300 may include a ROM (read only memory) and a RAM (random access memory).

[0161] Therefore, the steps of the methods or algorithms described in the various embodiments disclosed in this specification can be directly implemented by hardware, software modules, or a combination of the two executed by the processor 1100. The software module can also reside in a storage medium such as RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM (i.e., memory 1300 and / or storage device 1600).

[0162] An exemplary storage medium is connected to the processor 1100, and the processor 1100 can read information from the storage medium and can record information to the storage medium. As another method, the storage medium can be integrated with the processor 1100. The processor and the storage medium can also reside in an application specific integrated circuit (ASIC). The ASIC can also reside in a user terminal. As another method, the processor and the storage medium can also reside in a user terminal as a separate component.

[0163] The above description is only for illustrating the technical concept of the present invention, and a person skilled in the art can make various modifications and variations without departing from the essential characteristics of the present invention.

[0164] Therefore, the embodiments disclosed in the present invention are not used to limit the technical ideas of the present invention, but are used to illustrate the present invention, and the scope of the technical ideas of the present invention is not limited by such embodiments. The protection scope of the present invention should be interpreted by the claims, and should be interpreted as all technical ideas within the equivalent scope are included in the scope of the rights of the present invention.

Claims

1. A vehicle control device, comprising: Speech Recognition Department; Input section; Display unit; a memory storing at least one instruction; and a control unit operatively connected to the speech recognition unit, the input unit, the display unit, and the memory, The instructions are configured to, when executed by the control unit, cause the vehicle control device to execute: receiving, through the voice recognition unit, a voice input related to a designated function of the vehicle from a user, using the display unit to provide at least one user interface related to the designated function, When an action command related to the designated function is received through the input unit, an operation corresponding to the action command is performed.

2. The vehicle control device according to claim 1, wherein: At least one of the display unit, the input unit, or any combination thereof is disposed in at least one area of ​​a steering wheel of the vehicle.

3. The vehicle control device according to claim 1, wherein: The instructions are configured to, when executed by the control unit, cause the vehicle control device to execute: identifying the operation corresponding to the action command, The operation command is transmitted to a designated function providing device capable of executing the operation among at least one function providing device disposed in the own vehicle.

4. The vehicle control device according to claim 1, wherein: The instructions are configured to, when executed by the control unit, cause the vehicle control device to execute: based on a result of speech recognition processing of the speech input, identifying the designated function from among a plurality of functions provided by the own vehicle, It is determined whether the designated function can be executed by the control unit.

5. The vehicle control device according to claim 4, wherein: The instructions are configured to, when executed by the control unit, cause the vehicle control device to execute: In the case where the designated function can be executed by the control unit: displaying, by the display unit, the at least one user interface related to the designated function; When the motion command of at least one of a touch input to the at least one user interface, a user input to the input unit, or any combination thereof is received, the operation corresponding to the motion command is performed.

6. The vehicle control device according to claim 4, wherein: In the case where the designated function cannot be performed by the control unit: The display unit displays guidance information related to at least one external device capable of providing the designated function.

7. The vehicle control device according to claim 1, wherein: The input unit is configured to include an input device, which includes at least one button, a steering wheel button, a touch screen, or any combination thereof.

8. The vehicle control device according to claim 7, wherein: The command is configured to, when executed by the control unit, cause the vehicle control device to perform the following steps: The operation corresponding to the action command is identified based on at least one of a single click, a double click, multiple clicks, a long press, a touch slide, a rotation input, a first touch input of a specified pattern, a second touch input of a touch area larger than a specified size, or any combination thereof.

Images