Electronic device for a vehicle, mobile device for controlling an electronic device for a vehicle, and method for controlling an electronic device for a vehicle by using a mobile device

Abstract

Disclosed are a mobile device, a vehicle-mounted electronic device, a method, and a medium therefor. The mobile device includes a communicator, a display, a memory / medium, and a processor. The processor implements a method including receiving environment information and driving state information from the vehicle-mounted device, generating a control interface based on the received information, and outputting the control interface. The vehicle-mounted control device includes a communicator, a memory / medium, and a processor, which transmits the environment information and the driving state information to the mobile device, receives input information generated through the control interface transmitted by the mobile device, and performs a corresponding control operation based on the input information.

Description

Technical Field

[0001] This disclosure relates to in-vehicle electronic devices, mobile devices for controlling in-vehicle electronic devices, and methods for controlling in-vehicle electronic devices using mobile devices. More specifically, this disclosure relates to in-vehicle electronic devices, mobile devices for controlling in-vehicle electronic devices, and methods for controlling in-vehicle electronic devices using a control interface provided on the mobile device. Background Technology

[0002] To meet the needs of vehicle users and increase their convenience, various functions have been developed and implemented. For example, by connecting a mobile device to in-vehicle electronics, the in-vehicle electronics can combine the functionality of applications installed on the mobile device (e.g., a smartphone), allowing the mobile device user to seamlessly continue operating the application within the vehicle environment. However, while the mobile device's functionality can thus operate within the vehicle environment, the mobile device itself may not be able to control the functionality of the in-vehicle electronics.

[0003] Furthermore, mobile devices can provide the ability to control some functions of in-vehicle electronic devices through interoperability with them. However, to utilize these control functions, users must enter a control mode corresponding to the environment of the in-vehicle electronic devices. Typically, the operation of desired functions is restricted while the vehicle is in motion because the driver's attention or line of sight may be dangerously distracted. Summary of the Invention

[0004] Technical solutions to the problem

[0005] An in-vehicle electronic device is provided, including a control interface that enhances interoperability with a paired mobile device, thereby providing greater convenience for the user. Furthermore, an in-vehicle electronic device is provided that performs control operations based on control input received via the control interface on the mobile device. Specifically, an in-vehicle electronic device is provided that transmits at least one of environmental information, vehicle driving status information, or driver condition information to a communicatively connected mobile device, and performs control operations based on control input received from the mobile device.

[0006] Furthermore, a mobile device is provided that outputs a control interface, which enhances interoperability with in-vehicle electronic devices. Specifically, a mobile device is provided that can generate a control interface based on environmental information from the in-vehicle electronic device and according to the operating environment of the in-vehicle electronic device.

[0007] In addition, a mobile device is provided that generates and outputs an appropriate control interface based on the vehicle's driving status information or the driver's condition information.

[0008] Beneficial effects of this disclosure

[0009] According to embodiments of this disclosure, a mobile device can automatically generate and output an appropriate control interface for interoperating with the vehicle-mounted electronic device based on at least one of environmental information of the vehicle-mounted electronic device, driving status information of the vehicle, or condition information of the driver, so that the driver can more conveniently control the vehicle-mounted electronic device through the mobile device.

[0010] Furthermore, the method can provide a control environment tailored to driving conditions or the driver's state, reducing distractions and obstacles to driver attention, thereby increasing vehicle operation safety while utilizing certain vehicle-related functions. Thus, it improves driver safety while also enhancing user convenience. Attached Figure Description

[0011] Figure 1 This is a diagram illustrating an in-vehicle electronic device and a mobile device for controlling the in-vehicle electronic device according to an embodiment of the present disclosure.

[0012] Figure 2 This is a flowchart illustrating a method for controlling an in-vehicle electronic device using a mobile device according to an embodiment of the present disclosure.

[0013] Figure 3a , Figure 3b and Figure 3c This is a reference diagram illustrating a method for determining a control interface based on environmental information of an in-vehicle electronic device, performed by a mobile device according to an embodiment of the present disclosure.

[0014] Figure 4 This is a flowchart illustrating a method for controlling an in-vehicle electronic device using a mobile device according to an embodiment of the present disclosure.

[0015] Figure 5 This is a block diagram illustrating the configuration of an in-vehicle electronic device according to an embodiment of the present disclosure.

[0016] Figure 6 This is a block diagram illustrating the configuration of a mobile device according to an embodiment of the present disclosure.

[0017] Figure 7a , Figure 7b and Figure 7c This is a reference diagram illustrating a method for determining a control interface based on environmental information from an in-vehicle electronic device and driving state information of a vehicle, executed by a mobile device according to an embodiment of the present disclosure.

[0018] Figure 8 This is a flowchart illustrating a method for controlling an in-vehicle electronic device using a mobile device according to an embodiment of the present disclosure.

[0019] Figure 9a and Figure 9bThis is a reference diagram illustrating a method for determining a control interface based on environmental information from an in-vehicle electronic device and driver condition information, performed by a mobile device according to an embodiment of the present disclosure.

[0020] Figure 10 This is a block diagram illustrating the configuration of an in-vehicle electronic device according to another embodiment of the present disclosure.

[0021] Figure 11 This is a block diagram illustrating the configuration of a mobile device according to another embodiment of the present disclosure.

[0022] Figure 12 This is a diagram illustrating operations performed using artificial intelligence (AI) technology according to embodiments of the present disclosure.

[0023] Figure 13 This is a diagram illustrating an in-vehicle electronic device operating with a server according to an embodiment of the present disclosure.

[0024] Figure 14 This is a detailed explanation. Figure 13 The image.

[0025] Figure 15 This is a diagram illustrating a mobile device operating with a server according to an embodiment of the present disclosure. Detailed Implementation

[0026] According to embodiments of this disclosure, a mobile device is disclosed for controlling an in-vehicle electronic device. The mobile device includes: a communicator configured to communicate with the in-vehicle electronic device; a display; a memory storing one or more instructions; and a processor configured to execute one or more instructions stored in the memory, such that the mobile device: controls the communicator to receive environmental information of the in-vehicle electronic device and driving state information of the vehicle from the in-vehicle electronic device; generates a control interface for controlling the in-vehicle electronic device based on the received environmental information of the in-vehicle electronic device and the received driving state information of the vehicle; and controls the display to output the control interface.

[0027] The environmental information of the vehicle electronic device may include at least one of information about the functions performed in the vehicle electronic device or information about the control functions available within the functions performed, and the driving status information of the vehicle may include at least one of information about whether the vehicle is moving or information about the current speed of the vehicle.

[0028] The processor can also: based on the received environmental information, select one or more control functions that are acceptable to the input, such that at least some of the selected one or more control functions are included in the generated control interface.

[0029] The processor can also generate a first control interface when the vehicle is stopped and a second control interface when the vehicle is moving, such that the number of control functions included in the second control interface is less than the number of control functions included in the first control interface.

[0030] The mobile device may also include input / output circuitry configured to receive user input about the control interface as input information, enabling the input information to be transmitted to onboard electronic equipment via a communicator.

[0031] The processor can receive status information about the driver operating the vehicle from the vehicle's electronic devices, and generate a control interface based at least in part on the received driver status information.

[0032] The processor can also generate a first control interface when the status information indicates a normal state and a second control interface when the status information indicates an abnormal state, including a number of control functions in the second control interface that are fewer than the number of control functions included in the first control interface.

[0033] The processor can output at least one of the following based on the driver's condition information: a warning sound, vibration, or notification message.

[0034] According to embodiments of this disclosure, an in-vehicle electronic device is disclosed, comprising: a communicator configured to communicate with a mobile device; a memory storing one or more instructions; and a processor. The processor executes the instructions to cause the in-vehicle electronic device to: control the communicator to send environmental information and vehicle driving state information related to functions performed in the in-vehicle electronic device to the mobile device; receive user input as input information through a control interface generated by the mobile device based on the environmental information and the vehicle driving state information; and perform control operations based on the input information.

[0035] The vehicle-mounted electronic equipment may also include a display, such that one or more instructions can be executed by a processor to: control the display to output an interface screen corresponding to the function being performed, and update the interface screen as the control operation is performed.

[0036] The processor can also: receive information related to vehicle operation from the vehicle's sensors, and obtain the vehicle's driving status information based on the information related to vehicle operation.

[0037] The processor can also: obtain status information of the driver operating the vehicle and control the communicator to send status information to the mobile device.

[0038] According to embodiments of this disclosure, a method for controlling an in-vehicle electronic device using a mobile device is disclosed. The method includes: receiving environmental information of the in-vehicle electronic device and driving state information of the vehicle from the in-vehicle electronic device via a communication circuit; generating a control interface for controlling the in-vehicle electronic device by a processor based on the received environmental information of the in-vehicle electronic device and driving state information of the vehicle; and outputting the generated control interface on a display.

[0039] Throughout this disclosure, the expression "at least one of a, b, or c" indicates only a; only b; only c; both a and b; both a and c; both b and c; all of a, b, and c; or variations thereof.

[0040] The terminology used herein will be briefly described, and this disclosure will be described in detail.

[0041] In consideration of the functionality of this disclosure, the terminology used herein is that which is currently widely used in the art; however, these terms may vary depending on the intent, precedent, or new technology of a person skilled in the art. Furthermore, some of the terms used herein may be arbitrarily chosen by the applicant, and in such cases, these terms are defined in detail below. Therefore, the specific terms used herein should be defined based on their unique meaning and the entire context of this disclosure.

[0042] It should be understood that when a component “includes” another component, that component does not exclude another component, but may further include another component, unless the context clearly specifies otherwise. Furthermore, terms such as “unit” or “module” as used herein refer to a unit that performs at least one function or operation, and a unit may be implemented as hardware or software, or a combination of hardware and software.

[0043] Similarly, the expression "at least one of A, B or C" can refer to "(A); (B); (C); (A and B); (A and C); (B and C); or (A, B and C)".

[0044] This disclosure will now be described more fully with reference to the accompanying drawings so that those skilled in the art can perform this disclosure without difficulty. However, this disclosure may be implemented in many different forms and should not be limited to the embodiments set forth herein. For clarity, portions irrelevant to the description of this disclosure have been omitted from the drawings, and throughout the specification, the same components are indicated by the same reference numerals.

[0045] Figure 1 This is a diagram illustrating an in-vehicle electronic device 100 and a mobile device 200 for controlling the in-vehicle electronic device 100 according to an embodiment of the present disclosure.

[0046] refer to Figure 1In-vehicle electronic equipment 100 refers to electronic equipment installed, arranged, or included in a vehicle, and may be electronic equipment used to realize in-vehicle infotainment (IVI) technology. Infotainment is a term that integrates information such as vehicle operation, navigation, and entertainment, referring to various entertainment and user-friendly functions that combine informational and entertaining aspects. In other words, an infotainment system can refer to a system that allows vehicle users to use information in a way that is as enjoyable and convenient as entertainment.

[0047] Specifically, an IVI system refers to a system that displays various information that a vehicle can provide, such as radio, audio, video, navigation, voice commands, and automatic safety diagnostics, so that users (drivers and / or passengers) can easily and conveniently identify or use this information. Therefore, infotainment systems have evolved and progressed towards increasing user convenience.

[0048] refer to Figure 1 The in-vehicle electronic equipment 100 may include electronic equipment that implements an infotainment system and can provide functions such as navigation, audio, video, and radio within the vehicle.

[0049] Furthermore, according to embodiments of this disclosure, the mobile device 200 refers to a portable electronic device capable of controlling the in-vehicle electronic device 100 by performing communication with it. Specifically, the mobile device 200 may include mobile computing devices, such as wearable devices, smartphones, tablets, PDAs, etc. However, the mobile device 200 is not limited thereto.

[0050] According to embodiments of this disclosure, the vehicle-mounted electronic device 100 and the mobile device 200 can communicate with each other. For example, the vehicle-mounted electronic device 100 and the mobile device 200 can be "paired" according to a specific communication standard. When the vehicle-mounted electronic device 100 and the mobile device 200 initiate a connection through a communication network according to, for example, the Bluetooth communication standard, the vehicle-mounted electronic device 100 and the mobile device 200 can establish a communication connection by pairing with each other according to the Bluetooth communication standard, and exchange data for completing the Bluetooth communication connection.

[0051] Optionally, when the vehicle-mounted electronic device 100 and the mobile device 200 are connected via an Internet of Things (IoT) platform, the vehicle-mounted electronic device 100 and the mobile device 200 can perform communication connections with each other according to the rules used to form the communication network of the IoT platform.

[0052] Optionally, when the vehicle electronic device 100 and the mobile device 200 are connected via a Bluetooth Low Energy (BLE) communication network, the vehicle electronic device 100 and the mobile device 200 can establish a communication connection with each other by performing a pairing operation and exchanging data for BLE communication connection according to the BLE communication standard.

[0053] Furthermore, the vehicle-mounted electronic device 100 can proactively request a communication connection with the mobile device 200 to perform a communication connection operation, or the mobile device 200 can proactively request a communication connection with the vehicle-mounted electronic device 100 to perform a communication connection operation. Similarly, when the communication connection between the vehicle-mounted electronic device 100 and the mobile device 200 is completed, the vehicle-mounted electronic device 100 and the mobile device 200 can register with each other.

[0054] When a communication connection is established between the vehicle-mounted electronic device 100 and the mobile device 200 according to embodiments of this disclosure, the vehicle-mounted electronic device 100 can send acquired environmental context information, vehicle driving status information, driver condition information, etc., to the mobile device 200. The mobile device 200 can generate a control interface based on the received environmental information, vehicle driving status information, driver condition information, etc., and output the generated control interface to a display screen to provide a control interface to the user. Therefore, the user can control the functions of the vehicle-mounted electronic device 100 by using the control interface output to the mobile device 200. This will be described in detail with reference to the following drawings.

[0055] Figure 2 This is a flowchart illustrating a method for controlling an in-vehicle electronic device 100 using a mobile device 200 according to an embodiment of the present disclosure.

[0056] refer to Figure 2 According to embodiments of this disclosure, the vehicle-mounted electronic device 100 and the mobile device 200 can communicate with each other during operation S210. This has been referenced. Figure 1 It has been described in detail, and therefore the detailed description of it has been omitted.

[0057] According to embodiments of the present disclosure, the vehicle-mounted electronic device 100 can obtain environmental information during operation S220.

[0058] In this context, the environmental information can indicate the function being performed in the vehicle electronic device 100. Furthermore, when multiple functions are performed in the vehicle electronic device 100, the environmental information can include information about the functions being performed in the topmost computing layer (e.g., a foreground application, rather than a background application). Additionally, the environmental information can indicate the control functions available among the performed functions.

[0059] For example, when the audio player function is executed in the vehicle electronic device 100, the environmental information can indicate that the "audio player" function is being executed, and also indicate the control functions that can be selected / executed within the audio player (e.g., play / pause, play the previous song, play the next song, on / off, volume control, etc.).

[0060] In operation S230, the vehicle-mounted electronic device 100 can transmit environmental information from its own device to the mobile device 200 via a communication network. In this regard, a short-range communication network can be used to transmit the environmental information. This short-range communication network can be a communication network based on communication standards such as Bluetooth, Wi-Fi, or BLE.

[0061] According to embodiments of the present disclosure, the mobile device 200 can generate a control interface based on environmental information received from the vehicle-mounted electronic device 100 during operation S240. For example, the mobile device 200 can generate an audio control interface based on the received environmental information.

[0062] During operation S250, the mobile device 200 according to this embodiment of the disclosure can output the control interface generated in operation S240. For example, the mobile device 200 can output the generated audio control interface to a display. The audio control interface can include control functions such as play / pause, play previous song, play next song, on / off, volume control, etc. The audio control interface screen can include interactive objects corresponding to each control function (such as play / pause, play previous song, play next song, on / off, volume control, etc.).

[0063] Therefore, during operation S260, the mobile device 200 can receive user input for controlling the in-vehicle electronic equipment 100 via a control interface output to a display. For example, the mobile device 200 can receive touch input for pressing an object included in the audio control interface screen to play the next song.

[0064] In operation S270, the mobile device 200 can send input information corresponding to the received user input to the vehicle-mounted electronic device 100. For example, the mobile device 200 can send input information to the vehicle-mounted electronic device 100 instructing "play the next song".

[0065] In operation S280, the vehicle electronic device 100 can perform control operations based on input information received from the mobile device 200. For example, the vehicle electronic device 100 can play the next song based on input information indicating "play the next song", and update the interface screen output to the vehicle electronic device 100 to the corresponding screen (e.g., display an image representing the requested song) to output the updated screen.

[0066] Figures 3a to 3c This is a reference diagram illustrating a method for determining a control interface based on environmental information of an in-vehicle electronic device 100, performed by a mobile device 200 according to an embodiment of the present disclosure.

[0067] refer to Figure 3aAccording to embodiments of the present disclosure, the in-vehicle electronic device 100 can perform navigation functions. The in-vehicle electronic device 100 can output a navigation screen to a display. The navigation screen may include a first object indicating the current location of the vehicle displayed on a map representing a local geographic area. Furthermore, the navigation screen may include a second object 310, and the area displayed on the map can be changed via input to the second object 310. For example, when the second object 310 moves on the map, the navigation screen may display a preset range of areas on the display relative to the position of the moving second object 310. Additionally, the navigation screen can perform zoom functions on the map using zoom-in and zoom-out functions. Furthermore, the navigation screen may include various functions such as destination setting, waypoint setting, route reselection, and navigation termination.

[0068] The vehicle-mounted electronic device 100 can send information to the mobile device 200 indicating whether the function being performed is navigation or information identifying the control functions available on the current navigation screen as environmental information.

[0069] According to embodiments of the present disclosure, a mobile device 200 can generate a navigation control interface 320 based on received environmental information and output the navigation control interface 320 to the display of the mobile device 200. In this case, the navigation control interface 320 may include some or all of the same control functions available on a navigation screen.

[0070] For example, the navigation control interface 320 may include a third object 330 corresponding to the second object 310 displayed on the in-vehicle electronic device 100, and may include screen zoom-in / zoom-out functionality. Furthermore, the navigation control interface 320 may include various functions such as destination setting, waypoint setting, route reselection, and navigation termination.

[0071] Therefore, users can perform navigation control inputs by using the navigation control interface 320 provided by the mobile device 200. For example, users can change the map area displayed on the in-vehicle electronic device 100 by moving a third object 330. In addition, users can zoom in or out on the map screen displayed on the in-vehicle electronic device 100 by touching the navigation control interface 320 with two fingers and using pinch or spread input.

[0072] Furthermore, users can use voice to input destinations, set waypoints, etc., into the mobile device 200, and correspondingly, the in-vehicle electronic device 100 can set destinations or waypoints based on the voice input to the mobile device 200. However, this disclosure is not limited thereto.

[0073] refer to Figure 3bAccording to embodiments of the present disclosure, the vehicle-mounted electronic device 100 can display a screen using an up / down control input 341, a left / right control input 342, or a rotation control input 343. For example, the screen displayed on the vehicle-mounted electronic device 100 may include a list in which multiple selectable items are arranged vertically, horizontally, or circularly.

[0074] The vehicle-mounted electronic device 100 can send information about whether the currently displayed screen is the screen using the up / down control input 341, left / right control input 342, or rotation control input 343 as environmental information to the mobile device 200.

[0075] According to embodiments of the present disclosure, the mobile device 200 can generate a control interface as a directional control interface based on received environmental information, and can output the directional control interface to a display. In this regard, the directional control interface may include a wheel key 350. Therefore, when a user performs a clockwise rotation input of the wheel key 350 provided by the mobile device 200, the user can move the cursor or focus down, right, or clockwise to select an item from a list displayed on the in-vehicle electronic device 100. Optionally, when a user performs a counter-clockwise rotation input of the wheel key 350 provided by the mobile device 200, the user can move the cursor or focus up, left, or counter-clockwise to select an item from a list displayed on the in-vehicle electronic device 100. However, the present disclosure is not limited thereto.

[0076] in addition, Figure 3b The directional control interface shown includes a scroll wheel 350, but this disclosure is not limited thereto, and the directional control interface may include various types of input components, such as two directional keys (buttons), four directional keys (buttons), up and down scroll keys, left and right scroll keys, etc.

[0077] refer to Figure 3c According to embodiments of the present disclosure, the in-vehicle electronic device 100 can perform audio player functions. The in-vehicle electronic device 100 can output an audio player screen 360 to a display. The audio player screen 360 may include information about the currently playing media file (e.g., title, artist, genre, etc.), and objects selectable to perform control functions available on the audio player screen 360 (e.g., play the previous song, play the next song, play / pause, volume control, etc.).

[0078] The in-vehicle electronic device 100 can send information about the currently executing function, such as an audio player function, and information about the control functions available on the current audio player screen 360, as environmental information to the mobile device 200.

[0079] According to embodiments of the present disclosure, the mobile device 200 can generate an audio control interface 370 based on received environmental information and output the audio control interface 370 to a display. In this regard, the audio control interface 370 may include control functions available on the audio player screen 360.

[0080] For example, the audio control interface 370 may include objects representing functions such as playing the previous song, playing the next song, play / pause, and volume control.

[0081] Therefore, the mobile device 200 can receive audio player control input through the audio control interface 370 provided by the mobile device 200. For example, the mobile device 200 can receive touch input that selects an object to play the next song in the generated audio control interface 370. The mobile device 200 can send the input information corresponding to the command to play the next song to the in-vehicle electronic device 100, and the in-vehicle electronic device 100 can start playing the next song based on the received input information.

[0082] Figure 4 This is a flowchart illustrating a method for controlling an in-vehicle electronic device 100 using a mobile device 200 according to an embodiment of the present disclosure.

[0083] refer to Figure 4 According to embodiments of this disclosure, the vehicle-mounted electronic device 100 and the mobile device 200 can communicate with each other during operation S410. This has been referenced. Figure 1 It has been described in detail, and therefore the detailed description of it has been omitted.

[0084] According to embodiments of the present disclosure, the vehicle-mounted electronic device 100 can obtain environmental information in operation S420 and obtain driving state information in operation S430. Reference has been made to... Figure 2 Operation S220 describes operation S420 for obtaining environmental information, and therefore a detailed description thereof is omitted.

[0085] The vehicle's driving status information may include information about whether the vehicle on which the on-board electronic equipment 100 is installed or arranged is in operation (whether the vehicle is moving or stationary), and speed information when the vehicle is moving (e.g., whether the actual speed and / or indicated speed fall within a predetermined speed range indicated as high speed, medium speed or low speed).

[0086] The vehicle electronic device 100 can obtain vehicle driving status information based on vehicle driving-related information received from the vehicle's vehicle sensor module (e.g., current speed, steering angle, pedal activation, gear selection, steering signal activation, directionality of activated steering signal, etc.).

[0087] The vehicle-mounted electronic device 100 can send environmental information and vehicle driving status information to the mobile device 200 via a communication network (S440).

[0088] In operation S450, the mobile device 200 according to an embodiment of the present disclosure can generate a control interface based on environmental information and vehicle driving status information received from the vehicle electronic device 100.

[0089] For example, mobile device 200 can determine that the control interface is an audio control interface based on received environmental information. Furthermore, mobile device 200 can generate any of a plurality of audio control interfaces based on received driving status information. For example, when the vehicle's driving status information indicates that the vehicle is stopped, mobile device 200 can generate a first audio control interface, which includes control functions such as play / pause, play previous song, play next song, on / off, and volume control. Furthermore, when the vehicle's driving status information indicates that the vehicle is moving within a predefined range associated with "high" speed, mobile device 200 can generate a second audio control interface, which includes some (but not all) of the audio control functions included in the first audio control interface. However, this disclosure is not limited thereto.

[0090] During operation S460, the mobile device 200 according to an embodiment of this disclosure can output an interface corresponding to the determined control interface to a display. For example, the mobile device 200 can output an audio control interface screen generated between the first audio control interface and the second audio control interface to the display.

[0091] Therefore, during operation of S470, the mobile device 200 can receive user input controlling the vehicle electronic equipment 100 through the audio control interface output to the display of the mobile device 200.

[0092] In operation S480, the mobile device 200 can send input information corresponding to the received user input to the vehicle-mounted electronic device 100.

[0093] In operation S490, the vehicle electronic device 100 can perform control operations based on input information received from the mobile device 200.

[0094] Figure 5 This is a block diagram illustrating the configuration of an in-vehicle electronic device 100 according to an embodiment of the present disclosure.

[0095] refer to Figure 5 According to embodiments of the present disclosure, the vehicle-mounted electronic device 100 may include a communicator 110, a processor 120, a memory 130, and a display 140.

[0096] The communicator 110 can communicate with external devices or servers via at least one wired or wireless communication network. According to embodiments of this disclosure, the communicator 110 may include: at least one short-range communication module (not shown) that performs communication according to communication standards such as Bluetooth, Wi-Fi, BLE, NFC / RFID, Wi-Fidirect, UWB, Zigbee, etc.; and a long-range communication module (not shown) that communicates with a server (not shown) supporting long-range communication according to a long-range communication standard. The long-range communication module (not shown) can perform communication via a communication network conforming to 3G, 4G, and / or 5G communication standards or a network used for Internet communication. According to embodiments of this disclosure, the communicator 110 can communicate with the mobile device 200 via a short-range communication method. However, the communicator 110 is not limited thereto.

[0097] Furthermore, the communicator 110 can communicate with the vehicle sensor module 500 installed in the vehicle. For example, the communicator 110 can communicate with the vehicle sensor module 500 via a controller area network (CAN).

[0098] The vehicle sensor module 500 can be installed on the vehicle to detect changes in vehicle speed, steering angle, pedal activation, gear selection, steering signal activation, etc., to obtain information related to vehicle operation, and to send driving-related information to the on-board electronic device 100. Therefore, the communicator 110 can receive at least one of the following from the vehicle sensor module 500 by performing CAN communication: driving speed sensing information, vehicle steering angle information, pedal sensing information, gear lever sensing information, information on whether the steering signal is activated, or the directionality of the activated steering signal.

[0099] Processor 120 typically controls the operation of in-vehicle electronic equipment 100. Processor 120 can execute one or more programs stored in memory 130. Memory 130 according to embodiments of this disclosure can store various data, programs, or applications for driving and controlling in-vehicle electronic equipment 100.

[0100] Processor 120 may include hardware components that perform arithmetic, logic, and input / output operations as well as signal processing. Processor 120 may include at least one of the following: a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), or a field-programmable gate array (FPGA), but is not limited thereto.

[0101] The memory 130 may include, for example: non-volatile memory, including at least one of flash memory, hard disk memory, multimedia card micro or card memory (e.g., Secure Digital (SD) memory, Extreme Digital (XD) memory, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM) or programmable read-only memory (PROM); and volatile memory, such as random access memory (RAM) or static random access memory (SRAM).

[0102] The memory 130 may store instructions, data structures, and program code readable by the processor 120. In the following embodiments of this disclosure, the processor 120 may be implemented by executing the instructions or code of a program stored in the memory 130.

[0103] The processor 120 can monitor environmental information of the in-vehicle electronic device 100 and control the communicator 110 to send the environmental information to the mobile device 200. In this regard, the environmental information may include information about the functions being performed in the in-vehicle electronic device 100, and, when multiple functions are being performed, information about the function being performed at the top level (e.g., the foreground). Furthermore, the environmental information may include information about the control functions available in the respective functions.

[0104] Furthermore, the processor 120 can obtain vehicle driving status information. For example, the processor 120 can obtain information about whether the vehicle is moving, whether the vehicle is stopped, when the vehicle is moving, information about the current speed, and whether the vehicle is in danger or an emergency, based on at least one of the driving speed sensing information, vehicle steering angle information, pedal sensing information, gear lever sensing information, information about whether the turn indicator is activated, or the direction of the activated turn indicator, received from the vehicle sensor module 500. The processor 120 can control the communicator 110 to send the obtained vehicle driving status information to the mobile device 200.

[0105] In addition, the processor 120 can control the communicator 110 to obtain information about the current time of the vehicle electronic device 100, map the information to environmental information or driving status information, and send the information to the mobile device 200.

[0106] Furthermore, when receiving input information from the mobile device 200, the processor 120 can interpret the input information and execute control operations corresponding to the input information.

[0107] The display 140 according to an embodiment of this disclosure can output images on a screen. Specifically, the display 140 can output images corresponding to video data through a display panel (not shown) included therein, allowing the user to visually recognize the video data. Here, the screen output by the display 140 may include a user interface screen.

[0108] Specifically, the display 140 may also include a touch screen (not shown) integrated with a display panel (not shown). When the display 140 includes a display panel integrated with a touch screen, the display 140 can output a user interface screen capable of receiving touch input. Furthermore, when user input (e.g., touch) corresponding to a command is detected through the user interface screen, the display 140 can send the detected touch input to the processor 120. The processor 120 can then interpret the detected touch input, recognize and execute the command corresponding to the user input.

[0109] According to embodiments of the present disclosure, the display 140 can output an interface screen corresponding to the functions performed in the vehicle electronic device 100. Furthermore, when receiving input information from the mobile device 200, the processor 120 can perform control operations in the same manner as when receiving user input (e.g., touch) via the interface screen output to the display 140.

[0110] Furthermore, when performing control operations based on input information received from the mobile device 200, the processor 120 can update the display of the interface screen.

[0111] Figure 6 This is a block diagram illustrating the configuration of a mobile device 200 according to an embodiment of the present disclosure.

[0112] refer to Figure 6 The mobile device 200 according to embodiments of the present disclosure may include a communicator 210 (e.g., a communication circuit), a processor 220, a memory 230, a display 240, and a user input device 250 (e.g., an input and / or output circuit).

[0113] For example, the communicator 210 may include a short-range communicator, a mobile communicator, etc., corresponding to the performance and structure of the mobile device 200.

[0114] Short-range communicators can include, but are not limited to, Bluetooth communicators, BLE communicators, near-field communicators, WLAN (Wi-Fi communicators, Zigbee communicators, Infrared Data Association (IrDA) communicators, Wi-Fidirect (WFD) communicators, UWB communicators, Ant+ communicators, microwave (uWave) communicators, etc.

[0115] A mobile communicator can transmit and receive wireless signals with at least one of a base station, an external terminal, or a server via a mobile communication network. Here, depending on the transmission and reception of text / multimedia messages, the wireless signals may include voice call signals, video call signals, or various types of data.

[0116] According to embodiments of this disclosure, the communicator 210 can communicate with the vehicle-mounted electronic device 100 to receive environmental information and driving status information of the vehicle from the vehicle-mounted electronic device 100. Furthermore, the communicator 210 can also receive time information mapped to the environmental information and the vehicle's driving status information.

[0117] The processor 220 according to embodiments of the present disclosure can generally control the operation of the mobile device 200. Furthermore, the processor 220 can control other components included in the mobile device 200 to perform specific operations. The processor 220 according to embodiments of the present disclosure can execute one or more programs stored in the memory 230. The processor 220 may include single-core, dual-core, triple-core, quad-core, and multi-core processors. Furthermore, the processor 220 may include multiple processors.

[0118] According to embodiments of the present disclosure, the memory 230 can store various data, programs, or applications for driving and controlling the mobile device 200.

[0119] Furthermore, the program stored in memory 230 may include one or more instructions. The program (one or more instructions) or application stored in memory 230 may be executed by processor 220.

[0120] According to embodiments of this disclosure, the processor 220 can generate a control interface based on environmental information received from the vehicle electronic device 100 and the vehicle's driving state information. The processor 220 can obtain information about the functions performed in the vehicle electronic device 100 based on the environmental information, and information about the control functions available in the corresponding functions. For example, when it is identified that the function being performed in the vehicle electronic device 100 is an audio player, the processor 220 can generate a control interface as an audio control interface for controlling the audio player based on the environmental information. Furthermore, the processor 220 can select one of multiple audio control interfaces based on the driving state information. For example, when it is identified that the vehicle is stopped, the processor 220 can select a first audio control interface, which includes control functions such as play / pause, play previous song, play next song, on / off, and volume control; and when it is identified that the vehicle is traveling at high speed, it can select a second audio control interface, which includes some of the audio control functions included in the first audio control interface. However, this disclosure is not limited thereto.

[0121] The memory 230 may include at least one type of storage medium from the following: flash memory type storage medium, hard disk type storage medium, multimedia card micro storage medium, card type memory (e.g., SD or XD memory), RAM, static RAM (SRAM), ROM, electrically erasable programmable ROM (EEPROM), programmable ROM (PROM), magnetic storage, magnetic disk and optical disk.

[0122] The display 240 can convert image signals, data signals, OSD signals, control signals, etc., processed by the processor 120 to generate drive signals. The display 240 can be implemented using a PDP, liquid crystal display (LCD), organic light-emitting diode (OLED), flexible display, etc., and can also be implemented using a three-dimensional (3D) display. Furthermore, the display 240 can be configured as a touch screen, serving as both an output device and an input device. The display 240 according to embodiments of this disclosure can output a generated control interface.

[0123] User input device 250 (e.g., input circuitry) refers to a component through which a user inputs data for controlling mobile device 200. For example, user input device 250 may include a keypad, dome switch, touchpad (contact capacitance method, pressure resistance layer method, infrared detection method, surface ultrasonic conduction method, integral tension measurement method, piezoelectric effect method, etc.), scroll wheel, scroll wheel switch, etc., but is not limited to these.

[0124] Furthermore, the user input device 250 may include a voice recognition device (not shown) for voice recognition. For example, the voice recognition device may include a microphone and receive the user's voice commands or voice requests. Additionally, the user input device 250 may include a motion sensor (not shown). For example, the motion sensor (not shown) may sense the user's movement in the vehicle and receive the sensed movement as user input. Furthermore, the aforementioned voice recognition device and motion sensor may not be included in the user input device 250, but may be included as modules independent of the user input device 250 in the mobile device 200.

[0125] Figures 7a to 7c This is a reference diagram illustrating a method for determining a control interface based on environmental information of an in-vehicle electronic device 100 and driving state information of a vehicle, performed by a mobile device 200 according to an embodiment of the present disclosure.

[0126] refer to Figure 7aAccording to embodiments of the present disclosure, the in-vehicle electronic device 100 can perform an audio player function. The in-vehicle electronic device 100 can output an audio player screen to a display. The audio player screen may include information about the currently playing music (e.g., title, artist, genre, etc.) and objects representing the control functions available on the audio player screen (e.g., play previous song, play next song, play / pause, volume control, etc.).

[0127] The vehicle-mounted electronic device 100 can send information about the currently executing function, such as an audio player function, and information about the control functions available on the current audio player screen, as environmental information to the mobile device 200.

[0128] According to embodiments of the present disclosure, the mobile device 200 can generate an audio control interface based on received environmental information and output the audio control interface to a display. In this regard, the mobile device 200 can output one of multiple audio control interfaces based on vehicle driving status information. For example, when the vehicle driving status information indicates that the vehicle is stopped, the mobile device 200 can output a first audio control interface 710 to the display, which includes control functions such as play / pause, play previous song, play next song, on / off, and volume control. Simultaneously, when the vehicle driving status information indicates that the vehicle is moving at high speed, the mobile device 200 can output a second audio control interface 720 to the display, which includes some of the audio control functions (e.g., play / pause, play previous song, and play next song) included in the first audio control interface 710.

[0129] refer to Figure 7b According to embodiments of the present disclosure, the in-vehicle electronic device 100 can perform an audio player function and output the audio player screen to a display. Reference has been made to... Figure 7a The description of the environmental information sent to the mobile device 200 when the in-vehicle electronic device 100 performs the audio player function is omitted.

[0130] According to embodiments of the present disclosure, the mobile device 200 can generate an audio control interface based on received environmental information and output the audio control interface to a display. In this regard, the mobile device 200 can output one of multiple audio control interfaces based on vehicle driving status information. For example, when the vehicle driving status information indicates that the vehicle is moving at high speed, the mobile device 200 can provide the audio control interface as a motion input interface, through which input is received via motion. The motion input interface detects left-right or up-down hand movements. For example, left and right hand movements can correspond to commands to play the previous or next song, and up and down hand movements can correspond to increasing and decreasing the playback volume. However, the present disclosure is not limited thereto. Furthermore, when providing a motion input interface, the mobile device 200 can output a motion guidance screen 730 regarding motion and guide the user with movements corresponding to specific functions. Optionally, when the vehicle driving status information indicates that the vehicle is moving at high speed, the mobile device 200 can provide the audio control interface as a voice input interface, through which voice input is received.

[0131] Meanwhile, when the vehicle's driving status information indicates that the vehicle should stop, the mobile device 200 can output a touch input interface 740 to the display, where the audio control function is implemented as touch keys (buttons).

[0132] refer to Figure 7c According to embodiments of the present disclosure, the in-vehicle electronic device 100 can perform navigation functions and output the navigation screen to a display. Furthermore, the in-vehicle electronic device 100 can perform the function of setting a destination within the navigation function.

[0133] The in-vehicle electronic device 100 can send information about the destination setting function in the navigation function, which is currently being performed, as environmental information to the mobile device 200.

[0134] According to embodiments of the present disclosure, the mobile device 200 can generate a control interface based on received environmental information, through which a destination can be input. In this regard, the mobile device 200 can determine the input method of the control interface based on vehicle driving status information, through which a destination can be input. For example, when the vehicle driving status information indicates that the vehicle is moving at high speed, the mobile device 200 can use a voice input interface to provide the control interface, through which voice is received. Furthermore, when a voice input interface is provided, the mobile device 200 can output a guidance message 750 "Please tell me the destination" on the screen to prompt the user to input the destination by voice. Therefore, the mobile device 200 can receive the user's voice input and send the input information corresponding to the received voice input (e.g., destination information parsed from the voice) to the in-vehicle electronic device 100.

[0135] Simultaneously, when the vehicle's driving status information indicates that the vehicle should stop, the mobile device 200 can provide a touch-based keyboard input interface 760. Therefore, the mobile device 200 can receive touch input from the touch keyboard and send the input information corresponding to the received touch input (e.g., destination information) to the in-vehicle electronic device 100.

[0136] Figure 8 This is a flowchart illustrating a method for controlling an in-vehicle electronic device 100 using a mobile device 200 according to an embodiment of the present disclosure.

[0137] refer to Figure 8 According to embodiments of this disclosure, the vehicle-mounted electronic device 100 and the mobile device 200 can communicate with each other during operation S810. This has been referenced. Figure 1 It has been described in detail, and therefore the detailed description of it has been omitted.

[0138] According to embodiments of the present disclosure, the vehicle-mounted electronic device 100 can obtain environmental information in operation S820 and obtain driver condition information in operation S830. Reference has been made to... Figure 2 Operation S220 describes operation S820 for obtaining environmental information, and therefore a detailed description thereof is omitted.

[0139] In addition, the driver's condition information may include information on whether the driver's state while driving the vehicle on which the vehicle electronic equipment 100 is installed or arranged is "normal" or "abnormal" (i.e., based on whether the driver's biometric indicators collected from sensors, cameras, etc. fall within a preset threshold range for normal or abnormal) and the driver's health condition (e.g., increased heart rate, abnormal electrocardiogram (ECG), etc.).

[0140] The vehicle-mounted electronic equipment 100 can obtain images of the driver and driver gaze information from an internal camera located inside the vehicle. For example, the internal camera can capture the driver and obtain images of the driver in real time. Furthermore, the internal camera may include a gaze-tracking sensor that captures and detects the driver's pupils and their movement. Therefore, the internal camera can transmit the driver's image and gaze information to the vehicle-mounted electronic equipment 100. The vehicle-mounted electronic equipment 100 can determine the driver's condition based on the gaze information, such as whether the driver's gaze is distracted, and determine whether the driver is drowsy based on the image of the driver.

[0141] Furthermore, the in-vehicle electronic device 100 can obtain information related to the driver's health from a wearable device worn by the driver. For example, the wearable device worn by the driver can measure the driver's heart rate, ECG, etc. Therefore, the wearable device can send information such as the driver's heart rate and ECG to the in-vehicle electronic device 100, and the in-vehicle electronic device 100 can determine whether the driver's health condition is abnormal based on the received information.

[0142] During operation S840, the vehicle electronic device 100 can transmit environmental information and driver status information to the mobile device 200 via a communication network.

[0143] In operation S850, the mobile device 200 according to an embodiment of the present disclosure can generate a control interface based on environmental information and driver condition information received from the vehicle electronic device 100.

[0144] For example, the mobile device 200 can generate an audio control interface based on received environmental information. Furthermore, the mobile device 200 can select any of a plurality of audio control interfaces based on received driver condition information. For example, when the driver condition information indicates a normal state, the mobile device 200 can select a first audio control interface, which includes control functions such as play / pause, play previous song, play next song, on / off, and volume control. Furthermore, when the driver condition information indicates a caution or dangerous situation, the mobile device 200 can select a second audio control interface, which includes some of the audio control functions included in the first audio control interface. However, this disclosure is not limited thereto.

[0145] During operation S860, the mobile device 200 according to an embodiment of the present disclosure can output the generated control interface to a display.

[0146] Furthermore, when the driver's status information indicates a dangerous situation, the mobile device 200 can output a warning sound or vibration, or output a warning message together with the second audio control interface. Therefore, the mobile device 200 can notify the user of a dangerous situation.

[0147] When operating S870, the mobile device 200 can receive user input for controlling the vehicle electronic device 100 through the control interface output to the display, and send the input information corresponding to the received user input to the vehicle electronic device 100.

[0148] In operation S890, the vehicle electronic device 100 can perform control operations based on input information received from the mobile device 200.

[0149] Figure 9a and Figure 9bThis is a reference diagram illustrating a method for determining a control interface based on environmental information from an in-vehicle electronic device 100 and driver condition information, performed by a mobile device 200 according to an embodiment of the present disclosure.

[0150] refer to Figure 9a According to embodiments of the present disclosure, the in-vehicle electronic device 100 can perform an audio player function. The in-vehicle electronic device 100 can output an audio player screen to a display. The audio player screen may include information about the currently playing media file (e.g., title, artist, genre, etc.) and objects representing selectable control functions available on the audio player screen (e.g., play previous song, play next song, play / pause, volume control, etc.).

[0151] The vehicle-mounted electronic device 100 can send information indicating that the function to be performed is an audio player function, and information about the control functions available on the current audio player screen, as environmental information to the mobile device 200. According to embodiments of this disclosure, the mobile device 200 can generate an audio control interface based on the received environmental information and output the audio control interface to a display. In this regard, the mobile device 200 can generate one of multiple audio control interfaces based on the driver's condition information. For example, when the vehicle driver's condition information indicates a "normal" condition, the mobile device 200 can output a first audio control interface 910 to the display, which includes control functions such as play / pause, play previous song, play next song, on / off, and volume control.

[0152] Simultaneously, when the driver's status information indicates a state of alert, the mobile device 200 can output a second audio control interface 920 to the display, which includes some of the audio control functions (e.g., play / pause, play previous song, and play next song) included in the first audio control interface 910. Furthermore, the mobile device 200 can output a warning sound, vibration, or warning message 925 corresponding to the state of alertness.

[0153] Furthermore, when the driver's condition information indicates a dangerous situation, the mobile device 200 can output a third audio control interface 930 to the display by magnifying icons indicating functions included in the second audio control interface 920. Additionally, the mobile device 200 can output a warning sound, vibration, or warning message 935 corresponding to the dangerous situation.

[0154] refer to Figure 9bThe in-vehicle electronic device 100 according to embodiments of the present disclosure can perform an audio player function and output the audio player screen to a display. Furthermore, the vehicle-mounted electronic device 100 according to embodiments of the present disclosure can be communicatively connected to multiple mobile devices 200 and 900. For example, the first mobile device 200 may be a mobile device belonging to the driver of the vehicle, and the second mobile device 900 may be a mobile device belonging to a passenger in the vehicle.

[0155] According to embodiments of the present disclosure, mobile devices 200 and 900 can generate an audio control interface based on received environmental information and output the audio control interface to a display. In this regard, when the vehicle is being driven, the driver's mobile device (first mobile device 200) can output a second audio control interface 920 to the display, which includes some audio control functions (e.g., play / pause, play previous song, and play next song).

[0156] Meanwhile, the passenger's mobile device (second mobile device 900) can output a first audio control interface 910 to the display, which includes control functions such as play / pause, play the previous song, play the next song, on / off, and volume control.

[0157] Furthermore, the second mobile device 900 according to embodiments of this disclosure can receive driver status information from the vehicle-mounted electronic device 100, and when the driver status information indicates a cautious or dangerous situation, the second mobile device 900 can output warning sounds, vibrations, warning messages 940, etc. Therefore, for example, passengers may be alerted to an abnormal driver condition and take action to avoid an accident.

[0158] Figure 10 This is a block diagram of the configuration of an in-vehicle electronic device 1000 according to another embodiment of the present disclosure.

[0159] Figure 10 The vehicle-mounted electronic equipment 1000 can be used as a reference. Figure 1 An embodiment of the disclosed content of the described in-vehicle electronic device 100.

[0160] refer to Figure 10 The vehicle-mounted electronic device 1000 may include a processor 1010, an input / output device 1002 (i.e., input / output circuitry), and a communicator 1003. Here, the processor 1010 and the input / output device 1002 may be collectively referred to as the IVI head unit 1001. Furthermore, the vehicle-mounted electronic device 1000 may be disposed between the central front portion of the driver's seat and the passenger seat in the vehicle.

[0161] The communicator 1003 can also be referred to as a transmission control unit (TCU).

[0162] In this context, the TCU is the component that controls the sending and receiving of data in the vehicle and can be responsible for communication between the vehicle and external electronic devices (e.g., servers, mobile devices, etc.).

[0163] In addition, the processor 1010 may include a component 1011 for implementing a hardware platform (e.g., an application processor or "AP", memory, etc.) and a component 1012 for implementing a software platform (OS program, automotive safety software, application program, etc.).

[0164] Specifically, the component 1011 implementing the hardware platform may include at least one AP 1050 and a memory 1060. Here, the memory 1060 is related to the reference... Figure 5 The descriptions are the same. Furthermore, in Figure 10 In this embodiment, memory 1060 is included in processor 1010. Alternatively, memory 1060 may not be included in processor 1010 and may be incorporated as a separate component in vehicle electronics 1000.

[0165] Furthermore, the component 1011 implementing the hardware platform may also include a Universal Serial Bus (USB) module (not shown), an FM / DMB tuner (not shown), etc. In this regard, the USB module may include a USB plug (not shown) to read data from an inserted USB drive. Additionally, the FM / DMB tuner can selectively receive FM / DMB broadcast signals. Specifically, the FM / DMB tuner can tune and select the frequency of the channel to be received by the vehicle-mounted electronic equipment 1000 from multiple radio wave components of the broadcast signal received via amplification, mixing, and resonant wireless transmission. The broadcast signal received by the FM / DMB tuner may include audio, video, and additional information (e.g., Electronic Program Guide (EPG)).

[0166] The components 1012 that implement the software platform may include OS programs, automotive safety software, applications, etc. In this case, the OS programs may include QNX-based, Linux-based, or Android-based OS programs.

[0167] Input / output device 1002 is a component that provides data to a user or receives user requests, and may include at least one of display 1020, camera module 1030, or user interface 1040. Display 1020 is corresponding to... Figure 5 The configuration of the monitor 140 is described, and therefore its detailed description is omitted.

[0168] The camera module 1030 is a component for acquiring image and audio data, and may include a camera 1031 and a microphone 1032. The camera module 1030 may also include a speaker 1033 to output operating sounds of the camera 1031, etc. Furthermore, the speaker 1033 is a separate component independent of the camera module 1030 and can perform audio output operations. Additionally, the camera module 1030 can serve as a detection sensor for recognizing user gestures and voice.

[0169] Camera 1031 can be implemented as integrated into or separate from the vehicle electronics 1000. When implemented as a separate device, camera 1031 can be electrically connected to the processor 1010 of the vehicle electronics 1000 via communicator 1003 or input / output device 1002. For example, when camera 1031 is implemented separately from the vehicle electronics 1000, camera 1031 can be positioned corresponding to the driver's face and upper body to capture images corresponding to the driver's face and upper body. For example, camera 1031 implemented separately can acquire images of the driver or the driver's gaze information to transmit the acquired images and gaze information to the vehicle electronics 1000.

[0170] Microphone 1032 can receive voice signals. Microphone 1032 can receive user voice input, and processor 1010 can recognize control commands corresponding to the voice input received by microphone 1032 and control the operation to be performed corresponding to the control commands.

[0171] The user interface 1040 can receive user input for controlling the in-vehicle electronic equipment 1000. The user interface 1040 may include buttons, scroll wheels, keyboards, micro-switches, touch panels, and tactile sensors for receiving user input.

[0172] The communicator 1003 may include at least one of a Bluetooth module 1071, a Wi-Fi module 1072, a GPS module 1073, an RF module 1074, or a communication processor (CP) module 1075. Here, the CP module 1075 is a modem chipset and can communicate with external electronic devices via a communication network conforming to 3G, 4G, or 5G communication standards. The communicator 1003 may also include at least one communication module (not shown) that performs communication conforming to communication standards such as BLE, NFC / RFID, Wi-FiDirect, UWB, and / or ZigBee.

[0173] Furthermore, components included in the vehicle electronics 1000, such as processor 1010, input / output device 1002, and communicator 1003, can communicate with each other via the vehicle network. Additionally, the vehicle electronics 1000 can communicate with other components (not shown) in the vehicle via the vehicle network. In this regard, the vehicle network can be a network compliant with CAN and / or Media-Oriented System Transmission (MOST).

[0174] at the same time, Figure 5 and Figure 10 The block diagrams of the in-vehicle electronic devices 100 and 1000 shown are block diagrams of embodiments of this disclosure. Depending on the specifications of the actual implemented in-vehicle electronic devices 100 and 1000, each component in the block diagram may be integrated, added, or omitted. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. Furthermore, the functions performed in each block are used to describe embodiments of this disclosure, and specific operations or devices do not limit this disclosure.

[0175] Figure 11 This is a block diagram illustrating the configuration of a mobile device 1100 according to another embodiment of the present disclosure. Figure 11 The mobile device 1100 can be Figure 1 Disclosed embodiments of the mobile device 200.

[0176] refer to Figure 11 The mobile device 1100 according to embodiments of the present disclosure may further include a user input device 1110 (e.g., an input circuit), an output device 1120 (e.g., an output circuit), a sensing unit 1140, a processor 1105, a communicator 1130, an audio / video (A / V) input device 1160, or a memory 1170.

[0177] Here, the communicator 1130, processor 1105, memory 1170, display 1121, and user input device 1110 respectively correspond to Figure 6 The communicator 210, processor 220, memory 230, display 240 and user input device 250, and therefore the same description of them is omitted.

[0178] The sensing unit 1140 may include sensors for sensing the state of the mobile device 1100 or the state around the mobile device 1100. Furthermore, the sensing unit 1140 may transmit the information sensed by the sensors to the processor 1105. The sensing unit 1140 may include at least one of the following, but is not limited to: a magnetic sensor 1141, an accelerometer 1142, a temperature / humidity sensor 1143, an infrared sensor 1144, a position sensor 1146, an atmospheric pressure sensor 1147, a proximity sensor 1148, an RGB sensor 1149, or a gyroscope sensor 1145. The function of each sensor can be intuitively inferred by those skilled in the art based on the sensor's name, and therefore a detailed description is omitted.

[0179] A / V input 1160 is used to input audio or video signals and may include a camera 1161 and a microphone 1162. The camera 1161 can acquire image frames, such as still images or videos, via an image sensor in video call mode or shooting mode. Images captured by the image sensor can be processed by a processor 1105 or a separate image processor (not shown).

[0180] Image frames processed by camera 1161 can be stored in memory 1170 or transmitted externally via communicator 1130. Depending on the architecture of mobile device 1100, camera 1161 may include two or more cameras.

[0181] Microphone 1162 can receive external sound signals and process them into electronic speech data. For example, microphone 1162 can receive sound signals from external devices or speakers. Microphone 1162 can use various noise removal algorithms to remove noise that occurs when an external sound signal is input.

[0182] The output device 1120 is used to output audio signals, video signals or vibration signals, and may include a display 1121, a sound output device 1122 and a vibration motor 1123, etc.

[0183] The sound output device 1122 can output audio data received from the communicator 1130 or stored in the memory 1170. Similarly, the sound output device 1122 can output sound signals related to functions performed in the mobile device 1100 (e.g., call signal reception sound, message reception sound, and notification sound). Furthermore, the sound output device 1122 may include a speaker, a buzzer, etc.

[0184] The communicator 1130 may include a short-range communicator 1151 configured to utilize one or more of a plurality of short-range communication standards. The communicator 1130 may also include a mobile communicator 1152 for mobile-type communications (e.g., cellular) and a broadcast receiver 1153 for receiving broadcast transmissions.

[0185] The vibration motor 1123 (e.g., a haptic motor) can output a vibration signal. For example, the vibration motor 1123 can output a vibration signal corresponding to the output of audio data or video data (e.g., call signal reception sound, message reception sound, etc.). In addition, the vibration motor 1123 can output a vibration signal when a touch is input on the touch screen.

[0186] at the same time, Figure 6 and Figure 11 The block diagrams of mobile devices 200 and 1100 shown are block diagrams of embodiments of this disclosure. Depending on the specifications of the actual implemented mobile devices 200 and 1100, each component of the block diagram may be integrated, added, or omitted. That is, two or more components may be combined into one component, or a component may be subdivided into two or more components as needed. Furthermore, the functions performed in each block are used to describe embodiments of this disclosure, and specific operations or devices do not limit this disclosure.

[0187] Furthermore, at least one of the operations performed by processors 120 and 1010 of in-vehicle electronic devices 100 and 1000 and by processors 220 and 1105 of mobile devices 200 and 1100, according to embodiments of this disclosure, can be performed using artificial intelligence (AI) technology. (Refer to the following...) Figure 12 Describe in detail at least one operation performed using AI technology.

[0188] Figure 12 This is a diagram illustrating operations performed using AI technology according to embodiments of the present disclosure.

[0189] Specifically, the processors 120 and 1010 of the vehicle electronic devices 100 and 1000 may use AI technology that performs calculations through neural networks to perform at least one of the following: i) obtaining environmental information, ii) obtaining vehicle driving status information, iii) obtaining driver status information, or iv) performing control operations based on input information received from mobile devices 200 and 1100.

[0190] Furthermore, the processors 220 and 1105 of the mobile devices 200 and 1100 can use AI technology that performs calculations via neural networks to perform at least one of the following: i) generating a control interface based on environmental information received from the vehicle electronic devices 100 and 1000; ii) generating a control interface based on environmental information and vehicle driving status information received from the vehicle electronic devices 100 and 1000; iii) generating a control interface based on environmental information and driver condition information received from the vehicle electronic devices 100 and 1000; or iv) generating a control interface based on environmental information, vehicle driving status information, and driver condition information received from the vehicle electronic devices 100 and 1000.

[0191] AI technology can perform processing such as analysis and / or classification on input data through neural network-based operations to obtain target results.

[0192] AI technology can be implemented using algorithms. Here, the algorithm or set of algorithms used to implement AI technology can be referred to as a neural network. A neural network can receive input data and perform the operations described above for analysis and / or classification, thereby outputting result data. To ensure that the neural network accurately outputs result data corresponding to the input data, it needs to be trained. Here, "training" can refer to training the neural network to self-discover or learn methods for analyzing multiple input data, classifying multiple input data, and / or extracting features from multiple input data to generate result data. More specifically, through the training process, the neural network can optimize the weight values ​​in the neural network using training data (e.g., multiple different images). The neural network can output the target result by self-learning input data with optimized weight values.

[0193] A neural network can be classified as a deep neural network when it has multiple hidden layers that serve as internal layers for performing operations; that is, when the depth of the neural network performing the operations increases. Examples of AI neural networks can include, but are not limited to, CNNs, deep neural networks (DNNs), RNNs, restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), and deep Q-networks. Neural networks can be segmented. For example, CNNs can be segmented into deep convolutional neural networks (DCNNs), "CapsNet" neural networks (not shown), etc.

[0194] In embodiments of this disclosure, "AI model" can refer to a neural network comprising at least one layer, which is used to receive input data and output a target result. Furthermore, "AI model" can refer to an algorithm or a set of algorithms that performs operations through a neural network and outputs a target result, a processor that executes the algorithm or a set of algorithms, software that executes the algorithm or a set of algorithms, or hardware that executes the algorithm or a set of algorithms.

[0195] refer to Figure 12 The neural network 1210 can be trained by receiving training data as input. The trained neural network 1210 can receive input data 1211 through input terminal 1220, and output terminal 1240 can analyze the input data 1211 to execute the operation of output data 1215 as target data. The operation of the neural network 1210 can be executed by the hidden layer 1230. For convenience, Figure 12 A single hidden layer 1230 is shown, but multiple hidden layers 1230 can be formed.

[0196] Specifically, in embodiments of this disclosure, neural network 1210 can be trained to obtain environmental information of in-vehicle electronic devices 100 and 1000 based on information about functions performed in in-vehicle electronic devices 100 and 1000, screen information output to in-vehicle electronic devices 100 and 1000, etc. Furthermore, in embodiments of this disclosure, neural network 1210 can be trained to obtain driving state information of the vehicle based on information related to vehicle driving. Additionally, in embodiments of this disclosure, neural network 1210 can be trained to obtain driver condition information based on images of the driver, driver gaze information, information related to the driver's health, etc.

[0197] In embodiments of this disclosure, neural network 1210 may be trained to determine appropriate control operations based on user input information received from mobile devices 200 and 1100.

[0198] In embodiments of this disclosure, a neural network 1210 may be implemented within processors 120 and 1010 of in-vehicle electronic devices 100 and 1000. This neural network performs at least one of i) obtaining environmental information, ii) obtaining vehicle driving state information, iii) obtaining driver condition information, or iv) performing control operations based on input information received from the aforementioned mobile devices 200 and 1100. Alternatively, the neural network 1210 performing at least one of i) obtaining environmental information, ii) obtaining vehicle driving state information, iii) obtaining driver condition information, or iv) performing control operations based on input information received from the mobile devices 200 and 1100 may be separate from the in-vehicle electronic devices 100 and 1000 and may be implemented within a separate electronic device (not shown) or processor (not shown) located in the vehicle.

[0199] The operation using the neural network 1210 described above can be performed by a server (not shown) capable of communicating with the vehicle electronic devices 100 and 1000 according to embodiments of the present disclosure via a wireless communication network. (Refer to...) Figure 13 and Figure 14 Describes the communication between electronic devices 100 and 1000 and a server (not shown).

[0200] Furthermore, in embodiments of this disclosure, the neural network 1210 can be trained to generate a control interface based on environmental information received from the vehicle electronic devices 100 and 1000. Furthermore, in embodiments of this disclosure, the neural network 1210 can be trained to generate a control interface based on vehicle environmental information and driving state information received from the vehicle electronic devices 100 and 1000. Furthermore, in embodiments of this disclosure, the neural network 1210 can be trained to generate a control interface based on environmental information and driver condition information received from the vehicle electronic devices 100 and 1000. Furthermore, in embodiments of this disclosure, the neural network 1210 can be trained to generate a control interface based on environmental information, vehicle driving state information, and driver condition information received from the vehicle electronic devices 100 and 1000.

[0201] In embodiments of this disclosure, a neural network 1210 may be implemented within processors 220 and 1105 of mobile devices 200 and 1100. This neural network performs at least one of the following: i) generating a control interface based on environmental information received from vehicle electronic devices 100 and 1000; ii) generating a control interface based on environmental information and vehicle driving status information received from vehicle electronic devices 100 and 1000; iii) generating a control interface based on environmental information and driver condition information received from vehicle electronic devices 100 and 1000; or iv) generating a control interface based on the aforementioned environmental information, vehicle driving status information, and driver condition information received from vehicle electronic devices 100 and 1000. Optionally, the neural network 1210 can be implemented in an electronic device (not shown) separate from the mobile devices 200 and 1100 or the processor (not shown). This neural network performs at least one of the following: i) generating a control interface based on environmental information received from the vehicle electronic devices 100 and 1000; ii) generating a control interface based on environmental information received from the vehicle electronic devices 100 and 1000 and the vehicle's driving state information; iii) generating a control interface based on environmental information received from the vehicle electronic devices 100 and 1000 and the driver's condition information; or iv) generating a control interface based on the environmental information received from the vehicle electronic devices 100 and 1000, the vehicle's driving state information, and the driver's condition information.

[0202] The operation using the neural network 1210 described above can be performed by a server (not shown) capable of communicating with mobile devices 200 and 1100 according to embodiments of this disclosure via a wireless communication network. (Refer to...) Figure 15 Describes the communication between mobile devices 200 and 1100 and a server (not shown).

[0203] Figure 13 This is a diagram illustrating in-vehicle electronic devices 100 and 1000 operating together with server 1300 according to an embodiment of this disclosure.

[0204] Server 1300 may include servers, server systems, server-based devices, etc., which send data to and receive data from vehicle electronic devices 100 and 1000 via communication network 1301 for data processing.

[0205] In embodiments of this disclosure, server 1300 may include a communicator for communicating with in-vehicle electronic devices 100 and 1000 installed inside vehicle 1400, and a processor for executing at least one instruction.

[0206] Server 1300 can receive information about the functions performed in the vehicle electronic devices 100 and 1000, and output screen information to the vehicle electronic devices 100 and 1000. Furthermore, server 1300 can receive driving-related information about the vehicle 1400 from the vehicle sensor module. Additionally, server 1300 can receive images of the driver, driver gaze information, and driver health-related information.

[0207] Server 1300 can train an AI model and store the trained AI model. Server 1300 can use the trained AI model and the received information to perform at least one of i) obtaining environmental information, ii) obtaining driving status information of vehicle 1400, or iii) obtaining driver status information.

[0208] In addition, server 1300 can control the communicator to send at least one of the acquired environmental information, driving status information of vehicle 1400, or driver status information to vehicle electronic devices 100 and 1000.

[0209] Typically, compared to server 1300, vehicle-mounted electronic devices 100 and 1000 may have limited memory storage capacity, processing speed, and training dataset collection capabilities. Therefore, operations utilizing large-scale data storage and computation can be performed in server 1300, and the data and / or AI models can then be sent to vehicle-mounted electronic devices 100 and 1000 via a communication network. Vehicle-mounted electronic devices 100 and 1000 can then receive and use the data and / or AI data through server 1300 without requiring a processor with large storage capacity and high processing speed, thus enabling rapid and easy operation.

[0210] Figure 14 This is a detailed explanation. Figure 13 The image.

[0211] Usage and Reference Figure 5 The same situation as the described vehicle-mounted electronic device 100 is used as an example to describe and illustrate. Figure 14 100 in-vehicle electronic devices.

[0212] refer to Figure 14 Server 1300 may include communicator 1310, processor 1320 and database (DB) 1330.

[0213] The communicator 1310 may include one or more components capable of communicating with the vehicle-mounted electronic device 100. The communicator 1310 may include at least one communication module, such as a short-range communication module, a wired communication module, a mobile communication module, a broadcast receiver module, etc. Here, at least one communication module may refer to a tuner performing broadcast reception or a communication module capable of performing data transmission / reception via a network conforming to communication standards (such as Bluetooth, Wireless Local Area Network (WLAN), Wireless Fidelity (WiFi), Wireless Broadband (WiBro), Microwave Access Global Interoperability (WiMax), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA), the Internet, 3G, 4G, 5G, and / or communication schemes using millimeter wave (mmWave)).

[0214] For example, the communicator 1310 can rapidly send and receive large amounts of data by using millimeter waves (mmWave). Specifically, the vehicle can rapidly receive large amounts of data, thereby quickly providing data to enhance the vehicle's operational safety (e.g., data for autonomous driving, data for navigation services, etc.) and user-generated content (e.g., movies, music, etc.), thereby improving vehicle safety and / or user convenience.

[0215] The mobile communication module included in the communicator 1310 can communicate with another device (e.g., a server not shown) located at a distance via a communication network conforming to communication standards such as 3G, 4G, and / or 5G. Here, the communication module communicating with a server (not shown) located at a distance can be referred to as a "remote communication module".

[0216] Processor 1320 can control the overall operation of server 1300. For example, processor 1320 can perform operations by executing at least one instruction or program of server 1300.

[0217] Database 1330 may include memory (not shown) that may store at least one of at least one of the following: instructions, programs, or data used by server 1300 when performing a specific operation. Database 1330 may store data used by server 1300 when performing operations according to a neural network.

[0218] In embodiments of this disclosure, server 1300 may store references Figure 12 The neural network 1210 is described. The neural network 1210 can be stored in at least one of the processor 1105 or the database 1330. The neural network 1210 included in the server 1300 can be a neural network that has already been trained thereon.

[0219] Server 1300 can send its trained neural network to communicator 110 of vehicle electronic device 100 via communicator 1310. Then, vehicle electronic device 100 can obtain and store the trained neural network and obtain the target output data through the neural network.

[0220] Figure 15 This is a diagram illustrating the operation of a mobile device 200 together with a server 1500 according to an embodiment of this disclosure.

[0221] Usage and Reference Figure 6 The same situation as described in the mobile device 200 is used as an example to describe and illustrate. Figure 15 Mobile devices 200.

[0222] Server 1500 may include servers, server systems, server-based devices, etc., which send data to and receive data from mobile device 200 via a communication network to process the data.

[0223] In embodiments of this disclosure, server 1500 may include communicator 1510, processor 1520, and database (DB) 1530.

[0224] The communicator 1510 may include one or more components capable of communicating with the mobile device 200. The specific configuration of the communicator 1510 is related to... Figure 14 The configuration of the communicator 1310 is the same, so its detailed description is omitted.

[0225] According to an embodiment of the present disclosure, the communicator 1510 can receive at least one of environmental information of an in-vehicle electronic device, driving status information of the vehicle, or driver status information from the mobile device 200.

[0226] Processor 1520 can typically control the operation of server 1500. For example, processor 1520 can perform operations by executing at least one instruction or program of server 1500.

[0227] Database 1530 may include memory (not shown) that may store at least one of at least one instruction, program, or data used by server 1500 to perform a specific operation. Database 1530 may store data used by server 1500 to perform operations based on a neural network.

[0228] In embodiments of this disclosure, server 1500 may store references Figure 12 The neural network 1210 is described. The neural network 1210 can be stored in at least one of the processor 1520 or the database 1530. The neural network 1210 included in the server 1500 can be a neural network that has already been trained thereon.

[0229] The processor 1520 can use an AI model, including a neural network that has been trained and received information, to generate a control interface. Furthermore, the processor 1520 can control the communicator 1510 to send information about the generated control interface to the mobile device 200.

[0230] Server 1500 can send the trained neural network on its device to communicator 210 of mobile device 200 via communicator 1510. Then, mobile device 200 can obtain and store the trained neural network on its device and obtain the target output data through the neural network.

[0231] Typically, compared to server 1500, mobile device 200 may have limited storage capacity, processing speed, and training dataset collection capabilities. Therefore, operations utilizing large-scale data storage and computation can be performed on server 1500, and the necessary data and / or AI models can then be sent to mobile device 200 via a communication network. Mobile device 200 can then receive and use the data and / or AI data from server 1500 without requiring a processor with large storage capacity and high processing speed, thus enabling quick and easy operation.

[0232] According to embodiments of this disclosure, a method for controlling in-vehicle electronic devices using a mobile device can be implemented as program commands executable by various computer devices and can be recorded on a computer-readable medium. The computer-readable recording medium may include program commands, data files, and data structures, individually or in combination. The program commands recorded on the computer-readable recording medium may be specifically designed and configured for this disclosure, or may be known and usable by one of ordinary skill in the art of computer software. Examples of computer-readable recording media include: magnetic media, such as hard disks, floppy disks, or magnetic tapes; optical media, such as optical disc read-only memory (CD-ROM) or digital versatile disc (DVD); magneto-optical media, such as optical floppy disks; and hardware devices specifically configured to store and execute program commands, such as ROM, RAM, or flash memory. Examples of program commands include high-level language code executable by a computer using an interpreter, and machine language code generated by a compiler.

[0233] Furthermore, a method of operating an electronic device according to a disclosed embodiment of this disclosure can be provided in a computer program product. The computer program product is a product that is available for purchase between a seller and a buyer.

[0234] Computer program products may include a service program and a computer-readable storage medium storing the service program thereon. For example, a computer program product may be delivered to a manufacturer or electronic marketplace (e.g., Google Play) via a broadcast receiver. TM Software programs (e.g., downloadable applications) distributed electronically via a marketplace (e.g., an online store or App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily generated. In this case, the storage medium may be the manufacturer's server, the marketplace's server, or the storage medium of a relay server temporarily storing the software program.

[0235] In a system including server and client devices, the computer program product may include the storage media of the server or the storage media of the client device. Alternatively, when a third device (e.g., a smartphone) communicates with the server or client device, the computer program product may include the storage media of the third device. Alternatively, the computer program product may include the software program itself transferred from the server to the client device or the third device, or from the third device to the client device.

[0236] In this scenario, one of the server, client device, and third device may execute the method according to embodiments of this disclosure by executing a computer program product. Optionally, at least two of the server, client device, and third device may execute the method according to disclosed embodiments of this disclosure in a distributed manner by executing a computer program product.

[0237] For example, a server (e.g., a cloud server or an AI server) can execute computer program products stored on the server and can control client devices communicating with the server to perform methods according to the disclosed embodiments of this disclosure.

[0238] While embodiments of the present disclosure have been described in detail above, the scope of the present disclosure is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concepts of the present disclosure as defined by the claims are also within the scope of the present disclosure.

Claims

1. A mobile device for controlling in-vehicle electronic equipment, the mobile device comprising: A communicator configured to communicate with the vehicle-mounted electronic equipment; monitor; Memory, which stores one or more instructions; as well as processor, The one or more instructions wherein the processor may execute to cause the mobile device to: The communicator is controlled to receive environmental information and driving status information of the vehicle-mounted electronic device from the vehicle-mounted electronic device, wherein the environmental information includes information about the functions currently being performed in the vehicle-mounted electronic device, and wherein the driving status information includes information indicating whether the vehicle is moving. Based on the received environmental information, one or more control functions are identified that are associated with the function currently being performed in the on-board electronic device. Based on the received environmental information, a control interface is generated using a neural network to provide the identified control functions and control the on-board electronic equipment. Based on the received driving status information, when the vehicle is stationary, a first control interface of multiple control interfaces is selected; or when the vehicle is moving, a second control interface of the multiple control interfaces is selected. The first control interface is configured to receive a first type of user input, and the second control interface is configured to receive a second type of user input different from the first type. Control the display to output the selected control interface. The one or more instructions wherein said instructions may be executed by the processor to: Receive information about the driver's condition while operating the vehicle from the onboard electronic equipment. The second control interface transforms into a third or fourth control interface based on the received driver status information, and The number of control functions and the size of the icons representing those functions in the fourth control interface differ from those in the second control interface. The neural network is trained to generate multiple control interfaces for remotely controlling functions performed by the on-board electronic devices that correspond to the environmental information.

2. The mobile device according to claim 1, The environmental information of the in-vehicle electronic device includes information about the control functions available within the functions being performed. The driving status information of the vehicle includes the vehicle's current speed.

3. The mobile device of claim 2, wherein one or more instructions are executable by the processor to: Based on the received environmental information, select one or more control functions that can be received by input, and At least some of the selected control functions are included in the generated control interface.

4. The mobile device according to claim 2, wherein controlling the display to output the control interface further includes: This includes a smaller number of control functions in the second control interface compared to the number of control functions included in the first control interface.

5. The mobile device of claim 1, further comprising an input / output circuit configured to receive user input regarding the control interface as input information. The input information is transmitted to the vehicle-mounted electronic device via the communicator.

6. The mobile device according to claim 1, wherein, When the status information indicates a situation requiring attention, the third control interface is generated, and When the status information indicates a dangerous situation, the fourth control interface is generated. This includes the fact that the icons in the fourth control interface are larger than the icons in the third control interface.

7. The mobile device of claim 1, wherein the one or more instructions are executable by the processor to: Based on the received driver status information, output at least one of sound, vibration, or notification message.

8. A method for controlling an in-vehicle electronic device using a mobile device, the method comprising: The vehicle receives environmental information and driving status information of the vehicle electronic device via a communication circuit, wherein the environmental information includes information about the function currently being performed in the vehicle electronic device, and wherein the driving status information includes information indicating whether the vehicle is moving. Based on the received environmental information, one or more control functions are identified that are associated with the function currently being performed in the vehicle-mounted electronic device; Based on the vehicle's environmental information, the processor generates multiple control interfaces using a neural network to provide the identified control functions and control the on-board electronic devices. Based on the received driving status information, when the vehicle is not moving, a first control interface of the plurality of control interfaces is selected, or when the vehicle is moving, a second control interface of the plurality of control interfaces is selected, wherein the first control interface is configured to receive a first type of user input, and the second control interface is configured to receive a second type of user input that is different from the first type. as well as The selected control interface will be displayed on the monitor. The method further includes: Receive information about the driver's condition while operating the vehicle from the onboard electronic equipment. The second control interface transforms into a third or fourth control interface based on the received driver status information, and The number of control functions and the size of the icons representing those functions differ in the fourth control interface from those in the second control interface. The neural network is trained to generate the plurality of control interfaces for remotely controlling functions performed by the on-board electronic equipment corresponding to the environmental information.

9. The method of claim 8, wherein the environmental information of the on-board electronic device includes information about the control functions available within the performed function. The driving status information of the vehicle includes the vehicle's current speed.

10. The method of claim 9, wherein generating the control interface further comprises: Based on the received environmental information, select one or more acceptable control functions for input. At least some of the selected control functions are included in the selected control interface.

Images