Wearable electronic device for displaying virtual object, and operating method thereof

Abstract

A wearable electronic device according to one embodiment comprises a camera, a display, a communication circuit and a processor, wherein the processor can form, through the communication circuit, a communication connection with a control device included in a vehicle, checks, through the camera, the state of a user having boarded the vehicle, check the traveling state of the vehicle, determine, on the basis of the state of the user and / or the traveling state, one or more regions for checking gestures of the user, and execute, on the basis of checking the first gesture of the user in the one or more regions, a first function corresponding to a first gesture from among one or more functions. Other various embodiments are possible.

Description

Wearable electronic device for displaying virtual objects, and method for operating the same

[0001] The present disclosure relates to a wearable electronic device for displaying a virtual object and a method of operating the same.

[0002] Wearable electronic devices, such as extended reality (XR) devices, including augmented reality glasses (AR glasses), virtual reality (VR) devices, video see-through (VST) devices, and head-mounted displays (HMDs), are increasingly providing diverse services and additional features. To enhance the utility of these devices and satisfy the needs of diverse users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices that offer diverse features and differentiate themselves from competitors. Consequently, the various functions offered by wearable electronic devices are also becoming increasingly sophisticated.

[0003] AR glasses or VST devices can provide users with a realistic experience by displaying virtual images while worn on the user's body. AR glasses or VST (video see-through) devices can replace smartphones in various fields, such as gaming, entertainment, education, and social networking services (SNS). Through AR glasses or VST (video see-through) devices, users can receive realistic content and, through interaction, experience the sensation of being immersed in a virtual world.

[0004] The above information is provided solely as background information to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] According to one embodiment, a wearable electronic device may include a camera, a display, communication circuitry, and a processor.

[0006] According to one embodiment, the wearable electronic device can form a communication connection with a control device included in the automobile through the communication circuit.

[0007] According to one embodiment, the wearable electronic device can check the status of a user riding in the vehicle through the camera.

[0008] According to one embodiment, the wearable electronic device can check the driving status of the vehicle.

[0009] According to one embodiment, the wearable electronic device may determine at least one area for confirming a gesture of the user based on at least one of a state of the user riding in the vehicle or the driving state.

[0010] According to one embodiment, the wearable electronic device can execute a first function corresponding to the first gesture among at least one function based on identifying a first gesture of the user in the at least one area.

[0011] According to one embodiment, a method of operating a wearable electronic device may include forming a communication connection with a control device included in a vehicle.

[0012] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking a status of a user riding in the vehicle through a camera of the wearable electronic device.

[0013] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking a driving state of the vehicle.

[0014] According to one embodiment, a method of operating a wearable electronic device may include an operation of determining at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state.

[0015] According to one embodiment, a method of operating a wearable electronic device may include an operation of executing a first function corresponding to the first gesture among at least one function based on identifying a first gesture of the user in the at least one area.

[0016] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0017] FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0018] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0019] FIG. 4 is a schematic block diagram of a system including a wearable electronic device and a control device according to one embodiment.

[0020] FIG. 5 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to execute a function corresponding to a user's gesture.

[0021] FIG. 6A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object when it is determined that one of a user's hands is in contact with a handle.

[0022] FIG. 6B is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object when it is determined that both hands of a user are in contact with the handle.

[0023] FIG. 6c is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object based on a driving state of a vehicle when it is determined that one of the user's hands is in contact with the steering wheel.

[0024] FIG. 7 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of at least one area based on the driving state of a vehicle.

[0025] FIG. 8 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object in an area adjacent to an armrest.

[0026] FIG. 9A is a flowchart illustrating an operation of determining an area for displaying information related to a vehicle when a wearable electronic device according to one embodiment is set to an autonomous mode.

[0027] FIG. 9b is a flowchart illustrating an operation for determining the size of an area for displaying information related to a vehicle when a wearable electronic device according to one embodiment is set to an autonomous mode.

[0028] FIG. 10A is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to determine at least one virtual object corresponding to at least one area.

[0029] FIG. 10b is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to determine at least one area for confirming a user's gesture.

[0030] FIG. 11 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display at least one object.

[0031] FIG. 12A and FIG. 12B are diagrams illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of at least one area based on the driving speed of a vehicle.

[0032] FIG. 13A and FIG. 13B are drawings for explaining an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of at least one area based on a rotation angle of a handle.

[0033] FIG. 14 is a diagram for explaining an operation of a wearable electronic device according to one embodiment to determine at least one area.

[0034] FIG. 15A and FIG. 15B are drawings for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display at least one object.

[0035] FIG. 16A is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to determine at least one area when a control device is set to an autonomous driving mode of a vehicle.

[0036] FIG. 16b is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information related to a vehicle when a control device is set to a second stage autonomous driving mode of the vehicle.

[0037] FIG. 16c is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information related to a vehicle when a control device is set to a third stage autonomous driving mode of the vehicle.

[0038] The same reference numbers may be used throughout the drawings to indicate the same components.

[0039] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0040] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0041] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0042] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, generative adversarial networks (GAN), a transformer, or a combination of two or more of the above, but is not limited to the examples described above. In addition to or as an alternative to a hardware structure, the artificial neural network may include a software structure. Depending on the implementation, the artificial neural network may further include at least one of a transformer or a generative adversarial network (GAN).

[0043] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0044] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0045] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0046] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0047] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0048] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0049] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0050] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0051] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0052] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0053] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0054] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0055] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0056] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0057] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0058] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0059] In one embodiment, the antenna module (197) may generate a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0060] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0061] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, or 104) or the server (108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0062] FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0063] Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).

[0064] According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image, and a lens for guiding the image to the display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0065] According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may be propagated inside the optical waveguide and provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide an output image of the optical output module (211) to a user's eye by using at least one diffractive element or reflective element.

[0066] According to one embodiment of the present disclosure, the camera module (250) can capture still images and / or moving images. According to one embodiment, the camera module (250) is disposed within a lens frame and can be disposed around the display member (201).

[0067] According to one embodiment of the present disclosure, the first camera module (251) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or aperiodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

[0068] According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.

[0069] According to one embodiment of the present disclosure, the third camera module (255) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. According to one embodiment of the present disclosure, the third camera module (255) can be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, the second camera module (253) can also be used for hand detection and tracking, and user gesture recognition. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) can be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module can include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0070] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0071] Referring to FIGS. 3A and 3B, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or depth sensors (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on the first surface (310) of the housing.

[0072] In one embodiment, the camera modules (311, 312) can acquire images related to the environment surrounding the wearable electronic device.

[0073] In one embodiment, the camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. The camera modules (313, 314, 315, 316) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. The camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the camera modules (311, 312) can also be used for hand detection and tracking, and user gesture.

[0074] In one embodiment, a depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (217), the camera modules (313, 314, 315, 316) may determine the distance to an object.

[0075] According to one embodiment, a camera module (325, 326) for facial recognition and / or a display (321) (and / or a lens) may be disposed on the second side (320) of the housing.

[0076] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0077] In one embodiment, the display (321) (and / or lens) may be disposed on the second side (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among the plurality of camera modules (313, 314, 315, 316). Although not illustrated in FIGS. 3A and 3B , the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2 .

[0078] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured to a body part of the user. The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0079] FIG. 4 is a schematic block diagram of a system including a wearable electronic device and a control device according to one embodiment.

[0080] Referring to FIG. 4, according to one embodiment, a system (400) may include a wearable electronic device (401) and an automobile (500).

[0081] According to one embodiment, a wearable electronic device (401) may include a camera (410), a processor (420), a memory (480), a display (460), and a communication circuit (490). According to one embodiment, a vehicle (500) may include a control device (501) that executes a function related to the vehicle (500).

[0082] According to one embodiment, the wearable electronic device (401) may be implemented in a manner identical to or similar to the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the wearable electronic device (300) of FIGS. 3A and 3B. According to one embodiment, the wearable electronic device (401) may be implemented as an augmented reality (AR) glass or a video see-through (VST) device. However, this is merely an example, and embodiments of the present invention may be implemented as various devices.

[0083] According to one embodiment, the processor (420) can control the overall operation of the wearable electronic device (401). For example, the processor (420) can be implemented in the same or similar manner as the processor (120) of FIG. 1.

[0084] According to one embodiment, the processor (420) can communicate with the control device (501) via a communication circuit (490).

[0085] According to one embodiment, the processor (420) can use the camera (410) to determine the location of the user within the vehicle (500) in which the user is riding. According to one embodiment, the processor (420) can use ultra-wide band (UWB) technology between the wearable electronic device (401) and the control device (501) of the vehicle (500) to determine the location of the user within the vehicle (500). According to one embodiment, the processor (420) can use ultra-wide band (UWB) technology between the wearable electronic device (401) and an external electronic device to determine the location of the user within the vehicle (500). For example, the external electronic device may include a smartphone or a tablet PC. However, this is only an example, and embodiments of the present invention can determine the location of the user in various ways.

[0086] In one embodiment, if the processor (420) determines that the user is positioned in the driver's seat, the processor (420) can identify the positions of the user's hands or one of their hands and the position of the steering wheel of the vehicle (500). In one embodiment, if the processor (420) determines that the user is positioned in a seat other than the driver's seat, the processor (420) can identify the positions of the user's hands or one of their hands and the position of the armrest of the vehicle (500).

[0087] According to one embodiment, the processor (420) may obtain an image using the camera (410). According to one embodiment, the processor (420) may obtain depth information from the image using a sensor (not shown) (e.g., the depth sensor (317) of FIG. 3A). According to one embodiment, the processor (420) may determine the position of the user's hands or one of their hands, the position of the steering wheel of the vehicle (500), and / or the position of the armrest of the vehicle (500) based on the depth information. According to one embodiment, the processor (420) may also obtain an image using a camera included in the vehicle (500). According to one embodiment, the processor (420) may obtain an image obtained by a camera included in the vehicle (500) from the control device (501). According to one embodiment, the processor (420) may determine the positions of the user's both hands or one hand, the position of the steering wheel of the vehicle (500), and / or the position of the armrest of the vehicle (500) based on depth information of an image acquired by a camera included in the vehicle (500). According to one embodiment, the processor (420) may also obtain sensing information acquired by at least one sensor included in the vehicle (500) from the control device (501). According to one embodiment, the processor (420) may determine the positions of the user's both hands or one hand, the position of the steering wheel of the vehicle (500), and / or the position of the armrest of the vehicle (500) based on the sensing information. For example, the control device (501) may transmit sensing information sensed by a sensor included in the vehicle (500) to the wearable electronic device (401). For example, at least one sensor included in the automobile (500) may include a motion sensor included in the automobile (500) and / or a touch sensor. For example, the touch sensor may include a touch sensor included in the steering wheel of the automobile (500). However, this is merely an example, and the at least one sensor is not limited thereto and may include various sensors.

[0088] According to one embodiment, the processor (420) can check the state of a user riding in a vehicle (500). For example, the state of the user may mean that both or one of the user's hands are in proximity (e.g., in contact) with the steering wheel or armrest of the vehicle (500). According to one embodiment, the state in which both or one of the user's hands are in proximity to the steering wheel or armrest of the vehicle (500) may indicate a state in which both or one of the user's hands are separated from the steering wheel or armrest of the vehicle (500) by a specified distance. For example, the specified distance may be set by the user or automatically set by the processor (420). According to one embodiment, the state in which both or one of the user's hands are in proximity to the steering wheel or armrest of the vehicle (500) may indicate a state in which both or one of the user's hands are in contact with the steering wheel or armrest of the vehicle (500).

[0089] In one embodiment, the processor (420) may display a setting screen that sets at least one area for confirming a user's gesture based on determining that both or one of the user's hands is in proximity to at least one of a plurality of parts of the steering wheel of the vehicle (500) or is in proximity to an armrest. For example, the at least one area may include an area proximate to the steering wheel of the vehicle (500).

[0090] According to one embodiment, the processor (420) may determine at least one area for confirming the user's gesture based on a user input that sets at least one area for confirming the user's gesture. However, this is merely an example, and the at least one area for confirming the user's gesture may be automatically set by the processor (420).

[0091] According to one embodiment, the processor (420) can change the size or position of at least one area for confirming the user's gesture based on the driving state of the vehicle (500) and the user's gaze.

[0092] According to one embodiment, the processor (420) can detect the user's gaze. According to one embodiment, the processor (420) can determine at least one area for detecting at least one user gesture based on the user's gaze. For example, if the user's hand is close to the steering wheel of the car (500) and the user's gaze is directed toward the steering wheel of the car (500), the processor (420) can determine at least one area for detecting the user's gesture with a first size (or area). For example, the first size may represent a size set by the user on a setting screen. For example, if the user's hand is close to the steering wheel of the car (500) and the user's gaze is directed toward an area other than the steering wheel of the car (500), the processor (420) can determine at least one area for detecting the user's gesture with a size (or area) different from the first size. For example, if the user's hand is close to the steering wheel of the car (500) and the user's gaze is directed toward an area other than the steering wheel of the car (500), the processor (420) can change the location of at least one area for detecting the user's gesture. For example, the processor (420) can change the location of at least one area for confirming the user's gesture from a location set by the user through a setting screen to a location where the user's gaze is directed.

[0093] For example, when the user's hand is close to the armrest of the car (500) and the user's gaze is directed toward the armrest of the car (500), the processor (420) may determine at least one area for confirming the user's gesture with a first size (or area). For example, when the user's hand is close to the armrest of the car (500) and the user's gaze is directed toward an area other than the armrest of the car (500), the processor (420) may change the location of at least one area for confirming the user's gesture. For example, the processor (420) may change the location of at least one area for confirming the user's gesture to a location toward which the user's gaze is directed.

[0094] According to one embodiment, the processor (420) may display at least one virtual object. For example, the processor (420) may display the virtual object in at least one area set as an area for confirming at least one user gesture or in an area adjacent to the at least one area. The processor (420) may also display the virtual object in an area different from the at least one area.

[0095] According to one embodiment, at least one virtual object may include at least one virtual object related to the automobile (500). For example, the at least one virtual object may include at least one of an object related to a function of turning on a turn signal of the automobile (500), an object related to a function of turning on an emergency light, an object related to a function of forming a short-range communication connection between the control device (501) and an external electronic device, or an object related to a function of displaying an image captured by a camera included in the automobile (500) and an external environment of the automobile (500). For example, the image captured by a camera included in the automobile (500) may be obtained from the control device (501). However, this is an example, and embodiments of the present invention may include objects related to various functions.

[0096] According to one embodiment, at least one object may include at least one virtual object for controlling the wearable electronic device (401). For example, the at least one virtual object may include at least one of an object related to a function of executing a call application of the wearable electronic device (401), an object related to a function of executing a music application of the wearable electronic device (401), an object related to a function of playing content (e.g., a video) stored in the wearable electronic device (401), or an object related to a function of forming a short-range communication connection between the wearable electronic device (401) and an external electronic device.

[0097] According to one embodiment, at least one virtual object may be displayed in at least one area designated by the processor (420). According to one embodiment, the processor (420) may display an object related to a function of turning on a left turn signal in an area adjacent to a left portion of the steering wheel of the automobile (500). For example, the processor (420) may display an object related to a function of turning on a right turn signal in an area adjacent to a right portion of the steering wheel. According to one embodiment, the processor (420) may display an object related to a function of executing a music application of the wearable electronic device (401) in an area adjacent to an upper portion of the steering wheel. According to one embodiment, the processor (420) may display an object related to a function of executing a call application of the wearable electronic device (401) in an area adjacent to a lower portion of the steering wheel. According to one embodiment, the processor (420) may display an object related to a function of displaying content in an area adjacent to an armrest.

[0098] According to one embodiment, at least one virtual object may be displayed in at least one area designated by a user's input. According to one embodiment, when an input for at least one virtual object among the plurality of virtual objects is confirmed, the processor (420) may set the at least one virtual object as a virtual object designated for one of the plurality of parts of the handle. According to one embodiment, the processor (420) may change the virtual object designated for one of the plurality of parts of the handle based on an input for changing the virtual object designated for one of the plurality of parts of the handle. According to one embodiment, the processor (420) may display the plurality of virtual objects in an area adjacent to the armrest. According to one embodiment, when an input for at least one virtual object among the plurality of virtual objects is confirmed, the processor (420) may set the at least one virtual object as a virtual object designated for the armrest. According to one embodiment, the processor (420) may change a virtual object assigned to one of a plurality of portions of the handle based on an input for changing a virtual object assigned to the armrest. According to one embodiment, the processor (420) may display at least one designated virtual object when it is determined that both hands of the user are in proximity to (e.g., in contact with) the handle. According to one embodiment, the processor (420) may display at least one first virtual object in an area adjacent to a first portion of the handle to which one hand of the user is in proximity to (e.g., in contact with) the handle, and may display at least one second virtual object in an area adjacent to a second portion of the handle to which the other hand of the user is in proximity to (e.g., in contact with). The first at least one virtual object may include a virtual object assigned to the first portion of the handle. The second at least one virtual object may include a virtual object assigned to the second portion of the handle.

[0099] In one embodiment, the processor (420) may not display at least one virtual object if it is determined that one of the user's hands is in proximity to (e.g., contacting) the handle and the other hand is not in proximity to (e.g., contacting) the handle. In one embodiment, the processor (420) may display at least one virtual object if it is determined that one of the user's hands is in proximity to (e.g., contacting) the armrest.

[0100] According to one embodiment, the processor (420) may determine whether the vehicle (500) is driving if it is determined that one of the user's hands is in proximity to (e.g., in contact with) the steering wheel and the other hand is not in proximity to (e.g., in contact with) the steering wheel. According to one embodiment, the processor (420) may not display at least one virtual object if it is determined that the vehicle (500) is in motion. According to one embodiment, the processor (420) may display at least one virtual object if it is determined that the vehicle (500) is not in motion. According to one embodiment, the processor (420) may display at least one virtual object in an area adjacent to a portion of the steering wheel to which one of the user's hands is in proximity to (e.g., in contact with).

[0101] According to one embodiment, the processor (420) may determine whether the vehicle (500) is parked if it is determined that one of the user's hands is in proximity to (e.g., in contact with) the steering wheel and the other hand is not in proximity to (e.g., in contact with) the steering wheel. According to one embodiment, the processor (420) may display at least one virtual object if it is determined that the vehicle (500) is in a parked state. According to one embodiment, the processor (420) may display at least one virtual object if it is determined that the vehicle (500) is not in a parked state. According to one embodiment, the processor (420) may display at least one virtual object in an area adjacent to a portion of the steering wheel to which one of the user's hands is in proximity to (e.g., in contact with) the steering wheel.

[0102] In one embodiment, the processor (420) can determine the driving speed of the vehicle if it is determined that one of the user's hands is in proximity (e.g., contacting) with the steering wheel and the other hand is not in proximity (e.g., contacting) with the steering wheel. For example, the driving speed can be obtained from the control device (501).

[0103] According to one embodiment, if the driving speed of the vehicle (500) is determined to be greater than the first specified speed, the processor (420) may not display at least one virtual object (e.g., an object related to a function of displaying content). According to one embodiment, if the driving speed of the vehicle (500) is determined to be less than the first specified speed, the processor (420) may display at least one virtual object (e.g., an object related to a function of displaying content). According to one embodiment, the processor (420) may display at least one virtual object (e.g., an object related to a function of displaying content) in an area adjacent to a portion of the steering wheel that one of the user's hands is in contact with. For example, the first specified speed may mean 30 km / h. However, this is an example, and the magnitude of the first specified speed may not be limited to the above example. For example, the first specified speed may be automatically set by the wearable electronic device (401) or may be set by the user. For example, the first designated speed may refer to a driving speed of the vehicle for determining whether to display at least one virtual object when one of the user's hands is close to (e.g., in contact with) the steering wheel and the other hand is not close to (e.g., in contact with) the steering wheel. According to one embodiment, the processor (420) may adjust the size of at least one virtual object based on the driving state of the vehicle (500). For example, the processor (420) may set the ratio for adjusting the size of at least one area for confirming the user's gesture to be the same as the ratio for adjusting the size of at least one object. Through this, the processor (420) may reduce the size of the displayed virtual object when the driving speed of the vehicle (500) or the rotation angle of the steering wheel is large, thereby providing the user with an environment in which to focus on driving the vehicle.

[0104] According to one embodiment, the processor (420) may adjust the display position of at least one virtual object based on the driving state of the vehicle (500). According to one embodiment, when it is determined that the vehicle (500) is driving, the processor (420) may adjust the display position of at least one virtual object displayed when the vehicle (500) is driving from a first display position of the virtual object when the vehicle (500) is not driving to a second display position. For example, the second display position may be a position further from the steering wheel or the position of the user's hand than the first display position. Depending on the implementation, the second display position may be a position closer from the steering wheel or the position of the user's hand than the first display position. For example, the at least one virtual object may be displayed by being fixed to a specific position (e.g., a windshield portion of the vehicle (500).

[0105] According to one embodiment, the processor (420) may adjust the display position of at least one virtual object based on the rotation angle of the steering wheel of the automobile (500). For example, the processor (420) may display at least one virtual object at a greater distance from the position of the user's hand or the position of the steering wheel of the automobile (500) as the rotation angle of the steering wheel of the automobile (500) increases.

[0106] In one embodiment, the processor (420) may display at least one virtual object at a location specified by the driving speed of the vehicle (500). For example, the processor (420) may display at least one virtual object at a further distance from the location of the user's hand or the location of the steering wheel of the vehicle (500) as the driving speed of the vehicle (500) increases.

[0107] According to one embodiment, the processor (420) may adjust the size of at least one virtual object based on the driving state of the vehicle (500). According to one embodiment, when it is determined that the vehicle (500) is driving, the processor (420) may adjust the size of at least one virtual object to a second size smaller than the first size of the virtual object when the vehicle (500) is not driving and display the adjusted size.

[0108] According to one embodiment, the processor (420) may adjust the size of at least one virtual object based on the driving speed of the vehicle (500). According to one embodiment, the processor (420) may adjust the size of at least one virtual object based on the rotation angle of the steering wheel of the vehicle (500). For example, the processor (420) may adjust the size of at least one virtual object to be displayed smaller as the driving speed of the vehicle (500) increases. For example, the processor (420) may adjust the size of at least one virtual object to be displayed smaller as the rotation angle of the steering wheel of the vehicle (500) increases.

[0109] In one embodiment, the processor (420) may not display at least a portion of at least one virtual object designated for the steering wheel based on the driving condition of the vehicle. For example, the processor (420) may determine that both of the user's hands are in proximity (e.g., in contact) with the steering wheel.

[0110] For example, if the processor (420) determines that the vehicle is driving, the processor (420) may not display an object related to a function of displaying content (e.g., an image or a video) among at least one virtual object. For example, if the processor (420) determines that the vehicle is driving, the processor (420) may not execute a function of displaying content even if an input is confirmed to select an object related to a function of displaying content among at least one virtual object while the object related to the function of displaying content (e.g., an image or a video) is being displayed through the display (460).

[0111] For example, if the processor (420) determines that the driving speed of the vehicle is greater than the first specified speed, the processor (420) may not display an object related to a function of displaying content (e.g., an image or a video) among at least one virtual object. For example, if the processor (420) determines that the driving speed of the vehicle is greater than the first specified speed, the processor (420) may not execute a function of displaying content even if an input is confirmed to select an object related to a function of displaying content among at least one virtual object while the object related to the function of displaying content (e.g., an image or a video) is being displayed through the display (460).

[0112] For example, if the processor (420) determines that the rotation angle of the steering wheel of the car is greater than the first specified angle, the processor (420) may not display an object related to the function of displaying content among at least one virtual object. For example, if the processor (420) determines that the rotation angle of the steering wheel of the car is greater than the first specified angle, the processor (420) may not execute the function of displaying content even if an input for selecting an object related to the function of displaying content among at least one virtual object is confirmed while the object related to the function of displaying content (e.g., an image or a video) is being displayed through the display (460).

[0113] In one embodiment, the processor (420) can check the driving status of the vehicle (500) and adjust the size of at least one area for checking the user's gesture based on the driving status. In one embodiment, the driving status of the vehicle (500) can include a status related to the driving speed of the vehicle (500) or the rotation angle of the steering wheel.

[0114] According to one embodiment, the processor (420) may decrease the size of at least one area for confirming the user's gesture as the driving speed of the vehicle (500) increases. According to one embodiment, if the driving speed of the vehicle (500) is determined to be lower than a first specified speed, the processor (420) may set the size of at least one area for confirming the user's gesture to a first size. For example, the first size may represent a size set by the user on a setting screen. According to one embodiment, if the driving speed of the vehicle (500) is determined to be higher than the first specified speed, the processor (420) may set the size of at least one area for confirming the user's gesture to a second size smaller than the first size. For example, the first specified speed may mean 30 km / h. However, this is an example, and the size of the first specified speed may not be limited to the above example. For example, the first specified speed may be automatically set by the wearable electronic device (401) or may be set by the user. For example, the first specified speed may mean a driving speed of a vehicle (500) for determining the size of at least one area.

[0115] According to one embodiment, the processor (420) may reduce the size (or area) of at least one region for confirming the user's gesture as the rotation angle of the steering wheel of the automobile (500) increases. According to one embodiment, if the rotation angle of the steering wheel is determined to be smaller than a first specified angle, the processor (420) may set the size of at least one region for confirming the user's gesture to a first size. According to one embodiment, if the rotation angle of the steering wheel is determined to be larger than the first specified angle, the processor (420) may set the size of at least one region for confirming the user's gesture to a second size smaller than the first size. For example, the first specified angle may mean 10 degrees. However, this is an example, and the size of the first specified angle may not be limited to the above example. For example, the first specified angle may be automatically set by the processor (420) or may be set by the user. Through this, when the driving speed of the vehicle (500) or the rotation angle of the steering wheel is large, the processor (420) can reduce the size of at least one area for confirming the user's gesture, thereby providing the user with an environment in which to focus on driving the vehicle.

[0116] According to one embodiment, the processor (420) may change the location of at least one area for confirming the user's gesture based on the user's gaze. For example, the processor (420) may change the location of at least one area for confirming the user's gesture to a location toward which the user's gaze is directed.

[0117] According to one embodiment, the processor (420) may confirm a first gesture of the user for at least one virtual object in at least one area for confirming the user's gesture. According to one embodiment, the processor (420) may determine that there is an input for at least one virtual object displayed through the display (460) based on the confirmation of the first gesture in at least one area for confirming the user's gesture. For example, the first gesture may be a gesture assigned to at least one virtual object. According to one embodiment, when the first gesture of the user for at least one virtual object is confirmed in at least one area for confirming the user's gesture while both of the user's hands are in contact with the handle, the processor (420) may determine that there is an input for at least one virtual object. According to one embodiment, when the first gesture of the user for at least one virtual object is confirmed while either of the user's hands is in contact with the handle, the processor (420) may determine that there is an input for at least one virtual object.

[0118] According to one embodiment, when the processor (420) confirms the user's first gesture for at least one virtual object in an area other than at least one area for confirming the user's gesture, it can determine that there is no input for at least one virtual object. Depending on the implementation, according to one embodiment, when the processor (420) confirms the user's first gesture for at least one virtual object in an area where at least one virtual object is displayed, it can also determine that there is an input for at least one virtual object.

[0119] According to one embodiment, the processor (420) may confirm the first gesture based on the movement speed or movement distance of a specific finger among the user's fingers. According to one embodiment, if at least one region is adjacent to the right side of the handle, the processor (420) may confirm the first gesture based on the movement distance or movement speed of the right finger. According to one embodiment, if at least one region is adjacent to the left side of the handle, the processor (420) may confirm the first gesture based on the movement distance or movement speed of the left finger. According to one embodiment, if at least one region is adjacent to the lower side of the handle, the processor (420) may confirm the first gesture based on the movement distance or movement speed of the right or left finger. According to one embodiment, if at least one region is adjacent to the upper side of the handle, the processor (420) may confirm the first gesture based on the movement distance or movement speed.

[0120] For example, the processor (420) may determine that a first gesture for selecting a first object among at least one virtual object displayed through the display (460) has been confirmed when the moving speed of a specific finger is greater than the first speed and less than the second speed. For example, the processor (420) may determine that a first gesture for selecting a second object among at least one virtual object displayed through the display (460) has been confirmed when the moving speed of a specific finger is greater than the second speed and less than the third speed. For example, the third speed may include a speed greater than the second speed.

[0121] For example, the processor (420) may determine that a first gesture for selecting a first object among at least one virtual object displayed through the display (460) has been confirmed when the movement distance of a specific finger is greater than a first distance and less than a second distance. For example, the processor (420) may determine that a first gesture for selecting a second object among at least one virtual object displayed through the display (460) has been confirmed when the movement distance of a specific finger is greater than a second distance and less than a third distance. For example, the third distance may include a distance greater than the second distance.

[0122] According to one embodiment, the processor (420) can confirm the first gesture based on the size (or area) of at least one region for confirming the user's gesture and the movement speed or movement distance of a specific finger among the user's fingers. According to one embodiment, the processor (420) can determine that the smaller the size (or area) of at least one region for confirming the user's gesture, the smaller the movement speed or movement distance at which the user's gesture is determined to be confirmed. Accordingly, according to one embodiment, when the at least one region for confirming the user's gesture is small, the movement of the user's finger can be relatively small. The processor (420) can adjust the recognition rate for the user's gesture based on the size of at least one region.

[0123] According to one embodiment, the processor (420) can confirm the first gesture based on at least one of the movement direction or shape of a specific finger among the user's fingers. According to one embodiment, if at least one region is adjacent to the right side of the handle, the processor (420) can confirm the first gesture based on at least one of the movement direction or shape of the right finger. According to one embodiment, if at least one region is adjacent to the left side of the handle, the processor (420) can confirm the first gesture based on at least one of the movement direction or shape of the left finger. According to one embodiment, if at least one region is adjacent to the lower side of the handle, the processor (420) can confirm the first gesture based on at least one of the movement direction or shape of the right or left finger. According to one embodiment, if at least one region is adjacent to the upper side of the handle, the processor (420) can confirm the first gesture based on at least one of the movement direction or shape of the right or left finger. For example, a first gesture may include a gesture of extending a specific finger (e.g., a thumb) and not extending the remaining fingers. For example, a first gesture may include moving a specific finger from left to right a specific number of times. For example, a first gesture may include a gesture of bending a specific finger. For example, a first gesture may include rotating a specific finger a specific number of times. For example, a first gesture may include rotating a specific finger clockwise or counterclockwise a specific number of times. For example, a first gesture may include a gesture of a user's hand contacting (e.g., approaching, grabbing) a steering wheel of a car (500). However, this is merely an example, and the first gesture and the direction of the user's hand (e.g., right hand, left hand) may not be limited to the above examples.

[0124] According to one embodiment, the processor (420) may display a plurality of virtual objects in an area adjacent to any one of the plurality of parts. According to one embodiment, when a first gesture of the user is confirmed, the processor (420) may display a virtual pointer. According to one embodiment, the processor (420) may display the virtual pointer in an area adjacent to any one of the plurality of parts. For example, the first gesture may include a gesture of spreading a specific finger of one of the user's hands. According to one embodiment, when a second gesture of the user is confirmed, the processor (420) may move the virtual pointer. For example, the second gesture may include a gesture of moving a specific finger of one of the user's hands from bottom to top. When the second gesture is confirmed, the processor (420) may move the virtual pointer from bottom to top. According to one embodiment, when a third gesture of the user is confirmed, the processor (420) may determine that there is an input for a virtual object included in the plurality of virtual objects displayed at the location of the virtual pointer. For example, the third gesture may include a gesture of bending a specific finger of one of the user's fingers. However, this is only an example, and the first gesture, the second gesture, and the third gesture may not be limited to the above examples.

[0125] According to one embodiment, the processor (420) may transmit a signal corresponding to the first gesture to the control device (501) based on confirming the first gesture. According to one embodiment, the signal corresponding to the first gesture may include a control signal related to the vehicle (500) to execute a first function corresponding to the first gesture. According to one embodiment, the processor (420) may transmit the control signal to the control device (501) to execute a function of turning on a turn signal, a function of executing a call application, a function of turning on a hazard light, a function of executing a music application, a function of forming a short-range communication connection, a function of displaying an image captured from the outside of the vehicle (500), or a function of displaying content. For example, the control device (501) may execute a call application of an external electronic device connected to the control device (501) based on the control signal. For example, the control device (501) may execute a music application of an external electronic device connected to the control device (501) based on the control signal. For example, the control device (501) may turn on the turn signal or the emergency light based on the control signal. For example, the control device (501) may transmit an image acquired using a camera included in the automobile (500) to the wearable electronic device (401) based on the control signal. The processor (420) may display the acquired image. However, this is an example, and the function corresponding to the first gesture may not be limited to the above examples.

[0126] According to one embodiment, the processor (420) may transmit a control signal related to the vehicle (500) to the control device (501) to execute a first function corresponding to the first gesture when the first gesture is confirmed in at least one area. According to one embodiment, the processor (420) may not transmit a control signal to the control device (501) when the first gesture is confirmed in an area other than the at least one area.

[0127] According to one embodiment, the processor (420) may execute a first function corresponding to the first gesture based on confirming the first gesture in at least one area. According to one embodiment, the processor (420) may establish a short-range communication connection with an external electronic device. According to one embodiment, the processor (420) may establish a short-range communication connection with an external electronic device connected to the control device (501). According to one embodiment, the processor (420) may execute a call application of an external electronic device that is communicatively connected to the wearable electronic device (401). According to one embodiment, the processor (420) may execute a music application of an external electronic device that is communicatively connected to the wearable electronic device (401). According to one embodiment, the processor (420) may display content stored in the memory (480). According to one embodiment, the processor (420) may obtain content from an external electronic device that is communicatively connected to the wearable electronic device (401) and display the content.

[0128] According to one embodiment, the processor (420) may execute a second function subsequent to the first function after the first function corresponding to the first gesture has been executed. According to one embodiment, the processor (420) may execute the first function upon confirming the first gesture, and may execute the second function after the first function has been executed even if no additional gesture is confirmed.

[0129] According to one embodiment, the processor (420) may, after a first function corresponding to a first gesture is executed, identify an additional gesture that causes a second function to be executed after the first function. According to one embodiment, when an additional gesture is identified, the processor (420) may execute the second function. For example, the additional gesture may include a gesture of extending a specific finger (e.g., a thumb) and not extending the remaining fingers. For example, the additional gesture may include moving a specific finger from left to right a specific number of times. For example, the additional gesture may include a gesture of bending a specific finger. For example, the additional gesture may include rotating a specific finger a specific number of times. For example, the additional gesture may include rotating a specific finger clockwise or counterclockwise a specific number of times. For example, the additional gesture may include a gesture of the user's hand contacting (e.g., approaching, grabbing) the steering wheel of the vehicle (500). However, this is merely an example, and the additional gesture and the direction of the user's hand (e.g., right hand, left hand) may not be limited to the above examples.

[0130] For example, the first function may include a function of turning on a turn signal or a function of turning on a hazard light. For example, the second function may include a function of displaying an image captured by a camera included in the vehicle (500) of the exterior of the vehicle (500). According to one embodiment, the processor (420) may obtain an image captured by a camera included in the vehicle (500) of the exterior of the vehicle (500) from the control device (501) after turning on the turn signal. According to one embodiment, the processor (420) may display an image captured by the exterior of the vehicle (500).

[0131] According to one embodiment, the processor (420) may identify a user's gesture to display a virtual object that is not displayed on the display (460) on the display (460). According to one embodiment, when the processor (420) identifies a user's gesture to display a virtual object that is not displayed on the display (460) on the display (460), the processor (420) may display the virtual object on the display (460).

[0132] The operations of the wearable electronic device (401) described in the drawings below may be performed by the processor (420). However, for convenience of explanation, the operations performed by the processor (420) will be described as being performed by the wearable electronic device (401).

[0133] FIG. 5 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to execute a function corresponding to a user's gesture.

[0134] Referring to FIG. 5, according to one embodiment, in operation 511, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may be connected to a control device (501) (e.g., the control device (501) of FIG. 4) included in a vehicle (500) (e.g., the vehicle (500) of FIG. 4).

[0135] According to one embodiment, the wearable electronic device (401) can identify the automobile (500) based on the strength of a communication signal with a control device (501) included in the automobile (500). According to one embodiment, the wearable electronic device (401) can identify the automobile (500) through a camera (410) (e.g., the camera (410) of FIG. 4). According to one embodiment, the wearable electronic device (401) can also identify the automobile (500) using an external electronic device (e.g., a smartphone, a tablet PC, or an external wearable electronic device different from the wearable electronic device (401)) that is in communication with the wearable electronic device (401).

[0136] According to one embodiment, when a car (500) is identified, the wearable electronic device (401) can check whether a key (e.g., a digital key) of the car (500) is stored within the wearable electronic device (401). For example, the digital key may include information about an identifier. According to one embodiment, it can also be checked whether a key (e.g., a digital key) of the car (500) is stored in an external electronic device that is communicatively connected to the wearable electronic device (401). According to one embodiment, the wearable electronic device (401) can obtain a key (e.g., a digital key) of the car (500) from the external electronic device.

[0137] According to one embodiment, the wearable electronic device (401) can transmit a key (e.g., a digital key) of the car (500) to the control device (501). According to one embodiment, the control device (501) can check whether the key of the car (500) stored in the control device (501) matches the key of the car (500) received from the wearable electronic device (401). According to one embodiment, the control device (501) can unlock the car (500) based on whether the key of the car (500) stored in the control device (501) matches the key of the car (500) received from the wearable electronic device (401).

[0138] According to an implementation, in one embodiment, the wearable electronic device (401) and the control device (501) can perform user authentication. For example, the control device (501) can store a designated ID and a designated password related to the vehicle (500). According to an embodiment, the wearable electronic device (401) can receive an ID and a password from the user. According to an embodiment, the control device (501) can compare the ID and password obtained from the wearable electronic device (401) with the designated ID and the designated password, respectively. According to an embodiment, the control device (501) can unlock the vehicle (500) when the ID and password obtained from the wearable electronic device (401) match the designated ID and the designated password. According to an implementation, in one embodiment, the vehicle (500) can also be unlocked by iris recognition or fingerprint recognition of the user.

[0139] According to one embodiment, in operation 513, the wearable electronic device (401) can check the status of a user riding in a vehicle. According to one embodiment, the wearable electronic device (401) can check the status of the user based on the location of the user within the vehicle (500) in which the user is riding.

[0140] According to one embodiment, the user's state may include a state regarding the positions of both hands of the user. For example, the user's state may include a state in which both hands or one or both hands of the user are in proximity to (e.g., in contact with) the steering wheel or armrest of the car (500). According to one embodiment, the wearable electronic device (401) may use a camera (410) (e.g., the camera (410) of FIG. 4) to check the user's position and state within the car (500) in which the user is riding. According to one embodiment, the wearable electronic device (401) may obtain information about the user's state from the control device (501) (e.g., the control device (501) of FIG. 4). For example, the control device (501) may obtain information about the user's state through at least one sensor (e.g., a touch sensor or a motion sensor) or a camera included in the car (500).

[0141] According to one embodiment, when the wearable electronic device (401) determines that the user is positioned in the driver's seat, it can determine whether both or one of the user's hands are in proximity to the steering wheel of the vehicle. According to one embodiment, when the wearable electronic device (401) determines that the user is positioned in a seat other than the driver's seat, it can determine whether both or one of the user's hands are in proximity to the armrest. According to one embodiment, the wearable electronic device (401) can display a setting screen that allows the user to set at least one area for confirming a gesture of the user based on determining that both or one of the user's hands are in proximity to the steering wheel of the vehicle (500) or the armrest. For example, the at least one area can include an area in proximity to the steering wheel of the vehicle (500). According to one embodiment, the at least one area for confirming a gesture of the user can be automatically set by the wearable electronic device (401).

[0142] In one embodiment, the user's status may include the user's gaze. In one embodiment, the wearable electronic device (401) may detect the user's gaze through a camera (410).

[0143] According to one embodiment, in operation 515, the wearable electronic device (401) can check the driving state of the automobile (500). For example, the driving state of the automobile (500) may include a state in which the automobile (500) is driving, stopped, or parked. For example, the driving state of the automobile (500) may include a state regarding the driving speed of the automobile (500) or the rotation angle of the steering wheel of the automobile (500).

[0144] According to one embodiment, in operation 517, the wearable electronic device (401) may determine at least one area for confirming the user's gesture based on at least one of the user's state or the driving state of the vehicle (500). According to one embodiment, although operation 517 is described as being performed after operation 515, operation 517 may be performed first, and operation 515 may be performed thereafter.

[0145] According to one embodiment, the wearable electronic device (401) may determine that at least one area proximate to at least one portion of a plurality of portions of a steering wheel of a vehicle is identified as at least one area for identifying at least one gesture of the user, based on determining that both or one of the user's hands is proximate to at least one portion of a plurality of portions of a steering wheel of a vehicle. For example, the plurality of portions may include an upper portion of the steering wheel, a lower portion of the steering wheel, a right portion of the steering wheel, and a left portion of the steering wheel.

[0146] According to one embodiment, the wearable electronic device (401) may set an area near the armrest as at least one area for confirming at least one gesture of the user based on determining that one of the user's hands is near the armrest of the vehicle. According to one embodiment, when the user's hand is near the steering wheel of the vehicle (500) and the user's gaze is directed toward an area other than the steering wheel of the vehicle (e.g., a side mirror or a rearview mirror), the wearable electronic device (401) may adjust the size of at least one area for confirming the user's gesture to a second size larger than the first size. For example, the first size and the second size may be set by the user or may be set by the wearable electronic device (401). For example, the first size may represent a reference size before being adjusted. According to the implementation, the wearable electronic device (401) may adjust the size of at least one area for confirming the user's gesture to a size smaller than the first size when the user's hand is close to the steering wheel of the car (500) and the user's gaze is directed to an area other than the steering wheel of the car (500) (e.g., a side mirror, a rearview mirror).

[0147] According to one embodiment, when the user's hand is close to the armrest of the car (500) and the user's gaze is directed to an area other than the armrest of the car (500), the wearable electronic device (401) may adjust the size of at least one area for confirming the user's gesture to a second size larger than the first size. For example, the first size and the second size may be set by the user or may be set by the wearable electronic device (401). For example, the first size may represent a reference size prior to adjustment. Depending on the implementation, the wearable electronic device (401) may adjust the size of at least one area for confirming the user's gesture to a size smaller than the first size when the user's hand is close to the armrest of the car (500) and the user's gaze is directed to an area other than the armrest of the car (500).

[0148] According to one embodiment, in operation 519, the wearable electronic device (401) may display at least one virtual object. For example, the wearable electronic device (401) may display at least one virtual object in at least one area set as an area for confirming at least one gesture or in an area close to the at least one area. The wearable electronic device (401) may also display at least one virtual object in an area different from the at least one area. However, this is an example, and the locations where the at least one virtual object is displayed may not be limited to the examples above.

[0149] According to one embodiment, at least one virtual object may include at least one virtual object related to the automobile (500). For example, the at least one virtual object may include at least one of an object related to a function of turning on a turn signal of the automobile (500), an object related to a function of turning on an emergency light, an object related to a function of forming a short-range communication connection between the control device (501) and an external electronic device, or an object related to a function of displaying an image captured by a camera included in the automobile (500) of an external environment of the automobile (500). For example, the image captured by a camera included in the automobile (500) of an external environment of the automobile (500) may be obtained from the control device (501). However, this is an example, and embodiments of the present invention may include objects related to various functions.

[0150] According to one embodiment, the at least one virtual object may include at least one virtual object for controlling the wearable electronic device (401). For example, the at least one virtual object may include at least one of an object related to a function of executing a call application of the wearable electronic device (401), an object related to a function of executing a music application of the wearable electronic device (401), an object related to a function of playing content (e.g., a video) stored in the wearable electronic device (401), or an object related to a function of forming a short-range communication connection between the wearable electronic device (401) and an external electronic device.

[0151] According to one embodiment, at least one virtual object may be displayed in at least one area designated by the wearable electronic device (401). According to one embodiment, at least one virtual object may also be displayed in at least one area designated by a user input. For example, the wearable electronic device (401) may display an object related to a function of turning on a left turn signal in an area adjacent to the left side of the steering wheel of the automobile (500). For example, the wearable electronic device (401) may display an object related to a function of turning on a right turn signal in an area adjacent to the right side of the steering wheel. For example, the wearable electronic device (401) may display an object related to a function of executing a music application in an upper area of ​​the steering wheel. For example, the wearable electronic device (401) may display an object related to a function of executing a call application in a lower area of ​​the steering wheel. For example, the wearable electronic device (401) may display an object related to a function of displaying content (e.g., a video or image) in an area adjacent to an armrest.

[0152] According to one embodiment, in operation 521, the wearable electronic device (401) may identify a first gesture in at least one area for identifying a user's gesture. According to one embodiment, the wearable electronic device (401) may identify the first gesture based on at least one of a movement direction or shape of a specific finger of the user. For example, the first gesture may mean a gesture of extending a specific finger (e.g., a thumb) and not extending the remaining fingers. For example, the first gesture may mean moving a specific finger from left to right a specific number of times. For example, the first gesture may mean a gesture of bending a specific finger. For example, the first gesture may mean rotating a specific finger a specific number of times. For example, the first gesture may mean rotating a specific finger clockwise or counterclockwise a specific number of times. However, this is an example, and the first gesture may not be limited to the above examples.

[0153] According to one embodiment, in operation 523, the wearable electronic device (401) may execute a function corresponding to the first gesture based on confirming the first gesture in at least one area for confirming the user's gesture. According to one embodiment, the wearable electronic device (401) may not execute the function corresponding to the first gesture based on confirming the first gesture in an area other than the at least one area for confirming the user's gesture.

[0154] For example, if the wearable electronic device (401) determines that the function corresponding to the first gesture is a first function related to the automobile (500), the wearable electronic device (401) may transmit a control signal to the control device (501) to cause the control device (501) to execute the first function. According to one embodiment, if the first gesture is determined in an area different from at least one area, the wearable electronic device (401) may not transmit a control signal to the control device (501) to cause the control device (501) to execute the function corresponding to the first gesture.

[0155] For example, the control device (501) may execute a call application of an external electronic device connected to the control device (501) based on a control signal. The control device (501) may execute a music application of an external electronic device connected to the control device (501) based on a control signal. For example, the control device (501) may turn on a turn signal or turn on an emergency light based on a control signal. For example, the control device (501) may establish a short-range communication connection with an external electronic device connected to the control device (501). For example, the external electronic device may be a smartphone, a tablet PC, or an external wearable electronic device different from the wearable electronic device (401).

[0156] For example, if the wearable electronic device (401) determines that the function corresponding to the first gesture is a second function associated with the wearable electronic device (401), the wearable electronic device (401) may execute the second function. According to one embodiment, if the first gesture is determined in an area different from at least one area, the wearable electronic device (401) may not execute the second function.

[0157] For example, if the function corresponding to the first gesture is determined to be a second function related to the wearable electronic device (401), the wearable electronic device (401) may establish a short-range communication connection with an external electronic device. For example, if the function corresponding to the first gesture is determined to be a second function related to the wearable electronic device (401), the wearable electronic device (401) may execute a call application of an external electronic device (e.g., a smartphone) that is communicatively connected to the wearable electronic device (401). For example, if the function corresponding to the first gesture is determined to be a second function related to the wearable electronic device (401), the wearable electronic device (401) may execute a call application of the wearable electronic device (401). According to one embodiment, the wearable electronic device (401) may also execute a music application of an external electronic device (e.g., a smartphone) that is communicatively connected to the wearable electronic device (401). For example, if the wearable electronic device (401) determines that the function corresponding to the first gesture is a second function related to the wearable electronic device (401), the wearable electronic device (401) may execute a music application of the wearable electronic device (401). For example, if the function corresponding to the first gesture is determined to be a second function related to the wearable electronic device (401), the wearable electronic device (401) may display content stored in the memory (480) (e.g., the memory (480) of FIG. 4). For example, if the function corresponding to the first gesture is determined to be a second function related to the wearable electronic device (401), the wearable electronic device (401) may obtain content from an external electronic device (e.g., a smartphone) that is communicatively connected to the wearable electronic device (401) and display the content.

[0158] FIG. 6A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object when it is determined that one of the user's hands is in contact with the handle.

[0159] Referring to FIG. 6A, according to one embodiment, in operation 611, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4 ) may use a camera (410) (e.g., the camera (410) of FIG. 4 ) to determine that one of the user's hands is in proximity to (e.g., in contact with) a first portion of a steering wheel of a vehicle (500). For example, the first portion of the steering wheel may include an upper portion of the steering wheel, a lower portion of the steering wheel, a right portion of the steering wheel, or a left portion of the steering wheel.

[0160] According to one embodiment, in operation 613, the wearable electronic device (401) may display at least one virtual object in a first area adjacent to the first portion. According to one embodiment, the at least one virtual object may include a virtual object designated in the first portion.

[0161] According to one embodiment, in operation 615, the wearable electronic device (401) may identify a first gesture of one hand in a first region. For example, the first region may represent an area included in at least one region for identifying a user's gesture. For example, the first gesture may be a gesture assigned to at least one virtual object.

[0162] According to one embodiment, the wearable electronic device (401) can identify a first gesture based on at least one of the movement direction or shape of a specific finger among the user's fingers. For example, the first gesture may mean a gesture of extending a specific finger (e.g., the thumb) and not extending the remaining fingers. For example, the first gesture may mean moving a specific finger from left to right a specific number of times. For example, the first gesture may mean bending a specific finger. For example, the first gesture may mean rotating a specific finger a specific number of times. For example, the first gesture may mean rotating a specific finger a specific number of times in a clockwise or counterclockwise direction. However, this is merely an example, and the first gesture may not be limited to the above examples.

[0163] According to one embodiment, in operation 617, the wearable electronic device (401) may execute a first function assigned to the first gesture based on confirming a first gesture of either hand in the first area. FIG. 6B is a flowchart illustrating an operation of displaying at least one virtual object when the wearable electronic device according to one embodiment confirms that both hands of the user are in contact with the handle.

[0164] Referring to FIG. 6B, according to one embodiment, at operation 621, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can determine whether both hands of the user are close to the steering wheel of the car (500) (e.g., the car (500) of FIG. 4).

[0165] According to one embodiment, when the wearable electronic device (401) determines that both hands of the user are close to the handle (operation 621 - Yes), in operation 623, the wearable electronic device (401) may display at least one first virtual object in the first area and at least one second virtual object in the second area. According to one embodiment, the wearable electronic device (401) may determine that the user's left hand is close to the first part of the handle and the user's right hand is close to the second part of the handle. According to one embodiment, the first part and the second part may be different from each other. For example, the first part of the handle may include the left part of the handle. For example, the second part of the handle may include the right part of the handle.

[0166] According to one embodiment, the first at least one virtual object may include a virtual object designated to be displayed in the first area when one of the at least one virtual objects of the user is in proximity to the first portion of the handle and the other of the user's hand is in proximity to the second portion of the handle. According to one embodiment, the second at least one virtual object may include at least one virtual object designated to be displayed in the second area when one of the at least one virtual objects of the user is in proximity to the first portion of the handle and the other of the user's hand is in proximity to the second portion of the handle.

[0167] According to one embodiment, the first at least one virtual object may include at least one virtual object associated with at least one of a function of turning on a left turn signal, a function of launching a call application, a function of turning on emergency lights, or a function of turning on a music application. According to one embodiment, the second at least one virtual object may include at least one virtual object associated with at least one of a function of turning on a right turn signal, a function of launching a call application, a function of turning on emergency lights, or a function of turning on a music application. However, this is an example, and examples of virtual objects may not be limited to the above examples.

[0168] According to one embodiment, in operation 625, the wearable electronic device (401) can identify a second gesture of either hand in the second area.

[0169] According to one embodiment, in operation 627, the wearable electronic device (401) may execute a second function corresponding to the second gesture with a control device (501) (e.g., the control device (501) of FIG. 4).

[0170] According to one embodiment, if it is determined that neither of the user's hands are in proximity to the handle (operation 621-No), in operation 629, the wearable electronic device (401) may not display the first at least one virtual object and the second at least one virtual object. According to one embodiment, if it is determined that one of the user's hands is in proximity to the first portion of the handle and the other of the user's hand is not in contact with the handle, the wearable electronic device (401) may not display both the first at least one virtual object and the second at least one virtual object. According to one embodiment, if it is determined that one of the user's hands is not in contact with the first portion of the handle and the other of the user's hand is in contact with the handle, the wearable electronic device (401) may not display the first at least one virtual object and the second at least one virtual object.

[0171] According to an implementation, in one embodiment, the first at least one virtual object may include a virtual object designated to be displayed in the first area when one of the user's hands is in proximity to the first portion of the handle and the other of the user's hand is not in proximity to the second portion of the handle. In one embodiment, the wearable electronic device (401) may display the first at least one virtual object in the first area when one of the user's hands is in proximity to the first portion of the handle and the other of the user's hand is not in proximity to the second portion of the handle.

[0172] According to one embodiment, the second at least one virtual object may include at least one virtual object designated to be displayed in the second area when one of the user's hands is not in proximity to the first portion of the handle and the other of the user's hand is in proximity to the second portion of the handle. According to one embodiment, the wearable electronic device (401) may display the second at least one virtual object in the second area when one of the user's hands is not in proximity to the first portion of the handle and the other of the user's hand is in proximity to the second portion of the handle.

[0173] According to an implementation, in one embodiment, the first at least one virtual object may include a virtual object designated to be displayed in the first area when neither of the user's hands are in proximity to the handle. In one embodiment, the wearable electronic device (401) may display the first at least one virtual object in the first area when neither of the user's hands are in proximity to the handle. In one embodiment, the second at least one virtual object may include a virtual object designated to be displayed in the second area when neither of the user's hands are in proximity to the handle. In one embodiment, the wearable electronic device (401) may display the second at least one virtual object in the second area when neither of the user's hands are in proximity to the handle.

[0174] FIG. 6c is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object based on a driving state of a vehicle when it is determined that one of the user's hands is in contact with the steering wheel.

[0175] Referring to FIG. 6C, according to one embodiment, at operation 631, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can determine that one hand is close to the steering wheel of a car (500) (e.g., the car (500) of FIG. 4) and the other hand is not close to the steering wheel.

[0176] According to one embodiment, in operation 633, the wearable electronic device (401) can determine whether the vehicle (500) is driving. According to one embodiment, the wearable electronic device (401) can determine whether the vehicle (500) is driving using a sensor included in the wearable electronic device (401). According to one embodiment, the wearable electronic device (401) can determine whether the vehicle (500) is driving based on a moving speed acquired using the sensor. According to one embodiment, the wearable electronic device (401) can also determine whether the vehicle (500) is driving based on sensing information acquired from a control device (501) included in the vehicle (500) (e.g., the control device (501) of FIG. 4). For example, the sensing information may include information on a driving speed of the vehicle (500).

[0177] According to one embodiment, when the wearable electronic device (401) determines that the car (500) is driving (operation 633 - Yes), in operation 635, the wearable electronic device (401) may not display the first at least one virtual object and the second at least one virtual object among the at least one virtual object. According to one embodiment, when the wearable electronic device (401) determines that the car (500) is driving, the wearable electronic device (401) may display the remaining virtual objects except for the first at least one virtual object and the second at least one virtual object among the at least one virtual object. Depending on the implementation, according to one embodiment, when the wearable electronic device (401) determines that the car (500) is driving, the wearable electronic device (401) may not display all of the at least one virtual object. For example, the first at least one virtual object and the second at least one virtual object may include objects that are not related to driving of the car (500). For example, the first at least one virtual object and the second at least one virtual object may include an object related to a function of displaying content (e.g., an image or a video) and an object related to a function of executing a music application of the wearable electronic device (401). For example, the first at least one virtual object and the second at least one virtual object may be set by a user's input or the wearable electronic device (401). According to one embodiment, when the wearable electronic device (401) determines that the car (500) is not driving (operation 633-No), in operation 637, the wearable electronic device (401) may display the first at least one virtual object in an area close to a first portion of the steering wheel touched by either hand. For example, the first at least one virtual object may include a virtual object designated for the first portion.

[0178] Through this, the wearable electronic device (401) can provide an environment in which the user can focus on driving the car by not displaying at least one virtual object while driving.

[0179] FIG. 7 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of at least one area based on a driving state of a vehicle.

[0180] Referring to FIG. 7, according to one embodiment, in operation 711, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can check the driving state of the vehicle. For example, the driving state may include the driving speed of the vehicle (500) (e.g., the vehicle (500) of FIG. 4) or the rotation angle of the steering wheel of the vehicle (500). According to one embodiment, the wearable electronic device (401) can obtain the driving speed of the vehicle (500) or the rotation angle of the steering wheel from the control device (501) (e.g., the control device (501) of FIG. 4). According to one embodiment, the wearable electronic device (401) may also obtain the driving speed of the vehicle (500) or the rotation angle of the steering wheel through the camera (410).

[0181] According to one embodiment, in operation 713, the wearable electronic device (401) may adjust the size of at least one area for confirming the user's gesture based on the proximity state of the steering wheel of the vehicle (500) and the driving state of the vehicle (500).

[0182] According to one embodiment, the wearable electronic device (401) may decrease the size of at least one region as the driving speed of the vehicle (500) increases. According to one embodiment, if the driving speed of the vehicle (500) is determined to be lower than a first specified speed, the wearable electronic device (401) may set the size of at least one region to a first size. According to one embodiment, if the driving speed of the vehicle (500) is determined to be higher than the first specified speed, the wearable electronic device (401) may set the size of at least one region to a second size smaller than the first size. For example, the first specified speed may mean 30 km / h. However, this is an example, and the size of the first specified speed may not be limited to the above example. For example, the first specified speed may be automatically set by the wearable electronic device (401) or may be set by the user. For example, the first specified speed may mean the driving speed of the vehicle (500) for determining the size of the at least one region.

[0183] According to one embodiment, the wearable electronic device (401) may decrease the size of at least one region as the rotation angle of the steering wheel of the automobile (500) increases. According to one embodiment, if the rotation angle of the steering wheel is determined to be smaller than a first specified angle, the wearable electronic device (401) may set the size of at least one region to a first size. According to one embodiment, if the rotation angle of the steering wheel is determined to be larger than the first specified angle, the wearable electronic device (401) may set the size of at least one region to a second size smaller than the first size. For example, the first specified angle may mean 10 degrees. However, this is an example, and the size of the first specified angle may not be limited to the above example. For example, the first specified angle may be automatically set by the wearable electronic device (401) or may be set by the user.

[0184] According to one embodiment, the wearable electronic device (401) can adjust the size of at least one virtual object through the display (460) (e.g., the display (460) of FIG. 4) by adjusting the size of at least one area. For example, the wearable electronic device (401) can set the ratio for adjusting the size of at least one area to be the same as the ratio for adjusting the size of at least one object.

[0185] According to one embodiment, in operation 715, the wearable electronic device (401) may identify a first gesture in at least one area. For example, the first gesture may include a gesture for executing a first function assigned to at least one function.

[0186] According to one embodiment, in operation 717, the wearable electronic device (401) may execute a first function specified in the first gesture.

[0187] Through this, the wearable electronic device (401) can provide an environment for the user to focus on driving by reducing the size of the area for confirming a gesture for executing a function related to the control device (501) of the wearable electronic device (401) or the automobile (500) when the driving speed of the automobile (500) or the rotation angle of the steering wheel is large.

[0188] FIG. 8 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display at least one virtual object in an area adjacent to an armrest.

[0189] Referring to FIG. 8, according to one embodiment, in operation 811, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may determine that one of the user's hands is in proximity to (e.g., in contact with) an armrest of a car (500) (e.g., the car (500) of FIG. 4).

[0190] According to one embodiment, in operation 813, the wearable electronic device (401) may determine at least one area for confirming the user's gesture. For example, the at least one area may include an armrest or an area proximate to the armrest.

[0191] According to an implementation, in one embodiment, the size of at least one region may be adjusted based on the driving state of the vehicle (500). In one embodiment, the wearable electronic device (401) may adjust the size of at least one region to be smaller or larger as the speed of the vehicle (500) increases. In one embodiment, the wearable electronic device (401) may adjust the size of at least one region to be smaller or larger as the rotation angle of the steering wheel of the vehicle (500) increases.

[0192] According to one embodiment, in operation 815, the wearable electronic device (401) may display at least one virtual object.

[0193] According to one embodiment, at least one object may include at least one virtual object related to the wearable electronic device (401). For example, the at least one virtual object may include at least one of an object related to a function of executing a call application of the wearable electronic device (401), an object related to a function of executing a music application of the wearable electronic device (401), an object related to a function of playing content (e.g., a video) stored in the wearable electronic device (401), or an object related to a function of forming a short-range communication connection between the wearable electronic device (401) and an external electronic device.

[0194] According to one embodiment, the at least one virtual object may include at least one virtual object related to the automobile (500). For example, the at least one virtual object may include at least one of an object related to a function of turning on a turn signal of the automobile (500), an object related to a function of turning on a hazard light, an object related to a function of forming a short-range communication connection between the control device (501) and an external electronic device, or an object related to a function of displaying an image captured by a camera included in the automobile (500) of an external environment of the automobile (500). For example, the image captured by a camera included in the automobile (500) of the external environment of the automobile (500) may be obtained from the control device (501).

[0195] According to one embodiment, in operation 817, the wearable electronic device (401) may identify a third gesture in at least one area. According to one embodiment, the wearable electronic device (401) may identify the third gesture based on at least one of the movement direction or shape of a specific finger of the user. For example, the third gesture may mean a gesture of extending a specific finger (e.g., an index finger) and not extending the remaining fingers. For example, the third gesture may mean moving a specific finger from left to right a specific number of times. For example, the third gesture may mean bending a specific finger. For example, the third gesture may mean rotating a specific finger a specific number of times. For example, the third gesture may mean rotating a specific finger clockwise or counterclockwise a specific number of times. However, this is an example, and the third gesture may not be limited to the above examples.

[0196] According to one embodiment, in operation 819, the wearable electronic device (401) may execute a function corresponding to the third gesture based on confirming a third gesture of one hand of the user in at least one area. For example, if the wearable electronic device (401) determines that the third gesture corresponds to at least one virtual object associated with the wearable electronic device (401), the wearable electronic device (401) may execute a function corresponding to the at least one virtual object. For example, if the wearable electronic device (401) determines that the third gesture corresponds to at least one virtual object associated with the automobile (500), the wearable electronic device (401) may transmit a control signal to the control device (501) to execute a function corresponding to the at least one virtual object.

[0197] According to one embodiment, the wearable electronic device (401) can execute a fourth function corresponding to a fourth gesture when a fourth gesture is confirmed after a third function corresponding to a third gesture is executed.

[0198] For example, the wearable electronic device (401) may display content based on a third gesture. According to one embodiment, while displaying content (e.g., a video), the wearable electronic device (401) may execute a function corresponding to the fourth gesture based on confirming a fourth gesture in at least one area, or transmit a control signal to the control device (501) to execute a function corresponding to the fourth gesture. According to one embodiment, the wearable electronic device (401) may confirm the fourth gesture based on at least one of a movement direction or shape of a specific finger of the user. For example, the fourth gesture may refer to a gesture in which the user extends the index finger and the middle finger, but does not extend the remaining fingers. According to one embodiment, when the fourth gesture is confirmed, the wearable electronic device (401) may display at least one object related to a function of adjusting the volume of the content.

[0199] According to one embodiment, when a fifth gesture of moving a user's index finger from bottom to top is confirmed, the wearable electronic device (401) may increase the volume of the content or transmit a control signal to the control device (501) to increase the volume of the content. According to one embodiment, when a sixth gesture of moving a user's index finger from top to bottom is confirmed, the wearable electronic device (401) may decrease the volume of the content or transmit a control signal to the control device (501) to decrease the volume of the content. However, this is an example, and the fourth gesture, the fifth gesture, and the sixth gesture may not be limited to the above examples.

[0200] According to an implementation, in one embodiment, the wearable electronic device (401) can determine that the user's hand, identified in an area near the handle, moves to an area near the armrest. In one embodiment, the wearable electronic device (401) can determine at least one area for determining the user's gesture as an area near the handle and an area near the armrest.

[0201] FIG. 9A is a flowchart illustrating an operation of determining an area for displaying information related to a vehicle when a wearable electronic device according to one embodiment is set to an autonomous mode.

[0202] Referring to FIG. 9A, according to one embodiment, in operation 911, a control device (501) (e.g., the control device (501) of FIG. 4) may set an autonomous driving mode of a vehicle (500) (e.g., the vehicle (500) of FIG. 4). According to one embodiment, the autonomous driving mode may include a first stage autonomous driving mode, a second stage autonomous driving mode, and a third stage autonomous driving mode. For example, the first stage autonomous driving mode, the second stage autonomous driving mode, and the third stage autonomous driving mode may be set by a user input.

[0203] For example, the autonomous driving mode of the first stage may include a step in which the vehicle (500) can adjust its driving speed without user intervention. For example, the autonomous driving mode of the second stage may include a step in which the vehicle (500) can adjust its driving speed and maintain a certain distance from the vehicle in front without user intervention. For example, the autonomous driving mode of the third stage may include a step in which the vehicle (500) can adjust its driving speed, maintain a certain distance from the vehicle in front, and change lanes without user intervention. However, this is an example, and the steps of the autonomous driving mode may not be limited thereto. According to one embodiment, when the control device (501) is set to the autonomous driving mode, it may transmit information about the steps of the autonomous driving mode to the wearable electronic device (401).

[0204] According to one embodiment, in operation 913, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4 ) may determine at least one area displaying information related to the vehicle (500) based on the stage of the autonomous driving mode.

[0205] For example, if the wearable electronic device (401) determines that the autonomous driving mode is the first stage, it may display information related to the vehicle (500) in a lower area of ​​the entire area of ​​the windshield of the vehicle (500). For example, the lower area of ​​the windshield of the vehicle may include a center information display (CID) or a head up display (HUD).

[0206] For example, when the wearable electronic device (401) determines that the autonomous driving mode is the second stage, it may display information related to the automobile (500) on at least a portion of the entire area of ​​the windshield of the automobile (500), including the lower area of ​​the windshield. According to one embodiment, when the autonomous driving mode is the second stage, the second size of the area where information related to the automobile (500) is displayed may be larger than the first size of the area where information related to the automobile (500) is displayed when the autonomous driving mode is the first stage.

[0207] For example, when the wearable electronic device (401) determines that the autonomous driving mode is in the third stage, it may display information related to the automobile (500) on the entire area of ​​the windshield of the automobile (500). According to one embodiment, when the autonomous driving mode is in the third stage, the third size of the area where information related to the automobile (500) is displayed may be larger than the first size and the second size.

[0208] According to one embodiment, in operation 915, the wearable electronic device (401) may display information related to the vehicle (500) in the determined area. According to one embodiment, the information related to the vehicle (500) may include information about the driving direction, information about the driving speed, instrument panel information, navigation information, or content information. According to one embodiment, the wearable electronic device (401) may display different information for each stage of the autonomous driving mode. For example, according to one embodiment, the wearable electronic device (401) may display content information only when the autonomous driving mode is entirely at stage 3.

[0209] According to an embodiment, the wearable electronic device (401) can check the driving status of the automobile (500). According to an embodiment, the wearable electronic device (401) can adjust the size of an area displaying information related to the automobile (500) based on the driving speed of the automobile (500). According to an embodiment, the wearable electronic device (401) can adjust the size of an area displaying information related to the automobile (500) based on the rotation angle of the steering wheel of the automobile (500).

[0210] For example, according to one embodiment, when the autonomous driving mode is the first stage and the driving speed corresponds to a designated speed, the wearable electronic device (401) may adjust the size of the area displaying information related to the vehicle to a size smaller or larger than the first size. For example, according to one embodiment, when the autonomous driving mode is the second stage and the driving speed corresponds to a designated speed, the wearable electronic device (401) may adjust the size of the area displaying information related to the vehicle to a size smaller or larger than the second size. For example, according to one embodiment, when the autonomous driving mode is the third stage and the driving speed corresponds to a designated speed, the wearable electronic device (401) may adjust the size of the area displaying information related to the vehicle to a size smaller or larger than the third size.

[0211] For example, according to one embodiment, when the autonomous driving mode is the first stage and the rotation angle of the steering wheel corresponds to a specified angle, the wearable electronic device (401) can adjust the size of the area displaying information related to the vehicle to a size smaller or larger than the first size. For example, according to one embodiment, when the autonomous driving mode is the second stage and the rotation angle of the steering wheel corresponds to a specified angle, the wearable electronic device (401) can adjust the size of the area displaying information related to the vehicle to a size smaller or larger than the second size. For example, according to one embodiment, when the autonomous driving mode is the third stage and the rotation angle of the steering wheel corresponds to a specified angle, the wearable electronic device (401) can adjust the size of the area displaying information related to the vehicle to a size smaller or larger than the third size.

[0212] FIG. 9B is a flowchart illustrating an operation of determining at least one area for executing a vehicle-related function when a wearable electronic device according to one embodiment is set to an autonomous mode.

[0213] Referring to FIG. 9B, according to one embodiment, in operation 931, the control device (501) (e.g., the control device (501) of FIG. 4) may set the vehicle (500) to an autonomous driving mode. According to one embodiment, the autonomous driving mode may include a first stage autonomous driving mode, a second stage autonomous driving mode, and a third stage autonomous driving mode.

[0214] According to one embodiment, in operation 933, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4 ) may determine at least one area in which the user's gesture can be identified.

[0215] According to one embodiment, in operation 935, at least one virtual object corresponding to at least one function associated with the automobile (500) or the wearable electronic device (401) may be displayed.

[0216] For example, when the autonomous driving mode is the first stage, at least one area where the user's gesture can be confirmed and an area where at least one virtual object is displayed may include a lower area of ​​the windshield of the vehicle among the entire area of ​​the windshield of the vehicle (500). For example, when the autonomous driving mode is the second stage, at least one area where the user's gesture can be confirmed and an area where at least one virtual object is displayed may include at least a portion of an area including a lower area of ​​the windshield of the vehicle (500) among the entire area of ​​the windshield of the vehicle (500). For example, when the autonomous driving mode is the third stage, at least one area where the user's gesture can be confirmed and an area where at least one virtual object is displayed may be the entire area of ​​the windshield of the vehicle (500).

[0217] According to one embodiment, the at least one virtual object may include at least one virtual object for controlling the wearable electronic device (401). For example, the at least one virtual object may include at least one of an object related to a function of executing a call application of the wearable electronic device (401), an object related to a function of executing a music application of the wearable electronic device (401), an object related to a function of playing content (e.g., a video) stored in the wearable electronic device (401), or an object related to a function of forming a short-range communication connection between the wearable electronic device (401) and an external electronic device.

[0218] According to one embodiment, the at least one virtual object may include at least one virtual object related to the automobile (500). For example, the at least one virtual object may include at least one of an object related to a function of turning on a turn signal of the automobile (500), an object related to a function of turning on a hazard light, an object related to a function of forming a short-range communication connection between the control device (501) and an external electronic device, or an object related to a function of displaying an image captured by using a camera included in the automobile (500) and an environment outside the automobile (500).

[0219] Depending on the implementation, according to one embodiment, depending on the stage of the autonomous driving mode of the vehicle (500), the virtual objects displayed through the display (460) (e.g., the display (460) of FIG. 4) may be different from each other.

[0220] According to one embodiment, in operation 937, the wearable electronic device (401) can check the driving status of the automobile (500) (e.g., the automobile (500) of FIG. 4).

[0221] According to one embodiment, in operation 939, the wearable electronic device (401) may adjust the size of at least one area based on the driving state of the vehicle (500).

[0222] In one embodiment, the wearable electronic device (401) may reduce the size of at least one region as the driving speed of the vehicle (500) increases. In one embodiment, the wearable electronic device (401) may reduce the size of at least one region as the rotation angle of the steering wheel of the vehicle (500) increases.

[0223] According to an implementation, in one embodiment, if the wearable electronic device (401) determines that the autonomous driving mode of the vehicle (500) is in the third stage, the wearable electronic device (401) may not adjust the size of at least one area regardless of the driving state of the vehicle (500). However, this is an example, and the stage of the autonomous driving mode in which the size of at least one area is not adjusted may be set based on a user's input.

[0224] FIG. 10A is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to determine at least one virtual object corresponding to at least one area.

[0225] Referring to FIG. 10A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can identify the location of a user within a vehicle (500) in which the user is riding (e.g., the vehicle (500) of FIG. 4). According to one embodiment, the wearable electronic device (401) can display information (1020, 1021) regarding the identified location of the user. According to one embodiment, the wearable electronic device (401) can identify the location of the user in the driver's seat.

[0226] According to one embodiment, the wearable electronic device (401) may display guide information (e.g., a region for executing a function while holding the handle may be set. Hold the desired position and set the region for executing the function) (1010) to determine at least one region for confirming the user's gesture.

[0227] According to one embodiment, when one of the user's hands approaches (e.g., touches) the upper portion (1031) of the handle among the upper portion (1031) of the handle, the right portion (1032) of the handle, the lower portion (1033) of the handle, and the left portion (1034) of the handle, the wearable electronic device (401) may display at least one virtual object corresponding to the upper portion (1031) of the handle in an area adjacent to the upper portion (1031) of the handle.

[0228] According to one embodiment, when a first virtual object included in at least one virtual object is selected, the wearable electronic device (401) may correspond the first virtual object to the upper portion (1031) of the handle. According to one embodiment, when a plurality of virtual objects are selected, the wearable electronic device (401) may correspond the plurality of virtual objects to the upper portion (1031) of the handle. According to one embodiment, when one of the user's hands approaches the upper portion (1031) of the handle, the wearable electronic device (401) may display the first virtual object or the plurality of virtual objects in an area adjacent to the upper portion (1031) of the handle.

[0229] According to one embodiment, when one hand of the user approaches (e.g., touches) the right portion (1032) of the handle, the wearable electronic device (401) may display at least one virtual object corresponding to the right portion (1032) of the handle in an area adjacent to the right portion (1032) of the handle. According to one embodiment, when a second virtual object is selected from among the at least one virtual object, the wearable electronic device (401) may correspond the second virtual object to the right portion (1032) of the handle. According to one embodiment, when one hand of the user approaches the right portion (1032) of the handle, the wearable electronic device (401) may display the second virtual object in an area adjacent to the right portion (1032) of the handle. According to one embodiment, when a plurality of virtual objects correspond to the right portion (1032) of the handle, the plurality of virtual objects may be displayed in an area adjacent to the right portion (1032) of the handle.

[0230] According to one embodiment, when one hand of the user approaches the lower portion (1033) of the handle, the wearable electronic device (401) may display at least one virtual object corresponding to the lower portion (1033) of the handle in an area adjacent to the lower portion (1033) of the handle. According to one embodiment, when a third virtual object is selected from among the at least one virtual object, the wearable electronic device (401) may correspond the third virtual object to the lower portion (1033) of the handle. According to one embodiment, when one hand of the user approaches the lower portion (1033) of the handle, the wearable electronic device (401) may display the third virtual object in an area adjacent to the lower portion (1033) of the handle. According to one embodiment, when a plurality of virtual objects correspond to the lower portion (1033) of the handle, the plurality of virtual objects may be displayed in an area adjacent to the lower portion (1033) of the handle.

[0231] According to one embodiment, when one hand of the user approaches the left portion (1034) of the handle, the wearable electronic device (401) may display at least one virtual object corresponding to the left portion (1034) of the handle in an area adjacent to the left portion (1034) of the handle. According to one embodiment, when a fourth virtual object is selected from among the at least one virtual object, the wearable electronic device (401) may correspond the fourth virtual object to the left portion (1034) of the handle. According to one embodiment, when one hand of the user approaches the left portion (1034) of the handle, the wearable electronic device (401) may display the fourth virtual object in an area adjacent to the left portion (1034) of the handle. According to one embodiment, when a plurality of virtual objects correspond to the left portion (1034) of the handle, the plurality of virtual objects may be displayed in an area adjacent to the lower portion (1033) of the handle.

[0232] According to one embodiment, the first virtual object, the second virtual object, the third virtual object, and the fourth virtual object may be identical to each other or may be different from each other.

[0233] According to an implementation, in one embodiment, the wearable electronic device (401) may display at least one virtual object corresponding to the left portion (1034) of the handle and at least one virtual object corresponding to the right portion (1032) of the handle when the user's both hands are respectively close to the left portion (1034) and the right portion (1032) of the handle. In one embodiment, the wearable electronic device (401) may correspond a fourth virtual object to the left portion (1034) and a second virtual object to the right portion (1032) of the handle based on the user's input. In one embodiment, the wearable electronic device (401) may display the fourth virtual object in an area close to the left portion (1034) and the second virtual object in the right portion (1032) only when the user's both hands are respectively close to the left portion (1034) and the right portion (1032) of the handle. According to one embodiment, if the wearable electronic device (401) determines that only one hand of the user is close to the left portion (1034) or the right portion (1032) of the handle, the wearable electronic device (401) may not display the fourth virtual object in the area close to the left portion (1034) and may not display the second virtual object in the right portion (1032).

[0234] According to one embodiment, the wearable electronic device (401) may display at least one virtual object corresponding to the upper portion (1031) of the handle and at least one virtual object corresponding to the lower portion (1033) of the handle when the user's both hands are in proximity to the upper portion (1031) and the lower portion (1033) of the handle, respectively. According to one embodiment, the wearable electronic device (401) may correspond a first virtual object to the upper portion (1031) and a third virtual object to the lower portion (1033) of the handle, based on the user's input. According to one embodiment, the wearable electronic device (401) may display a first virtual object in an area proximate to the upper portion (1031) and a third virtual object in the lower portion (1033) of the handle only when the user's both hands are in proximity to the upper portion (1031) and the lower portion (1033) of the handle, respectively. According to one embodiment, if it is determined that only one hand of the user is close to the upper portion (1031) or the lower portion (1033) of the handle, the wearable electronic device (401) may not display the first virtual object in the area close to the upper portion (1031) and may not display the third virtual object in the lower portion (1033).

[0235] FIG. 10b is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to determine at least one area for confirming a user's gesture.

[0236] Referring to FIG. 10B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may determine at least one area (1040, 1041, 1050, 1051, 1060, 1061) for confirming a user's gesture based on a driving state of a vehicle (500) (e.g., the vehicle (500) of FIG. 4). According to one embodiment, the at least one area (1040, 1041, 1050, 1051, 1060, 1061) is not limited to the size and shape illustrated in FIG. 10B, and may be implemented in various sizes and shapes.

[0237] For example, according to one embodiment, when the driving speed of the car (500) is determined to be less than the first speed, the wearable electronic device (401) may determine at least one area as the first at least one area (1040, 1041). For example, according to one embodiment, when the driving speed of the car (500) is determined to be greater than the first speed and less than the second speed, the wearable electronic device (401) may determine at least one area as the second at least one area (1050, 1051). For example, according to one embodiment, when the driving speed of the car (500) is determined to be greater than the second speed, the wearable electronic device (401) may determine at least one area as the third at least one area (1060, 1061). For example, the second speed may be greater than the first speed, and the third speed may include a speed greater than the second speed.

[0238] For example, the size of the first at least one region (1040, 1041) may be larger than the size of the second at least one region (1050, 1051) and the size of the third at least one region (1060, 1061). For example, the size of the second at least one region (1050, 1051) may be larger than the size of the third at least one region (1060, 1061).

[0239] For example, according to one embodiment, when the rotation angle of the handle of the car (500) is determined to be smaller than the first angle, the wearable electronic device (401) may determine at least one area as the first at least one area (1040, 1041). For example, according to one embodiment, when the rotation angle of the handle of the car (500) is determined to be larger than the first angle and smaller than the second angle, the wearable electronic device (401) may determine at least one area as the second at least one area (1050, 1051). For example, according to one embodiment, when the rotation angle of the handle of the car (500) is determined to be larger than the second angle, the wearable electronic device (401) may determine at least one area as the third at least one area (1060, 1061). For example, the second angle may include an angle larger than the first angle, and the third angle may include an angle larger than the second angle. For example, the size of the first at least one region (1040, 1041) may be larger than the size of the second at least one region (1050, 1051) and the size of the third at least one region (1060, 1061). For example, the size of the second at least one region (1050, 1051) may be larger than the size of the third at least one region (1060, 1061).

[0240] According to one embodiment, the wearable electronic device (401) can determine at least one area based on the user's gaze. According to one embodiment, the wearable electronic device (401) can determine the user's gaze through a camera (410) (e.g., the camera (410) of FIG. 4).

[0241] For example, if the wearable electronic device (401) determines that the user's gaze is on the handle, it may determine at least one area as the first at least one area (1040, 1041).

[0242] For example, if the wearable electronic device (401) determines that the user's gaze is in the lower area of ​​the entire area of ​​the wind shield of the automobile (500), the wearable electronic device (401) may determine at least one area as the second at least one area (1050, 1051).

[0243] For example, if the wearable electronic device (401) determines that the user's gaze is in the upper region of the entire area of ​​the wind shield, the wearable electronic device (401) may determine at least one region as the third at least one region (1060, 1061). However, this is an example, and embodiments of the present invention may determine at least one region in various ways based on the user's gaze.

[0244] FIG. 11 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display at least one object.

[0245] Referring to FIG. 11, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can display guide information (1110) (e.g., “Perform a specified gesture while holding the steering wheel”) that displays a plurality of virtual objects that can execute a function related to a car (500) (e.g., the car (500) of FIG. 4).

[0246] According to one embodiment, the wearable electronic device (401) may display a first virtual object (1131), a second virtual object (1132), and a third virtual object (1133) in a first area (1130) adjacent to the left area (1034) of the handle based on determining that one of the user's hands is close to the left area (1034) of the handle. The first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) may refer to virtual objects designated to the left area (1034) of the handle. For example, the first virtual object (1131) may represent an object related to a left turn signal, the second virtual object (1132) may represent an object related to a call application, and the third virtual object (1133) may represent an object related to an emergency light. According to one embodiment, the first area (1130) may represent an area for confirming a user's gesture.

[0247] According to one embodiment, the wearable electronic device (401) may display a fourth virtual object (1121), a fifth virtual object (1122), and a sixth virtual object (1123) in a second area (1120) adjacent to the right portion (1032) of the handle based on determining that the other hand of the user is close to the right portion (1032) of the handle. The fourth virtual object (1121), the fifth virtual object (1122), and the sixth virtual object (1123) may refer to virtual objects designated to the right portion (1032) of the handle. For example, the fourth virtual object (1121) may represent an object related to a right turn signal, the fifth virtual object (1122) may represent an object related to a short-range communication connection, and the sixth virtual object (1123) may represent an object related to content display. According to one embodiment, the second area (1120) may represent an area for confirming a user's gesture.

[0248] For example, an object related to a short-range communication connection may represent an object capable of performing a short-range communication connection between an external electronic device connected to a control device (501) and a wearable electronic device (401). For example, an object related to a short-range communication connection may also represent an object capable of performing a short-range communication connection between a control device (501) and an external electronic device.

[0249] FIG. 12A and FIG. 12B are diagrams illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of at least one area based on the driving speed of a vehicle.

[0250] Referring to FIG. 12A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can detect that one of the user's hands is in contact with (e.g., in proximity to) a right area of ​​a steering wheel of a car (500) (e.g., the car (500) of FIG. 4).

[0251] In one embodiment, the wearable electronic device (401) can determine that the driving speed of the automobile (500) is 20 km / h. In one embodiment, the wearable electronic device (401) can obtain the driving speed of the automobile (500) from the control device (501) (e.g., the control device (501) of FIG. 4).

[0252] According to one embodiment, the wearable electronic device (401) can determine the sizes at which each of the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) is displayed based on determining that the driving speed is less than a first designated speed (e.g., 30 km / h).

[0253] According to one embodiment, the wearable electronic device (401) can determine the size of an area (1130) for confirming a user's gesture based on a driving speed. According to one embodiment, the wearable electronic device (401) can display an area (1130) for confirming a user's gesture.

[0254] According to one embodiment, in FIG. 12A, the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) are shown as being displayed in an area (1130) for confirming a user's gesture, but the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) may be displayed in an area other than the area (1130) for confirming a user's gesture.

[0255] According to one embodiment, when the wearable electronic device (401) confirms the user's first gesture in the area (1130) for confirming the user's gesture, it can confirm that there is an input for a virtual object corresponding to the first gesture among the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133).

[0256] According to an implementation, in one embodiment, even when the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) are displayed in an area other than the area (1130) for confirming a user gesture, if the wearable electronic device (401) confirms a user gesture in an area where the first virtual object (1131) is displayed, it can determine that there is an input for the first virtual object (1131). In one embodiment, if the wearable electronic device (401) confirms a user gesture in an area where the second virtual object (1132) is displayed, it can determine that there is an input for the second virtual object (1132). In one embodiment, if the wearable electronic device (401) confirms a user gesture in an area where the third virtual object (1133) is displayed, it can determine that there is an input for the third virtual object (1133).

[0257] Referring to FIG. 12B, according to one embodiment, the wearable electronic device (401) can determine that the driving speed of the automobile (500) is 100 km / h. According to one embodiment, based on determining that the driving speed is greater than a first specified speed (e.g., 30 km / h), the wearable electronic device (401) can display the sizes of the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) when the driving speed is greater than the first specified speed (e.g., 30 km / h) as smaller than the sizes of the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) when the driving speed is less than the first specified speed.

[0258] According to one embodiment, the wearable electronic device (401) may identify an area (1130) for identifying a user's gesture based on a driving speed. According to one embodiment, the wearable electronic device (401) may display an area (1130) for identifying a user's gesture. According to one embodiment, the size of the area (1130) for identifying a user's gesture when the driving speed is greater than a first specified speed (e.g., 30 km / h) may be smaller than the size of the area (1130) for identifying a user's gesture when the driving speed is less than the first specified speed (e.g., 30 km / h).

[0259] According to one embodiment, the wearable electronic device (401) may reduce the sizes of the first virtual object (1131), the second virtual object (1132), and the third virtual object (1133) as the driving speed increases. According to one embodiment, the wearable electronic device (401) may reduce the size of the area (1130) for confirming the user's gesture as the driving speed increases. Through this, the wearable electronic device (401) may provide the user with the effect of focusing on driving when the driving speed of the vehicle increases.

[0260] According to one embodiment, the wearable electronic device (401) may not display a virtual object (e.g., a second virtual object (1132)) unrelated to the driving of the vehicle (500) based on determining that the driving speed of the vehicle (500) is greater than a first designated speed (e.g., 30 km / h). For example, the virtual object related to the driving of the vehicle (500) may include an object related to a function of turning on the hazard lights of the vehicle (500), an object related to a function of turning on the turn signals of the vehicle (500), or an object related to a function of displaying an image (or video) captured of the external environment of the vehicle (500) using a camera included in the vehicle (500).

[0261] In one embodiment, the wearable electronic device (401) may not display a virtual object (e.g., a second virtual object (1132)) unrelated to the driving of the vehicle (500) based on determining that the vehicle (500) is driving.

[0262] According to one embodiment, the wearable electronic device (401) may not execute a function related to a virtual object (e.g., a second virtual object (1132)) unrelated to the driving of the vehicle (500) even if a gesture for selecting a virtual object (e.g., a second virtual object (1132)) unrelated to the driving of the vehicle (500) is confirmed based on determining that the driving speed of the vehicle (500) is greater than a first designated speed (e.g., 30 km / h).

[0263] According to one embodiment, the wearable electronic device (401) may not execute a function related to a virtual object (e.g., a second virtual object (1132)) unrelated to the driving of the vehicle (500) even if a gesture is confirmed to select the virtual object (e.g., a second virtual object (1132)) unrelated to the driving of the vehicle (500) based on determining that the vehicle (500) is driving.

[0264] FIG. 13A and FIG. 13B are drawings for explaining an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of at least one area based on a rotation angle of a handle.

[0265] Referring to FIG. 13A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can detect that one hand of a user is in proximity to (e.g., contacting) a left area of ​​a steering wheel of a car (500) (e.g., the car (500) of FIG. 4) and the other hand of the user is in proximity to (e.g., contacting) a right area of ​​the steering wheel of the car (500).

[0266] In one embodiment, the wearable electronic device (401) can determine that the rotation angle of the steering wheel of the automobile (500) is a1. For example, the size of a1 may be 10 degrees.

[0267] According to one embodiment, the wearable electronic device (401) can determine the size at which each virtual object is displayed based on determining that the size of a1 is smaller than a first specified size. For example, the first specified size may be 20 degrees.

[0268] According to one embodiment, the wearable electronic device (401) can determine the size of an area (1120, 1130) for confirming a user's gesture based on the rotation angle of the handle. According to one embodiment, the wearable electronic device (401) can display an area (1120, 1130) for confirming a user's gesture.

[0269] According to one embodiment, in FIG. 13a, virtual objects are shown as being displayed in an area (1120, 1130) for confirming a user's gesture, but the virtual objects may be displayed in an area other than the area (1120, 1130) for confirming a user's gesture.

[0270] Referring to FIG. 13b, according to one embodiment, the wearable electronic device (401) can determine that the rotation angle of the steering wheel of the automobile (500) is a2. For example, the size of a2 may be 30 degrees.

[0271] According to one embodiment, the wearable electronic device (401) may, based on determining that the size of a2 is greater than the first specified size, display the size of the first area (1130) where virtual objects are displayed when the size of a2 is greater than the first specified size as smaller than the size of the first area (1130) where virtual objects are displayed when the size of a2 is less than the first specified size.

[0272] According to one embodiment, the wearable electronic device (401) may, based on determining that the size of a2 is greater than the first specified size, display the size of the second area (1120) where virtual objects are displayed when the size of a2 is greater than the first specified size as smaller than the size of the second area (1120) where virtual objects are displayed when the size of a2 is less than the first specified size.

[0273] FIG. 14 is a diagram for explaining an operation of a wearable electronic device according to one embodiment to determine at least one area.

[0274] Referring to FIG. 14, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can identify the location of a user within a vehicle (500) in which the user is riding. According to one embodiment, the wearable electronic device (401) can display information (1420, 1421) regarding the identified location of the user. According to one embodiment, the wearable electronic device (401) can identify the location of the user as the right rear seat.

[0275] According to one embodiment, the wearable electronic device (401) may display guide information (e.g., “Place your hand on the armrest and make a gesture”) (1410, 1440) to determine at least one area for confirming the user’s gesture. For example, the guide information (1410, 1440) may be displayed as text or an image.

[0276] According to one embodiment, the wearable electronic device (401) can use a camera (410) (e.g., the camera (410) of FIG. 4) to determine that one of the user's hands (1431) is in contact with a portion (1430) of the armrest.

[0277] According to one embodiment, the wearable electronic device (401) may display a virtual object (1450) related to content based on determining that one of the user's hands (1431) is in contact with a portion (1430) of the armrest. For example, the area where the virtual object (150) related to content is displayed may include an upper portion of a field of view (FOV) area of ​​the camera (410) or the wearable electronic device (401). However, this is an example, and the area where the virtual object (150) related to content is displayed may also be an area close to a portion (1430) of the armrest.

[0278] In one embodiment, the wearable electronic device (401) may determine that there is an input for a virtual object (150) related to content when it is determined that a specific finger (e.g., an index finger) of one of the user's hands (1431) is bent at a portion (1430) of the armrest. In one embodiment, the wearable electronic device (401) may play the content.

[0279] FIG. 15A and FIG. 15B are drawings for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display at least one object.

[0280] Referring to FIG. 15A, according to one embodiment, a wearable electronic device (401) may display content (1510) (e.g., an image or video) when an input for a virtual object (1450) related to the content is confirmed.

[0281] According to one embodiment, the wearable electronic device (401) may display a plurality of virtual objects (1520, 1530, 1540) on the content (1510). The plurality of virtual objects (1520, 1530, 1540) may display an object (1520) related to a function of reducing the loudness of the content, an object (1530) related to a function of increasing the loudness of the content, and an object (1540) related to a function of terminating playback of the content.

[0282] According to one embodiment, the wearable electronic device (401) may reduce the sound intensity (1550) of the content when a gesture of a hand (1531) assigned to an object (1520) related to a function of reducing the sound intensity of the content is identified above an area where the armrest (1532) or the content (1510) is displayed. For example, the gesture assigned to the object (1520) related to the function of reducing the sound intensity of the content may mean a gesture of extending the index finger of the user's right hand and moving the index finger in an upward-downward direction while keeping the remaining fingers open.

[0283] According to one embodiment, the wearable electronic device (401) may terminate playback of content when a gesture assigned to an object (1540) related to a function of terminating playback of content is identified above the armrest (1530) or the area where content (1510) is displayed. For example, the gesture assigned to the object (1540) related to a function of terminating playback of content may mean extending all of the user's right fingers.

[0284] According to one embodiment, the wearable electronic device (401) may increase the volume of the content when a gesture assigned to an object (1530) related to a function of increasing the volume of the content is confirmed above an area where the armrest (1530) or the content (1510) is displayed. For example, the gesture assigned to the object (1530) related to a function of increasing the volume of the content may mean a gesture of spreading out the index finger and the middle finger of the user's right hand and moving the index finger and the middle finger in an upward direction (1570) while keeping the remaining fingers open.

[0285] FIG. 16A is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to determine at least one area when a control device is set to an autonomous driving mode of a vehicle.

[0286] Referring to FIG. 16A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display information related to autonomous driving of a vehicle (500) in a designated area when a control device (501) (e.g., the control device (501) of FIG. 4) is set to an autonomous driving mode of a vehicle (500) (e.g., the vehicle (500) of FIG. 4). For example, the autonomous driving mode may include a first-stage autonomous driving mode, a second-stage autonomous driving mode, and a third-stage autonomous driving mode.

[0287] For example, a first-level autonomous driving mode may include a step in which the vehicle can adjust its driving speed without user intervention. For example, a second-level autonomous driving mode may include a step in which the vehicle can adjust its driving speed and maintain a certain distance from the vehicle in front without user intervention. For example, a third-level autonomous driving mode may include a step in which the vehicle can adjust its driving speed, maintain a certain distance from the vehicle in front, and change lanes without user intervention.

[0288] According to one embodiment, the designated area may include a first area (1610), a second area (1620), and a third area (1630).

[0289] According to one embodiment, the wearable electronic device (401) may display information related to the vehicle in a second area (1620) of the vehicle when the autonomous driving mode is determined to be the first stage.

[0290] According to one embodiment, the wearable electronic device (401) may display information related to the vehicle in the second area (1620) of the vehicle and the third area (1630) of the vehicle when the autonomous driving mode is determined to be the second stage.

[0291] According to one embodiment, when the wearable electronic device (401) determines that the autonomous driving mode is in the third stage, it may display information related to the vehicle in the first area (1610) of the vehicle, the second area (1620) of the vehicle, and the third area (1630) of the vehicle.

[0292] In one embodiment, information related to the vehicle may include information regarding driving direction, driving speed, instrument panel information, navigation information, or content information. However, this is merely an example, and the information related to the designated area and vehicle may not be limited to the above examples.

[0293] FIG. 16b is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information related to a vehicle when a control device is set to a second stage autonomous driving mode of the vehicle.

[0294] Referring to FIG. 16B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can determine that a control device (501) (e.g., the control device (501) of FIG. 4) is set to a second stage autonomous driving mode of a vehicle (500) (e.g., the vehicle (500) of FIG. 4).

[0295] According to one embodiment, when the wearable electronic device (401) is set to the autonomous driving mode of the second stage, it may display at least one of information on the driving direction (1651), information on the driving speed (1652), instrument panel information, or navigation information in the second area (1620) of the vehicle.

[0296] According to one embodiment, when the wearable electronic device (401) is set to the autonomous driving mode of the second stage, it may display a virtual object (1640) representing the screen of an external electronic device that is in communication with the wearable electronic device (401) in the third area (1630). For example, the external electronic device may include a smartphone. For example, the virtual object (1640) may represent the screen of an application related to music playback installed on the external electronic device.

[0297] For example, when an input to a virtual object (1640) is confirmed, the wearable electronic device (401) can play music corresponding to the input.

[0298] FIG. 16c is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information related to a vehicle when a control device is set to a third stage autonomous driving mode of the vehicle.

[0299] Referring to FIG. 16c, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can determine that a control device (501) (e.g., the control device (501) of FIG. 4) is set to a third stage autonomous driving mode of a vehicle (500) (e.g., the vehicle (500) of FIG. 4).

[0300] According to one embodiment, when the wearable electronic device (401) is set to the third stage autonomous driving mode, it may display at least one of information about the driving direction, information about the driving speed, instrument panel information, or navigation information in the second area (1620) of the vehicle.

[0301] According to one embodiment, when the wearable electronic device (401) is set to the third stage autonomous driving mode, it may display a virtual object (1640) representing the screen of an external electronic device that is connected to the wearable electronic device (401) in the third area (1630). For example, the external electronic device may include a smartphone. For example, the virtual object (1640) may represent the screen of an application related to video playback installed on the external electronic device.

[0302] For example, when an input to a virtual object (1640) is confirmed, the wearable electronic device (401) can play a video corresponding to the input.

[0303] According to one embodiment, when the wearable electronic device (401) is set to the third stage autonomous driving mode, it may display a screen (1660) for a video in the first area (1610). According to one embodiment, the screen (1660) for the video may be displayed in an area of ​​the first area (1610) close to the handle.

[0304] According to one embodiment, a wearable electronic device may include a camera, a display, communication circuitry, a processor, and a memory storing instructions.

[0305] According to one embodiment, the wearable electronic device can form a communication connection with a control device included in the automobile through the communication circuit.

[0306] According to one embodiment, the wearable electronic device can check the status of a user riding in the vehicle through the camera.

[0307] According to one embodiment, the wearable electronic device can check the driving status of the vehicle.

[0308] According to one embodiment, the wearable electronic device may determine at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state.

[0309] According to one embodiment, the wearable electronic device can execute a first function for the first gesture among the at least one function based on identifying the first gesture of the user in the at least one area.

[0310] According to one embodiment, the wearable electronic device can determine the status of the user based on the location of the user within the vehicle.

[0311] According to one embodiment, the wearable electronic device may display at least one virtual object associated with the at least one function based on determining that one of the user's hands is in proximity to a first portion of a steering wheel of the vehicle.

[0312] According to one embodiment, the wearable electronic device can execute the first function based on identifying the first gesture of the one hand in the first region adjacent to the first portion among the at least one region.

[0313] According to one embodiment, the wearable electronic device may determine a first area corresponding to a location located a first distance away from a steering wheel of the vehicle among the at least one area, based on determining that the driving speed of the vehicle is a first speed.

[0314] According to one embodiment, the wearable electronic device may determine a second area corresponding to a location located a specified second distance from the steering wheel of the vehicle, the second distance being less than the specified first distance, based on determining that the driving speed of the vehicle is a second speed greater than the first speed.

[0315] According to one embodiment, the wearable electronic device may display at least one virtual object associated with the at least one function based on determining that one of the user's hands is in proximity to an armrest of the vehicle.

[0316] According to one embodiment, the wearable electronic device may display at least one virtual object associated with the at least one function when both hands of the user are close to the steering wheel of the vehicle, based on determining that the vehicle is in a driving state.

[0317] According to one embodiment, the wearable electronic device may display at least one virtual object associated with the at least one function based on determining that the vehicle is stopped, even if both hands of the user are not in proximity to the steering wheel of the vehicle.

[0318] According to one embodiment, the wearable electronic device may determine the size of the at least one region as a first size when the driving speed of the vehicle is determined to be a first speed less than or equal to a first specified speed, and may determine the size of the at least one region as a second size less than the first size when the driving speed of the vehicle is determined to be a second speed greater than the first specified speed.

[0319] According to one embodiment, the wearable electronic device may determine the size of the at least one region as a first size when the rotation angle of the steering wheel of the vehicle is determined to be a first angle less than or equal to a first specified angle, and may determine the size of the at least one region as a second size less than the first size when the rotation angle of the steering wheel of the vehicle is determined to be a second angle greater than the first specified angle.

[0320] According to one embodiment, a first movement distance of the user's specific finger indicating the first gesture, which is confirmed when the driving speed of the vehicle is the first speed, may be greater than a second movement distance of the user's specific finger indicating the first gesture, which is confirmed when the driving speed of the vehicle is the second speed.

[0321] In one embodiment, the wearable electronic device can detect the user's gaze using the camera.

[0322] According to one embodiment, the wearable electronic device can determine the at least one area based on the gaze of the user.

[0323] According to one embodiment, the wearable electronic device can identify the first gesture based on at least one of a movement direction or shape of a specific finger of the user.

[0324] According to one embodiment, the wearable electronic device may display information related to autonomous driving of the vehicle in a designated area when the control device is set to an autonomous driving mode of the vehicle.

[0325] According to one embodiment, a method of operating a wearable electronic device may include forming a communication connection with a control device included in a vehicle.

[0326] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking a status of a user riding in the vehicle through the camera.

[0327] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking a driving state of the vehicle.

[0328] According to one embodiment, a method of operating a wearable electronic device may include an operation of determining at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state.

[0329] According to one embodiment, a method of operating a wearable electronic device may include an operation of executing a first function corresponding to the first gesture among at least one function based on identifying a first gesture of the user in the at least one area.

[0330] According to one embodiment, a method of operating a wearable electronic device may include an operation of checking the status of the user based on the location of the user within the vehicle.

[0331] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying at least one virtual object related to the at least one function based on determining that the user's left hand is close to a first portion of a steering wheel of the vehicle.

[0332] According to one embodiment, a method of operating a wearable electronic device may include an operation of executing the first function based on confirming the first gesture of the left hand with respect to the at least one virtual object in a first area proximate to the first portion among the at least one area.

[0333] According to one embodiment, a method of operating a wearable electronic device may include determining a first area corresponding to a location located a first distance away from a steering wheel of the vehicle among the at least one area, based on determining that a driving speed of the vehicle is a first speed.

[0334] According to one embodiment, a method of operating a wearable electronic device may include determining a second area corresponding to a location located a specified second distance from a steering wheel of the vehicle, the second distance being less than the specified first distance, based on determining that a driving speed of the vehicle is a second speed greater than the first speed, among the at least one area.

[0335] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying at least one virtual object related to the at least one function based on determining that one of the user's hands is in proximity to an armrest of the vehicle.

[0336] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying at least one virtual object related to the at least one function when both hands of the user are close to the steering wheel of the vehicle, based on determining that the vehicle is in a driving state.

[0337] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying at least one virtual object related to the at least one function, based on determining that the vehicle is stopped, even if both hands of the user are not close to the steering wheel of the vehicle.

[0338] According to one embodiment, a method of operating a wearable electronic device may include an operation of reducing the size of the at least one area as the driving speed increases.

[0339] According to one embodiment, a method of operating a wearable electronic device may include an operation of reducing a size of the at least one area as a rotation angle of the steering wheel of the vehicle increases.

[0340] According to one embodiment, a method of operating a wearable electronic device may include an operation of confirming a gaze of the user using the camera.

[0341] According to one embodiment, a method of operating a wearable electronic device may include an operation of determining at least one area based on the gaze of the user.

[0342] According to one embodiment, a method of operating a wearable electronic device may include an operation of confirming the first gesture based on at least one of a direction or shape of movement of a specific finger of the user with respect to at least one virtual object.

[0343] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying information related to autonomous driving of the vehicle in a designated area when the control device is set to an autonomous driving mode of the vehicle.

[0344] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of forming a communication connection with a control device included in the vehicle.

[0345] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of checking a status of a user riding in the vehicle through the camera.

[0346] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of checking a driving state of the vehicle.

[0347] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of determining at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state.

[0348] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of executing a first function corresponding to the first gesture among at least one function based on identifying a first gesture of the user in the at least one area.

[0349] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of determining the status of the user based on the location of the user within the vehicle.

[0350] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an action of displaying at least one virtual object associated with the at least one function based on determining that one of the user's hands is in proximity to a first portion of a steering wheel of the vehicle.

[0351] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation to perform the first function based on identifying the first gesture of the one hand with respect to the at least one virtual object in a first area proximate to the first portion of the at least one area.

[0352] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of determining a first area corresponding to a location located a first distance away from a steering wheel of the vehicle among the at least one area, based on determining that the driving speed of the vehicle is a first speed.

[0353] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of determining a second area corresponding to a location located a specified second distance from the steering wheel of the vehicle, the second distance being less than the specified first distance, based on determining that the driving speed of the vehicle is a second speed greater than the first speed.

[0354] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an action of displaying at least one virtual object associated with the at least one function based on determining that one of the user's hands is in proximity to an armrest of the vehicle.

[0355] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an action of displaying at least one virtual object associated with the at least one function when both hands of the user are close to the steering wheel of the vehicle, based on determining that the vehicle is in a driving state.

[0356] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an action of displaying at least one virtual object associated with the at least one function, based on determining that the vehicle is in a stopped state, even if both hands of the user are not in proximity to the steering wheel of the vehicle.

[0357] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of reducing the size of the at least one area as the driving speed increases.

[0358] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of decreasing the size of the at least one area as the rotation angle of the steering wheel of the vehicle increases.

[0359] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of identifying a gaze of the user using the camera.

[0360] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of determining the at least one area based on the gaze of the user.

[0361] According to one embodiment, the non-transitory recording medium may include at least one instruction capable of executing an operation of confirming the first gesture based on at least one of a direction or shape of movement of a specific finger of the user with respect to at least one virtual object.

[0362] According to one embodiment, the non-transitory recording medium may include at least one instruction that can execute an operation of displaying information related to autonomous driving of the vehicle in a designated area when the control device is set to an autonomous driving mode of the vehicle.

[0363] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0364] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0365] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0366] Various embodiments of the present document may be implemented as software (e.g., program (140)) including one or more commands stored in a storage medium (e.g., built-in memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101, 200, 300, 501)). For example, a processor (e.g., processor (120, 420)) of a machine (e.g., electronic device (101, 200, 300, 501)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'Non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0367] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0368] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a wearable electronic device (401 of FIG. 4), Camera (410 in Fig. 4); Display (460 in Fig. 4); Communication circuit (490 in Fig. 4); At least one processor (420 in FIG. 4); and A memory (480 of FIG. 4) for storing instructions, said instructions, when individually or collectively executed by said at least one processor, cause said wearable electronic device to: A communication connection is formed with a control device (501 in Fig. 4) included in a vehicle (500 in Fig. 4) through the above communication circuit, Check the status of the user inside the car through the above camera, Check the driving condition of the above vehicle, determining at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state; A wearable electronic device configured to execute a first function corresponding to the first gesture among at least one function based on identifying a first gesture of the user in at least one of the above areas.

2. In paragraph 1, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: determine the state of the user based on a location of the user within the vehicle.

3. In any one of paragraphs 1 and 2, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: display at least one virtual object associated with the at least one function based on determining that one of the user's hands is in proximity to the first portion of the steering wheel of the vehicle; A wearable electronic device configured to execute the first function based on identifying the first gesture of the one hand in a first area proximate to the first portion among the at least one area.

4. In any one of paragraphs 1 to 3, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: determine a first region corresponding to a location located a first distance from a steering wheel of the vehicle among the at least one region, based on determining that the driving speed of the vehicle is a first speed; A wearable electronic device configured to determine a second area corresponding to a location located a specified second distance from the steering wheel of the vehicle, the specified first distance being less than the determined first distance, based on determining that the driving speed of the vehicle is a second speed greater than the first speed.

5. In any one of paragraphs 1 to 4, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: display at least one virtual object associated with the at least one function based on determining that one of the user's hands is in proximity to an armrest of the vehicle.

6. In any one of paragraphs 1 to 5, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: display at least one virtual object associated with the at least one function when both hands of the user are in proximity to the steering wheel of the vehicle based on determining that the vehicle is in a driving state; A wearable electronic device configured to display at least one virtual object related to the at least one function based on determining that the vehicle is stopped, even if both hands of the user are not in proximity to the steering wheel of the vehicle.

7. In any one of paragraphs 1 to 6, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: determine a size of the at least one region as a first size if the driving speed of the vehicle is determined to be a first speed less than or equal to a first designated speed; A wearable electronic device configured to determine the size of at least one area as a second size smaller than the first size when the driving speed of the vehicle is determined to be a second speed greater than the first specified speed.

8. In any one of paragraphs 1 to 7, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: determine a size of the at least one region to be a first size if the rotation angle of the steering wheel of the vehicle is determined to be a first angle less than or equal to a first specified angle; A wearable electronic device configured to determine the size of at least one area to be a second size smaller than the first size when the rotation angle of the steering wheel of the vehicle is confirmed to be a second angle larger than the first specified angle.

9. In any one of paragraphs 1 to 8, A wearable electronic device wherein a first movement distance of a specific finger of the user indicating the first gesture, which is confirmed when the driving speed of the vehicle is the first speed, is set to be greater than a second movement distance of the specific finger of the user indicating the first gesture, which is confirmed when the driving speed of the vehicle is the second speed.

10. In any one of paragraphs 1 to 9, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: identify the user's gaze using the camera; A wearable electronic device configured to determine at least one area based on said gaze of said user.

11. In any one of paragraphs 1 to 10, The instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: identify the first gesture based on at least one of a direction or shape of movement of a particular finger of the user.

12. In any one of paragraphs 1 to 11, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to: display information related to autonomous driving of the vehicle in a designated area when the control device is set to an autonomous driving mode of the vehicle.

13. In the operating method of a wearable electronic device (401 of FIG. 4), An operation of forming a communication connection with a control device (501 in FIG. 4) included in a vehicle (500 in FIG. 4); An action of checking the status of a user in the car through the camera (410 of FIG. 4) of the wearable electronic device; An action to check the driving status of the above vehicle; An operation of determining at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state; and A method of operating a wearable electronic device, comprising: executing a first function corresponding to the first gesture among at least one function, based on identifying a first gesture of the user in at least one area.

14. In paragraph 13, A method of operating a wearable electronic device further comprising an action of checking the status of the user based on the location of the user within the vehicle.

15. A storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform operations, the operations comprising: An operation of forming a communication connection with a control device (501 in FIG. 4) included in a vehicle (500 in FIG. 4); An action of checking the status of a user in the car through the camera (410 of FIG. 4) of the wearable electronic device; An action to check the driving status of the above vehicle; An operation of determining at least one area for confirming a gesture of the user based on at least one of the user's state or the driving state; and A storage medium including an operation for executing a first function corresponding to the first gesture among at least one function based on identifying a first gesture of the user in at least one area.

Images