Electronic device, method, and non-transitory computer-readable storage medium for obtaining notification from vehicle

Abstract

This electronic device may comprise at least one communication circuit, at least one processor, and at least one memory for storing instructions. The instructions may cause, when executed by the at least one processor, the electronic device to receive a request for a first communication connection from at least one other communication circuit of a vehicle through the at least one communication circuit, and the instructions may cause, when executed by the at least one processor, the electronic device to: on the basis of the first communication connection, receive object information on at least one object around the vehicle from the at least one other communication circuit; on the basis of the object information, identify an object out of a user's gaze among the at least one object; and on the basis of the object information, output a notification on the identified object.

Description

Electronic device, method, and non-transitory computer-readable storage medium for obtaining notifications from a vehicle

[0001] The following descriptions relate to an electronic device, method, and non-transitory computer readable storage medium for obtaining notifications from a vehicle.

[0002] An electronic device may provide multiple functions. For example, the electronic device may output media via wired and / or wireless communication connections with external electronic devices. The electronic device may identify one or more electronic devices capable of communication with the user. For example, the one or more electronic devices may include wearable devices and automobiles.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] An electronic device is disclosed. The electronic device may include at least one communication circuit. The electronic device may include at least one sensor for obtaining data for identifying the location of irises of both eyes of the user. The electronic device may include at least one processor. The electronic device may include at least one memory for storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to receive a request for a first communication connection from at least one second communication circuit of a vehicle through the at least one first communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device to receive object information about at least one object surrounding the vehicle from the at least one second communication circuit based on the first communication connection. The instructions, when executed by the at least one processor, may cause the electronic device to identify the gaze of the user based on the data for identifying the location of the iris. The instructions, when executed by the at least one processor, may cause the electronic device to identify, based on the object information, at least one object that is out of the user's line of sight. The instructions, when executed by the at least one processor, may cause the electronic device to output a notification regarding the object identified as being out of the user's line of sight, based on the object information.

[0005] A method is disclosed. The method may be performed in an electronic device comprising at least one communication circuit and at least one sensor for obtaining data for identifying the positions of irises of both eyes of a user. The method may include receiving a request for a first communication connection from at least one second communication circuit of a vehicle through the at least one first communication circuit. The method may include receiving object information about at least one object surrounding the vehicle from the at least one other communication circuit based on the first communication connection. The method may include identifying the gaze of the user based on the data for identifying the position of the iris. The method may include identifying an object among at least one object that is out of the gaze of the user based on the object information. The method may include outputting a notification for the object identified as being out of the gaze based on the object information.

[0006] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may comprise a program comprising instructions. The instructions, when executed by at least one processor of an electronic device including at least one communication circuit and at least one sensor for obtaining data for identifying the positions of irises of both eyes of the user, may cause the electronic device to receive a request for a first communication connection from at least one second communication circuit of a vehicle through the at least one first communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device to receive object information about at least one object around the vehicle from the at least one second communication circuit based on the first communication connection. The instructions, when executed by the at least one processor, may cause the electronic device to identify the gaze of the user based on the data for identifying the positions of the irises. The instructions, when executed by the at least one processor, may cause the electronic device to identify, based on the object information, at least one object that is out of the user's line of sight. The instructions, when executed by the at least one processor, may cause the electronic device to output a notification regarding the object identified as being out of the user's line of sight, based on the object information.

[0007] An electronic device is disclosed. The electronic device may include at least one sensor. The electronic device may include at least one other sensor that obtains data for identifying the positions of irises of both eyes of the user. The electronic device may include at least one speaker. The electronic device may include at least one first communication circuit. The electronic device may include at least one processor. The electronic device may include at least one memory storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to receive a request for a communication connection from at least one second communication circuit of an external electronic device through the at least one first communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device to receive audio content from the external electronic device based on the communication connection. The instructions, when executed by the at least one processor, may cause the electronic device to output the audio content through the at least one speaker. The instructions, when executed by the at least one processor, may cause the electronic device to obtain information about at least one object around the electronic device through the at least one sensor. The instructions, when executed by the at least one processor, may cause the electronic device to identify a gaze of the user based on the data for identifying the location of the iris. The instructions, when executed by the at least one processor, may cause the electronic device to identify an object out of the gaze of the user among the at least one object based on the information about the at least one object.The instructions, when executed by the at least one processor, may cause the electronic device to transmit a request for a first communication connection to the at least one second communication circuit through the at least one first communication circuit based on identifying the object as being out of the line of sight. The instructions, when executed by the at least one processor, may cause the electronic device to transmit, based on the first communication connection, object information about the object identified as being out of the line of sight to the external electronic device, such that the external electronic device outputs a notification about the identified object based on object information about the object identified as being out of the line of sight.

[0008] A method is disclosed. The method may be performed by an electronic device comprising at least one sensor, at least one other sensor for obtaining data for identifying the positions of irises of both eyes of the user, at least one speaker, and at least one first communication circuit. The method may include receiving a request for a communication connection from at least one second communication circuit of an external electronic device through the at least one first communication circuit. The method may include receiving audio content from the external electronic device based on the communication connection. The method may include outputting the audio content through the at least one speaker. The method may include obtaining information about at least one object surrounding the electronic device through the at least one sensor. The method may include identifying the gaze of the user based on the data for identifying the positions of the irises. The method may include identifying an object, among at least one object, that is out of the gaze of the user based on the information about the at least one object. The method may include an operation of transmitting a request for a first communication connection to the at least one second communication circuit through the at least one first communication circuit based on identifying the object that is out of the line of sight. The method may include an operation of transmitting, to the external electronic device, object information about the object identified as being out of the line of sight based on the first communication connection, such that the external electronic device outputs a notification about the identified object based on the object information about the object identified as being out of the line of sight.

[0009] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may include a program comprising instructions. The instructions, when executed by at least one processor of an electronic device including at least one sensor, at least one other sensor for obtaining data for identifying the positions of irises of both eyes of the user, at least one speaker, and at least one first communication circuit, may cause the electronic device to receive a request for a communication connection from at least one second communication circuit of an external electronic device through the at least one first communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device to receive audio content from the external electronic device based on the communication connection. The instructions, when executed by the at least one processor, may cause the electronic device to output the audio content through the at least one speaker. The instructions, when executed by the at least one processor, may cause the electronic device to obtain information about at least one object around the electronic device through the at least one sensor. The instructions, when executed by the at least one processor, may cause the electronic device to identify a gaze of the user based on the data for identifying the location of the iris. The instructions, when executed by the at least one processor, may cause the electronic device to identify an object out of the gaze of the user among the at least one object based on the information about the at least one object.The instructions, when executed by the at least one processor, may cause the electronic device to transmit a request for a first communication connection to the at least one second communication circuit through the at least one first communication circuit based on identifying the object as being out of the line of sight. The instructions, when executed by the at least one processor, may cause the electronic device to transmit, based on the first communication connection, object information about the object identified as being out of the line of sight to the external electronic device, such that the external electronic device outputs a notification about the identified object based on object information about the object identified as being out of the line of sight.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0011] Figure 2 is a simplified block diagram of an electronic device according to one embodiment.

[0012] FIG. 3A illustrates an example of communication connections between electronic devices according to one embodiment.

[0013] FIG. 3b illustrates an example of volume control between electronic devices according to one embodiment.

[0014] FIG. 3c illustrates an example of a sequence for communication connection between electronic devices according to one embodiment.

[0015] FIG. 3d illustrates an example of a driving situation of a vehicle according to one embodiment.

[0016] Figure 4 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0017] Figure 5 is a flowchart showing the operation of an electronic device according to one embodiment.

[0018] Figure 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0019] Figure 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0020] Figure 8 is a flowchart showing the operation of an electronic device according to one embodiment.

[0021] Figure 9 is a flowchart showing the operation of an electronic device according to one embodiment.

[0022] FIG. 10A illustrates an example of a perspective view of a wearable device according to one embodiment.

[0023] FIG. 10b illustrates an example of one or more hardware elements disposed within a wearable device, according to one embodiment.

[0024] FIG. 11A illustrates an example of an appearance of a wearable device according to one embodiment.

[0025] FIG. 11b illustrates an example of an appearance of a wearable device according to one embodiment.

[0026] Figure 12a illustrates an example of a user wearing a wearable device.

[0027] FIG. 12b illustrates an example of a screen displayed on a wearable device according to one embodiment.

[0028] FIG. 12c illustrates an example of a screen displayed on a wearable device or display according to one embodiment.

[0029] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components. In addition, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0030] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0031] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0032] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0033] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0034] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0035] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0036] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0037] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0038] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0039] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0040] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0041] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0042] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0043] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0044] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0045] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0046] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0047] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0048] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 664 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for realizing URLLC.

[0049] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0050] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0051] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0052] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0053] FIG. 2 is a simplified block diagram of an electronic device (101) according to one embodiment.

[0054] Referring to FIG. 2, according to one embodiment, an electronic device (101) can communicate with a vehicle (210) and / or at least one electronic device (201, 203). The electronic device (101) can communicate with the vehicle (210) and / or at least one electronic device (201, 203) based on a direct (e.g., wired) communication channel and / or a wireless communication channel. The electronic device (101) can communicate with the vehicle (210) and / or at least one electronic device (201, 203) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) and / or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)).

[0055] In one embodiment, the electronic device (101) of FIG. 2 may correspond to the electronic device (101) of FIG. 1.

[0056] In one embodiment, the electronic device (101) may include a processor (120), a memory (130), a speaker (250), a display (260), a sensor (270), and a communication circuit (290). The processor (120) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (130) of FIG. 2 may correspond to the memory (130) of FIG. 1. The speaker (250) of FIG. 2 may correspond to the audio output module (155) of FIG. 1. The display (260) of FIG. 2 may correspond to the display module (160) of FIG. 1. The sensor (270) of FIG. 2 may correspond to the sensor module (176) of FIG. 1. The communication circuit (290) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0057] In one embodiment, a vehicle (210) may include an electronic device (205). The electronic device (205) may include a processor (225), a memory (235), a speaker (255), a display (265), a sensor (275), and a communication circuit (295). The processor (225) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (235) of FIG. 2 may correspond to the memory (130) of FIG. 1. The speaker (255) of FIG. 2 may correspond to the audio output module (155) of FIG. 1. The display (265) of FIG. 2 may correspond to the display module (160) of FIG. 1. The sensor (275) of FIG. 2 may correspond to the sensor module (176) of FIG. 1. The communication circuit (295) of Fig. 2 can correspond to the communication module (190) of Fig. 1.

[0058] In one embodiment, at least one electronic device (201, 203) may be an audio output device. For example, at least one electronic device (201, 203) may be at least one of a headset, earphones, or earbuds. At least one electronic device (201, 203) may constitute a set of earbuds.

[0059] In one embodiment, the electronic device (201) may include a processor (221), a memory (231), a speaker (251), and a communication circuit (291). The processor (221) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (231) of FIG. 2 may correspond to the memory (130) of FIG. 1. The speaker (251) of FIG. 2 may correspond to the audio output module (155) of FIG. 1. The communication circuit (291) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0060] In one embodiment, the electronic device (203) may include a processor (223), a memory (233), a speaker (253), and a communication circuit (293). The processor (223) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (233) of FIG. 2 may correspond to the memory (130) of FIG. 1. The speaker (253) of FIG. 2 may correspond to the audio output module (155) of FIG. 1. The communication circuit (293) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0061] FIG. 3A illustrates an example of communication connections between electronic devices (101, 201, 203, 205) according to one embodiment.

[0062] Figure 3a can be explained with reference to Figures 1 and 2.

[0063] In one embodiment, situations (310, 320, 330) of FIG. 3A may represent communication connections (311, 313, 315) between an electronic device (101) and other electronic devices (201, 203, 205). A first situation (310) illustrates a situation before a communication connection is established between an electronic device (101) and an electronic device (205) of a vehicle (210). A second situation (320) illustrates a situation after a communication connection is established between an electronic device (101) and an electronic device (205) of a vehicle (210). A third situation (330) illustrates a situation after a communication connection is established between an electronic device (101) and at least one electronic device (201, 203) is released.

[0064] In one embodiment, referring to the first situation (310), the electronic device (101) can establish at least one communication connection (311, 313) with at least one electronic device (201, 203). Here, the communication connection (311, 313) may be a communication connection based on Bluetooth. For example, the communication connection (311, 313) may be a communication connection based on LE (low energy) audio. However, the present invention is not limited thereto. For example, the electronic device (101) may be communicatively connected with one electronic device (e.g., electronic device (201)) among at least one electronic device (201, 203), and may not be communicatively connected with another electronic device (e.g., electronic device (203)). Another electronic device (e.g., electronic device (203)) that is not connected to the electronic device (101) can sniff the communication connection between the electronic device (101) and an electronic device (e.g., electronic device (201)). According to an embodiment, the communication connection (311, 313) may be based on BLE (Bluetooth low energy). The communication connection (311, 313) may be based on a communication technique different from Bluetooth. For example, the communication connection (311, 313) may be based on WiFi. The communication connection (311, 313) may be a one-way communication connection from the electronic device (101) to at least one electronic device (201, 203). The communication connection (311, 313) may be a two-way communication connection different from Bluetooth. However, the present invention is not limited thereto.

[0065] In one embodiment, in the first situation (310), the electronic device (101) can transmit a media file via at least one communication connection (311, 313) to at least one electronic device (201, 203). For example, the electronic device (101) can transmit at least one of an audio file, an image file, or a video file. The electronic device (101) can transmit the media file so that the at least one electronic device (201, 203) outputs content based on the media file. For example, the electronic device (201, 203) can output content based on the media file via at least one speaker (251, 253).

[0066] In one embodiment, in the first situation (310), the electronic device (101) may broadcast an advertising signal (e.g., a pilot signal or a beacon signal). The electronic device (101) may periodically broadcast the advertising signal to identify at least one other electronic device. However, the present invention is not limited thereto. The electronic device (101) may obtain an advertising signal (e.g., a pilot signal or a beacon signal) from at least one other electronic device.

[0067] In one embodiment, the electronic device (101) may obtain a request for a communication connection (315) from the electronic device (205). The electronic device (101) may obtain a request for establishing a communication connection (315) from the electronic device (205). However, this is not limited thereto. The electronic device (101) may request the electronic device (205) to establish a communication connection (315) based on an advertising signal from the electronic device (205).

[0068] In one embodiment, the electronic device (101) may establish a communication connection (315) with the electronic device (205). Here, the communication connection (315) may be a communication connection based on Bluetooth. For example, the communication connection (315) may be a communication connection based on LE audio. However, the present invention is not limited thereto. The communication connection (315) may be a communication connection based on BLE. The communication connection (315) may be a communication connection based on a communication technique different from Bluetooth. For example, the communication connection (315) may be a communication connection based on WiFi. The communication connection (315) may be a one-way communication connection from the electronic device (101) to the vehicle (210). The communication connection (315) may be a two-way communication connection different from Bluetooth.

[0069] In one embodiment, in the second situation (320), the electronic device (101) can transmit a media file via communication connections (311, 313, 315) to the electronic devices (201, 203, 205). The electronic device (101) can transmit the media file so that the electronic devices (201, 203, 205) output content based on the media file. For example, the electronic device (201, 203) can output content based on the media file via at least one speaker (251, 253). For example, the electronic device (205) can output content based on the media file via at least the speaker (255) and / or the display (265).

[0070] In one embodiment, the electronic device (101) may transmit a control signal to gradually increase the size of an audio signal of content output by the electronic device (205). The electronic device (101) may transmit a control signal to gradually decrease the size of an audio signal of content output by at least one electronic device (201, 203). The audio output by at least one electronic device (201, 203) may be muted. The size of the audio signal output by at least one electronic device (201, 203) may converge to 0.

[0071] In one embodiment, in the third situation (330), the electronic device (101) can transmit a media file through a communication connection (315) with the electronic device (205). The electronic device (101) can stop transmitting the media file to the electronic devices (201, 203). The electronic device (101) can transmit the media file so that the electronic device (205), not the electronic devices (201, 203), outputs content based on the media file.

[0072] Below, the operation of the electronic device (101) processing information of the electronic device (101) is described.

[0073] In one embodiment, in the second situation (320) or the third situation (330), the electronic device (101) may receive a notification. Here, the notification may include at least one of a message notification (e.g., a message received), a phone application notification (e.g., a call received), or an application push notification (e.g., a driving guide of a navigation application).

[0074] For example, in a second situation (320), the electronic device (101) can obtain a notification while transmitting a media file through communication connections (311, 313, 315) with electronic devices (201, 203, 205). For example, in a third situation (330), the electronic device (101) can obtain a notification while transmitting a media file through a communication connection (315) with electronic device (205).

[0075] In one embodiment, the electronic device (101) may output a notification through a device other than the electronic device (205). For example, the electronic device (101) may output a notification through at least one speaker (250) and / or a display (260) of the electronic device (101). For example, the electronic device (101) may output a notification through at least one speaker (251, 253) of the electronic device (201, 203).

[0076] In one embodiment, the electronic device (101) can output a notification through a connection other than the communication connection (315). In a second situation (320), the electronic device (101) can output a notification through at least one communication connection (311, 313) with at least one electronic device (201, 203) while transmitting a media file through the communication connections (311, 313, 315) with the electronic devices (201, 203, 205). In a third situation (330), the electronic device (101) can activate through at least one communication connection (311, 313) with at least one electronic device (201, 203) while transmitting a media file through the communication connection (315) with the electronic device (205). Here, the activation can include establishing at least one communication connection (311, 313) through an instant connection request. Activation may include activation of at least one communication connection (311, 313) in a standby state.

[0077] As described above, the electronic device (101) can provide a notification received by the electronic device (101) to the user. The electronic device (101) can avoid disturbing other users of the vehicle (210) by providing the notification received by the electronic device (101) to the user through the electronic device (101) or at least one electronic device (201, 203). The electronic device (101) can provide information only to the user by providing the notification received by the electronic device (101) to the user through the electronic device (101) or at least one electronic device (201, 203).

[0078] Below, the operation of the electronic device (101) processing information from the electronic device (205) is described.

[0079] In one embodiment, the electronic device (205) can identify object information. The electronic device (205) can identify object information while the vehicle (210) is driving. The electronic device (205) can identify object information while power is supplied from the vehicle (210). The electronic device (205) can identify object information through a sensor (275). The electronic device (205) can identify object information for a plurality of objects selected from among all objects located around the vehicle (210). Here, the object information may be information related to a plurality of objects located in the driving direction of the vehicle (210). For example, the plurality of objects may include obstacles (e.g., other vehicles), facilities (e.g., speed bumps, pedestrians, or signs) located in the driving direction of the vehicle (210).

[0080] In one embodiment, the electronic device (205) can identify whether a first communication connection is established. The electronic device (205) can identify whether the first communication connection is established based on the identification of object information. For example, the electronic device (205) can identify whether the first communication connection needs to be established to transmit object information. For example, if a communication connection with the electronic device (101) is not established, the electronic device (205) can identify that the first communication connection needs to be established. For example, if it is difficult to transmit object information through the communication connection (315) with the electronic device (101), the electronic device (205) can identify that the first communication connection needs to be established. For example, if the communication connection (315) is a one-way communication connection from the electronic device (101) to the electronic device (205), the electronic device (205) can identify that the first communication connection needs to be established.

[0081] In one embodiment, the electronic device (205) may transmit a request for a first communication connection to the electronic device (101) based on the identification that establishment of a first communication connection is required. The electronic device (205) may establish the first communication connection based on the request for the first communication connection to the electronic device (101). Here, the first communication connection may be distinguished from the communication connection (315) used to receive an audio file. For example, the communication connection (315) used to receive an audio file may be a one-way communication connection, and the first communication connection may be a two-way communication connection. However, the present invention is not limited thereto. For example, the communication connection (315) may be a communication connection based on LE audio, and the first communication connection may be a two-way communication connection of another type (e.g., a communication connection based on WiFi, BT, or BLE).

[0082] In one embodiment, the electronic device (205) can transmit object information to the electronic device (101) based on the first communication connection.

[0083] In one embodiment, the electronic device (101) can receive object information via a first communication connection.

[0084] In one embodiment, the electronic device (101) may output notification information. The electronic device (101) may output notification information for at least one object among a plurality of objects. The electronic device (101) may output notification information for at least one object among the plurality of objects based on the user's gaze. For example, the electronic device (101) may output notification information for at least one object among the plurality of objects that the user has not recognized. For example, the electronic device (101) may output notification information for at least one object that is out of the user's gaze among the plurality of objects. Here, the user's unawareness of the object may mean that the user's gaze is not directed to the object after the object's state has changed. The user's unawareness of the object may mean that the user's gaze, identified through the sensor (275) of the automobile (210), is not directed to the object. The user's unawareness of an object may mean that the user's gaze identified by the sensor (270) of the electronic device (101) is not directed to the object. Here, the object being out of sight may mean that the user's gaze is not directed to the object after the state of the object changes. The object being out of sight may mean that the user's gaze identified by the sensor (275) of the automobile (210) is not directed to the object. The object being out of sight may mean that the user's gaze identified by the sensor (270) of the electronic device (101) is not directed to the object.

[0085] In one embodiment, the electronic device (101) can output notification information through the speaker (250). The electronic device (101) can output notification information through the display (260). The electronic device (101) can output notification information through the speaker (250) and the display (260).

[0086] In one embodiment, the electronic device (101) can output notification information through at least one electronic device (201, 203). The electronic device (101) can output notification information through at least one speaker (251, 253) of at least one electronic device (201, 203).

[0087] In one embodiment, the electronic device (101) can output notification information through the electronic device (101) and at least one electronic device (201, 203). The electronic device (101) can output notification information through the display (260) of the electronic device (101) and at least one speaker (251, 253) of the at least one electronic device (201, 203).

[0088] In one embodiment, the electronic device (101) may output notification information based on a passenger of the vehicle (210). The electronic device (101) may output notification information based on other passengers in addition to the user of the electronic device (101). For example, the electronic device (101) may output notification information through the electronic device (101) and / or at least one electronic device (201, 203) based on the presence of other passengers. For example, the electronic device (101) may output notification information through the electronic device (205) based on the absence of other passengers. For example, the electronic device (101) may request the electronic device (205) to output notification information based on the absence of other passengers.

[0089] As described above, the electronic device (101) can provide a notification to the user based on the object information detected by the electronic device (205). The electronic device (101) can avoid disturbing other users of the vehicle (210) by providing a notification to the user through the electronic device (101) or at least one electronic device (201, 203) based on the object information detected by the electronic device (205). The electronic device (101) can provide information only to the user by providing a notification to the user through the electronic device (101) or at least one electronic device (201, 203) based on the object information detected by the electronic device (205).

[0090] Below, the operation of mirroring a stereoscopic image through an electronic device (101) via an electronic device (205) is described.

[0091] In one embodiment, the processor (120) may display an image that takes binocular parallax into account through the display (260). Here, the image that takes binocular parallax into account may include a stereoscopic image. The stereoscopic image may be an image that provides a three-dimensional (3D) sense of space to the user. Here, the stereoscopic image may reflect an actual space. Reflecting an actual space may mean that at least one object existing in an actual space can be shown to the user through the display (260) through pass-through. Pass-through may mean an image processing technique that, while displaying a screen representing a virtual space on the display (260), displays another screen representing an actual space by superimposing it on at least a portion of the screen.

[0092] In one embodiment, the electronic device (101) may broadcast an advertising signal (e.g., a pilot signal or a beacon signal). The electronic device (101) may periodically broadcast the advertising signal to identify the electronic device (205) of the vehicle (210) while displaying an image that takes binocular parallax into account. However, the present invention is not limited thereto. The electronic device (101) may obtain an advertising signal (e.g., a pilot signal or a beacon signal) from the electronic device (205) while displaying an image that takes binocular parallax into account.

[0093] In one embodiment, the electronic device (101) can establish a communication connection (315) with the electronic device (205). While displaying an image that takes binocular disparity into account, the electronic device (101) can establish a communication connection (315) with the electronic device (205). Here, the communication connection (315) may be a communication connection based on Bluetooth. For example, the communication connection (315) may be a communication connection based on LE audio. However, the present invention is not limited thereto. The communication connection (315) may be a communication connection based on BLE. The communication connection (315) may be a communication connection based on a communication technique different from Bluetooth. For example, the communication connection (315) may be a communication connection based on WiFi. The communication connection (315) may be a one-way communication connection from the electronic device (101) to the vehicle (210). The communication connection (315) may be a two-way communication connection different from Bluetooth.

[0094] In one embodiment, the processor (120) may transmit an image to the vehicle (210) via the communication connection (315). The processor (120) may transmit a file related to the image to the vehicle (210) via the communication connection (315) so that the vehicle (210) outputs the image via the display (265). In one embodiment, the image transmitted to the vehicle (210) may be an original image for generating a stereoscopic image in the electronic device (101). In one embodiment, the image transmitted to the vehicle (210) may be a monoscopic image. Here, the display (265) of the vehicle (210) may be at least one of a digital instrument cluster, a head-up display, or a center information display (CID) of the vehicle (210). However, the present invention is not limited thereto.

[0095] In one embodiment, the electronic device (101) can transmit a control signal to cause the electronic device (205) to display a stereoscopic image more clearly. Based on transmitting the stereoscopic image, the electronic device (101) can transmit a control signal to cause the electronic device (205) to display the stereoscopic image more clearly. The electronic device (101) can display the stereoscopic image output by the electronic device (101) more faintly. Based on transmitting the stereoscopic image, the electronic device (101) can display the stereoscopic image output by the electronic device (101) more faintly.

[0096] In one embodiment, the electronic device (101) can stop displaying a stereoscopic image through the electronic device (101). The electronic device (101) can stop displaying a stereoscopic image through the electronic device (101) while the electronic device (205) displays the stereoscopic image. The electronic device (101) can display only a pass-through area reflecting the actual space through the display (260).

[0097] In one embodiment, the electronic device (101) can obtain a notification. The electronic device (101) can obtain a notification while displaying a stereoscopic image through the electronic device (205). Here, the notification may include at least one of a message notification (e.g., a message received), a phone application notification (e.g., a call received), or an application push notification (e.g., a driving guidance notification of a navigation application). The electronic device (101) can output the notification through a device other than the electronic device (205). For example, the electronic device (101) can output the notification through at least one speaker (250) and / or display (260) of the electronic device (101). For example, the electronic device (101) can output the notification through at least one speaker (251, 253) of the electronic devices (201, 203).

[0098] In one embodiment, the electronic device (101) may obtain a notification from the electronic device (205). The electronic device (101) may obtain the notification from the electronic device (205) while displaying a stereoscopic image through the electronic device (205). Here, the notification may include information related to a plurality of objects located in the driving direction of the vehicle (210). For example, the plurality of objects may include obstacles (e.g., other vehicles), facilities (e.g., speed bumps, pedestrians, or signs) located in the driving direction of the vehicle (210). The electronic device (101) may output a notification through at least one electronic device among the electronic devices (101, 201, 203, 205). The electronic device (101) may output notification information through the speaker (250). The electronic device (101) may output notification information through the display (260). The electronic device (101) may output notification information through the speaker (250) and the display (260). The electronic device (101) may output notification information through at least one electronic device (201, 203). The electronic device (101) may output notification information through at least one speaker (251, 253) of at least one electronic device (201, 203). For example, the electronic device (101) may output notification information through the electronic device (205) based on the absence of other passengers. For example, the electronic device (101) may request the electronic device (205) to output notification information based on the absence of other passengers.

[0099] As described above, the electronic device (101) can provide a notification received by the electronic device (101) to the user. The electronic device (101) can avoid disturbing other users of the vehicle (210) by providing the notification received by the electronic device (101) to the user through the electronic device (101) or at least one electronic device (201, 203). The electronic device (101) can provide information only to the user by providing the notification received by the electronic device (101) to the user through the electronic device (101) or at least one electronic device (201, 203).

[0100] As described above, the electronic device (101) is exemplified as displaying a stereoscopic image through the display (260), but this is merely an example. The electronic device (101) according to one embodiment can display a stereoscopic image through the electronic devices (201, 203). For example, the electronic devices (201, 203) can constitute a wearable device capable of displaying a stereoscopic image. In this case, the electronic device (101) can display a stereoscopic image through the electronic devices (201, 203). Thereafter, based on the communication connection with the electronic device (205), the electronic device (101) can display the stereoscopic image displayed through the electronic device (201, 203) through the electronic device (205).

[0101] Hereinafter, with reference to FIG. 3b, an operation of the electronic device (101) to adjust the volume can be described.

[0102] FIG. 3b illustrates an example of volume control between electronic devices (101, 201, 203, 205) according to one embodiment.

[0103] Figure 3b can be explained with reference to Figures 1, 2 and 3a.

[0104] In one embodiment, volume (351) may refer to the size of an audio signal output through at least one electronic device (201, 203). Volume (355) may refer to the size of an audio signal output through the electronic device (205).

[0105] In one embodiment, in the first situation (310), the electronic device (201, 203) may output content based on a media file through at least one speaker (251, 253). The electronic device (205) may not output content based on a media file through the speaker (255).

[0106] In one embodiment, in the second situation (320), electronic devices (201, 203, 205) can output content based on a media file through speakers (251, 253, 255). The size of an audio signal of the content output by the electronic device (205) can be gradually increased. The size of an audio signal of the content output by at least one electronic device (201, 203) can be gradually decreased. The audio of the content output by at least one electronic device (201, 203) can be muted. The size of an audio signal of the content output by at least one electronic device (201, 203) can converge to 0.

[0107] In one embodiment, in the third situation (330), the electronic device (205) may output content based on a media file through a speaker (255). The electronic device (201, 203) may not output content based on a media file through at least one speaker (251, 253).

[0108] FIG. 3c illustrates an example of a sequence of communication connections between electronic devices (101, 201, 203, 205) according to one embodiment.

[0109] Figure 3c can be explained with reference to Figures 1, 2 and 3a.

[0110] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0111] According to one embodiment, operations 361 to 372 may be understood to be performed in each processor (120, 221, 223, 225) of the electronic devices (101, 201, 203, 205).

[0112] In one embodiment, the electronic device (220) of FIG. 3C may refer to a set of electronic devices (201, 203). For example, an operation performed by the electronic device (101) on the electronic device (220) may refer to an operation performed on each of the electronic devices (201, 203). For example, an operation performed by the electronic device (101) on the electronic device (220) may refer to an operation performed on at least one of the electronic devices (201, 203).

[0113] In one embodiment, referring to FIG. 3c, in operation 361, an electronic device (101) and an electronic device (220) may be connected to each other for communication. For example, the electronic device (101) may establish at least one communication connection (311, 313) with at least one electronic device (201, 203).

[0114] In one embodiment, at operation 362, the electronic device (101) may detect the electronic device (205). For example, the electronic device (101) may detect the electronic device (205) based on broadcasting an advertising signal (e.g., a pilot signal or a beacon signal). The electronic device (101) may detect the electronic device (205) based on receiving an advertising signal from the electronic device (205).

[0115] In one embodiment, in operation 363, the electronic device (101) may request the electronic device (205) to establish a communication connection. However, this is not limited thereto. The electronic device (205) may request the electronic device (101) to establish a communication connection.

[0116] In one embodiment, in operation 364, the electronic device (101) and the electronic device (205) may be connected to each other for communication. Here, the communication connection between the electronic device (101) and the electronic device (205) may be a two-way communication connection. For example, the communication connection between the electronic device (101) and the electronic device (205) may be a communication connection based on at least one of LE audio, Bluetooth, BLE, or WiFi. However, the present invention is not limited thereto.

[0117] In one embodiment, at operation 365, the electronic device (101) may request the electronic device (220) to standby. The standby of the electronic device (220) may mean that the communication connection between the electronic device (101) and the electronic device (220) is deactivated. The deactivation of the communication connection may mean that only signals for maintaining the communication connection (e.g., pilot signals) are transmitted and received.

[0118] In one embodiment, at operation 366, the electronic device (205) can identify an object. The electronic device (205) can identify the object while the vehicle (210) is driving. The electronic device (205) can identify the object while power is supplied from the vehicle (210). The electronic device (205) can identify the object through a sensor (275). The electronic device (205) can identify a plurality of objects selected from among all objects located around the vehicle (210). Here, the plurality of objects can include obstacles (e.g., other vehicles), facilities (e.g., speed bumps, pedestrians, or signs) located in the driving direction of the vehicle (210).

[0119] In one embodiment, at operation 367, the electronic device (205) may transmit object information to the electronic device (101) based on a communication connection between the electronic device (101) and the electronic device (205).

[0120] In one embodiment, at operation 368, the electronic device (101) may determine whether to output object information externally.

[0121] In one embodiment, the electronic device (101) may determine whether to output object information from at least one electronic device (201, 203) based on whether the user is wearing at least one electronic device (201, 203). If the user is wearing at least one electronic device (201, 203), the electronic device (101) may determine to output object information from at least one electronic device (201, 203). If the user is not wearing at least one electronic device (201, 203), the electronic device (101) may determine to output object information from the electronic device (101).

[0122] In one embodiment, the electronic device (101) may determine whether to output object information externally based on a passenger of the vehicle (210). The electronic device (101) may determine whether to output object information externally based on other passengers in addition to the user of the electronic device (101). For example, the electronic device (101) may output notification information through at least one electronic device (201, 203) based on the presence of other passengers. For example, the electronic device (101) may output notification information through the electronic device (101) based on the absence of other passengers. However, the present invention is not limited thereto. For example, the electronic device (101) may request the output of notification information from the electronic device (205) based on the absence of other passengers.

[0123] In one embodiment, at operation 369, the electronic device (101) may request an immediate connection from the electronic device (220). The electronic device (101) may activate a communication connection with the electronic device (220). Here, the activation may include establishing at least one communication connection through an immediate connection request to the electronic device (201, 203). The activation may include activating at least one communication connection in a standby state.

[0124] In one embodiment, in operation 370, the electronic device (101) may transmit a notification to at least one electronic device (201, 203). The electronic device (101) may transmit notification information about an object to at least one electronic device (201, 203).

[0125] In one embodiment, in operation 371, the electronic device (220) may output notification information. At least one electronic device (201, 203) may output the notification information through at least one speaker (251, 253).

[0126] In one embodiment, in operation 372, the electronic device (101) may output notification information. The electronic device (101) may output the notification information through the speaker (250). The electronic device (101) may output the notification information through the display (260). The electronic device (101) may output the notification information through the speaker (250) and the display (260).

[0127] FIG. 3d illustrates an example of a driving situation of a vehicle (210) according to one embodiment.

[0128] In one embodiment, referring to FIG. 3D, a user may view the exterior of a car (210) through a windshield of the car (210). The surroundings of the car (210) may include at least one object (381, 383, 385).

[0129] In one embodiment, the electronic device (101) and / or the electronic device (205) of the automobile (210) can identify the user's gaze (390).

[0130] In one embodiment, the electronic device (101) can identify the user's gaze (390) through the sensor (270). In this case, the electronic device (205) can transmit information related to a plurality of objects (381, 383, 385) selected from among all objects located around the vehicle (210) to the electronic device (101). For example, the electronic device (205) can transmit information related to a plurality of objects (381, 383, 385) located in the driving direction of the vehicle (210) to the electronic device (101). The electronic device (101) can output a notification for at least one object based on the information related to the plurality of objects (381, 383, 385) from the electronic device (205). For example, the electronic device (101) may output a notification for at least one object among a plurality of objects (381, 383, 385) to which the user's gaze (390) is not directed. For example, the electronic device (101) may output notification information for at least one object (e.g., objects (383, 385)) that the user does not recognize among the plurality of objects (381, 383, 385). For example, the electronic device (101) may output notification information for at least one object (e.g., objects (383, 385)) that is out of the user's gaze (390) among the plurality of objects (381, 383, 385). Here, the user's unawareness of the object may mean that the user's gaze (390) is not directed to the object after the state of the object is changed. The user's unawareness of an object may mean that the object identified by the sensor (275) of the vehicle (210) is not directed toward the user's gaze (390). Here, the object being out of the gaze (390) may mean that the user's gaze (390) is not directed toward the object after the state of the object has changed.An object being out of sight (390) may mean that the object identified by the sensor (275) of the car (210) is not directed at the user's sight (390).

[0131] In one embodiment, the electronic device (205) can identify the user's gaze (390) through the sensor (275). In this case, the electronic device (205) can provide the electronic device (101) with information about at least one object (e.g., objects (383, 385)) among a plurality of objects (381, 383, 385) located around the vehicle (210) toward which the gaze (390) is not directed.

[0132] Figure 4 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0133] Figure 4 can be explained with reference to Figures 1 and 2.

[0134] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0135] According to one embodiment, operations 410 to 430 may be understood to be performed in an electronic device (e.g., a processor (e.g., processor (120) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 2).

[0136] In one embodiment, referring to FIG. 4, at operation 410, the processor (120) may receive a request for a first communication connection. The processor (120) may receive a request for the first communication connection from an electronic device (205) of a vehicle (210). Here, the first communication connection may be a communication connection based on Bluetooth. For example, the first communication connection may be a communication connection based on LE (low energy) audio. However, the present invention is not limited thereto. The first communication connection may be a communication connection based on BLE (Bluetooth low energy). The first communication connection may be a communication connection based on a communication technique different from Bluetooth. For example, the first communication connection may be a communication connection based on WiFi. The first communication connection may be a one-way communication connection from the vehicle (210) to the electronic device (101). The first communication connection may be a two-way communication connection different from Bluetooth.

[0137] In one embodiment, the processor (120) may establish a first communication connection. The processor (120) may establish the first communication connection in response to a request for the first communication connection from an electronic device (205) of the vehicle (210). The processor (120) may establish the first communication connection with the vehicle (210) based on the request for the first communication connection from the electronic device (205) of the vehicle (210).

[0138] In one embodiment, in operation 420, the processor (120) may receive notification information based on the first communication connection. Here, the notification information may be information generated in the vehicle (210). The notification information may be information acquired through a sensor (275) of the vehicle (210). The notification information may be information related to a plurality of objects (381, 383, 385) selected from among all objects located around the vehicle (210). For example, the notification information may be information related to a plurality of objects (381, 383, 385) located in the driving direction of the vehicle (210). For example, the plurality of objects (381, 383, 385) may include obstacles (e.g., other vehicles), facilities (e.g., speed bumps, pedestrians, or signs) located in the driving direction of the vehicle (210).

[0139] In one embodiment, at operation 430, the processor (120) may output notification information. The processor (120) may output notification information for at least one object among a plurality of objects (381, 383, 385). The processor (120) may output notification information for at least one object among the plurality of objects (381, 383, 385) based on the user's line of sight (390). For example, the processor (120) may output notification information for at least one object that the user does not recognize among the plurality of objects (381, 383, 385). For example, the processor (120) may output notification information for at least one object that is out of the line of sight (390) among the plurality of objects (381, 383, 385). Here, the user's unawareness of the object may mean that the user's gaze (390) is not directed to the object after the state of the object has changed. The user's unawareness of the object may mean that the user's gaze (390) is not directed to the object identified through the sensor (275) of the car (210). Here, the object moving out of the gaze (390) may mean that the user's gaze (390) is not directed to the object after the state of the object has changed. The object moving out of the gaze (390) may mean that the user's gaze (390) is not directed to the object identified through the sensor (275) of the car (210).

[0140] In one embodiment, the processor (120) may output notification information through the speaker (250). The processor (120) may output notification information through the display (260). The processor (120) may output notification information through the speaker (250) and the display (260).

[0141] In one embodiment, the processor (120) may output notification information through at least one electronic device (201, 203). The processor (120) may output notification information through at least one speaker (251, 253) of at least one electronic device (201, 203).

[0142] In one embodiment, the processor (120) can output notification information through the electronic device (101) and at least one electronic device (201, 203). The processor (120) can output notification information through the display (260) of the electronic device (101) and at least one speaker (251, 253) of the at least one electronic device (201, 203).

[0143] In one embodiment, the processor (120) may output notification information based on a passenger of the vehicle (210). The processor (120) may output notification information based on other passengers in addition to the user of the electronic device (101). For example, the processor (120) may output notification information through the electronic device (101) and / or at least one electronic device (201, 203) based on the absence of other passengers. For example, the processor (120) may output notification information through the electronic device (205) based on the presence of other passengers. For example, the processor (120) may request the electronic device (205) to output notification information based on the presence of other passengers.

[0144] Figure 5 is a flowchart showing the operation of an electronic device according to one embodiment.

[0145] FIG. 5 may be described with reference to FIGS. 1 and 2. For example, the operations of FIG. 5 may be included in operation 430 of FIG. 4. For example, the operations of FIG. 5 may be performed after operation 420 of FIG. 4. However, the present invention is not limited thereto.

[0146] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0147] According to one embodiment, operations 510 to 530 may be understood to be performed in an electronic device (e.g., a processor of an electronic device (101) of FIG. 2 (e.g., a processor (120) of FIG. 2)).

[0148] In one embodiment, referring to FIG. 5, in operation 510, the processor (120) may identify the user's gaze (390). The processor (120) may identify the user's gaze (390) through the sensor (270).

[0149] In one embodiment, in operation 520, the processor (120) may identify an object out of the line of sight (390) among a plurality of objects (381, 383, 385) based on the line of sight (390). Here, the object being out of the line of sight (390) may mean that the user's line of sight (390) is not directed toward the object after the state of the object is changed. The object being out of the line of sight (390) may mean that the user's line of sight (390) is not directed toward the object identified through the sensor (275) of the automobile (210).

[0150] In one embodiment, in operation 530, the processor (120) may output notification information about an object that is out of the line of sight (390). For example, the processor (120) may output notification information about at least one object that is out of the line of sight (390) among a plurality of objects (381, 383, 385). For example, the processor (120) may output notification information about at least one object that is out of the line of sight (390) among a plurality of objects (381, 383, 385) located in the driving direction. For example, the processor (120) may output notification information about at least one object that is out of the line of sight (390) among a plurality of objects (381, 383, 385) that have a possibility of collision with the automobile (210). Here, the probability of collision can be calculated based on at least one of the driving direction, driving speed, driving acceleration, relative position of the object, moving direction, moving speed, or moving acceleration of the object of the vehicle (210). Here, the probability of collision can be calculated based on at least one of the relative distance, relative speed, or relative acceleration between the vehicle (210) and the object.

[0151] In one embodiment, the processor (120) may output notification information about an object that is out of the line of sight (390) through the speaker (250) and / or the display (260). The processor (120) may output notification information about an object that is out of the line of sight (390) through at least one electronic device (201, 203). The processor (120) may output notification information about an object that is out of the line of sight (390) through the electronic device (101) and / or at least one electronic device (201, 203).

[0152] In one embodiment, the processor (120) may output notification information about an object that is out of the line of sight (390) based on an occupant of the vehicle (210). For example, the processor (120) may output notification information about an object that is out of the line of sight (390) through the electronic device (101) and / or at least one electronic device (201, 203) based on the absence of other occupants. For example, the processor (120) may output notification information about an object that is out of the line of sight (390) through the electronic device (205) based on the presence of other occupants.

[0153] Figure 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0154] FIG. 6 may be described with reference to FIGS. 1 and 2. For example, the operations of FIG. 6 may be performed prior to operation 410 of FIG. 4. However, the present invention is not limited thereto.

[0155] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0156] According to one embodiment, operations 610 to 640 may be understood to be performed in an electronic device (e.g., a processor of an electronic device (101) of FIG. 2 (e.g., a processor (120) of FIG. 2)).

[0157] In one embodiment, referring to FIG. 6, at operation 610, the processor (120) may output audio through a second communication connection. The processor (120) may output audio through at least one electronic device (201, 203) based on the second communication connection. The processor (120) may output audio based on the second communication connection with each of the electronic devices (201, 203). However, the present invention is not limited thereto. The processor (120) may output audio based on the second communication connection with one electronic device (e.g., electronic device (201)). Another electronic device (e.g., electronic device (203)) may output audio by sniffing the second communication connection. Here, the second communication connection may be a communication connection based on Bluetooth. For example, the second communication connection may be a communication connection based on LE audio. However, the present invention is not limited thereto. The second communication connection may be a communication connection based on BLE. The second communication connection may be a communication connection based on a communication technique different from Bluetooth. For example, the second communication connection may be a communication connection based on WiFi. The second communication connection may be a one-way communication connection from the electronic device (101) to at least one electronic device (201, 203). The second communication connection may be a two-way communication connection using a technique different from Bluetooth.

[0158] In one embodiment, the processor (120) may transmit an audio file to at least one electronic device (201, 203) via the second communication connection so that at least one electronic device (201, 203) outputs audio.

[0159] In one embodiment, at operation 620, the processor (120) may determine whether the vehicle (210) is identified. The processor (120) may determine whether the vehicle (210) is identified based on a signal (e.g., an advertising signal) based on a specified communication technique. For example, the processor (120) may determine whether the vehicle (210) is identified based on a response from the vehicle (210) to a signal (e.g., an advertising signal) based on a specified communication technique.

[0160] In one embodiment, in operation 620, if the vehicle (210) is identified, the processor (120) may perform operation 630. In operation 620, if the vehicle (210) is not identified, the processor (120) may perform operation 610 again.

[0161] In one embodiment, at operation 630, the processor (120) may establish another communication connection with the vehicle (210). The processor (120) may establish another communication connection with the vehicle (210) based on a specified communication technique.

[0162] In one embodiment, at operation 640, the processor (120) may transmit an audio file to the vehicle (210) via another communication connection. The processor (120) may transmit the audio file to the vehicle (210) via another communication connection so that the vehicle (210) outputs audio.

[0163] Figure 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0164] Figure 7 can be explained with reference to Figures 1 and 2.

[0165] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0166] According to one embodiment, operations 710 to 760 may be understood to be performed in an electronic device (e.g., a processor of an electronic device (101) of FIG. 2 (e.g., a processor (120) of FIG. 2)).

[0167] In one embodiment, referring to FIG. 7, at operation 710, the processor (120) may receive a request for a first communication connection. The processor (120) may receive a request for the first communication connection from an electronic device (205) of a vehicle (210). Here, the first communication connection may be a communication connection based on Bluetooth. For example, the first communication connection may be a communication connection based on LE audio. However, the present invention is not limited thereto. The first communication connection may be a communication connection based on BLE. The first communication connection may be a communication connection based on a communication technique different from Bluetooth. For example, the first communication connection may be a communication connection based on WiFi. The first communication connection may be a one-way communication connection from the vehicle (210) to the electronic device (101). The first communication connection may be a two-way communication connection in a technique different from Bluetooth.

[0168] In one embodiment, at operation 720, the processor (120) may determine whether the existing communication connection is a bidirectional communication connection. The processor (120) may determine whether the existing communication connection with the vehicle (210) is a bidirectional communication connection. The processor (120) may determine whether the existing communication connection for transmitting a media file (e.g., an audio file) to the vehicle (210) is a bidirectional communication connection.

[0169] In one embodiment, in operation 720, if the existing communication connection is a two-way communication connection, the processor (120) may perform operation 730. In operation 720, if the existing communication connection is not a two-way communication connection, the processor (120) may perform operation 750. In operation 720, if the existing communication connection is a one-way communication connection, the processor (120) may perform operation 750. Here, the one-way communication connection may be a communication connection from the electronic device (101) to the automobile (210).

[0170] In one embodiment, at operation 730, the processor (120) may receive notification information based on an existing communication connection. Here, the notification information may be information generated in the vehicle (210). The notification information may be information acquired through a sensor (275) of the vehicle (210). The notification information may be information related to a plurality of objects (381, 383, 385) selected from among all objects located around the vehicle (210). For example, the notification information may be information related to a plurality of objects (381, 383, 385) located in the driving direction of the vehicle (210). For example, the plurality of objects (381, 383, 385) may include obstacles (e.g., other vehicles) or facilities (e.g., speed bumps, pedestrians, or signs) located in the driving direction of the vehicle (210).

[0171] In one embodiment, at operation 740, the processor (120) may output notification information. The processor (120) may output notification information for at least one object among a plurality of objects (381, 383, 385). The processor (120) may output notification information for at least one object among the plurality of objects (381, 383, 385) based on the user's line of sight (390). For example, the processor (120) may output notification information for at least one object that the user does not recognize among the plurality of objects (381, 383, 385). For example, the processor (120) may output notification information for at least one object that is out of the line of sight (390) among the plurality of objects (381, 383, 385). Here, the user's unawareness of the object may mean that the user's gaze (390) is not directed to the object after the state of the object has changed. The user's unawareness of the object may mean that the user's gaze (390) is not directed to the object identified through the sensor (275) of the car (210). Here, the object moving out of the gaze (390) may mean that the user's gaze (390) is not directed to the object after the state of the object has changed. The object moving out of the gaze (390) may mean that the user's gaze (390) is not directed to the object identified through the sensor (275) of the car (210).

[0172] In one embodiment, the processor (120) may output notification information through the speaker (250). The processor (120) may output notification information through the display (260). The processor (120) may output notification information through the speaker (250) and the display (260).

[0173] In one embodiment, the processor (120) may output notification information through at least one electronic device (201, 203). The processor (120) may output notification information through at least one speaker (251, 253) of at least one electronic device (201, 203).

[0174] In one embodiment, the processor (120) can output notification information through the electronic device (101) and at least one electronic device (201, 203). The processor (120) can output notification information through the display (260) of the electronic device (101) and at least one speaker (251, 253) of the at least one electronic device (201, 203).

[0175] In one embodiment, the processor (120) may output notification information based on a passenger of the vehicle (210). The processor (120) may output notification information based on other passengers in addition to the user of the electronic device (101). For example, the processor (120) may output notification information through the electronic device (101) and / or at least one electronic device (201, 203) based on the absence of other passengers. For example, the processor (120) may output notification information through the electronic device (205) based on the presence of other passengers. For example, the processor (120) may request the electronic device (205) to output notification information based on the presence of other passengers.

[0176] In one embodiment, at operation 750, the processor (120) may establish a first communication connection. The processor (120) may establish the first communication connection in response to a request for the first communication connection from an electronic device (205) of the vehicle (210). The processor (120) may establish the first communication connection with the vehicle (210) based on the request for the first communication connection from the electronic device (205) of the vehicle (210).

[0177] In one embodiment, the processor (120) may release an existing communication connection based on establishing a first communication connection. According to one embodiment, the processor (120) may switch the existing communication connection to the first communication connection. Here, switching the existing communication connection to the first communication connection may mean releasing the existing communication connection and establishing the first communication connection.

[0178] In one embodiment, at operation 760, the processor (120) may receive notification information based on a first communication connection. Thereafter, the processor (120) may output the received notification information based on the first communication connection.

[0179] Figure 8 is a flowchart showing the operation of an electronic device according to one embodiment.

[0180] Figure 8 can be explained with reference to Figures 1 and 2.

[0181] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0182] According to one embodiment, operations 810 to 840 may be understood to be performed in an electronic device (e.g., a processor of an electronic device (101) of FIG. 2 (e.g., a processor (120) of FIG. 2)).

[0183] In one embodiment, the electronic device (101) performing the operation of FIG. 8 may be a device wearable by a user. For example, the electronic device (101) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the device.

[0184] In one embodiment, referring to FIG. 8, in operation 810, the processor (120) may display a stereoscopic image through the display (260). The stereoscopic image may be an image that takes into account the user's binocular parallax. The stereoscopic image may be an image for providing the user with a three-dimensional (3D) sense of space. Here, the stereoscopic image may reflect an actual space. Reflecting an actual space may mean that at least one object existing in an actual space can be shown to the user through the display (260) through pass-through. Pass-through may mean an image processing technique that, while displaying a screen representing a virtual space on the display (260), displays another screen representing an actual space by superimposing it on at least a portion of the screen.

[0185] In one embodiment, at operation 820, the processor (120) may determine whether the vehicle (210) is identified. The processor (120) may determine whether the vehicle (210) is identified based on a signal (e.g., an advertising signal) based on a specified communication technique. For example, the processor (120) may determine whether the vehicle (210) is identified based on a response from the vehicle (210) to a signal (e.g., an advertising signal) based on a specified communication technique.

[0186] In one embodiment, in operation 820, if the vehicle (210) is identified, the processor (120) may perform operation 830. In operation 820, if the vehicle (210) is not identified, the processor (120) may perform operation 810 again.

[0187] In one embodiment, at operation 830, the processor (120) may establish a communication connection with the vehicle (210). The processor (120) may establish a communication connection with the vehicle (210) based on a specified communication technique. Here, the communication connection may be a communication connection based on Bluetooth. For example, the communication connection may be a communication connection based on LE audio. However, the present invention is not limited thereto. The communication connection may be a communication connection based on BLE. The communication connection may be a communication connection based on a communication technique different from Bluetooth. For example, the communication connection may be a communication connection based on WiFi. The communication connection may be a one-way communication connection from the electronic device (101) to at least one electronic device (201, 203). The communication connection may be a two-way communication connection in a different manner from Bluetooth.

[0188] In one embodiment, at operation 840, the processor (120) may transmit an image to the vehicle (210) via a communication connection. The processor (120) may transmit a file related to the image to the vehicle (210) via another communication connection so that the vehicle (210) outputs the image via the display (265). In one embodiment, the image transmitted to the vehicle (210) may be an original image for generating a stereoscopic image in the electronic device (101). In one embodiment, the image transmitted to the vehicle (210) may be a monoscopic image. Here, the display (265) of the vehicle (210) may be at least one of a digital instrument cluster, a head-up display, or a center information display (CID) of the vehicle (210). However, the present invention is not limited thereto.

[0189] Figure 9 is a flowchart showing the operation of an electronic device (205) according to one embodiment.

[0190] Figure 9 can be explained with reference to Figures 1 and 2.

[0191] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0192] According to one embodiment, operations 910 to 940 may be understood to be performed in an electronic device of a vehicle (210) (e.g., a processor of an electronic device (205) of FIG. 2 (e.g., a processor (225) of FIG. 2)).

[0193] In one embodiment, referring to FIG. 9, at operation 910, the processor (225) may receive an audio file via a communication connection. For example, the processor (225) may receive the audio file via a communication connection with the electronic device (101). Here, receiving the audio file by the processor (225) may include sequentially receiving portions of the audio file from the electronic device (101). For example, receiving the audio file by the processor (225) may include obtaining audio data streamed from the electronic device (101).

[0194] The processor (225) can output audio based on the received audio file. The processor (225) can output audio through the speaker (255) based on the received audio file. However, the present invention is not limited thereto. For example, the processor (225) can receive a multimedia file (e.g., an image file, a video file) through a communication connection. The processor (225) can output content related to the multimedia file through the speaker (255) and / or the display (265) based on the received multimedia file.

[0195] In one embodiment, at operation 920, the processor (225) may identify object information. The processor (225) may identify object information through the sensor (275). The processor (225) may identify object information for a plurality of objects (381, 383, 385) selected from among all objects located around the vehicle (210). Here, the object information may be information related to a plurality of objects (381, 383, 385) located in the driving direction of the vehicle (210). For example, the plurality of objects (381, 383, 385) may include obstacles (e.g., other vehicles) located in the driving direction of the vehicle (210), facilities (e.g., speed bumps, pedestrians, or signs).

[0196] In one embodiment, at step 930, the processor (225) may establish a first communication connection. The processor (225) may transmit a request for the first communication connection to the electronic device (101). Based on the request for the first communication connection to the electronic device (101), the processor (225) may establish the first communication connection. Here, the first communication connection may be distinct from a communication connection used to receive an audio file. For example, the first communication connection may be distinct from a communication connection used to sequentially receive portions of an audio file from the electronic device (101). For example, the first communication connection may be distinct from a communication connection used to receive audio data streamed from the electronic device (101). For example, the communication connection used to receive the audio file (e.g., the second communication connection) may be a one-way communication connection, and the first communication connection may be a two-way communication connection. The communication connection (e.g., the second communication connection) used to receive the audio file may be a communication connection based on LE audio. The communication connection (e.g., the second communication connection) used to receive the audio file may be a one-way communication connection from the electronic device (101) to the automobile (210).

[0197] In one embodiment, at operation 940, the processor (225) may transmit object information to the electronic device (101) to output a notification about the object information via the first communication connection.

[0198] In one embodiment, the processor (225) may transmit object information about at least one object among the plurality of objects (381, 383, 385) to the electronic device (101). The processor (225) may transmit object information about at least one object among the plurality of objects (381, 383, 385) to the electronic device (101) based on the user's line of sight (390). For example, the processor (225) may transmit object information about at least one object that the user does not recognize among the plurality of objects (381, 383, 385) to the electronic device (101). For example, the processor (225) may transmit object information about at least one object that is out of the line of sight (390) among the plurality of objects (381, 383, 385) to the electronic device (101). Here, the user's unawareness of the object may mean that the user's gaze (390) is not directed to the object after the state of the object has changed. The user's unawareness of the object may mean that the user's gaze (390) is not directed to the object identified through the sensor (275) of the car (210). Here, the object moving out of the gaze (390) may mean that the user's gaze (390) is not directed to the object after the state of the object has changed. The object moving out of the gaze (390) may mean that the user's gaze (390) is not directed to the object identified through the sensor (275) of the car (210).

[0199] FIG. 10A illustrates an example of a perspective view of a wearable device (1099), according to one embodiment. FIG. 10B illustrates an example of one or more hardware elements disposed within a wearable device (1099), according to one embodiment. The wearable device (1099) of FIGS. 10A and 10B may correspond to the electronic device (101) of FIG. 1. As shown in FIG. 10A, the wearable device (1099), according to one embodiment, may include at least one display (1050) and a frame supporting the at least one display (1050).

[0200] According to one embodiment, a wearable device (1099) may be worn on a part of a user's body. The wearable device (1099) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines AR and VR to a user wearing the wearable device (1099). For example, the wearable device (1099) may output a virtual reality image to the user through at least one display (1050) in response to a user's designated gesture acquired through the motion recognition camera (1040-2) of FIG. 10B.

[0201] According to one embodiment, at least one display (1050) within a wearable device (1099) may provide visual information to a user. For example, at least one display (1050) may include a transparent or translucent lens. At least one display (1050) may include a first display (1050-1) and / or a second display (1050-2) spaced apart from the first display (1050-1). For example, the first display (1050-1) and the second display (1050-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0202] Referring to FIG. 10B, at least one display (1050) may form a display area on a lens to provide a user wearing a wearable device (1099) with visual information contained in external light passing through the lens, along with other visual information distinct from the visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by at least one display (1050) may be formed on a second surface (1032) among a first surface (1031) and a second surface (1032) of the lens. When a user wears the wearable device (1099), external light may be incident on the first surface (1031) and transmitted through the second surface (1032) to the user. As another example, at least one display (1050) may display a virtual reality image to be combined with a real screen transmitted via external light. The virtual reality image output from the at least one display (1050) may be transmitted to the user's eyes via one or more hardware included in the wearable device (1099) (e.g., optical devices (1082, 1084) and / or at least one waveguide (1033, 1034)).

[0203] In one embodiment, a wearable device (1099) may include waveguides (1033, 1034) that diffract light transmitted from at least one display (1050) and relayed by optical devices (1082, 1084) and transmit the diffracted light to a user. The waveguides (1033, 1034) may be formed based on at least one of glass, plastic, or polymer. Nanopatterns may be formed on at least a portion of the exterior or interior of the waveguides (1033, 1034). The nanopatterns may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the waveguides (1033, 1034) may be propagated to the other end of the waveguides (1033, 1034) by the nanopatterns. The waveguides (1033, 1034) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, the waveguides (1033, 1034) may be arranged within the wearable device (1099) to guide a screen displayed by at least one display (1050) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the waveguides (1033, 1034).

[0204] According to one embodiment, a wearable device (1099) may analyze an object included in a real-world image collected through a capturing camera (1040-1), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (1050). The virtual object may include at least one of text and an image regarding various information related to the object included in the real-world image. The wearable device (1099) may analyze the object based on a multi-camera, such as a stereo camera. For the object analysis, the wearable device (1099) may execute time-of-flight (ToF) and / or simultaneous localization and mapping (SLAM) supported by the multi-camera. A user wearing the wearable device (1099) may view an image displayed on at least one display (1050).

[0205] In one embodiment, the frame may be formed as a physical structure that allows the wearable device (1099) to be worn on the user's body. In one embodiment, the frame may cause the first display (1050-1) and the second display (1050-2) to be positioned corresponding to the user's left and right eyes when the user wears the wearable device (1099). The frame may support at least one display (1050). For example, the frame may support the first display (1050-1) and the second display (1050-2) to be positioned corresponding to the user's left and right eyes.

[0206] Referring to FIG. 10A, the frame may include a region (1020) that at least partially contacts a portion of the user's body when the user wears the wearable device (1099). For example, the region (1020) of the frame that contacts a portion of the user's body may include a region that contacts a portion of the user's nose, a portion of the user's ear, and a portion of the side of the user's face that the wearable device (1099) makes contact with. According to one embodiment, the frame may include a nose pad (1010) that contacts a portion of the user's body. When the wearable device (1099) is worn by the user, the nose pad (1010) may contact a portion of the user's nose. The frame may include a first temple (1004) and a second temple (1005) that contact a portion of the user's body that is distinct from the portion of the user's body.

[0207] For example, the frame may include a first rim (1001) that surrounds at least a portion of the first display (1050-1), a second rim (1002) that surrounds at least a portion of the second display (1050-2), a bridge (1003) that is disposed between the first rim (1001) and the second rim (1002), a first pad (1011) that is disposed along a portion of an edge of the first rim (1001) from one end of the bridge (1003), a second pad (1012) that is disposed along a portion of an edge of the second rim (1002) from the other end of the bridge (1003), a first temple (1004) that extends from the first rim (1001) and is secured to a portion of an ear of the wearer, and a second temple (1005) that extends from the second rim (1002) and is secured to a portion of an ear opposite the ear. The first pad (1011) and the second pad (1012) may be in contact with a portion of the user's nose, and the first temple (1004) and the second temple (1005) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (1004, 1005) may be rotatably connected to the rim through the hinge units (1006, 1007) of FIG. 10B. The first temple (1004) may be rotatably connected to the first rim (1001) through the first hinge unit (1006) disposed between the first rim (1001) and the first temple (1004). The second temple (1005) may be rotatably connected to the second rim (1002) via a second hinge unit (1007) disposed between the second rim (1002) and the second temple (1005). In one embodiment, the wearable device (1099) may use a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame to identify an external object (e.g., a user's fingertip) touching the frame and / or a gesture performed by the external object.

[0208] According to one embodiment, the wearable device (1099) may include hardware that performs various functions. For example, the hardware may include a battery module (1070), an antenna module (1075), optical devices (1082, 1084), speakers (1092-1, 1092-2), microphones (1094-1, 1094-2, 1094-3), a light-emitting module (not shown), and / or a printed circuit board (1090). The various hardware may be arranged within the frame.

[0209] According to one embodiment, microphones (1094-1, 1094-2, 1094-3) of the wearable device (1099) may be arranged on at least a portion of the frame to acquire sound signals. A first microphone (1094-1) arranged on the nose pad (1010), a second microphone (1094-2) arranged on the second rim (1002), and a third microphone (1094-3) arranged on the first rim (1001) are illustrated in FIG. 10B , but the number and arrangement of the microphones (1094) are not limited to the embodiment of FIG. 10B . When the number of microphones (1094) included in the wearable device (1099) is two or more, the wearable device (1099) may identify the direction of the sound signal by using a plurality of microphones arranged on different portions of the frame.

[0210] According to one embodiment, the optical devices (1082, 1084) can transmit virtual objects transmitted from at least one display (1050) to the wave guides (1033, 1034). For example, the optical devices (1082, 1084) can be projectors. The optical devices (1082, 1084) can be positioned adjacent to at least one display (1050) or can be included within at least one display (1050) as a part of the at least one display (1050). The first optical device (1082) can correspond to the first display (1050-1), and the second optical device (1084) can correspond to the second display (1050-2). The first optical device (1082) can transmit light output from the first display (1050-1) to the first waveguide (1033), and the second optical device (1084) can transmit light output from the second display (1050-2) to the second waveguide (1034).

[0211] In one embodiment, the camera may include an eye tracking camera (ET CAM) (1040-1), a motion recognition camera (1040-2), and / or a recording camera (1040-3). The recording camera (1040-3), the eye tracking camera (1040-1), and the motion recognition camera (1040-2) may be positioned at different locations on the frame and may perform different functions. The eye tracking camera (1040-1) may output data representing the gaze of a user wearing the wearable device (1099). For example, the wearable device (1099) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (1040-1). Although an example of a gaze tracking camera (1040-1) positioned toward the user's right eye is shown in FIG. 10B, the embodiment is not limited thereto, and the gaze tracking camera (1040-1) may be positioned solely toward the user's left eye, or toward both eyes.

[0212] In one embodiment, the capturing camera (1040-3) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (1050). The at least one display (1050) can display a single image in which information about the actual image or background including the image of the specific object acquired using the capturing camera is superimposed on a virtual image provided through optical devices (1082, 1084). In one embodiment, the capturing camera can be placed on a bridge (1003) disposed between the first rim (1001) and the second rim (1002).

[0213] In one embodiment, the gaze tracking camera (1040-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the wearable device (1099) and matching the user's gaze with visual information provided to at least one display (1050). For example, when the wearable device (1099) looks straight ahead, the wearable device (1099) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (1050). The gaze tracking camera (1040-1) can be caused to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (1040-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (1040-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (1040-1) may be positioned within the first rim (1001) and / or the second rim (1002) to face the direction in which the user wearing the wearable device (1099) is positioned.

[0214] In one embodiment, the gesture recognition camera (1040-2) can provide a specific event on a screen provided on at least one display (1050) by recognizing the movement of the user's whole or part of the body, such as the user's torso, hands, or face. The gesture recognition camera (1040-2) can recognize the user's gesture, obtain a signal corresponding to the gesture, and provide an indication corresponding to the signal on at least one display (1050). The processor can identify the signal corresponding to the gesture and perform a designated function based on the identification. In one embodiment, the gesture recognition camera (1040-2) can be disposed on the first rim (1001) and / or the second rim (1002).

[0215] In one embodiment, the camera included in the wearable device (1099) is not limited to the gaze tracking camera (1040-1) and the motion recognition camera (1040-2) described above. For example, the wearable device (1099) can identify an external object included in the user's field of view (FoV) using the photographing camera (1040-3) positioned toward the user's field of view (FoV). The wearable device (1099) can identify an external object based on a sensor for identifying the distance between the wearable device (1099) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (1099) may include a camera (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (1099).

[0216] Although not shown, in one embodiment, the wearable device (1099) may further include a light source (e.g., an LED) that emits light toward a subject being captured using the camera (e.g., the user's eyes, face, and / or an external object within the FoV). The light source may include an infrared wavelength LED. The light source may be disposed on at least one of the frame and hinge units (1006, 1007).

[0217] In one embodiment, the battery module (1070) may supply power to electronic components of the wearable device (1099). In one embodiment, the battery module (1070) may be disposed within the first temple (1004) and / or the second temple (1005). For example, the battery module (1070) may be a plurality of battery modules (1070). The plurality of battery modules (1070) may be disposed within each of the first temple (1004) and the second temple (1005). In one embodiment, the battery module (1070) may be disposed at an end of the first temple (1004) and / or the second temple (1005).

[0218] In one embodiment, the antenna module (1075) can transmit signals or power to, or receive signals or power from, the outside of the wearable device (1099). The antenna module (1075) can be electrically and / or operatively connected to communication circuitry within the wearable device (1099). In one embodiment, the antenna module (1075) can be positioned within the first temple (1004) and / or the second temple (1005). For example, the antenna module (1075) can be positioned proximate one surface of the first temple (1004) and / or the second temple (1005).

[0219] According to one embodiment, speakers (1092-1, 1092-2) may output audio signals to the outside of the wearable device (1099). The audio output module may be referred to as a speaker. In one embodiment, speakers (1092-1, 1092-2) may be positioned within the first temple (1004) and / or the second temple (1005) so as to be positioned adjacent to the ears of a user wearing the wearable device (1099). For example, the wearable device (1099) may include a second speaker (1092-2) positioned within the first temple (1004) and thus adjacent to the user's left ear, and a first speaker (1092-1) positioned within the second temple (1005) and thus adjacent to the user's right ear.

[0220] In one embodiment, the light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state to visually provide a user with information regarding a specific state of the wearable device (1099). For example, when the wearable device (1099) requires charging, the wearable device (1099) may repeatedly emit red light at a designated time. In one embodiment, the light-emitting module may be disposed on the first rim (1001) and / or the second rim (1002).

[0221] Referring to FIG. 10B, according to one embodiment, a wearable device (1099) may include a printed circuit board (PCB) (1090). The PCB (1090) may be included in at least one of the first temple (1004) or the second temple (1005). The PCB (1090) may include an interposer disposed between at least two sub-PCBs. One or more hardware components included in the wearable device (1099) may be disposed on the PCB (1090). The wearable device (1099) may include a flexible PCB (FPCB) for interconnecting the hardware components.

[0222] According to one embodiment, a wearable device (1099) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (1099) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (1099). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (1099) may identify a user's motion and / or gesture performed to execute or terminate a specific function of the wearable device (1099) based on the IMU.

[0223] FIGS. 11A and 11B illustrate an example of an exterior appearance of a wearable device (1199) according to one embodiment. The wearable device (1199) of FIGS. 11A and 11B may be included in the electronic device (101) of FIG. 1. An example of an exterior appearance of a first side (1110) of a housing of the wearable device (1199) according to one embodiment is illustrated in FIG. 11A, and an example of an exterior appearance of a second side (1120) opposite to the first side (1110) may be illustrated in FIG. 11B.

[0224] Referring to FIG. 11A, a first surface (1110) of a wearable device (1199) according to one embodiment may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (1199) may further include a strap for being fixed to a body part of a user, and / or one or more temples (e.g., the first temple (1004) and / or the second temple (1005) of FIGS. 10A and 10B). A first display (1150-1) for outputting an image to a left eye among the user's two eyes, and a second display (1150-2) for outputting an image to a right eye among the two eyes, may be disposed on the first surface (1110). The wearable device (1199) may be formed on the first surface (1110) and may further include a rubber or silicone packing to prevent interference from light (e.g., ambient light) different from the light emitted from the first display (1150-1) and the second display (1150-2).

[0225] According to one embodiment, a wearable device (1199) may include cameras (1140-1, 1140-2) for photographing and / or tracking both eyes of a user adjacent to the first display (1150-1) and the second display (1150-2), respectively. The cameras (1140-1, 1140-2) may be referred to as ET cameras. According to one embodiment, a wearable device (1199) may include cameras (1140-3, 1140-4) for photographing and / or recognizing a face of a user. The cameras (1140-3, 1140-4) may be referred to as FT cameras.

[0226] Referring to FIG. 11B, a camera (e.g., cameras (1140-5, 1140-6, 1140-7, 1140-8, 1140-9, 1140-10)) and / or a sensor (e.g., a depth sensor (1130)) for obtaining information related to the external environment of the wearable device (1199) may be disposed on a second surface (1120) opposite to the first surface (1110) of FIG. 11A. For example, the cameras (1140-5, 1140-6, 1140-7, 1140-8, 1140-9, 1140-10) may be disposed on the second surface (1120) to recognize external objects different from the wearable device (1199). For example, using cameras (1140-9, 1140-10), the wearable device (1199) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (1140-9) can be placed on a second surface (1120) of the wearable device (1199) to obtain an image to be displayed through a second display (1150-2) corresponding to the right eye among the two eyes. The camera (1140-10) can be placed on a second surface (1120) of the wearable device (1199) to obtain an image to be displayed through a first display (1150-1) corresponding to the left eye among the two eyes.

[0227] In one embodiment, the wearable device (1199) may include a depth sensor (1130) disposed on the second surface (1120) to identify a distance between the wearable device (1199) and an external object. Using the depth sensor (1130), the wearable device (1199) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (1199).

[0228] Although not shown, a microphone may be placed on the second side (1120) of the wearable device (1199) to acquire sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0229] As described above, according to one embodiment, the wearable device (1199) may have a form factor for being worn on a user's head. The wearable device (1199) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the head. Using cameras (1140-5, 1140-6, 1140-7, 1140-8, 1140-9, 1140-10) for recording video of an external space, the wearable device (1199) and a server (e.g., server (108) of FIG. 1) connected to the wearable device (1199) may provide an on-demand service that provides video of a location and / or place selected by the user, and / or a metaverse service.

[0230] According to one embodiment, the wearable device (1199) can display frames acquired through cameras (1140-9, 1140-10) on the first display (1150-1) and the second display (1150-2), respectively. The wearable device (1199) can provide a user with a mixed user experience of real objects and virtual objects (e.g., video see-through (VST)) by combining virtual objects within frames displayed through the first display (1150-1) and the second display (1150-2) and including real objects. The wearable device (1199) can change the virtual object based on information acquired by the cameras (1140-1, 1140-2, 1140-3, 1140-4, 1140-5, 1140-6, 1140-7, 1140-8) and / or the depth sensor (1130). For example, if a visual object corresponding to a real object and a virtual object at least partially overlap within the frame, the wearable device (1199) can stop displaying the virtual object based on detecting a motion for interacting with the real object. By stopping displaying the virtual object, the wearable device (1199) can prevent the visibility of the real object from being reduced as the visual object corresponding to the real object is occluded by the virtual object.

[0231] FIG. 12A illustrates an example of a user (1201) wearing a wearable device (1210). FIG. 12B illustrates an example of a screen displayed on a wearable device, according to one embodiment. FIG. 12C illustrates an example of a screen displayed on a wearable device or display, according to one embodiment.

[0232] The wearable device (1210) of FIGS. 12A, 12B, and 12C may correspond to the electronic device (101) of FIGS. 1, 2, and 3A. The wearable device (1210) of FIGS. 12A, 12B, and 12C may correspond to the wearable device (1099) of FIGS. 10A and 10B. The wearable device (1210) of FIGS. 12A, 12B, and 12C may correspond to the wearable device (1199) of FIGS. 11A and 11B.

[0233] The vehicle (1220) of FIGS. 12a, 12b, and 12c may correspond to the vehicle (210) of FIGS. 2 and 3a.

[0234] FIG. 12A may illustrate a situation in which content (1230) is displayed on a wearable device (1210). FIG. 12A illustrates a situation prior to establishing a communication connection between a wearable device (1210) and an electronic device (e.g., electronic device (205)) of a vehicle (1220).

[0235] In one embodiment, referring to FIG. 12A, a wearable device (1210) may display a screen (1215). For example, the wearable device (1210) may display the screen (1215) through a display (e.g., display (1050) of FIGS. 10A and 10B , or at least one display (1150-1, 1150-2) of FIG. 11A ). The screen (1215) may include an area where content (1230) is displayed, and a pass-through area (1235) that reflects an actual space. The pass-through area (1235) may reflect an actual space (e.g., a windshield (1225)) of a car (1220) viewed by a user (1201). Here, the content (1230) may include an execution result of an application. For example, the content (1230) may include driving-related information of a navigation application.

[0236] In one embodiment, the wearable device (1210) may establish a communication connection with an electronic device (205) of a vehicle (1220). Here, the communication connection between the wearable device (1210) and the electronic device (205) of the vehicle (1220) may be a communication connection based on Bluetooth. For example, the communication connection may be a communication connection based on LE (low energy) audio. However, the present invention is not limited thereto. According to an embodiment, the communication connection may be based on BLE (Bluetooth low energy). The communication connection may be based on a communication technique different from Bluetooth. For example, the communication connection may be based on WiFi. The communication connection may be a one-way communication connection from the wearable device (1210) to at least one electronic device (205). The communication connection may be a two-way communication connection different from Bluetooth. However, the present invention is not limited thereto.

[0237] In one embodiment, FIG. 12b may illustrate a situation in which content (1230, 1240) is displayed in a wearable device (1210) and a vehicle (1220). FIG. 12b illustrates a situation after a communication connection is established between an electronic device (e.g., electronic device (205)) of the wearable device (1210) and the vehicle (1220).

[0238] In one embodiment, referring to FIG. 12B, a wearable device (1210) can transmit a media file through a communication connection with an electronic device (205). The wearable device (1210) can transmit the media file so that the electronic device (205) outputs content based on the media file. For example, the electronic device (205) can output content (1240) based on the media file through a display (e.g., display (265)). For example, the electronic device (205) can output content (1240) through the display (265) of the windshield (1225). In one embodiment, the display (265) may be a head-up display (HUD) that projects content (1240) onto the windshield (1225) and provides the content (1240) reflected through the windshield (1225) to the user (1201). In one embodiment, the display (265) may be a head-up display (HUD) that is positioned in the space between the user (1201) and the windshield (1225) and provides the content (1240) directly to the user (1201).

[0239] In one embodiment, the wearable device (1210) may transmit a control signal to cause the electronic device (205) to display the content (1240) more clearly. The wearable device (1210) may display the content (1230) output by the wearable device (1210) more faintly. The content (1230) may not be displayed on the wearable device (1210). The brightness of the content (1230) displayed by the wearable device (1210) may converge to 0.

[0240] In one embodiment, FIG. 12c may illustrate a situation in which content (1240) is displayed in a car (1220). FIG. 12c illustrates a situation after a communication connection is established between a wearable device (1210) and an electronic device (205).

[0241] In one embodiment, referring to FIG. 12C, the wearable device (1210) can transmit a media file via a communication connection (315) with the electronic device (205). The wearable device (1210) can stop displaying the content (1230) via the wearable device (1210). The wearable device (1210) can only display a pass-through area (1235) that reflects the actual space. The electronic device (205) can output the content (1240) based on the media file via the display (265). For example, the electronic device (205) can output the content (1240) via the display (265) of the windshield (1225).

[0242] As described above, the electronic device (101) may include at least one first communication circuit (290). The electronic device (101) may include at least one sensor (270) for obtaining data for identifying the positions of irises of both eyes of the user. The electronic device (101) may include at least one processor (120). The electronic device (101) may include at least one memory (130) for storing instructions. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to receive a request for a first communication connection from at least one second communication circuit (295) of the automobile (210) through the at least one first communication circuit (290). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to receive object information about at least one object (381, 383, 385) around the vehicle (210) from the at least one second communication circuit (295) based on the first communication connection. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify a gaze (390) of the user based on the data for identifying the location of the iris. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify, based on the object information, an object among the at least one object (381, 383, 385) that is out of the gaze (390) of the user. The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to output a notification regarding the object identified as being out of the line of sight (390) based on the object information.

[0243] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to transmit the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) worn by the user via the at least one first communication circuit (290), such that the external electronic device (201, 203) outputs the notification.

[0244] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to transmit the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) such that the external electronic device (201, 203) outputs the notification through at least one first display (260) of the external electronic device (201, 203) that displays a stereoscopic image.

[0245] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to transmit the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) through the at least one first communication circuit (290), such that the external electronic device (201, 203) outputs the notification through the at least one speaker (251, 253) of the external electronic device (201, 203).

[0246] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to receive a request for a communication connection from the at least one second communication circuit (295) while transmitting audio content to an external electronic device (201, 203) worn by a user through a second communication connection with the external electronic device (201, 203).

[0247] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to transmit the audio content to the automobile (210) rather than to the external electronic device (201, 203) via the communication connection after establishing the communication connection.

[0248] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to switch the communication connection to the first communication connection in response to receiving a request for the first communication connection. The communication connection may be a unidirectional communication connection, and the first communication connection may be a bidirectional communication connection.

[0249] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to establish the first communication connection distinct from the communication connection in response to receiving a request for the first communication connection. The communication connection may be a unidirectional communication connection, and the first communication connection may be a bidirectional communication connection.

[0250] The electronic device (101) may further include at least one sensor (270) for obtaining data for identifying the position of the irises of both eyes of the user. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify the line of sight (390) of the user based on the data for identifying the position of the iris. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify an object that deviates from the identified line of sight (390) among the at least one object (381, 383, 385). The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to output a notification regarding the identified object.

[0251] The electronic device (101) may further include at least one first display (260) for displaying a stereoscopic image. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to receive a request for a communication connection from the at least one second communication circuit (295) while the electronic device (101) worn by the user displays content as the stereoscopic image through the at least one first display (260). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to transmit the content through the communication connection so as to display the content as the stereoscopic image through the at least one second display (265) of the automobile (210) after establishing the communication connection.

[0252] The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to stop displaying the content through the at least one first display (260) while the content is being displayed through the at least one second display (265).

[0253] The electronic device (101) may further include at least one sensor (270). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify another user around the electronic device (101) through the at least one sensor (270). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to request transmission of the object information to the at least one second communication circuit (295) through the at least one first communication circuit (290) based on the identification of the other user. The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to request the at least one second communication circuit (295) through the at least one first communication circuit (290) to stop transmitting the object information based on the other user not being identified.

[0254] As described above, the method can be performed in an electronic device (101) including at least one communication circuit (290) and at least one sensor (270) for obtaining data for identifying the position of irises of both eyes of the user. The method can include receiving a request for a first communication connection from at least one second communication circuit (295) of a vehicle (210) via the at least one first communication circuit (290). The method can include receiving object information about at least one object (381, 383, 385) around the vehicle (210) from the at least one other communication circuit (295) based on the first communication connection. The method can include identifying a gaze (390) of the user based on the data for identifying the position of the iris. The method may include an operation of identifying, based on the object information, an object among at least one object (381, 383, 385) that is out of the user's line of sight (390). The method may include an operation of outputting a notification for the object identified as being out of the user's line of sight (390), based on the object information.

[0255] The method may include an operation of transmitting the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) worn by the user via the at least one first communication circuit (290), such that the external electronic device (201, 203) outputs the notification.

[0256] The method may include an action of transmitting the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) such that the external electronic device (201, 203) outputs the notification through at least one first display (260) of the external electronic device (201, 203) that displays a stereoscopic image.

[0257] The method may include an operation of transmitting the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) through the at least one first communication circuit (290), such that the external electronic device (201, 203) outputs the notification through at least one speaker (251, 253) of the external electronic device (201, 203).

[0258] The method may include an operation of receiving a request for a communication connection from at least one second communication circuit (295) while transmitting audio content to an external electronic device (201, 203) worn by a user through a second communication connection with the external electronic device (201, 203). After establishing the communication connection, the method may include an operation of transmitting the audio content to the automobile (210) rather than to the external electronic device (201, 203) through the communication connection.

[0259] The method may include an operation of identifying the line of sight (390) of the user based on data for identifying the position of the iris through at least one sensor (270) of the electronic device (101). The method may include an operation of identifying the line of sight (390) of the user based on the data for identifying the position of the iris. The method may include an operation of identifying an object that deviates from the identified line of sight (390) among the at least one object (381, 383, 385). The method may include an operation of outputting a notification for the identified object.

[0260] The method may include an operation of displaying content as a stereoscopic image through at least one first display (260) of the electronic device (101) while the electronic device (101) is worn by the user. The method may include an operation of receiving a request for a communication connection from at least one second communication circuit (295) while the electronic device (101) worn by the user is displaying content through at least one first display (260) of the electronic device (101). After establishing the communication connection, the method may include an operation of transmitting the content through the communication connection so as to display the content as the stereoscopic image through at least one other display (265) of the automobile (210).

[0261] The method may include an operation of identifying another user around the electronic device (101) through at least one sensor (270) of the electronic device (101). The method may include an operation of requesting transmission of the object information to the at least one second communication circuit (295) through the at least one first communication circuit (290) based on the other user being identified. The method may include an operation of requesting suspension of the object information to the at least one second communication circuit (295) through the at least one first communication circuit (290) based on the other user not being identified.

[0262] As described above, a non-transitory computer-readable storage medium may include a program including instructions. The instructions, when executed by at least one processor (120) of an electronic device (101) including at least one communication circuit (290) and at least one sensor (270) for obtaining data for identifying the position of irises of both eyes of the user, may cause the electronic device (101) to receive a request for a first communication connection from at least one second communication circuit (295) of a vehicle (210) via the at least one first communication circuit (290). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to receive object information about at least one object (381, 383, 385) around the vehicle (210) from the at least one second communication circuit (295) based on the first communication connection. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify the user's gaze (390) based on the data for identifying the location of the iris. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify, based on the object information, an object among at least one object (381, 383, 385) that is out of the user's gaze (390). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to output a notification for the object identified as being out of the gaze (390) based on the object information.

[0263] As described above, the electronic device (205) may include at least one sensor (275). The electronic device (205) may include at least one other sensor for obtaining data for identifying the positions of the irises of both eyes of the user. The electronic device (205) may include at least one speaker (255). The electronic device (205) may include at least one first communication circuit (295). The electronic device (205) may include at least one processor (225). The electronic device (205) may include at least one memory (235) for storing instructions. The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to receive a request for a communication connection from at least one second communication circuit (290) of an external electronic device (101) through the at least one first communication circuit (295). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to receive audio content from the external electronic device (101) based on the communication connection. The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to output the audio content through the at least one speaker (255). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to obtain information about at least one object (381, 383, 385) around the electronic device (205) through the at least one sensor (275). The above instructions, when executed by the at least one processor (225), may cause the electronic device (205) to identify the user's gaze (390) based on the data for identifying the location of the iris.The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to identify, based on information about the at least one object (381, 383, 385), an object among the at least one object (381, 383, 385) that is out of the user's gaze. The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to transmit, based on identifying the object that is out of the user's gaze (390), a request for a first communication connection to the at least one second communication circuit (290) via the at least one first communication circuit (295). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to transmit, based on the first communication connection, object information about the object identified as being out of the line of sight (390), to the external electronic device (101), such that the electronic device (205) outputs a notification about the identified object based on object information about the object identified as being out of the line of sight (390).

[0264] The above communication connection may be a one-way communication connection, and the first communication connection may be a two-way communication connection.

[0265] The electronic device (205) may further include at least one other sensor (275) for obtaining data for identifying the position of the irises of both eyes of the user. The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to identify the gaze (390) of the user based on the data for identifying the position of the irises.

[0266] The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to identify another user around the electronic device (205) via the at least one sensor (275). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to transmit, to the external electronic device (101), object information about the object identified as being out of the line of sight (390), based on the first communication connection, based on the other user being identified. The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to output, through the at least one speaker (255), the notification instead of transmitting the object information, based on the other user not being identified.

[0267] As described above, the method may be performed by an electronic device (205) including at least one sensor (275), at least one other sensor for obtaining data for identifying the positions of irises of both eyes of the user, at least one speaker (255), and at least one first communication circuit (295). The method may include an operation of receiving a request for a communication connection to at least one second communication circuit (290) of an external electronic device (101) through the at least one first communication circuit (295). The method may include an operation of receiving audio content from the external electronic device (101) based on the communication connection. The method may include an operation of outputting the audio content through the at least one speaker (255). The method may include an operation of obtaining information about at least one object (381, 383, 385) around the electronic device (205) through the at least one sensor (275). The method may include an operation of identifying a user's gaze (390) based on the data for identifying the location of the iris. The method may include an operation of identifying an object among the at least one object (381, 383, 385) that is out of the user's gaze (390) based on information about the at least one object (381, 383, 385). The method may include an operation of transmitting a request for a first communication connection to the at least one second communication circuit (290) through the at least one first communication circuit (295) based on identifying the object that is out of the gaze (390).The method may include an operation of transmitting, to the external electronic device (101), object information about the object identified as being out of the line of sight (390), based on the first communication connection, such that the external electronic device (101) outputs a notification about the identified object based on the object information about the object identified as being out of the line of sight (390).

[0268] As described above, a non-transitory computer-readable storage medium may include a program including instructions. The instructions, when executed by at least one processor (225) of an electronic device (205) including at least one sensor (275), at least one other sensor for obtaining data for identifying the positions of irises of both eyes of the user, at least one speaker (255), and at least one first communication circuit (295), may cause the electronic device (205) to receive a request for a communication connection from at least one second communication circuit (290) of an external electronic device (101) via the at least one first communication circuit (295). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to receive audio content from the external electronic device (101) based on the communication connection. The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to output the audio content through the at least one speaker (255). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to obtain information about at least one object (381, 383, 385) around the electronic device (205) through the at least one sensor (275). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to identify the user's gaze (390) based on the data for identifying the location of the iris.The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to identify, based on information about the at least one object (381, 383, 385), an object among the at least one object (381, 383, 385) that is out of the user's line of sight (390). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to transmit, based on identifying the object that is out of the user's line of sight (390), a request for a first communication connection to the at least one second communication circuit (290) via the at least one first communication circuit (295). The instructions, when executed by the at least one processor (225), may cause the electronic device (205) to transmit, based on the first communication connection, object information about the object identified as being out of the line of sight (390), to the external electronic device (101), such that the electronic device (205) outputs a notification about the identified object based on object information about the object identified as being out of the line of sight (390).

[0269] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0270] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0271] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0272] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0273] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0274] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), At least one first communication circuit (290), At least one sensor (270) for obtaining data for identifying the position of the iris of both eyes of the user; at least one processor (120), and At least one memory (130) for storing instructions, wherein when the instructions are executed by the at least one processor (120), the electronic device (101) Receive a request for a first communication connection from at least one second communication circuit (295) of the vehicle (210) via at least one first communication circuit (290), Based on the first communication connection, object information about at least one object (381, 383, 385) around the vehicle (210) is received from at least one second communication circuit (295), Based on the data for identifying the position of the iris, the user's gaze (gaze, 390) is identified, Based on the above object information, identify an object among at least one object (381, 383, 385) that is out of the user's line of sight (390), and Based on the above object information, causing a notification to be output for the object identified as being out of the line of sight (390). Electronic devices.

2. In claim 1, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: Causing an external electronic device (201, 203) worn by a user to transmit object information about an object identified as being out of the line of sight (390) to the external electronic device (201, 203) via the at least one first communication circuit (290) so as to output the notification. Electronic devices.

3. In claim 2, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: Causing the external electronic device (201, 203) to transmit the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) so that the external electronic device (201, 203) outputs the notification through at least one first display (260) of the external electronic device (201, 203) displaying a stereoscopic image. Electronic devices.

4. In claim 2, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: Causing the external electronic device (201, 203) to output the notification through at least one speaker (251, 253) of the external electronic device (201, 203), thereby transmitting the object information about the object identified as being out of the line of sight (390) to the external electronic device (201, 203) through the at least one first communication circuit (290). Electronic devices.

5. In claim 1, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: While transmitting audio content to an external electronic device (201, 203) through a second communication connection with the user, a request for a communication connection is received from at least one second communication circuit (295), After establishing the above communication connection, causing the audio content to be transmitted to the automobile (210) rather than the external electronic device (201, 203) through the communication connection. Electronic devices.

6. In claim 5, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: In response to receiving a request for said first communication connection, causing said communication connection to be switched to said first communication connection; The above communication connection is a one-way communication connection, and the first communication connection is a two-way communication connection. Electronic devices.

7. In claim 5, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: In response to receiving a request for said first communication connection, causing said first communication connection to be established, said first communication connection being distinct from said communication connection; The above communication connection is a one-way communication connection, and the first communication connection is a two-way communication connection. Electronic devices.

8. In claim 1, further comprising at least one first display (260) for displaying a stereoscopic image; The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: While the electronic device (101) worn by the user displays content as the stereoscopic image through the at least one first display (260), a request for a communication connection is received from the at least one second communication circuit (295), After establishing said communication connection, causing said content to be transmitted through said communication connection so as to display said content as a stereoscopic image through at least one second display (265) of said automobile (210). Electronic devices.

9. In claim 8, The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: Causing the display of said content through said at least one first display (260) to be stopped while said content is being displayed through said at least one second display (265). Electronic devices.

10. In claim 1, further comprising at least one sensor (270), The above instructions, when executed by at least one processor (120), cause the electronic device (101) to: Through at least one sensor (270), other users around the electronic device (101) are identified, Based on the identification of said other user, requesting transmission of said object information to said at least one second communication circuit (295) through said at least one first communication circuit (290), Causing the at least one second communication circuit (295) to request the cessation of transmission of the object information, based on the other user not being identified, through the at least one first communication circuit (290). Electronic devices.

11. In an electronic device (205), At least one sensor (275), At least one other sensor for obtaining data for identifying the position of the iris of both eyes of the user; At least one speaker (255), At least one first communication circuit (295), at least one processor (225), and At least one memory (235) for storing instructions, wherein when the instructions are executed by the at least one processor (225), the electronic device (205) Through at least one first communication circuit (295), a request for a communication connection is received from at least one second communication circuit (290) of an external electronic device (101), Based on the above communication connection, audio content is received from the external electronic device (101), Outputting the above audio content through at least one speaker (255), Through at least one sensor (275), information about at least one object (381, 383, 385) around the electronic device (205) is obtained, Based on the data for identifying the position of the iris, the user's gaze (390) is identified, Based on the information about at least one object (381, 383, 385) above, identify an object among at least one object (381, 383, 385) that is out of the user's line of sight (390), Based on identifying the object that is out of the line of sight (390), a request for a first communication connection is transmitted to the at least one second communication circuit (290) through the at least one first communication circuit (295), Causing the external electronic device (101) to transmit, based on the first communication connection, the object information about the object identified as being out of the line of sight (390), to the external electronic device (101), so as to output a notification about the identified object based on the object information about the object identified as being out of the line of sight (390). Electronic devices.

12. In claim 11, The above communication connection is a one-way communication connection, and the first communication connection is a two-way communication connection. Electronic devices.

13. In claim 11, The above instructions, when executed by the at least one processor (225), cause the electronic device (205) to: Through at least one sensor (275), other users around the electronic device (205) are identified, Based on the identification of said other user, based on said first communication connection, transmits to said external electronic device (101) said object information about said object identified as being out of said line of sight (390), Based on the fact that the other user is not identified, causing the notification to be output via the at least one speaker (255) instead of transmitting the object information. Electronic devices.

14. A method performed in an electronic device (101) comprising at least one communication circuit (290) and at least one sensor (270) for obtaining data for identifying the position of the irises of both eyes of the user, An operation of receiving a request for a first communication connection from at least one second communication circuit (295) of a vehicle (210) via at least one first communication circuit (290); An operation of receiving object information about at least one object (381, 383, 385) around the vehicle (210) from at least one second communication circuit (295) based on the first communication connection; An operation of identifying the user's gaze (gaze, 390) based on the data for identifying the position of the iris. Based on the above object information, an operation of identifying an object among at least one object (381, 383, 385) that is out of the user's line of sight (390), and Based on the above object information, an action is included to output a notification for the object identified as being out of the line of sight (390). method.

15. In claim 14, An operation of transmitting object information about an object identified as being out of the line of sight (390) to the external electronic device (201, 203) through the at least one first communication circuit (290) so that the external electronic device (201, 203) worn by the user outputs the notification. method.

Images