Electronic device for displaying driving information and driving information display method using same

Abstract

An electronic device for displaying driving information according to embodiments of the present disclosure may comprise: a display including a plurality of areas; a camera; a sensor; at least one processor including processing circuitry; and a memory including one or more storage media for storing one or more instructions. The one or more instructions, when executed individually and / or collectively by the at least one processor, may cause the electronic device to: identify a driving event by using the sensor; on the basis of the driving event, obtain interworked driving information in which first driving information displayed in a first area and second driving information displayed in a second area are synchronized; and display the interworked driving information in at least one of the first area and the second area.

Description

Electronic device for displaying driving information and method for displaying driving information using the same

[0001] Various embodiments of the present disclosure relate to a display method, and more particularly, to an electronic device for displaying driving information of a vehicle and a driving information display method using the same.

[0002] To provide users with a more immersive experience, 3D (3-dimensional) displays are being introduced. 3D displays can be categorized into glasses-based and glasses-free types, and electronic devices such as smartphones are being developed primarily around glasses-free 3D display technology, with user convenience in mind.

[0003] Recent advancements in glasses-free 3D display technologies, such as lenticular lens displays (LFDs), have enabled the simultaneous delivery of high resolution and a sense of depth. These technologies are being utilized in diverse fields such as entertainment, education, and healthcare, and are playing a significant role in maximizing the user experience.

[0004] Meanwhile, with the introduction of multiple displays within vehicles, the need for integration between these displays is growing. Drivers must simultaneously perceive a variety of information while driving, and if each display operates independently, it can lead to distraction and confusion. Therefore, a system is needed where multiple displays within a vehicle interact and provide integrated information.

[0005] Various embodiments of the present disclosure can provide an electronic device that provides integrated driving information by interacting with a transparent display of a windshield and an LFD of a dashboard, and automatically adjusts and displays necessary information by tracking the direction of a user's gaze, and a driving information display method using the same.

[0006] An electronic device for displaying driving information according to embodiments of the present disclosure may include a display including a plurality of areas, a camera, a sensor, at least one processor including a processing circuit, and a memory storing one or more instructions. The one or more instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to display first driving information in a first area of ​​the display, display second driving information in a second area of ​​the display, identify a driving event using the sensor, obtain linked driving information that synchronizes the first driving information and the second driving information based on the driving event, and display the linked driving information using an interaction between the first area and the second area.

[0007] A method for displaying driving information according to embodiments of the present disclosure may include an operation of displaying first driving information in a first area of ​​a display, an operation of displaying second driving information in a second area of ​​the display, an operation of identifying a driving event using a sensor, an operation of obtaining linked driving information that synchronizes the first driving information and the second driving information based on the driving event, and an operation of displaying the linked driving information using an interaction between the first area and the second area.

[0008] According to various embodiments of the present disclosure, an electronic device and a driving information display method using the same can provide integrated driving information through interaction between a transparent display on a windshield and an LFD on a dashboard. The electronic device and the driving information display method using the same can enhance driving convenience by intuitively and clearly providing users with information based on driving events.

[0009] Additionally, the electronic device of the present disclosure and the driving information display method using the same can track the user's gaze direction and automatically adjust and display necessary information based on the user's gaze direction. Therefore, the electronic device of the present disclosure and the driving information display method using the same can reduce the visual burden on the user while driving and improve the readability of the displayed information.

[0010] The effects that can be obtained from the exemplary embodiments of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly derived and understood by those skilled in the art to which the exemplary embodiments of the present disclosure pertain from the following description. In other words, unintended effects resulting from implementing the exemplary embodiments of the present disclosure can also be derived by those skilled in the art from the exemplary embodiments of the present disclosure.

[0011] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.

[0012] FIG. 2A and FIG. 2B are drawings showing the structure of a 3D display according to one embodiment of the present disclosure.

[0013] FIG. 3 is a diagram illustrating a method for an electronic device according to one embodiment of the present disclosure to provide a three-dimensional effect using two images.

[0014] FIG. 4 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0015] FIG. 5 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.

[0016] FIG. 6 is an exemplary diagram showing the interior of a vehicle in which an electronic device according to one embodiment of the present disclosure is implemented.

[0017] FIG. 7 is an exemplary diagram showing first driving information and second driving information displayed by an electronic device according to one embodiment of the present disclosure.

[0018] FIG. 8 is an exemplary diagram showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on a user's gaze direction.

[0019] FIGS. 9A and 9B are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on destination arrival.

[0020] FIGS. 10A and 10B are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on forward vehicle movement.

[0021] FIGS. 11A and 11B are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on a speed limit.

[0022] FIGS. 12a and 12b are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on weather changes.

[0023] FIG. 13 is an exemplary diagram showing the interior of a vehicle in which an electronic device is implemented, when the electronic device according to one embodiment of the present disclosure further includes a third area.

[0024] FIGS. 14a and 14b are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information using a third area.

[0025] FIG. 15 is an exemplary diagram showing the interior of a vehicle in which an electronic device is implemented, when the electronic device according to one embodiment of the present disclosure further includes a fourth area.

[0026] FIGS. 16 and 17 are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information using a fourth area.

[0027] FIGS. 18A to 18C are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure highlighting and displaying a destination in a first area.

[0028] Hereinafter, embodiments of this document will be described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, this document may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0029] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments of the present disclosure.

[0030] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0031] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0032] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0033] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0034] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0035] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0036] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0037] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0038] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0039] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0040] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0041] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0042] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0043] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0044] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0045] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0046] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0047] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0048] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0049] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first surface (e.g., a bottom surface) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second surface (e.g., a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0050] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0051] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service on its own, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0052] Hereinafter, the direction perpendicular to the display (or display panel) of the electronic device may be defined as the z-axis direction, the horizontal direction of the display perpendicular to the z-axis may be referred to as the x-axis direction, and the vertical direction may be referred to as the y-axis direction.

[0053] FIG. 2A and FIG. 2B are drawings showing the structure of a 3D display according to one embodiment of the present disclosure.

[0054] According to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1) may include a display (e.g., display module (160) of FIG. 1) that outputs various images. The images output from the display of the electronic device may be 3D (3 dimensional) images that provide a three-dimensional effect to the user.

[0055] Depending on the implementation method, 3D displays can be classified into a glasses-based method that allows a user to feel a three-dimensional effect when wearing glasses, and a glasses-free method that allows a user to feel a three-dimensional effect based on a structure arranged on the front of the display panel (210) without wearing glasses.

[0056] According to one embodiment, an electronic device can implement a glasses-free 3D display. The electronic device utilizes binocular parallax to generate a left-eye image (or first image) recognizable by the user's left eye (10) and a right-eye image (or second image) recognizable by the user's right eye (20), and can simultaneously display the left-eye image and the right-eye image using designated pixels of a display panel (210).

[0057] According to one embodiment, the electronic device may include an optical structure disposed in front of the display panel (210) (or in the +z direction from the display panel (210)) such that a left-eye image output from the display panel (210) is substantially recognized by the user's left eye (10) and not recognized by the user's right eye (20), and such that a right-eye image is substantially recognized by the user's right eye (20) and not recognized by the user's left eye (10). For example, the electronic device may include a lenticular lens structure (260) of FIG. 2A or a parallax barrier structure (270) of FIG. 2B such that the left-eye image and the right-eye image are recognizable by the left eye (10) and the right eye (20), respectively.

[0058] Referring to FIG. 2A, a film (or glass) including a plurality of lenticular lenses (260) may be disposed on the front of a display panel (210) of an electronic device. According to one embodiment, the plurality of lenticular lenses (260) included in the film may cover each pixel column or each group including a plurality of pixel columns. A left-eye image may be displayed on odd-numbered pixel columns (or groups) (220) on the display panel (210), and a right-eye image may be displayed on even-numbered pixel columns (or groups) (230).

[0059] According to one embodiment, the lenticular lenses covering the pixel column (220) on which the left-eye image is displayed may refract light corresponding to the output image in a direction corresponding to the position of the user's left eye (10), and the lenticular lenses covering the pixel column (230) on which the right-eye image is displayed may refract light corresponding to the output image in a direction corresponding to the position of the user's right eye (20). Here, the direction corresponding to the left-eye (10) position and the direction corresponding to the right-eye (20) position may be directions toward the positions of the user's left eye (10) and right eye (20) in each pixel column when the user looks straight ahead at a predetermined distance from the display. According to this structure, even if the left-eye image and the right-eye image are simultaneously output on the display panel (210), only the left-eye image can be substantially recognized through the user's left eye (10), and only the right-eye image can be substantially recognized through the user's right eye (20).

[0060] Referring to FIG. 2B, a parallax barrier (270) may be arranged on the front of the display panel (210) of the electronic device. According to one embodiment, the parallax barrier (270) may include a blocking bar (or black bar) (274) that blocks light output from the display panel (210) and a slit (272) that allows light to pass therethrough, intersecting each other. The horizontal widths of the blocking bar (274) and the slit (272) may correspond to the horizontal widths of a pixel row or a group including multiple pixel rows that intersect and output a left-eye image and a right-eye image. As the blocking bar (274) and the slit (272) are arranged to intersect in the parallax barrier (270), the left-eye image output from the odd-numbered pixel column (or group) (220) passes through the slit (272) and is recognized by the user's left eye (10), and the right-eye image output from the even-numbered pixel column (or group) (230) can be recognized by the user's right eye (20). In addition, the left-eye image is blocked by the blocking bar (274) in the direction toward the user's right eye (20) and is thus substantially not recognized by the user's right eye (20), and the right-eye image is blocked by the blocking bar (274) in the direction toward the user's left eye (10) and is thus substantially not recognized by the user's left eye (10).

[0061] In this document, an example of an electronic device implementing a 3D screen (e.g., the second area (612) of FIG. 6) using a lenticular lens structure (260) of FIG. 2a or a parallax barrier structure (270) of FIG. 2b is described, but the present invention is not limited thereto, and the electronic device may include a different type of glasses-free 3D display.

[0062] FIG. 3 is a diagram illustrating a method for an electronic device according to one embodiment of the present disclosure to provide a three-dimensional effect using two images.

[0063] According to one embodiment, the electronic device may provide a 3D image that provides a three-dimensional effect to the user by using a 3D display such as the lenticular lens structure (260) of FIG. 2A or the parallax barrier structure (270) of FIG. 2B. For example, the electronic device may generate a left-eye image and a right-eye image, respectively, and display the left-eye image and the right-eye image crosswise through predetermined pixel columns (e.g., odd-numbered columns and even-numbered columns) of the display panel (210), so that the left-eye image may be recognized by the user's left eye (10) and the right-eye image may be recognized by the user's right eye (20).

[0064] Referring to (a) of FIG. 3, when the graphic object of the left-eye image and the graphic object of the right-eye image are output through adjacent pixels on the display panel (210), the graphic object (300) of the 3D image recognized by the user as the graphic object of the left-eye image and the graphic object of the right-eye image are output can be recognized at the position of the display panel (210) based on the z-axis direction from the user's line of sight.

[0065] Referring to (b) of FIG. 3, when the graphic object (311) of the left-eye image is positioned on the left (or -x direction) and the graphic object (321) of the right-eye image is positioned on the right (or +x direction) based on the x-axis direction, the graphic object (301) of the 3D image can be recognized at a position further from the display panel (210) based on the z-axis direction from the user's line of sight. When the distance between the graphic object (311) of the left-eye image and the graphic object (321) of the right-eye image is formed to be further than in the example of (b) of FIG. 3, the graphic object (301) of the 3D image can be recognized at a position further from the user's line of sight based on the z-axis direction.

[0066] Referring to (c) of FIG. 3, when the graphic object (312) of the left eye image is positioned on the right (or +x direction) based on the x-axis direction and the graphic object (322) of the right eye image is positioned on the left, the graphic object (302) of the 3D image can be recognized at a position closer to the display panel (210) based on the z-axis direction from the user's line of sight. When the distance between the graphic object (312) of the left eye image and the graphic object (322) of the right eye image is formed to be greater than in the example of (c) of FIG. 3, the graphic object (302) of the 3D image can be recognized at a position closer to the z-axis direction from the user's line of sight.

[0067] According to one embodiment, the electronic device can control the depth perception of a 3D image perceived by the user by adjusting the relative positions and / or distances of the left-eye image and the right-eye image. For example, the electronic device can render a left-eye image and a right-eye image including a graphic object corresponding to a graphic object of the 3D image to provide a 3D effect for a specific graphic object, and can determine the position of each graphic object on the left-eye image and the right-eye image based on the z-axis position of the determined graphic object.

[0068] FIG. 4 is a block diagram showing the configuration of an electronic device (400) according to one embodiment of the present disclosure.

[0069] Referring to FIG. 4, an electronic device (400) according to one embodiment may include a display module (430) (e.g., the display module (160) of FIG. 1), a camera module (440) (e.g., the camera module (180) of FIG. 1), a sensor (450) (e.g., the sensor module (176) of FIG. 1), a processor (410) (e.g., the processor (120) of FIG. 1), and a memory (420) (e.g., the memory (130) of FIG. 1), and various embodiments of the present document may be implemented even if some of the illustrated configurations are omitted or replaced. At least some of the illustrated configurations may be operatively, electrically, and / or functionally connected to each other. The electronic device (400) may include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1.

[0070] According to one embodiment, some of the components of the electronic device (400) (e.g., sensor (450), processor (410), memory (420)) may be positioned inside the housing of the electronic device (400), other components (e.g., display module (430), camera module (440)) may have at least a portion thereof exposed to the outside of the housing, and other components may be configured to be insertable and detachable inside the housing of the electronic device (400).

[0071] According to one embodiment, the display module (430) includes at least one display and can output various images provided from the processor (410). For example, the display module (430) may be implemented as a liquid crystal display (LCD), a light-emitting diode (LED) display, or an organic light-emitting diode (OLED) display, but is not limited thereto. The display module (430) may be configured as a touch screen that detects a touch and / or proximity touch (or hovering) input using a part of a user's body (e.g., a finger) or a stylus. The display module (430) may include at least some of the configurations and / or functions of the display module (160) of FIG. 1.

[0072] In one embodiment, the display module (430) may include a transparent display provided on a windshield of a vehicle. For example, the transparent display may include transparent micro LEDs and / or a lenticular lens (e.g., the lenticular lens (260) of FIG. 2A).

[0073] According to one embodiment, a portion of the display module (430) may be implemented as a 3D display that provides a 3D image to a user. The 3D display may be provided on the dashboard of a vehicle. For example, the display module (430) may include a structure such as a lenticular lens (e.g., the lenticular lens (260) of FIG. 2A) or a parallax barrier (e.g., the parallax barrier (270) of FIG. 2B) that is arranged in front of a display panel including a plurality of pixels. The structure of the display module (430) for implementing a 3D effect has been described with reference to FIGS. 2A and 2B.

[0074] According to one embodiment, the processor (410) can render a left-eye image recognizable to the user's left eye and a right-eye image recognizable to the user's right eye and display them alternately in odd-numbered pixel columns (or a group including pixel columns) and even-numbered columns (or a group including pixel columns) of the display module (430), respectively. The processor (410) can control the z-axis direction position and depth perception of the 3D image perceived by the user by adjusting the relative position and / or distance of the left-eye image and the right-eye image. An image rendering method of the processor (410) for implementing a 3D effect has been described with reference to FIG. 3. Hereinafter, the left-eye image may be referred to as a first image, and the right-eye image may be referred to as a second image.

[0075] According to one embodiment, the camera module (440) can capture a surrounding subject, convert the image information into digital data, and provide it to the processor (410). The electronic device (400) can include at least one camera module (440) on the front side where the display module (430) is included in the housing and / or the rear side opposite thereto. According to one embodiment, the camera module (440) can include a lens assembly including at least one lens that collects light emitted from an external environment (or a subject), an image sensor (e.g., a CCD (charged coupled device) sensor, a CMOS (complementary metal oxide semiconductor) sensor) that converts the light collected through the lens assembly into an electrical signal to generate image data, and an image signal processor that performs various processing on the image data acquired from the image sensor. At least some of the above-described components of the camera module (440) can be omitted or replaced with other components. The camera module (440) can provide an image captured from the external environment to the processor (410) in real time through an interface (e.g., a mobile industry processor interface). The camera module (440) may include at least some of the configuration and / or functions of the camera module (180) of FIG. 1.

[0076] In one embodiment, the processor (410) may track the user's gaze direction based on an image acquired from a camera module (440) (e.g., a front camera). For example, the processor (410) may analyze an image acquired in real time from the camera module (440) to extract the user's eye area and monitor the movement of the pupil to track the user's gaze direction.

[0077] According to one embodiment, the electronic device (400) may include at least one sensor (450). For example, the electronic device (400) may further include various types of sensors, such as an acceleration sensor, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor. The sensor (450) may include at least some of the configurations and / or functions of the sensor module (176) of FIG. 1.

[0078] According to one embodiment, the electronic device (400) can detect the inclination (or angle formed with respect to the ground) of the electronic device (400) using at least one sensor (450) (e.g., an acceleration sensor, a gyro sensor). For example, the acceleration sensor can sense acceleration in the direction of three axes (x-axis, y-axis, z-axis), the gyro sensor can sense angular velocity, and the processor (410) can determine the inclination of the electronic device (400) based on acceleration data obtained from the acceleration sensor and angular velocity data obtained from the gyro sensor.

[0079] According to one embodiment, the memory (420) may include a storage medium (e.g., volatile memory and / or non-volatile memory) to temporarily or permanently store various data. The memory (420) may include at least some of the configuration and / or functions of the memory (130) of FIG. 1 and may store the program (140) of FIG. 1. The memory (420) may store various instructions that may be executed by the processor (410). Such instructions may include arithmetic and logical operations, data movement, or control commands such as input / output that may be recognized by the processor (410).

[0080] According to one embodiment, the processor (410) is a configuration capable of performing calculations or data processing related to control and / or communication of each component of the electronic device (400), and may be composed of one or more processors. The processor (410) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1. The processor (410) may be operatively, functionally, and / or electrically connected to each component of the electronic device (400), such as the display module (430), the camera module (440), the sensor (450), and the memory (420). The calculation and data processing functions that the processor (410) may implement on the electronic device (400) are not limited, but in this document, various embodiments for determining the z-axis direction position of a graphic object based on the properties of the graphic object and rendering a 3D image so that it can be recognized at the determined z-axis direction position will be described. The operations of the processor (410) to be described later can be performed by loading instructions stored in the memory (420).

[0081] According to one embodiment, the electronic device (400) can render a 2D image or a 3D image and output it through the display module (430). For example, the processor (410) can generate a first image (or a left-eye image) and a second image (or a right-eye image) constituting a 3D image, respectively, and place pixel data of the first image in odd-numbered pixel columns (or pixel column groups including pixels) and place pixel data of the second image in even-numbered pixel columns (or pixel column groups including pixels), thereby generating a 3D image. When the 3D image is output by the display module (430), only the first image may be substantially recognized by the user's left eye, and only the second image may be substantially recognized by the user's right eye, depending on an optical structure such as a lenticular lens or a parallax barrier.

[0082] According to one embodiment, an image output through the display module (430) may include at least one graphic object. Here, the graphic object may include at least one of a widget, an icon, an application execution screen, or a pop-up window, but is not limited thereto. Hereinafter, a widget will be described as an example of a graphic object, but the embodiments described below may also be applied to other types of graphic objects other than widgets.

[0083] According to one embodiment, the processor (410) can generate a graphic object as a 2D graphic object or a 3D graphic object, and can compose a 3D image using the 2D graphic object and / or the 3D graphic object. For example, even if a first graphic object and a second graphic object displayed in an image are both 2D graphic objects, if the z-axis direction positions of the first graphic object and the second graphic object are different, the user can feel a three-dimensional effect. The 3D image can include at least one 2D graphic object and at least one 3D graphic object, and at least one 2D or 3D graphic object can be recognized at a different position in the z-axis direction from other graphic objects.

[0084] According to one embodiment, the processor (410) may track the user's gaze direction based on an image acquired from the camera module (440) and determine the position of a graphic object displayed on a 3D image based on the gaze direction. For example, the processor (410) may acquire a user's pupil image in real time using the front camera module (440) and track the gaze direction according to changes in the position of the pupil. The processor (410) may track the user's gaze direction and automatically adjust and display information necessary for the user based on the user's gaze direction. For example, when the user looks in a specific direction, the processor (410) may display information in an area corresponding to the gaze direction or highlight information corresponding to the gaze direction.

[0085] FIG. 5 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.

[0086] FIG. 6 is an exemplary diagram showing the interior of a vehicle in which an electronic device according to one embodiment of the present disclosure is implemented.

[0087] FIG. 7 is an exemplary diagram showing first driving information and second driving information displayed by an electronic device according to one embodiment of the present disclosure.

[0088] Referring to FIGS. 5 to 7, an electronic device according to one embodiment may display first driving information (DI1) in a first area (611) of the display module (610) (operation 510), display second driving information (DI2) in a second area (612) of the display module (610) (operation 520), identify a driving event using the sensor (operation 530), obtain linked driving information that synchronizes the first driving information (DI1) and the second driving information (DI2) based on the driving event (operation 540), and display the linked driving information using the interaction of the first area (611) and the second area (612) (operation 550).

[0089] In one embodiment, an electronic device can provide integrated driving information by interacting with a transparent display on a windshield and an LFD on a dashboard. The electronic device can improve driving convenience by intuitively and clearly providing information based on driving events to the user. In the following operational embodiments, each operation may be performed sequentially, but is not necessarily sequential. For example, the order of each operation may be changed, or at least two operations may be performed in parallel.

[0090] According to an example, in operation 510, the electronic device may display first driving information (DI1) in a first area (611) of the display module (610).

[0091] As shown in FIG. 6, the display module (610) may include a first region (611). For example, the first region (611) may include a transparent display. The transparent display may be formed on a windshield of a vehicle, thereby displaying the first driving information (DI1) on the windshield.

[0092] The first region (611) may include a transparent display configured such that a portion of the screen is transparent, allowing objects behind and in front to be seen. For example, the transparent display may be implemented on a transparent substrate made of glass, plastic, and / or polymer. The first region (611) may display a clear image (e.g., first driving information (DI1)) without a backlight through the transparent display.

[0093] For example, a transparent display applied to a windshield can visually provide primary driving information (DI1) without obstructing the vehicle's forward view. The transparent display can be made of high-strength glass or reinforced plastic, making it resistant to external impacts. The transparent display can display images with high resolution and brightness to ensure visibility from various angles. Furthermore, the transparent display can automatically adjust brightness to match the lighting conditions inside and outside the vehicle, providing visibility appropriate to changing lighting conditions (e.g., day or night).

[0094] The first driving information (DI1) may include data related to the current driving status of the vehicle. For example, the first driving information (DI1) may include at least one of the vehicle's current speed, driving route, remaining fuel level, or basic warning lights (e.g., engine warning light, tire pressure warning light). The first driving information (DI1) may be intuitively and clearly displayed on a transparent display in the first area (611), thereby visually integrating with the vehicle's view ahead (e.g., road) that the user is looking at. For example, in the first area (611), the vehicle's speed may be displayed as a digital number, and the driving route may be visualized as a transparent arrow or line. For example, in the first area (611), the remaining fuel level may be displayed in the form of a gauge, and warning lights may be expressed as intuitive icons. For example, the first driving information (DI1) may be positioned at the edge or bottom of the windshield so as not to obstruct the driver's view while driving. For example, the first driving information (DI1) may be highlighted based on the importance of the information.

[0095] According to an example, in operation 520, the electronic device may display second driving information (DI2) in a second area (612) of the display module (610).

[0096] As shown in FIG. 6, the display module (610) may include a second area (612). For example, the second area (612) may include at least one of a 2D display or a 3D display (e.g., LFD). The 2D display or the 3D display may be attached to a dashboard of a vehicle, thereby displaying the second driving information (DI2) on the dashboard.

[0097] The second area (612) may include a 3D display (e.g., LFD) configured to allow a portion of the screen to appear three-dimensional from various angles. For example, the LFD may provide a sense of depth through binocular parallax using a lenticular lens array. The second area (612) may display a three-dimensional image (e.g., second driving information (DI2)) that is easily recognizable to a user through the 3D display. For example, a 3D display applied to a dashboard may include a high-resolution lenticular lens array, thereby providing a three-dimensional image that changes in real time through binocular parallax. The 3D display may display an image with high resolution and brightness to ensure visibility from various angles. In addition, the 3D display may automatically adjust brightness to suit the lighting conditions inside the vehicle, thereby providing visibility suitable for changing lighting conditions, such as day or night.

[0098] The second driving information (DI2) may include information that requires an immediate response from the user. For example, the second driving information (DI2) may include at least one of a driving operation status, an emergency warning message, a rearview camera image, or lane keeping information. The second driving information (DI2) may be intuitively and clearly displayed on a 3D display in the second area (612) so that the user can quickly perform a necessary operation. For example, in the second area (612), at least one of the pressure of the brake pedal, the rotation angle of the steering wheel, or the position of the accelerator pedal may be displayed as a 3D image. For example, in the second area (612), an emergency warning message including at least one of a forward collision warning and a tire puncture warning may be visualized in 3D form. For example, when reversing, the rearview camera image may be automatically activated and displayed as a 3D image in the second area (612). For example, when a vehicle deviates from its lane, lane keeping information may be displayed as a 3D image along with a warning message in the second area (612).

[0099] In one embodiment, as shown in FIG. 6, the electronic device may include a camera module (620). The camera module (620) of the electronic device may be mounted inside the vehicle and may track the user's gaze direction in real time. The electronic device may display first driving information (DI1) or second driving information (DI2) based on the user's gaze direction.

[0100] For example, the camera module (620) can capture a real-time image of the user's pupil and track the gaze direction according to changes in the pupil's position. For example, the electronic device can determine the position of a graphic object displayed on the display module (610) based on the user's gaze direction acquired from the camera module (620). The operation of the electronic device displaying linked driving information based on the user's gaze direction will be described in detail below with reference to FIG. 8.

[0101] In one embodiment, the camera module (620) may be placed in an area inside the vehicle. For example, the camera module (620) may be placed between the first area (611) and the second area (612) of the display module (610). For example, the camera module (620) may be placed below the second area (612) of the display module (610). For example, the camera module (620) may be placed above the second area (612) of the display module (610) (e.g., at a location adjacent to the vehicle's rearview mirror). Although the above-described placement area of ​​the camera module (620) is an example, the camera module (620) may be placed in various areas inside the vehicle where the user's gaze direction can be tracked. In the embodiments of FIGS. 7, 8, 9a, 9b and 18a below, for convenience of explanation, the camera module is described as being positioned below the first region of the display module as an example; however, as described above, the camera module may be positioned at various locations inside the vehicle.

[0102] In one example, at operation 530, the electronic device may use a sensor to identify a driving event.

[0103] Electronic devices may include various sensors to identify (or determine) driving events. For example, the electronic device may include at least one of a forward radar, a rearview camera, an ultrasonic sensor, an infrared (IR) sensor, a lane detection camera, a speed sensor, or a global positioning system (GPS) sensor. For example, the forward radar may detect vehicles or obstacles ahead. For example, the rearview camera may monitor the approach of a rear-facing vehicle. For example, the ultrasonic sensor may detect nearby obstacles during parking. For example, the IR sensor may detect heat sources such as pedestrians or animals during night driving. For example, the lane detection camera may monitor for lane departures. For example, the speed sensor may measure the current speed of the vehicle. For example, the GPS sensor may track the current location and driving path of the vehicle.

[0104] An electronic device can analyze sensing data collected from sensors in real time and determine a driving event based on whether a specific condition is met. For example, the driving event may include at least one of reaching a destination, moving a vehicle in front, a speed limit, a change in weather, or an approaching vehicle from behind. For example, the electronic device can determine a driving event in which the vehicle reaches a set destination within a predetermined distance. For example, the electronic device can determine a driving event in which a vehicle in front moves unexpectedly or stops suddenly. For example, the electronic device can determine a driving event in which the vehicle speed exceeds a set speed limit. For example, the electronic device can determine a driving event in which the driving environment changes due to a change in weather during driving. For example, the electronic device can determine a driving event in which another vehicle rapidly approaches from behind.

[0105] In one embodiment, an electronic device can use artificial intelligence to determine driving events. The artificial intelligence model used by the electronic device to determine driving events may be a single AI model or may be implemented as multiple AI models. The AI ​​model may be comprised of a neural network (or artificial neural network) and may include statistical learning algorithms that mimic biological neurons in machine learning and cognitive science. A neural network may refer to a model in general that has problem-solving capabilities, with artificial neurons (nodes) forming a network through the combination of synapses, which change the strength of the synaptic connections through learning. Neurons in a neural network may include a combination of weights or biases. A neural network may include one or more layers, each composed of one or more neurons or nodes. For example, an electronic device may include an input layer, a hidden layer, and an output layer. The neural network constituting the electronic device can infer a desired result (output) from any input by changing the weights of neurons through learning.

[0106] For example, the AI ​​model used by an electronic device may be a generative AI model. A generative AI model can generally refer to an AI neural network that creates new types of data based on user input. Generative AI models may include models that generate images and / or models that generate language. Representative models for generating images include generative adversarial networks (GANs) and variational autoencoders (VAEs), and examples include diffusion-based generative models that use VAEs and Transformer structures. Language-generating models are models trained to statistically generate the most appropriate output based on input values, such as CHAT-GPT 3 and CHAT-GPT 4. There are also large multimodal models (LMMs) that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them.

[0107] At least one processor included in the electronic device can generate a neural network, train or learn a neural network, perform a calculation based on received input data, generate an information signal based on the calculation result, or retrain the neural network. The models of the neural network may include various types of models such as a CNN (Convolution Neural Network) such as GoogleNet, AlexNet, VGG Network, etc., a R-CNN (Region with Convolution Neural Network), a RPN (Region Proposal Network), a RNN (Recurrent Neural Network), a S-DNN (Stacking-based deep Neural Network), a S-SDNN (State-Space Dynamic Neural Network), a Deconvolution Network, a DBN (Deep Belief Network), a RBM (Restricted Boltzmann Machine), a Fully Convolutional Network, an LSTM (Long Short-Term Memory) Network, a Classification Network, etc., but are not limited thereto. The processor may include one or more processors for performing calculations according to the models of the neural network. For example, a neural network may include a deep neural network.

[0108] 뉴럴 네트워크는 CNN(Convolutional Neural Network), RNN(Recurrent Neural Network), 퍼셉트론(perceptron), 다층 퍼셉트론(multilayer perceptron), FF(Feed Forward), RBF(Radial Basis Network), DFF(Deep Feed Forward), LSTM(Long Short Term Memory), GRU(Gated RecuREnt Unit), AE(Auto Encoder), VAE(Variational Auto Encoder), DAE(Denoising Auto Encoder), SAE(Sparse Auto Encoder), MC(Markov Chain), HN(Hopfield Network), BM(Boltzmann Machine), RBM(Restricted Boltzmann Machine), DBN(Depp Belief Network), DCN(Deep Convolutional Network), DN(Deconvolutional Network), DCIGN(Deep Convolutional Inverse Graphics Network), GAN(Generative Adversarial Network), LSM(Liquid State Machine), ELM(Extreme Learning Machine), ESN(Echo State Network), DRN(Deep Residual Network), DNC(Differentiable Neural Computer), NTM(Neural Turning Machine), CN(Capsule Network), KN(Kohonen Network) 및 AN(Attention Network)를 포함할 수 있으나, 이에 제한되지 않는다.

[0109] According to an exemplary embodiment of the present disclosure, at least one processor included in an electronic device is configured to perform a CNN (Convolution Neural Network) such as GoogleNet, AlexNet, VGG Network, etc., R-CNN (Region with Convolution Neural Network), RPN (Region Proposal Network), RNN (Recurrent Neural Network), S-DNN (Stacking-based deep Neural Network), S-SDNN (State-Space Dynamic Neural Network), Deconvolution Network, DBN (Deep Belief Network), RBM (Restricted Boltzmann Machine), Fully Convolutional Network, LSTM (Long Short-Term Memory) Network, Classification Network, Generative Modeling, eXplainable AI, Continual AI, Representation Learning, AI for Material Design, BERT for natural language processing, SP-BERT, MRC / QA, Text Analysis, Dialog System, GPT-3, GPT-4, Visual Analytics for vision processing, Visual Understanding, Video Synthesis, ResNet for data intelligence, Anomaly Detection, Prediction, Time-Series Various artificial intelligence structures and algorithms can be used, including but not limited to Forecasting, Optimization, Recommendation, and Data Creation.

[0110] For example, in operation 540, the electronic device may obtain (or generate) linked driving information that synchronizes the first driving information (DI1) and the second driving information (DI2) based on the driving event.

[0111] Linked driving information may refer to integrated data in which first driving information (DI1) and second driving information (DI2) are mutually linked in real time to provide consistent driving information to the user. For example, as illustrated in FIG. 7, when a vehicle ahead moves or a speed limit zone is entered, the electronic device may provide first driving information (DI1) (e.g., basic driving information) to a first area (711) (e.g., transparent display of a windshield) and second driving information (DI2) (e.g., auxiliary information or warning) to a second area (712) (e.g., LFD of a dashboard) at the same time, which may enable the user to recognize continuous information through the first area (711) and the second area (712).

[0112] The electronic device can generate the linked driving information by performing at least one of time synchronization, space synchronization, or warning synchronization for the first driving information (DI1) and the second driving information (DI2) based on the driving event.

[0113] For example, the electronic device may generate the linked driving information by performing time synchronization on the first driving information (DI1) and the second driving information (DI2) based on the driving event. Time synchronization may mean that the information displayed in the first area (711) and the second area (712) are updated in real time according to the same time flow. For example, when entering a speed limit zone, the current speed may be displayed on the windshield, and at the same time, speed limit information and a deceleration warning may be displayed in real time on the LFD of the dashboard.

[0114] For example, the electronic device may generate the linked driving information by performing spatial synchronization on the first driving information (DI1) and the second driving information (DI2) based on the driving event. Spatial synchronization may mean synchronizing the information displayed in the first area (711) and the second area (712) so that the information is spatially linked and the user can consistently recognize the spatial information. For example, when driving route guidance is displayed on the windshield, driving speed and direction information according to the driving route may be simultaneously displayed on the LFD of the dashboard.

[0115] For example, the electronic device may generate the linked driving information by performing warning synchronization for the first driving information (DI1) and the second driving information (DI2) based on the driving event. Warning synchronization may mean that warning information is displayed simultaneously in the first area (711) and the second area (712) when a driving event occurs. For example, when a forward collision warning occurs, a collision warning icon may be displayed on the windshield, and at the same time, a driving guide for collision avoidance may be visualized as a 3D image on the LFD of the dashboard.

[0116] In one embodiment, an electronic device may obtain the linked driving information by linking the first driving information (DI1) and the second driving information (DI2). The electronic device may obtain the linked driving information based on the information linkage of the first driving information (DI1) and the second driving information (DI2). The information linkage may include at least one of information conversion, information movement, information linkage, or information integration. The electronic device may obtain the linked driving information based on at least one of information conversion, information movement, information linkage, or information integration between the first driving information (DI1) and the second driving information (DI2) based on the driving event.

[0117] According to an example, in operation 550, the electronic device may display the linked driving information by utilizing the interaction between the first area (711) and the second area (712). For example, the electronic device may display the linked driving information based on at least one of information switching, information movement, information linkage, or information integration between the first area (711) and the second area (712). For example, the electronic device may display the linked driving information obtained based on at least one of information switching, information movement, information linkage, or information integration between the first driving information (DI1) and the second driving information (DI2). The electronic device may display the linked driving information in at least one of the first area (711) or the second area (712). For example, the electronic device may display the linked driving information in the first area (711) and the second area (712). For example, the electronic device may display the linked driving information in the first area (711) or the second area (712).

[0118] Referring to FIG. 7, the electronic device may display linked driving information in at least one of the first area (711) and the second area (712). For example, the linked driving information may be displayed as an image optimized for the driving event at a predetermined location in the first area (711) or the second area (712) based on the type and importance of the driving event, or the user's gaze direction. The electronic device may display first driving information (DI1) among the linked driving information in the first area (711). Information displayed in the first area (711) among the linked driving information may be referred to as first driving information (DI1). The first driving information (DI1) among the linked driving information may be the same as or different from the first driving information displayed in the first area (711) before the linked driving information is acquired. For example, the first driving information (DI1) among the linked driving information may include driving direction information. The electronic device may display second driving information (DI2) among the linked driving information in the second area (712). The information displayed in the second area (712) of the linked driving information may be referred to as second driving information (DI2). The second driving information (DI2) of the linked driving information may be the same as or different from the second driving information displayed in the second area (712) before the linked driving information was acquired. For example, the second driving information (DI2) of the linked driving information may include a message indicating the remaining distance to the destination. For example, the second driving information (DI2) of the linked driving information may include remaining fuel information.

[0119] In one embodiment, the electronic device may display the linked driving information based on information switching between the first area (711) and the second area (712). For example, if an obstacle suddenly appears ahead while driving, warning information indicating a risk of collision may first be displayed on the transparent display of the first area (711), and then the warning information may be converted into a driving guide for collision avoidance and displayed as a 3D image in the second area (712).

[0120] In one embodiment, the electronic device may display the linked driving information based on the movement of information between the first region (711) and the second region (712). For example, when the user's gaze moves from the transparent display of the windshield (the first region (711)) to the 3D display of the dashboard (the second region (712)) while driving, the electronic device may move the information in real time. For example, when driving route guidance is provided in the first region (711) and the user looks at the dashboard, the corresponding route guidance information may move and be displayed in the second region (712). For example, the electronic device may perform the information movement smoothly so that the user can continue to recognize the driving route even while his or her gaze moves. For example, when the vehicle exceeds the speed limit, the electronic device may immediately move the speed limit warning displayed in the second region (712) to the first region (711) to quickly display the speed limit information in the user's forward field of vision.

[0121] In one embodiment, the electronic device may display the linked driving information based on the information linkage between the first area (711) and the second area (712). For example, when a driving route guidance is displayed on the transparent display of the first area (711) while driving, driving speed and direction information associated with the route may be synchronized and displayed on the 3D display of the second area (712). For example, when an arrow of a driving route is displayed on the first area (711), the current speed and driving direction information may be visualized in 3D on the second area (712).

[0122] In one embodiment, the electronic device may display the linked driving information based on information integration between the first area (711) and the second area (712). For example, when a rear camera image is displayed on the 3D display of the second area (712), warning information about a vehicle approaching from behind may be simultaneously displayed on the transparent display of the first area (711). For example, when a driving warning occurs due to a change in weather, a general driving warning according to the weather change may be displayed on the first area (711), and a specific driving guide suitable for the corresponding weather condition may be visualized as a 3D image on the second area (712).

[0123] FIG. 8 is an exemplary diagram showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on a user's gaze direction (GD).

[0124] Referring to FIG. 8, the electronic device can track the user's gaze direction (GD) and automatically adjust and display information necessary for the user based on the user's gaze direction (GD). For example, the electronic device can track the user's gaze direction (GD) using the camera module (820) and display the linked driving information at a location corresponding to the gaze direction (GD) among the first area (811) or the second area (812). Accordingly, the electronic device can reduce the visual burden on the user while driving and improve the readability of the displayed information.

[0125] The electronic device can track the user's gaze direction (GD) based on the image acquired from the camera module (820) and determine the position of a graphic object displayed on a 3D image based on the gaze direction (GD). The electronic device can acquire the user's pupil image in real time using the front camera module (820) and track the gaze direction (GD) based on changes in the pupil position.

[0126] The electronic device can use data tracking the gaze direction (GD) to highlight or enlarge important driving information depending on the direction the user is looking. For example, when the user is looking at the road ahead, the electronic device can display the first driving information (DI1) by moving the second driving information (DI2) of the dashboard (812) to the transparent display (811) of the windshield. Conversely, when the user is looking at the dashboard (812), the electronic device can move the first driving information (DI1) displayed on the transparent display (811) of the windshield to the LFD of the dashboard to display the second driving information (DI2).

[0127] Electronic devices can analyze data tracking gaze direction (GD) and dynamically adjust the layout of their screens based on the location of information (e.g., text and / or graphic information) being viewed by the user. For example, when the user gazes in a specific direction, the electronic device may display information in an area corresponding to the GD or highlight information corresponding to the GD. For example, the electronic device may adjust visual elements of the information (e.g., font size, font color, and / or background color) to enhance the readability of the information in the area being viewed by the user.

[0128] FIGS. 9A and 9B are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on arrival at a destination.

[0129] Referring to FIGS. 9a and 9b, the electronic device can display first driving information (DI1) (e.g., driving guide) in a first area (911), and based on reaching a destination (dest) within a reference distance, display second driving information (DI2) (e.g., driving guide) as a three-dimensional image in a second area (912).

[0130] For example, as shown in FIG. 9A, when the electronic device is further away from the destination (dest) than a reference distance, the electronic device may display first driving information (DI1) (e.g., driving guide) for reaching the destination (dest) in the first area (911). In this case, the electronic device may display general second driving information in the second area (912).

[0131] For example, as shown in FIG. 9B, the electronic device may display the driving guide as a three-dimensional image in the second area (912) based on reaching the destination (dest) within a reference distance. For example, the electronic device may move the first driving information (DI1) (e.g., driving guide) displayed in the first area (911) to the second area (912) based on reaching the destination (dest) within a reference distance, and display the second driving information (DI2) (e.g., the driving guide) as a three-dimensional image in the second area (912). For example, the electronic device may display the second driving information (DI2) (e.g., steering direction of the steering wheel) as a three-dimensional image in the second area (912) based on reaching the destination (dest) within a reference distance. For example, the electronic device may display second driving information (DI2) (e.g., steering direction of the steering wheel) as a three-dimensional image that appears at a location closer to the user's position than the second area (912) (e.g., at a location above the steering wheel).

[0132] FIGS. 10A and 10B are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on forward vehicle movement.

[0133] Referring to FIGS. 10a and 10b, the electronic device can display first driving information (DI1a) (e.g., prediction of movement of a front vehicle) in the first area (1011), and based on the movement (e.g., approach) of the front vehicle, display driving guide (e.g., steering direction of a steering wheel) as a three-dimensional image in the second area (1012).

[0134] For example, as shown in FIG. 10A, the electronic device can predict whether the preceding vehicle will enter the direction of movement of the electronic device when the preceding vehicle is not moving. Based on the prediction of whether the preceding vehicle will enter the direction of movement of the electronic device, the electronic device can visually display first driving information (e.g., the current location (DI1b) of the preceding vehicle and information predicting the possibility of movement (DI1a)) in the first area (1011). The preceding vehicle can be located at a distance from the electronic device. For example, the electronic device can be located at a sufficient distance from the preceding vehicle and predict the movement of the preceding vehicle and determine whether avoidance is necessary. For example, the preceding vehicle can be displayed by highlighting the preceding vehicle using a border highlight effect and / or a color tone effect. The electronic device can display general second driving information (DI2) in the second area (1012).

[0135] For example, as shown in FIG. 10b, the electronic device may display second driving information (DI2) (e.g., driving guide) as a three-dimensional image in the second area (1012) based on proximity to the front vehicle. For example, the second driving information (DI2) may include a steering guide for the steering wheel (e.g., a steering direction of the steering wheel). For example, the electronic device may display the steering direction of the steering wheel as a three-dimensional image that appears at a location closer than the second area (1012) (e.g., a location above the steering wheel). The electronic device may display a movement prediction of the front vehicle in the first area (1011) based on a prediction that the front vehicle will suddenly enter the moving direction of the electronic device, and visualize the second driving information (DI2) (e.g., a specific driving guide for collision avoidance) as a three-dimensional image in the second area (1012).

[0136] FIGS. 11A and 11B are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on a speed limit.

[0137] Referring to FIGS. 11a and 11b, the electronic device may display first driving information (DI1) (e.g., information displayed by highlighting a speed limit) in the first area (1111), and, based on exceeding the speed limit, display a deceleration warning as a three-dimensional image in the second area (1112).

[0138] For example, as shown in FIG. 11A, before entering a speed limit zone, the electronic device may highlight and display the speed limit in the first area (1111). For example, the electronic device may display first driving information (DI1) with a border effect applied to a speed sign and / or surveillance camera ahead in the first area (1111). In this case, the electronic device may display second driving information (DI2) including the current speed in the second area (1112).

[0139] For example, as shown in FIG. 11b, the electronic device may move the current speed displayed in the second area (1112) to the first area (1111) based on the speed limit being exceeded, and display the second driving information (DI2) (e.g., deceleration warning) as a three-dimensional image in the second area (1112). For example, when the vehicle exceeds the speed limit, the electronic device may highlight and display the current speed (DI1a) and / or the speed limit (DI1b) in the first area (1111), and provide a three-dimensional deceleration warning (DI2) in the second area (1112) so that the user can immediately recognize and react.

[0140] FIGS. 12a and 12b are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information based on weather changes.

[0141] Referring to FIGS. 12a and 12b, the electronic device can display a driving guide in the first area (1211) and display a deceleration warning corresponding to the driving guide as a three-dimensional image in the second area (1212) based on weather changes.

[0142] For example, as shown in FIG. 12a, when the weather begins to change, the electronic device can minimize the first driving information (DI1) displayed in the first area (1211) so that the user can clearly understand the weather change. The electronic device can display a weather forecast in the first area (1211) and display points to keep in mind when driving based on the forecasted weather change. In this case, the electronic device can display second driving information (DI2), including current speed (DI2a) or remaining fuel information (DI2b), in the second area (1212).

[0143] For example, as shown in FIG. 12b, the electronic device can detect that the weather is getting worse and display first driving information (DI1) corresponding to the worsening weather in the first area (1211). For example, the electronic device can warn of the worsening weather conditions in the first area (1211) and display driving safety advice (DI1b) to be kept in mind while driving. The electronic device can move information displayed in the second area (1212) to the first area (1211) and display it. For example, the electronic device can highlight and display the current speed (DI1a) in the first area (1211). For example, the electronic device can display remaining fuel information (DI1c) in the first area (1211). The electronic device can visualize a deceleration warning (DI2) as a three-dimensional image in the second area (1212) so that the user can immediately recognize and respond to the worsening weather.

[0144] FIG. 13 is an exemplary diagram showing the interior of a vehicle in which an electronic device is implemented when the electronic device according to one embodiment of the present disclosure further includes a third area (1313), and FIGS. 14a and 14b are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information using the third area (1413).

[0145] Referring to FIG. 13, the display module may include a first region (1311), a second region (1312), and a third region (1313). For example, the first region (1311) may include a transparent display. The transparent display may be formed on a windshield of a vehicle, thereby displaying the first driving information (DI1) on the windshield. For example, the second region (1312) may include a 3D display (e.g., LFD). The 3D display may be attached to a dashboard of a vehicle, thereby displaying the second driving information (DI2) on the dashboard.

[0146] In one embodiment, the display module may further include a third area (1313) for displaying third driving information (DI3) on an E-mirror of the vehicle. For example, the third area (1313) may include an E-mirror. An E-mirror can replace a traditional side mirror and display rear and side situations in real time through a high-resolution digital screen. For example, when a rear vehicle is rapidly approaching, the electronic device may display third driving information (DI3) including information about the approach of the rear vehicle on the E-mirror. For example, the third area (1313) may include a 3D display or a 3D E-mirror. In this case, when a rear vehicle is rapidly approaching, the electronic device may stereoscopically display third driving information (DI3) including information about the approach of the rear vehicle on the 3D display or the 3D E-mirror.

[0147] Referring to FIGS. 14A and 14B , the electronic device can display the linked driving information by utilizing the interaction of the first area (1411), the second area (1412), or the third area (1413). For example, the electronic device can generate the linked driving information by synchronizing the first driving information (DI1), the second driving information (DI2), or the third driving information (DI3) based on the driving event, and display the linked driving information by utilizing the interaction of the first area (1411), the second area (1412), or the third area (1413).

[0148] Referring to FIG. 14A, when a rear vehicle is approaching, the electronic device may display third driving information (DI3) regarding the rear vehicle in the third area (1413). For example, the electronic device may display at least one of approach information including the rear vehicle, or at least one of the approach speed of the rear vehicle, the approach direction, and the distance from the rear vehicle, in the E-mirror of the third area (1413). The electronic device may display first driving information (DI1) including rear vehicle approach information notifying the approach of the rear vehicle in the first area (1411). For example, the rear vehicle approach information may be expressed by emphasizing the border and / or the color of a corner area adjacent to the area where the rear vehicle will appear. For example, the electronic device may express the approach direction, approach distance, and / or approach speed of the rear vehicle by adjusting the position, color, and / or size of the rear vehicle approach information in the first area (1411). For example, when the rear vehicle is approaching quickly, the color of the approaching vehicle information may be emphasized and displayed in red. For example, if a rear vehicle approaches the user's vehicle, the size of the approaching vehicle information may be enlarged and displayed.

[0149] Referring to FIG. 14B, the electronic device may highlight the rear vehicle and display it as first driving information (DI1) after the rear vehicle begins to appear in the first area (1411). For example, as the rear vehicle appears in the first area (1411), becoming a front vehicle, the electronic device may highlight and display the rear vehicle in the first area (1411) using a border highlighting effect and / or a color tone effect.

[0150] In one embodiment, the electronic device can switch or move information about a rear vehicle from the third area (1413) to the first area (1411) based on physical data. For example, the electronic device can collect and analyze physical data such as distance, speed, and direction from the rear vehicle in real time to switch or move information about the rear vehicle from the third area (1413) (E-mirror) to the first area (1411) (transparent display). For example, when a rear vehicle approaches within a certain distance, the electronic device can calculate the approaching speed and direction of the vehicle and switch information from the third area (1413) to the first area (1411). For example, when a rear vehicle approaches within 30 meters of the rear of the vehicle and the speed exceeds 60 kilometers per hour, the electronic device can move the rear vehicle information displayed on the E-mirror to the transparent display so that the user can clearly recognize the approach of the rear vehicle while keeping their eyes on the front.

[0151] In one embodiment, the electronic device can switch or move information about a rear vehicle from the third region (1413) to the first region (1411) based on the user's gaze direction (GD). For example, the electronic device can track the user's gaze direction (GD) using a camera module and switch or move information about a rear vehicle from the third region (1413) to the first region (1411) based on the gaze direction (GD). For example, when the user looks at the rear situation through the E-mirror and then turns his / her gaze to the road ahead, the electronic device can immediately move the rear vehicle information from the E-mirror to the transparent display. For example, when the user recognizes an approaching rear vehicle and starts looking at the road ahead, the electronic device can switch the rear vehicle information displayed on the E-mirror to the transparent display so that the user can continue to recognize the approaching rear vehicle even after the user moves his / her gaze.

[0152] FIG. 15 is an exemplary diagram showing the interior of a vehicle in which an electronic device is implemented when the electronic device according to one embodiment of the present disclosure further includes a fourth area (1514), and FIGS. 16 and 17 are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure displaying linked driving information using the fourth area (1614, 1714).

[0153] Referring to FIG. 15, the display module may include a first region (1511), a second region (1512), and a fourth region (1514). For example, the first region (1511) may include a transparent display. The transparent display may be formed on a windshield of a vehicle, thereby displaying the first driving information (DI1) on the windshield. For example, the second region (1512) may include a 3D display (e.g., LFD). The 3D display may be attached to a dashboard of a vehicle, thereby displaying the second driving information (DI2) on the dashboard.

[0154] In one embodiment, the display module may further include a fourth area (1514) that displays fourth driving information (DI4) as a three-dimensional image on the windshield of the vehicle. The fourth area (1514) may include a lenticular lens layer to display the three-dimensional image on the windshield.

[0155] Referring to FIGS. 16 and 17, the electronic device can display the linked driving information by utilizing the interaction of the first area (1611, 1711), the second area (1612, 1712), and / or the fourth area (1614, 1714). For example, the electronic device can generate the linked driving information by synchronizing the first driving information (DI1), the second driving information (DI2), and / or the fourth driving information (DI4) based on the driving event, and display the linked driving information by utilizing the interaction of the first area (1611, 1711), the second area (1612, 1712), and / or the fourth area (1614, 1714).

[0156] Referring to FIG. 16, the fourth area (1614) may partially overlap with the first area (1611) on the windshield. For example, the electronic device may visually display the current location (DI1b) of the front vehicle and information predicting the possibility of movement (DI1a) in the first area (1611). For example, when the front vehicle is stopped or moving slowly, the electronic device may display fourth driving information (DI4), which visualizes a driving guide considering the front vehicle as a 3D image, in a portion of the fourth area (1614) corresponding to the windshield.

[0157] Referring to FIG. 17, the fourth area (1714) may overlap the first area (1711) entirely on the windshield. For example, the electronic device may visually display the current location (DI1b) of the front vehicle and information predicting the possibility of movement (DI1a) in the first area (1711). For example, when the front vehicle is stopped or moving slowly, the electronic device may display fourth driving information (DI4), which visualizes a driving guide considering the front vehicle as a 3D image, in the entire area (1714) of the windshield.

[0158] FIGS. 18A to 18C are exemplary diagrams showing an electronic device according to one embodiment of the present disclosure highlighting and displaying a destination in a first area (1811).

[0159] Referring to FIG. 18A, the electronic device can identify a destination using the sensor. The electronic device can track the user's gaze direction (GD) using the camera module (1820). If the gaze direction (GD) matches the destination, the electronic device can highlight and display the destination in the first area (1811).

[0160] Electronic devices can use GPS data or preset destination information to identify a destination. For example, an electronic device can use these sensors to scan the surrounding environment, determine the current vehicle location, and calculate a route to the destination. Once the electronic device has reached within a specified distance of the destination, the device can use these sensors to identify the destination.

[0161] The electronic device can track the user's face and pupils in real time through a camera module (1820) mounted inside the vehicle. For example, the electronic device can analyze the position of the user's pupils to determine the gaze direction (GD). The electronic device can identify the location where the user's gaze direction (GD) is focused.

[0162] The electronic device can compare the location of the identified destination with the tracked gaze direction (GD). If the user's gaze direction (GD) matches the location of the destination, the electronic device can determine that the user is looking at the destination. When the user is looking at the destination, the electronic device can display first driving information (DI1) highlighting the destination in the first area (1811).

[0163] In one embodiment, the electronic device may apply an effect (eff1) that highlights the border of a destination in the first region (1811). For example, referring to FIG. 18B, if the user's gaze direction (GD) matches the location of the destination, the electronic device may highlight the border of the destination by surrounding it with a thick line or a shiny border. For example, the electronic device may increase the visibility of the destination by adding a predetermined color to the border color of the destination. For example, the electronic device may apply the border highlighting effect to the destination until the vehicle reaches the destination.

[0164] In one embodiment, the electronic device may use an effect (eff2) that applies a color tone to a destination in the first region (1811). For example, referring to FIG. 18c, if the user's gaze direction (GD) aligns with the location of the destination, the electronic device may highlight the entire area of ​​the destination building or location by filling it with a predetermined color. For example, the electronic device may increase the visibility of the destination by changing the color tone of the destination to a transparent or opaque color. For example, the electronic device may set the color tone applied to the destination to a color (e.g., red or blue) that distinguishes it from the surrounding environment, thereby guiding the user to easily identify the destination.

[0165] Thus, according to various embodiments of the present disclosure, the electronic device and the driving information display method using the same can provide integrated driving information through interaction between the transparent display of the windshield and the LFD of the dashboard. Therefore, the electronic device and the driving information display method using the same can enhance driving convenience by intuitively and clearly providing the user with information based on driving events.

[0166] Additionally, the electronic device of the present disclosure and the driving information display method using the same can track the user's gaze direction (GD) and automatically adjust and display necessary information to the user's gaze direction (GD). Therefore, the electronic device of the present disclosure and the driving information display method using the same can reduce the visual burden on the user while driving and improve the readability of the displayed information.

[0167] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0168] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0169] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0170] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0171] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0172] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0173] An electronic device for displaying driving information according to embodiments of the present disclosure may include at least one display including a first area and a second area, a sensor, at least one processor including a processing circuit, and a memory including one or more storage media storing one or more instructions. The one or more commands, when individually and / or collectively executed by the at least one processor, may cause the electronic device to identify a driving event using the sensor, and based on the driving event, obtain linked driving information that synchronizes first driving information displayed in the first area (e.g., first area (611,711,811,911,10111,1111,1211,1311,1411,1511,1611,1711,1811)) and second driving information displayed in the second area (e.g., second area (612,712,812,912,1012,1112,1212,1312,1412,1512,1612,1712,1812)), and display the linked driving information in at least one of the first area or the second area.

[0174] In one embodiment, the one or more instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to obtain the linked driving information by performing at least one of time synchronization, spatial synchronization, or warning synchronization for the first driving information and the second driving information based on the driving event.

[0175] In one embodiment, the one or more instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to obtain the linked driving information based on at least one of information switching, information movement, information linking, or information integration between the first driving information and the second driving information, based on the driving event.

[0176] In one embodiment, the electronic device further includes a camera, and the one or more commands, when individually and / or collectively executed by the at least one processor, cause the electronic device to track a gaze direction of the user using the camera and display the linked driving information at a location corresponding to the gaze direction among the first area or the second area.

[0177] In one embodiment, the first region may be located on a transparent display provided on a windshield of the vehicle.

[0178] In one embodiment, the second region may be located on a 3D display or a 2D display provided on the dashboard of the vehicle.

[0179] In one embodiment, the driving event may include at least one of reaching a destination, moving a vehicle ahead, a speed limit, a change in weather, or approaching a vehicle behind.

[0180] In one embodiment, the first driving information displayed in the first area includes a driving guide, and the one or more commands, when individually and / or collectively executed by the at least one processor, may cause the electronic device to move the driving guide displayed in the first area to the second area and display it as a three-dimensional image or a two-dimensional image based on reaching a destination within a reference distance.

[0181] In one embodiment, the first driving information displayed in the first area includes a movement prediction of a front vehicle, and the one or more commands, when individually and / or collectively executed by the at least one processor, can cause the electronic device to display a driving guide based on the movement prediction of the front vehicle in the second area as a three-dimensional image or a two-dimensional image, based on the proximity of the front vehicle to the electronic device.

[0182] In one embodiment, the first driving information displayed in the first area includes a highlighted displayed speed limit, and the one or more commands, when individually and / or collectively executed by the at least one processor, can cause a deceleration warning to be displayed in the second area as a three-dimensional image or a two-dimensional image based on exceeding the speed limit.

[0183] In one embodiment, the one or more commands, when individually and / or collectively executed by the at least one processor, may cause the electronic device to display a driving guide in the first area and to display a deceleration warning corresponding to the driving guide in a three-dimensional image or a two-dimensional image in the second area based on a weather change.

[0184] In one embodiment, the at least one display further includes a third area displaying third driving information, the third area being positioned on an E-mirror of the vehicle. The one or more commands, when individually and / or collectively executed by the at least one processor, may cause the electronic device to generate, based on the driving event, the linked driving information that synchronizes the first driving information, the second driving information, and the third driving information, and to display the linked driving information in at least one of the first area, the second area, or the third area.

[0185] In one embodiment, the at least one display further includes a fourth area displaying fourth driving information, the fourth area being positioned on a 3D display provided on a windshield of the vehicle. The one or more commands, when individually and / or collectively executed by the at least one processor, may cause the electronic device to generate, based on the driving event, the linked driving information that synchronizes the first driving information, the second driving information, and the fourth driving information, and to display the linked driving information in at least one of the first area, the second area, or the fourth area.

[0186] In one embodiment, the electronic device further comprises a camera (440), and the one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to identify a destination using the sensor, track a gaze direction of the user using the camera, and highlight and display the destination in the first area based on the gaze direction being directed toward the destination.

[0187] A method for displaying driving information according to embodiments of the present disclosure may include an operation of identifying a driving event using a sensor, an operation of obtaining linked driving information that synchronizes first driving information displayed in the first area and second driving information displayed in the second area based on the driving event, and an operation of displaying the linked driving information in at least one of the first area and the second area.

[0188] In one embodiment, the operation of obtaining the linked driving information may include an operation of obtaining the linked driving information by performing at least one of time synchronization, space synchronization, or warning synchronization on the first driving information and the second driving information based on the driving event.

[0189] In one embodiment, the operation of obtaining the linked driving information may include an operation of obtaining the linked driving information based on at least one of information switching, information movement, information linking, or information integration between the first driving information and the second driving information.

[0190] In one embodiment, the operation of displaying the linked driving information may include an operation of tracking a user's gaze direction using a camera, and an operation of displaying the linked driving information at a location corresponding to the gaze direction among the first area or the second area.

[0191] In one embodiment, the first region may be located on a transparent display provided on a windshield of the vehicle.

[0192] In one embodiment, the second region may be located on at least one of a 3D display or a 2D display provided on a dashboard of the vehicle.

Claims

1. In electronic devices, At least one display (430) comprising a first area and a second area; sensor (450); At least one processor (410) comprising a processing circuit; and A memory (420) comprising one or more storage media storing one or more commands; The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Identify driving events using the above sensors, Based on the driving event, the first driving information displayed in the first area and the second driving information displayed in the second area are synchronized to obtain the linked driving information, Causing the linked driving information to be displayed in at least one of the first area or the second area; Electronic devices.

2. In paragraph 1, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on the driving event, by performing at least one of time synchronization, space synchronization, or warning synchronization for the first driving information and the second driving information, the linked driving information is acquired. Electronic devices.

3. In paragraph 1 or 2, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on the driving event, causing the linked driving information to be acquired based on at least one of information switching, information transfer, information linkage, or information integration between the first driving information and the second driving information. Electronic devices.

4. In any one of paragraphs 1 to 3, The electronic device further comprises a camera (440), The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Track the user's gaze direction using the above camera, Causing the linked driving information to be displayed at a location corresponding to the gaze direction among the first area or the second area. Electronic devices.

5. In any one of paragraphs 1 to 4, The first region is located on a transparent display provided on the windshield of the vehicle. Electronic devices.

6. In any one of paragraphs 1 to 5, The second area is located on at least one of a 2D display or a 3D display provided on the dashboard of the vehicle. Electronic devices.

7. In any one of paragraphs 1 to 6, The above driving event is, Including at least one of reaching the destination, moving vehicles ahead, speed limit, weather change, or approaching vehicles behind; Electronic devices.

8. In any one of paragraphs 1 to 7, The first driving information displayed in the first area includes a driving guide, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on reaching the destination within a standard distance, causing the driving guide displayed in the first area to move to the second area and display it as a three-dimensional image or a two-dimensional image. Electronic devices.

9. In any one of paragraphs 1 to 7, The first driving information displayed in the first area includes a prediction of the movement of the front vehicle, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Causing a driving guide based on a movement prediction of the front vehicle to be displayed as a three-dimensional image or a two-dimensional image in the second area based on the proximity of the front vehicle to the electronic device. Electronic devices.

10. In any one of paragraphs 1 to 7, The first driving information displayed in the first area includes a speed limit that is displayed by highlighting, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on exceeding the above speed limit, causing a deceleration warning to be displayed in the second area as a three-dimensional image or a two-dimensional image, Electronic devices.

11. In any one of paragraphs 1 to 7, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on weather changes, display driving guidance in the first area, Causing the deceleration warning corresponding to the driving guide in the second area to be displayed as a three-dimensional image or a two-dimensional image, Electronic devices.

12. In any one of paragraphs 1 to 11, The at least one display further includes a third area displaying third driving information, the third area being located on the E-mirror of the vehicle, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on the driving event, the linked driving information is obtained by synchronizing the first driving information, the second driving information, and the third driving information, Causing the linked driving information to be displayed in at least one of the first area, the second area, or the third area; Electronic devices.

13. In any one of paragraphs 1 to 12, The at least one display further includes a fourth area for displaying fourth driving information, the fourth area being located on a 3D display provided on a windshield of the vehicle, The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Based on the driving event, the linked driving information is generated by synchronizing the first driving information, the second driving information, and the fourth driving information, Causing the linked driving information to be displayed in at least one of the first area, the second area, or the fourth area; Electronic devices.

14. In any one of paragraphs 1 to 13, The electronic device further comprises a camera (440), The one or more instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Identify the destination using the above sensor, Track the user's gaze direction using the above camera, Based on the direction of the gaze toward the destination, causing the destination to be highlighted and displayed in the first area, Electronic devices.

15. In a method for displaying driving information, Actions that identify driving events using sensors; An operation of obtaining linked driving information that synchronizes the first driving information displayed in the first area and the second driving information displayed in the second area based on the driving event; and An operation of displaying the linked driving information in at least one of the first area or the second area; method.

Images