Hologram projection wearable communication terminal with AI variable optical control

Abstract

Achieving high-definition aerial hologram projection on small wearable devices has been challenging, and furthermore, there has been the issue of not being able to provide optimal display in response to environmental changes or the user's biological and psychological state. [Solution] The present invention comprises a hologram projection unit consisting of a metasurface optical element having variable optical properties and a projection light source, and an AI analysis unit that analyzes the user's biometric information, voice, and environmental information. Based on the AI ​​analysis results, the phase pattern, light intensity, and imaging position are variably controlled in real time to form a three-dimensional hologram image or cybernetic avatar image in the air. Furthermore, it is a communication terminal equipped with a multi-terminal cooperative support function that automatically switches display modes in response to ambient light, noise, and terminal attitude changes, and also shares status information among terminals to enable cooperative operation.

Description

Technical Field

[0001] The present invention relates to aerial hologram projection technology using a metasurface optical element. In particular, it analyzes user biometric information, mental state, environmental information, and voice input by AI, and variably controls optical parameters based on the analysis results to generate a high-definition stereoscopic hologram image in an extremely small housing such as a wristwatch-type wearable communication terminal.

Background Art

[0002] In conventional wearable terminals, a display screen or projection-type display has been used. However, due to the small size of the display area, the thickness of the optical system, power consumption, and the influence of ambient light, it has been difficult to display a stereoscopic image in the air.

[0003] Also, as hologram display technology, those using a light guide plate or a fixed diffractive optical element (HOE) are known. However, since their phase patterns are fixed, it has been impossible to perform optimal optical control according to changes in the user's health and mental states and the surrounding environment.

[0004] Furthermore, conventional smartwatches can acquire biometric data, but there has been no technology that links this to optical control to control stereoscopic display. Large devices are required for advanced optical control, and it has been practically impossible to achieve in an extremely small housing such as a wristwatch-type.

[0005] Also, there is technology for health display and AI interaction using an avatar, but a technology that combines the stereoscopic hologram display of the avatar and real-time optical correction has not yet been established.

[0006] The Patent Document 1 and the Patent Document 2 adopted a device form using an HMD and performed in-front-of-eye display of a hologram using a microlens.

[0007] The Patent Document 3 adopted a device form using a list band and projected a hologram onto a plane using a laser. [Prior art documents] [Patent Documents]

[0008] [Patent Document 1] U.S. Patent No. 10,326,983 [Patent Document 2] U.S. Patent No. 11,796,819 [Patent Document 3] U.S. Patent Publication No. 2016-0109953 [Overview of the project] [Problems that the invention aims to solve]

[0009] None of the aforementioned Patent Documents 1 to 3 disclose or suggest a configuration that dynamically controls the phase distribution of a metasurface optical element based on AI analysis to form a three-dimensional hologram in the air within a miniature watch-type casing, while simultaneously changing the avatar display in real time according to biological information, psychological information, and environmental information, and further providing multi-device cooperative support.

[0010] Projecting high-definition aerial holograms with small wearable devices has been difficult with conventional technology. Furthermore, there was a lack of technology to automatically adjust to optimal optical parameters in response to fluctuations in the user's biometric information, psychological state, posture changes, ambient light, noise, etc., and to change visibility, clarity, depth, and brightness in real time.

[0011] Furthermore, there were no wearable devices that combined 3D display of cybernetic avatars with real-time control of optical parameters, making it impossible to provide a display interface that allows for an intuitive understanding of the user's health and psychological state.

[0012] Furthermore, there were no wearable devices that could share status information between multiple devices, allowing family members, medical institutions, or nursing homes in remote locations to check the user's status via holograms.

[0013] Therefore, the present invention is (1) Even with an extremely small enclosure, it is possible to form a three-dimensional hologram image in the air, (2) The optical conditions are optimized by AI in response to user status and environmental changes. (3) Reflecting dynamic information such as cybernetic avatars in holograms, (4) Enables remote support through multi-device coordination. The purpose is to provide communication terminals. [Means for solving the problem]

[0014] To solve the above problems, the present invention includes the following configuration. (1) Metasurface optical element capable of dynamically controlling optical parameters based on AI analysis results (2) AI analyzes the user's biometric information, psychological state, voice input, and environmental information. (3) Mode switching according to analysis results (hologram / voice / avatar) (4) Formation of a three-dimensional hologram by light source control and phase pattern generation (5) Image position correction based on IMU, etc. (6) Multi-device cooperation function These features enable aerial hologram projection that is resilient to environmental changes, biological changes, and posture changes.

[0015] The communication terminal of the present invention automatically selects and switches between hologram display mode, voice dialogue mode, and cybernetic avatar display mode based on AI analysis results, thereby realizing a "diverse user interface that adapts to the environment," which was difficult with conventional single-display methods. In particular, it is characterized by its ability to maintain the optimal information presentation format even in the event of rapid changes in ambient light and noise, or changes in the user's posture.

[0016] The meta-surface optical element mounted on the communication terminal of the present invention can rapidly modulate the phase distribution, amplitude, polarization, diffraction angle, etc. according to the phase pattern generated by the AI analysis means. As a result, compared with the conventional fixed hologram optical element, a significant performance improvement is achieved in terms of imaging position, depth, thinning, and visibility.

[0017] Also, in the present invention, it includes AI analysis means for integrally analyzing biometric information (pulse, blood pressure, body temperature, SpO2, ECG, etc.) and psychological state estimation information acquired from the user, and environmental information (external disturbance light, illuminance, noise, person density, etc.). Therefore, it becomes possible to accurately estimate changes in the user's health state and psychological state and utilize the estimation results for optical control and avatar expression control.

[0018] Furthermore, based on the output of the AI analysis means, the optical control means performs light source control, phase map generation, driver IC control, etc., and rapidly reflects them to the meta-surface optical element. As a result, the brightness, transparency, shape, depth, line-of-sight direction, motion, etc. of the hologram image are updated in real time, enabling an intuitive and natural stereoscopic display for the user.

[0019] The present invention also includes dynamic hologram correction means using environmental data and terminal attitude information acquired from an acceleration sensor, gyro sensor, magnetic sensor, illuminance sensor, proximity sensor, etc. By this correction means, it is possible to automatically correct the displacement of the imaging position due to the movement of the wrist or the tilt of the arm and the deterioration of the hologram visibility due to external disturbance light, and it becomes possible to always maintain an ideal hologram display.

[0020] The communication unit of the present invention can perform two-way communication with cloud AI, an optical simulation API, an external database, or a medical / care / family terminal, etc., and can perform optimization of optical parameters, update of the avatar generation model, sharing of state information between multiple terminals, etc. As a result, the terminal realizes a system structure that continuously learns and evolves during use and maintains long-term functional improvement.

[0021] Furthermore, the present invention has a function of visualizing the user's state through a cybernetic avatar, enabling not only the user himself / herself to understand, but also remote parties such as family members, medical institutions, and nursing facilities to grasp the user's state in real time. As a result, various applications such as monitoring support, health management, remote communication, and life support are possible, and the utility value of the wearable terminal can be significantly expanded.

Advantages of the Invention

[0022] According to the present invention, even in an extremely small wristwatch-type housing, by using a variable metasurface optical element, it becomes possible to form a high-definition three-dimensional hologram image in the air. Since it is possible to stably present a "three-dimensional image floating on the wrist" that could not be achieved with conventional fixed hologram optical elements, the user can naturally view information without depending on eye movement or the angle of the wrist.

[0023] According to the present invention, the AI analysis means comprehensively analyzes biological information, psychological information, and environmental information and instructs the optical control means with optimized optical parameters, so that the hologram image is always optimized according to the user's state. As a result, brightness, sharpness, projection depth, and visibility are immediately adjusted, enabling "optical personalization according to the user's state," which was difficult with conventional technologies.

[0024] According to the present invention, since the expressions, movements, colors, transparencies, etc. of the cybernetic avatar generated by the AI are reflected in the hologram in real time, the user can intuitively understand health information, changes in the mental state, signs of abnormalities, etc. In particular, by linking emotion estimation and stress estimation with avatar movements, the health support and psychological support effects are enhanced.

[0025] Due to the environment-adaptive mode control of the present invention, hologram display, voice display, and avatar display automatically switch in various conditions such as outdoors, indoors, dark places, and noisy environments. Therefore, the user does not need to be conscious of the operation, and a high operability and user comfort are obtained in that the optimal display method is always selected.

[0026] According to the present invention, optical parameters and avatar models are continuously updated through integration with cloud AI, LLM (Large-Scale Language Model), and optical simulation APIs. As a result, the device of the present invention learns and evolves even after initial use, enabling long-term performance improvements.

[0027] According to the present invention, the metasurface optical element achieves extremely small size, low power consumption, and high-speed response, ensuring sufficient projection quality even in a wristwatch-sized device. In particular, the optical thickness is reduced compared to fixed lens systems, contributing to a thinner and lighter housing.

[0028] According to this invention, the AI ​​can estimate the user's hand movements and arm angles, and fine-tune the position of the hologram image accordingly. This provides a natural viewing experience, as if the avatar or projected information is always "resting in the palm of the hand." The user can experience a high level of visual immersion.

[0029] According to this invention, multi-device coordination is possible with family terminals, medical institution terminals, nursing home terminals, etc., and the condition of the elderly and patients can be shared in real time. Holographic warnings, explanations using avatars, and remote support are of extremely high value in medical and nursing care settings.

[0030] This invention provides a completely new interface that integrates hologram display, AI analysis, environmental detection, and avatar display, making it highly valuable for use in a wide range of industrial fields, including healthcare, welfare, consumer smartwatches, education, and entertainment. [Brief explanation of the drawing]

[0031] The drawings illustrate specific embodiments of the present invention as disclosed herein, including not only essential components of the invention but also optional and preferred embodiments. [Figure 1] Figure 1 is a diagram illustrating a communication system configuration including a communication terminal, illustrating an embodiment of the present invention. [Figure 2]Figure 2(a) is an external view showing the front surface of the wristwatch-type wearable device, and Figure 2(b) is a schematic diagram of the sensor configuration on the back surface of the wristwatch-type wearable device shown in Figure 2(a). [Figure 3] Figure 3 is a configuration diagram of the AI ​​analysis unit 41 and optical control means 42 shown in Figure 1. [Figure 4] Figure 1 shows the interaction between the cloud AI server 3 and the optical API server 5. [Figure 5] This diagram shows the aerial hologram projection flow illustrating this embodiment. [Figure 6] This diagram shows the avatar generation and facial expression control flow. [Figure 7] This is an environmental application mode control diagram. [Figure 8] This is a diagram illustrating multi-device collaborative support. [Figure 9] This is a user interface (UI) configuration diagram. [Figure 10] This diagram shows the AI ​​optical optimization flow. [Figure 11] This is a diagram illustrating the dynamic hologram correction configuration. [Figure 12] Figure 12 is a diagram showing a comparison table of the structure and advantageous effects of the present invention with prior art documents. [Modes for carrying out the invention]

[0032] The following describes an example of an embodiment of the present invention.

[0033] <Outline of the aerial hologram image formed and the embodiment> The size of the aerial hologram image formed by the communication terminal of this embodiment of the present invention can be formed as a three-dimensional image with a diagonal dimension of approximately 20 to 60 mm at a distance of approximately 10 to 50 mm from the watch-type housing. These values ​​are merely examples and can be appropriately changed depending on the brightness of the projection light source, the control resolution of the metasurface optical element, the ambient light conditions, and the user's viewing distance. This embodiment is not limited to these specific values ​​and also includes configurations that can form smaller or larger aerial hologram images.

[0034] The communication terminal 1 of this embodiment is a communication terminal that acquires the user's biometric information and voice input, and selects and presents at least one of a hologram display mode, a voice dialogue mode, and a cybernetic avatar display mode based on the results of analysis by AI, wherein the communication terminal comprises a metasurface optical element having variable optical properties, a projection light source that controls the light irradiated onto the metasurface optical element, an AI analysis means that generates a phase map, diffraction pattern, or optical modulation parameters of the metasurface optical element, and an optical control means that controls the phase distribution or diffraction characteristics of the metasurface optical element based on the AI ​​analysis results by the AI ​​analysis means, wherein the optical control means controls the metasurface optical element based on the phase map, diffraction pattern, or optical modulation parameters generated by the AI ​​analysis means, thereby variably projecting a three-dimensional image of a cybernetic avatar or an information hologram into space according to the user's state. Furthermore, in the communication terminal described above, the communication terminal is a wristwatch-type terminal worn on the user's wrist, and the aerial projection is imaged in the space above the wristwatch-type terminal.

[0035] This makes it possible to form a high-definition three-dimensional hologram image in mid-air, even in an extremely small, wristwatch-type casing, by using a variable metasurface optical element. Because it can stably present a "three-dimensional image floating on the wrist," which was not possible with conventional fixed hologram optical elements, users can naturally view information regardless of eye movement or arm angle. The communication terminal of this embodiment will be described in detail below based on the drawings.

[0036] <Embodiment 1: Overall configuration of a communication system including a communication terminal> Figure 1 is a diagram illustrating a communication system configuration including a communication terminal, illustrating an embodiment of the present invention. As shown in Figure 1, the communication terminal 1 of this embodiment is mainly composed of an optical projection unit 30, an AI analysis unit 41, a biometric information acquisition unit 50, an environmental detection unit 60, and a communication unit 110. It is capable of bidirectional communication with the cloud AI server 3, the optical API server 5, and the medical / nursing care collaboration terminal 6. The optical projection unit 30 also includes a characteristic metasurface optical element 31 and a projection light source 32 of this embodiment. The metasurface optical element 31 can have its phase, amplitude, polarization, or diffraction angle variably controlled using at least one of voltage application, thermal control, liquid crystal control, or phase change material control.

[0037] Cloud AI Server 3 is responsible for optical optimization, avatar generation, and psychological estimation, while the on-device AI provides immediate responses (real-time responses). The environmental detection unit 60 includes multiple environmental sensors such as an acceleration sensor, gyro sensor, magnetic sensor, illuminance sensor, microphone, and proximity sensor, and acquires environmental factor information, including arm angle, wrist movement, ambient light, noise, movement status, and indoor / outdoor determination, with high accuracy.

[0038] <Embodiment 2: Appearance of a wristwatch-type wearable device> Figure 2(a) is an external view showing the front surface of a wristwatch-type wearable device, and Figure 2(b) is a schematic diagram of the sensor configuration on the back surface of the wristwatch-type wearable device shown in Figure 2(a). As shown in Figure 2, the communication terminal 1 has a wristwatch-type housing with a light-emitting window 12 on its top surface from which an aerial hologram is projected (see Figure 2(a)). Biosensors such as a PPG sensor, ECG sensor, temperature sensor, and SpO2 sensor are located on the back of the communication terminal 1. The wristwatch-type wearable terminal, which functions as the communication terminal 1, is attached to the user's wrist with an armband 15 so that these biosensors are in close contact with the user's skin, thereby acquiring the user's biometric information. The light emission window 12 is coated with an anti-reflective coating to suppress reflections of external light and improve the visibility of the aerial projection.

[0039] <Functional configuration of optical control means and AI analysis unit> Figure 3 is a configuration diagram of the AI ​​analysis unit 41 and optical control means 42 shown in Figure 1. As shown in Figure 3, the AI ​​analysis unit 41 performs analysis processing such as user biometric data analysis 41a, psychological estimation 41b, environmental estimation 41c, contextual understanding using LLM (LLM contextual analysis) 41d, and optical parameter generation 41e. Here, the AI ​​analysis means 41 analyzes the user's biometric information (pulse, blood pressure, body temperature, blood oxygen saturation, electrocardiogram, etc.) and operates the optical control means according to changes in health status, psychological state, or social situation, allowing for variable changes in the brightness, depth, size, or display mode of the hologram image. Furthermore, the AI ​​analysis means 41 can perform natural language analysis on the user's voice input, classify it into at least one of small talk, consultation, health alert, or learning support, and automatically generate changes in the hologram image's facial expression, warning displays, or voice responses according to the classification results.

[0040] The optical control means 42 drives the metasurface optical element 31. The metasurface optical element 31 used in the present invention is composed of a nanopillar structure, a metalens structure, a phase change material (GST, etc.), a liquid crystal metasurface, or a dielectric array, etc. The optical control means 42 includes a driver IC, a DAC, a PWM control unit, a wiring board, a light source control driver, etc., and writes the phase pattern generated by the AI ​​analysis unit 41 to the metasurface optical element 31 at high speed. The optical control means 42 performs control such as phase control 42a, diffraction control 42b, polarization control 42c, and optical path control 42d.

[0041] (Cloud AI server 3 and optical API server 5 configuration) Figure 4 is a diagram showing the interaction between the cloud AI server 3 and the optical API server 5 in Figure 1. As shown in Figure 4, the cloud-side optical API server 5 performs diffraction simulation, phase optimization, wavefront aberration correction, and 3D hologram generation. Cloud AI Server 3 performs AI analysis, psychological / health estimation, and avatar estimation. The communication terminal 1 receives only the final phase map and reflects it on the metasurface optical element 31 via the optical control means 42.

[0042] <Flowchart for projecting aerial holograms> Figure 5 shows the aerial hologram projection flow illustrating this embodiment. As shown in the flowchart in Figure 5, the projection process involves turning on the light source (step 70), generating a phase map (step 71), controlling the metasurface (step 72), forming an image in the air (step 73), and correcting the display (step 74). Through the above series of processes, the communication terminal 1 forms a stable three-dimensional hologram image in the space above the wrist. Here, the IMU (accelerometer / gyroscope) detects the wrist position, and the AI ​​automatically corrects the image formation position, depth, and distortion.

[0043] <Avatar generation and facial expression control flow> Figure 6 shows the avatar generation and facial expression control flow. As shown in Figure 6, the avatar facial expression generation unit 90 generates avatar facial expressions and movements based on psychological estimation results and biometric information. This generation is a hybrid of preset facial expressions 90a and AI-generated AI motion 90b. The generated avatar facial expression corresponds to the user's psychological state, and a 3D hologram is projected from the hologram projection unit 30 through the light emission window 12 onto the user's wrist (see Figure 2(a)).

[0044] <Environmentally adaptive mode control> Figure 7 is an environmental application mode control diagram. In the mode control 80 shown in FIG. 7, an optimal display mode is automatically selected based on, for example, illuminance detection 60a, ambient light detection 60b, noise measurement 60c, indoor / outdoor determination (indoor / outdoor classification) 60d, battery remaining amount 60e, stress index, etc. by the environment detection unit 60. Specifically, in the mode control unit 80, a hologram mode, an avatar mode, and a voice dialogue mode are automatically selected. Here, at least one of the environmental factor information including ambient light, noise, the number of surrounding people, indoor / outdoor determination, and battery remaining amount is acquired, and the hologram display mode, the voice dialogue mode, and the cybernetic avatar display mode are automatically switched or used in combination according to the acquired environmental factor information. The optical control means 42 is characterized in that it changes the expression, movement, posture, line of sight, color tone, or transparency of the cybernetic avatar in real time and performs emotional expression feedback according to the user's health and psychological state.

[0045] <Multi-terminal collaborative support> FIG. 8 is a diagram showing multi-terminal collaborative support. As shown in FIG. 8, the communication terminal (this device) 1 can share the state of the family terminal 6a, the medical terminal 6b, the care terminal 6c, and the cybernetic avatar. Here, the communication terminal 1 is characterized by having a multi-terminal collaborative support function that shares the state information (such as health, psychology, and living conditions) of the cybernetic avatar with other communication terminals and adjusts the display content or dialogue content of the hologram image based on the shared information. Thereby, multi-terminal collaborative support becomes possible.

[0046] <User operation UI> FIG. 9 is a configuration diagram of the user operation UI. As shown in FIG. 9, the user input UI (user interface) 120 can use a plurality of types of UIs such as a voice input UI 120a, a touch input UI 120b, a gesture input UI 120c, and a line-of-sight input UI 120d in combination. Here, the line-of-sight input UI 120d is not necessarily essential and may be used arbitrarily according to user needs.

[0047] <AI optical optimization flow> FIG. 10 is a diagram showing the AI optical optimization flow. As shown in Figure 10, the optical API server 5 and the LLM / cloud AI server 3a work together to continuously optimize the phase map. The optical API server 5 performs processes such as phase optimization, depth optimization, and diffraction characteristic generation. The LLM / cloud AI server 3a performs contextual judgment, avatar motion optimization, etc. Here, the AI ​​analysis means is:

[0048] A communication terminal characterized by its ability to generate or optimize control patterns, projection depths, diffraction characteristics, or optical path conversion parameters of a metasurface optical element in conjunction with at least one of a large-scale language model (LLM), an optical simulation API, or an optical design cloud service.

[0049] As shown in Figure 10, optical parameters and avatar models are continuously updated through integration with cloud AI, LLM (Large-Scale Language Model), and optical simulation APIs. Here, the AI ​​analysis means can be integrated with either in-terminal AI, cloud AI, an external database API, or general-purpose artificial intelligence (AGI) / artificial superintelligence (ASI), and is characterized by an expandable configuration that allows for updates to the hologram display, avatar generation, optical control, and voice interaction through integration. As a result, the device of the present invention can learn and evolve even after initial use, achieving long-term performance improvements.

[0050] <Embodiment 3> <Embodiment 3: Dynamic Hologram Correction Configuration> In the communication terminal described in Embodiment 1 or 2, the communication terminal is equipped with detection means for detecting at least one of the user's wrist movement, terminal orientation changes, line of sight direction, ambient light intensity, ambient illumination, terminal tilt angle, or indoor / outdoor determination, and is equipped with dynamic hologram correction means that corrects at least one of the phase distribution, diffraction angle, amplitude, polarization state, optical path, imaging depth, or display area of ​​the metasurface optical element in real time based on the change information acquired by the detection means, and the correction is performed in such a way as to maintain the position of the hologram image within the user's field of view, thereby suppressing displacement, blurring, distortion, brightness reduction, or reduced visibility of the airborne hologram image. Figure 11 is a diagram of the dynamic hologram correction configuration. As shown in Figure 11, the detection means 200 includes a wrist movement sensor 201, a posture change sensor 202, a gaze direction sensor 203, an ambient light sensor 204, an ambient illuminance sensor 205, a terminal tilt angle sensor 206, and an indoor / outdoor determination sensor 2007.

[0051] The AI ​​correction analysis unit 410 performs analysis processing such as positional displacement estimation 411, distortion estimation 412, brightness reduction estimation 413, and depth optimization 414.

[0052] The corrective optical control means 420 includes a phase distribution correction circuit 421, a diffraction angle correction circuit 422, an amplitude / polarization correction circuit 423, an optical path correction circuit 424, an imaging depth correction circuit 425, and a display area correction circuit 426. These correction circuits perform corrective optical control to perform real-time dynamic hologram correction.

[0053] A phase map for corrective optical control is written to the metasurface optical element 31 to obtain a corrected hologram Hc. Here, the corrected hologram Hc can be made to suppress positional shift, distortion, and brightness reduction by the correction circuit of the corrective optical control means 420.

[0054] With a wristwatch-type communication terminal configured as described above, the advantageous effects shown in Figure 12 can be obtained compared to prior patent documents. Figure 12 is a diagram showing a comparison table of the structure and advantageous effects of the present invention with prior art documents. Comparing the configuration and advantageous effects of the present invention shown in Figure 12 with prior art documents, it is expected that the present invention dynamically controls the phase distribution of a metasurface optical element based on AI analysis, forms a three-dimensional hologram in a watch-type miniature housing, changes the avatar display in real time according to biological information, psychological information, and environmental information, and provides significant advantages in remote support applications that cannot be obtained with prior art documents 1, 2, and 3, particularly in multi-terminal collaborative support applications. Details are shown in Figure 12, so an explanation is omitted. [Explanation of symbols]

[0055] 1. Communication terminal (wristwatch type) 3. Cloud AI Server 5 Optical API Server 6. Medical and nursing care collaboration communication terminals 6a Medical terminals 6b Family terminal 6c Caregiving Terminal 12. Light-emitting window 15. Armband section 30 Optical projection section 31 Metasurface Optical Elements 41 AI analysis department 41a Biological analysis 41b Psychological estimation 41c Environmental estimation 41d LLM analysis 41e Optical parameter generation 41p Positional displacement estimation 41q Distortion Estimation 41r Brightness Estimation 41s depth optimization 42 Optical control means 42a Phase control 42b Diffraction control 42c Polarization Control 42d Optical Path Control 420 Correction optical control means 421 Phase distribution correction circuit 422 Diffraction Angle Correction Circuit 423 Amplitude / Polarization Correction Circuit 424 Optical path correction circuit 425 Image depth correction circuit 426 Display area correction circuit 50. Biological Information Acquisition Unit 60 Environmental detection unit 70 Light source turned on 71. Phase Map Generation 72 Metasurface Control 73. Aerial imaging 74 Display correction 80 Mode Control Unit 90 Avatar facial expression generation unit 110 Communications Department 120 User UI 200 Detection means 201 Wrist motion sensor 202 Attitude change sensor 203 Eye-line direction sensor 204 Ambient Light Sensor 205 Ambient Illuminance Sensor 206 Terminal tilt angle sensor 207 Indoor / Outdoor Detection Sensor H Uncorrected Hologram Image Hc-corrected hologram image

Claims

1. Acquisition means for acquiring the user's biometric information and voice input, and means for analyzing the user's biometric information and voice input, AI analysis means for generating phase information representing the phase distribution of a metasurface optical element, An optical control means for controlling the metasurface optical element based on the phase information generated by the AI ​​analysis means, A projection light source that irradiates the metasurface optical element with projection light, A detection means for detecting the orientation or movement state of a communication terminal, Correction means for correcting the phase information based on the posture or movement state acquired by the detection means, Equipped with, A communication terminal characterized by forming an aerial hologram image corresponding to voice input in the space above the communication terminal based on the phase information generated and corrected by the AI ​​analysis means and the correction means.

2. In the communication terminal described in claim 1, The aforementioned communication terminal is a wristwatch-type terminal worn on the user's wrist. A communication terminal characterized in that the aerial hologram image is formed in the space above the wristwatch-type terminal.

3. In the communication terminal according to claim 1 or 2, The aforementioned metasurface optical element is A communication terminal characterized by its ability to variably control phase, amplitude, polarization, or diffraction angle using at least one of voltage application, thermal control, liquid crystal control, or phase change material control.

4. In the communication terminal according to claim 1 or 2, The communication terminal is characterized in that the AI ​​analysis means analyzes the user's biometric information, and based on the results of the analysis, operates the optical control means to change the brightness, depth, or size of the aerial hologram image.

Images