Display device and aerial image display device
By using infrared light to display the high-temperature image part in the aerial image display device, combining vision and temperature sense, the problem of the prior art failure to use infrared light to provide a new image experience is solved, and a more realistic and efficient image display is achieved.
Patent Information
- Application Number
- CN202380038632.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-08-03
- Filing Date
- 2023-05-22
- Publication Date
- 2024-12-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing aerial image display devices fail to effectively utilize infrared light to provide a new image experience, especially when displaying high-temperature objects with temperatures higher than a given temperature.
The high-temperature image part is displayed by light containing infrared light, and the visible light emitting part and infrared light emitting part are arranged alternately in matrix in the display part, and the image light is reflected and imaged by using a reflective optical system, providing a combined experience of vision and temperature sensation.
It realizes a new image experience with temperature sensing for users, which can effectively distinguish and display high-temperature image parts, enhance the realistic sense and contrast of the image, and reduce power consumption.
Smart Images

Figure CN119072650A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a display device and an aerial image display device. Background Art
[0002] Conventionally, for example, an aerial image display device described in Patent Document 1 is known.
[0003] Prior Art Literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-67707 Summary of the invention
[0006] The display device of the present disclosure includes a display unit, and when an image displayed by the display unit includes a high-temperature image portion reflecting a high-temperature object having a temperature higher than a predetermined temperature, the high-temperature image portion is displayed using light including infrared light.
[0007] The aerial image display device disclosed in the present invention includes: a display unit having a display surface; and a reflective optical system, which reflects image light of an image displayed on the display surface to form an aerial image as a real image. When the image includes a high-temperature image portion of a high-temperature object whose temperature is higher than a given temperature, the high-temperature image portion is displayed on the display surface using light including infrared light. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The objects, features and advantages of the present disclosure will become clear from the following detailed description and the accompanying drawings.
[0009] Figure 1A It is a diagram showing the structure of an aerial image display device according to one embodiment of the present disclosure, and is a side view and a block diagram of a main part.
[0010] Figure 1B It is a diagram showing the structure of an aerial image display device according to another embodiment of the present disclosure, and is a side view and a block diagram of a main part.
[0011] Figure 2A Yes means Figure 1A A cross-sectional view of an example of a display portion of an aerial image display device.
[0012] Figure 2B Yes means Figure 2A A top view of an example of an arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit.
[0013] Figure 3 This is a diagram showing an example of an image displayed on the display unit, and is a front view of the image.
[0014] Figure 4A Yes means Figure 1A A cross-sectional view of another example of a display portion of an aerial image display device.
[0015] Figure 4B Yes means Figure 4A A top view of an example of an arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit.
[0016] Figure 4C Yes means Figure 4A A top view of other examples of the arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit.
[0017] Figure 5 Yes Description Figure 1A The diagram which defines the curvature of the first concave mirror in the reflective optical system of the aerial image display device is a cross-sectional view of the first concave mirror.
[0018] Figure 6 Yes means Figure 2A A top view of other examples of the arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit.
[0019] Figure 7 Yes means Figure 4A A top view of other examples of the arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit.
[0020] Figure 8 It is a diagram showing the structure of an aerial image display device according to another embodiment of the present disclosure, and is a side view and a block diagram of a main part.
[0021] Fig. 9 It is a diagram showing the structure of an aerial image display device according to another embodiment of the present disclosure, and is a side view and a block diagram of a main part.
[0022] Fig.10 It is used to illustrate Fig. 9 The diagram showing the effect of the aerial image display device is a side view of the user's hand and its surroundings.
[0023] Fig.11 It is a diagram showing the structure of an aerial image display device according to another embodiment of the present disclosure, and is a side view and a block diagram of a main part. DETAILED DESCRIPTION
[0024] Conventionally, various aerial image display devices that form an aerial image using image light emitted from a display device have been proposed. Patent Document 1 discloses an aerial image display device including a display device that emits infrared light.
[0025] Providing a new image experience to users The conventional display device and the aerial image display device described in Patent Document 1 do not use infrared light to provide a new image experience to users.
[0026] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. The figures referenced below represent the main components of the aerial image display device involved in the embodiments. The aerial image display device involved in the embodiments may have well-known components such as a driving circuit, a circuit substrate, a wiring conductor, a housing, etc. that are not shown in the figures. The figures referenced below are schematic, and the dimensional ratios on the figures are not necessarily consistent with the actual ones. In addition, in some of the drawings, an orthogonal coordinate system XYZ is defined for convenience.
[0027] Figure 1A , Figure 1B 2 are diagrams showing the structures of aerial image display devices according to two embodiments of the present disclosure. Figure 2A Yes means Figure 1A A cross-sectional view of an example of a display unit of an aerial image display device, Figure 2B Yes means Figure 2A A top view of an example of an arrangement of a plurality of visible light emitting units and a plurality of infrared light emitting units in a display unit, Figure 3 This is a front view showing an example of an image displayed on the display unit. Figure 4A Yes means Figure 1A A cross-sectional view of another example of the display portion of the aerial image display device, Figure 4B Yes means Figure 4A A top view of an example of an arrangement of a plurality of visible light emitting units and a plurality of infrared light emitting units in a display unit, Figure 4C Yes means Figure 4A A top view of other examples of the arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit. Figure 5 Yes Description Figure 1A A cross-sectional view of the first concave mirror showing the definition of the curvature of the first concave mirror in the reflective optical system of the aerial image display device. Figure 6 Yes means Figure 2A A top view of another example of an arrangement of a plurality of visible light emitting units and a plurality of infrared light emitting units in a display unit, Figure 7 Yes means Figure 4A A top view of another example of the arrangement of multiple visible light emitting units and multiple infrared light emitting units in a display unit. Figure 1A , Figure 1B In the figure, a shadow is added to the aerial image to show it. Figure 2A Indicated in Figure 2B The cross section is cut along the cutting line IIA-IIA. Figure 4A Indicated in Figure 4B The section cut at the IVA-IVA line. Figure 2B, Figure 4B , Figure 4C , Figure 6 , Figure 7 In FIG. 1 , the infrared light emitting portion (infrared light emitting element) is shown with a shadow. Figure 2B , Figure 4B , Figure 4C , Figure 6 , Figure 7 In the figure, only the visible light emitting portion and the infrared light emitting portion arranged on the substrate are shown.
[0028] The display device of the present disclosure includes a display unit, and is configured to display the high temperature image portion using light including infrared light when an image displayed by the display unit includes a high temperature image portion reflecting a high temperature object having a temperature higher than a given temperature. Figure 3 As shown in the figure, the display device has a display surface 2a, and when the image 4 displayed by the display surface 2a includes a high-temperature image portion 43 reflecting a high-temperature object having a temperature higher than a given temperature, the high-temperature image portion 43 is displayed using light including infrared light. The above structure has the following effects. Since the high-temperature image portion 43 of the image 4 is displayed by light including infrared light (visible light) when the image 4 includes the high-temperature image portion 43, the user (also referred to as a visual recognizer) can perceive the high-temperature image portion 43 of the visible light through vision and temperature sensation (for example, skin sensation, hereinafter also referred to as "temperature sensation"). As a result, a new image experience accompanied by a temperature sensation can be provided to the user.
[0029] The display device may include a display unit 2, a housing for accommodating the display unit 2, a supporting member / pedestal for supporting the housing, etc. The display unit 2 may be a transmissive display unit 2, in which case it may be a liquid crystal display unit including a backlight and a liquid crystal panel. The backlight may be a directly underneath type backlight having a plurality of light emitting units arranged in a two-dimensional manner on the back side of the liquid crystal panel. For example, the plurality of light emitting units include a plurality of visible light emitting units and a plurality of infrared light emitting units. The backlight has a substrate, and the plurality of visible light emitting units and the plurality of infrared light emitting units may be arranged alternately in a matrix on one surface (also referred to as a light emitting surface) of the substrate. The visible light emitting unit and the infrared light emitting unit are composed of self-luminous elements such as light emitting diodes (LEDs) and organic light emitting diodes (OLEDs).
[0030] The display unit 2 of the display device is not limited to the transmissive display unit 2, and may be a self-luminous display unit 2 including a plurality of self-luminous elements. The self-luminous element may be an LED, an OLED, etc. The self-luminous display unit 2 includes a plurality of pixels. The plurality of pixels may respectively include a visible light emitting unit and an infrared light emitting unit. The self-luminous display unit 2 may have a substrate, and the plurality of visible light emitting units and the plurality of infrared light emitting units are alternately arranged in a matrix on the light emitting surface of the substrate.
[0031] When the image 4 displayed by the display unit 2 includes a high temperature image unit 43 reflecting a high temperature object having a temperature higher than a given temperature (e.g., room temperature), if it is a liquid crystal display unit, the infrared light emitting unit corresponding to the high temperature image unit 43 in the backlight is made to emit light. If it is a self-luminous display unit 2, the infrared light emitting unit corresponding to the high temperature image unit 43 is made to emit light. The light emission intensity of the infrared light emitting unit can be controlled according to the assumed temperature of the high temperature image unit 43. The light emission intensity of the infrared light emitting unit can be controlled, for example, by controlling the current input to the infrared light emitting unit and the applied voltage by a light emission control unit connected to the display unit 2 or a light emission control unit installed in the display unit 2. If the high temperature image unit 43 is a person, an animal, a character, etc., the light emission intensity of the infrared light emitting unit can be controlled so that the user can feel a temperature equivalent to their body temperature (about 35°C to 37°C). If the high temperature image unit 43 is a heating element, such as hot water (about 38°C to 42°C), the light emission intensity of the infrared light emitting unit can be controlled so that the user can feel a temperature equivalent to hot water. If the high temperature image portion 43 is a heating element, such as a flame, the luminous intensity of the infrared light emitting portion can be controlled so that the user can feel the temperature when the hand covers the flame (about 40°C to 50°C). If the high temperature image portion 43 is a heating element, such as the sun, the luminous intensity of the infrared light emitting portion can be controlled so that the user can feel the temperature equivalent to the heat of the sun (about 30°C to 50°C).
[0032] The display device can distinguish the high temperature image portion 43 from the non-high temperature image portion in the image 4 displayed on the display unit 2 as follows. The display device includes a light emission control unit, and the light emission control unit is configured to store image data for each frame. The image data (also referred to as high temperature image data) of the high temperature image portion 43 can be stored in a manner that can distinguish the image data of the high temperature image portion 43 in the image data. For example, the start mark data, start label data, etc. indicating that it is the start portion are added to the head portion (start portion) of the high temperature image data, and the end mark data, end label data, etc. indicating that it is the end portion are added to the end portion (end portion) of the high temperature image data. The processing of adding the start mark data, start label data, etc. to the high temperature image data and the processing of adding the end mark data, end label data, etc. can also be performed manually. In addition, the image 4 displayed on the display unit 2 can be photographed by a camera or other imaging device, and the photographed image (camera image) can be analyzed by an analysis program software. Based on the fact that the high temperature image portion 43 is determined in the photographed image, the processing of adding the start mark data, start label data, etc. to the high temperature image data and the processing of adding the end mark data, end label data, etc. can be performed. The analysis software may include artificial intelligence (AI) software that analyzes the captured image to detect and extract a specific pattern. The AI software may also perform image recognition that directly analyzes the image data to detect and extract a specific pattern.
[0033] Display devices can be used in various electronic devices. Examples of such electronic devices include automobile route guidance systems (navigation systems), ship route guidance systems, aircraft route guidance systems, indicators for metering instruments of vehicles such as automobiles, dashboards, smartphone terminals, mobile phones, tablet terminals, personal digital assistants (PDAs), video cameras, digital still cameras, electronic notebooks, electronic books, electronic dictionaries, personal computers, copiers, terminal devices for gaming devices, televisions, product display labels, price display labels, industrial programmable display devices, car audio, digital audio players, fax machines, printers, automatic teller machines (ATMs), vending machines, medical display devices, digital display watches, smart watches, guidance display devices installed at stations and airports, etc., advertising signs (digital signage), head-mounted displays (HMDs), etc.
[0034] like Figure 1A As shown, the aerial image display device 1 of the present embodiment includes a display unit (hereinafter also referred to as a display device) 2 and a reflective optical system 3 .
[0035] The display device 2 has a display surface 2a, and displays an image 4 transmitted as image light L to the reflective optical system 3 (first concave mirror 31) side on the display surface 2a. The display device 2 can display an image 4 (in the case of infrared light) composed of a visible light image including infrared light. Figure 3 An example is shown in FIG. 1 ). The display device 2 emits image light L from the display surface 2a. The image light L may include at least one of the visible light L1 and the infrared light L2. Therefore, in some cases, the image light L may be composed only of the visible light L1, and in other cases, the image light L may be composed only of the infrared light L2.
[0036] The reflective optical system 3 reflects the image light L of the image 4 displayed on the display surface 2a and forms an image into an aerial image R of a real image. Thus, the user 5 can perceive the aerial image R formed by the image light L. In the case where the image light L is composed of only visible light L1, the user 5 can perceive the visible light aerial image R1 formed by the image of the visible light L1 through vision. In the case where the image light L includes visible light L1 and infrared light L2, the user 5 can perceive the visible light aerial image R1 formed by the image of the visible light L1 through vision, and can perceive the temperature of the infrared light aerial image R2 formed by the image of the infrared light L2 through feeling (for example, skin feeling). The reflective optical system 3 is composed of reflective optical elements such as concave mirrors and convex mirrors.
[0037] The display device 2 may be Figure 2A The transmissive display device 2 shown in FIG. 2 may be a liquid crystal display device including a backlight 21 and a liquid crystal panel 22 .
[0038] The backlight 21 may be a direct-under type backlight having a plurality of light-emitting units arranged in two dimensions on the back side (i.e., the light incident side) of the liquid crystal panel 22. The plurality of light-emitting units include a plurality of visible light-emitting units 21a and a plurality of infrared light-emitting units 21b. Figure 2A , Figure 2B As shown in the figure, the backlight 21 has a substrate 23, and a plurality of visible light emitting parts 21a and a plurality of infrared light emitting parts 21b can be arranged alternately in a matrix on the first surface 23a of the substrate 23. The visible light emitting parts 21a and the infrared light emitting parts 21b can be composed of self-luminous elements such as light emitting diodes (LEDs) and organic light emitting diodes (OLEDs). The substrate 23 can be a glass substrate, a plastic substrate, a metal substrate, a ceramic substrate, etc., or a composite substrate in which multiple types of these are stacked.
[0039] The visible light emitting unit 21a may emit white light. In this case, the visible light emitting unit 21a may include a red LED that emits red light, a green LED that emits green light, and a blue LED that emits blue light. The visible light emitting unit 21a may also include a white LED that emits white light. The white LED may also include an ultraviolet LED that emits ultraviolet light, and a phosphor that converts the wavelength of the ultraviolet light emitted from the ultraviolet LED into white light. The white LED may include a blue LED that emits blue light, and a phosphor that converts the wavelength of the blue light emitted from the blue LED into white light.
[0040] The infrared light emitting unit 21b may be an infrared LED that emits infrared light. The infrared LED may be a near-infrared LED that emits near-infrared light or infrared light with a wavelength of about 0.78 μm to 2.5 μm. In addition, "to" means "to", and the same applies to the following.
[0041] As is well known, the liquid crystal panel 22 may include a first polarizing plate, a color filter substrate, a liquid crystal layer, an array substrate, and a second polarizing plate. The liquid crystal panel 22 includes a plurality of pixels. The pixel includes a sub-pixel for red light emission, a sub-pixel for green light emission, and a sub-pixel for blue light emission. The pixel may include a sub-pixel for infrared light emission. Since infrared light has a higher transmittance to the liquid crystal panel 22 than visible light, the pixel may not have a sub-pixel for infrared light emission. The sub-pixel for red light emission converts the white light emitted from the visible light emitting section 21a into red light (red colored light) through the red filter section of the color filter substrate, and controls the amount of red light transmitted. The control of the amount of red light transmitted can be performed by controlling the amount of light of the white LED corresponding to the sub-pixel for red light emission. In addition, the sub-pixel for red light emission can utilize the red light emitted in the red LED in the visible light emitting section 21a corresponding to the sub-pixel. In this case, the control of the amount of red light transmitted can be performed by controlling the amount of light of the red LED. The above-mentioned sub-pixel structure can also be applied to the sub-pixel for green light emission and the sub-pixel for blue light emission. The sub-pixel for red light emission, the sub-pixel for green light emission, and the sub-pixel for blue light emission can shield the infrared light emitted from the infrared light emitting unit 21 b to some extent.
[0042] When a pixel has a sub-pixel for infrared light emission, the sub-pixel for infrared light emission can utilize the infrared light emitted by the infrared light LED corresponding to the sub-pixel, which is the infrared light emitting unit 21b. The control of the transmission amount of infrared light in the sub-pixel for infrared light emission can be performed by controlling the light amount of the infrared light LED.
[0043] In the case where the pixel does not have a sub-pixel for infrared light emission, the structure may be such that the infrared light emitted from the infrared light LED or the like as the infrared light emitting unit 21b transmits at least one of the sub-pixel for red light emission, the sub-pixel for green light emission, and the sub-pixel for blue light emission. The control of the transmission amount of infrared light in the pixel can be performed by controlling the light amount of the infrared light LED or the like.
[0044] The display device 2 has the above-mentioned structure, and can display a visible light image including infrared light on the display surface 2a according to an image signal input from the outside. The display device 2 can have a zone dimming function. That is, the display device 2 can individually control the intensity of white light emitted by the multiple visible light emitting units 21a according to the image signal input from the outside, and can individually control the intensity of infrared light emitted by the multiple infrared light emitting units 21b. In this case, the contrast and color tone of the image 4 can be improved, and as a result, the contrast and color tone of the aerial image R can be improved. In addition, the power consumption of the display device 2 can be reduced.
[0045] Figure 2B An example is shown in which the number of the plurality of visible light emitting sections 21a and the number of the plurality of infrared light emitting sections 21b are the same, but the number of the plurality of infrared light emitting sections 21b may be less than the number of the plurality of visible light emitting sections 21a. Since the infrared light emitted from the infrared light emitting section 21b is easier to transmit through the liquid crystal panel 22 than the visible light (white light) emitted from the visible light emitting section 21a, even if the number of the plurality of infrared light emitting sections 21b is less than the number of the plurality of visible light emitting sections 21a, sufficient intensity of the infrared light L2 can be maintained.
[0046] The display device 2 is not limited to a transmissive display device 2, and may be a self-luminous display device 2 including a plurality of self-luminous elements. The self-luminous display device 2 includes a plurality of pixels 24 (in Figure 4A ). The plurality of pixels 24 include a visible light emitting portion 24a and an infrared light emitting portion 24b. Figure 4A , 4B As shown, the self-luminous display device 2 includes a substrate 23 , and a plurality of visible light emitting sections 24 a and a plurality of infrared light emitting sections 24 b may be alternately arranged in a matrix on a first surface 23 a of the substrate 23 .
[0047] like Figure 4BAs shown, the plurality of visible light emitting portions 24a respectively include a red light emitting element 24aR that emits red light, a green light emitting element 24aG that emits green light, and a blue light emitting element 24aB that emits blue light. The plurality of infrared light emitting portions 24b respectively include an infrared light emitting element 24bI that emits infrared light. The red light emitting element 24aR, the green light emitting element 24aG, the blue light emitting element 24aB, and the infrared light emitting element 24bI may be composed of, for example, LEDs, OLEDs, and the like. The red light emitting element 24aR, the green light emitting element 24aG, the blue light emitting element 24aB, and the infrared light emitting element 24bI may be composed of micro-LEDs. When the micro-LED is disposed on the first surface 23a, it may have a rectangular shape in a plan view with a length of one side being about 1 μm or more and about 100 μm or about 3 μm or more and about 10 μm or less. The infrared light emitting element 24bI may be a near-infrared LED, an infrared LED, a near-infrared OLED, or an infrared OLED that emits near-infrared light or infrared light with a wavelength of about 0.78 μm to 2.5 μm.
[0048] The self-luminous display device 2 individually controls the luminous intensity of multiple visible light emitting units 24a (i.e., red light emitting element 24aR, green light emitting element 24aG, and blue light emitting element 24aB) according to the image signal input from the outside, and individually controls the luminous intensity of multiple infrared light emitting units 24b. As a result, the self-luminous display device 2 can display the image 4 composed of visible light image and infrared light image on the display surface 2a. In addition, the infrared light image cannot be directly perceived by human vision, but the infrared light image part and its surroundings in the aerial image R can be perceived by human touch. Therefore, the infrared light image can also be called the infrared light temperature sensing part.
[0049] The red light emitting element 24aR, the green light emitting element 24aG, the blue light emitting element 24aB and the infrared light emitting element 24bI of each pixel of the self-luminous display device 2 can be as follows: Figure 4B As shown in the row direction of the display device 2 ( Figure 4B The red light emitting element 24aR, the green light emitting element 24aG, the blue light emitting element 24aB and the infrared light emitting element 24bI of each pixel can be arranged side by side as shown in FIG. Figure 4C As shown, they are arranged in a matrix of 2 rows and 2 columns.
[0050] like Figure 1AAs shown, the aerial image display device 1 includes a light control unit 6. The light control unit 6 controls the image 4 displayed on the display surface 2a based on an image signal input from the outside. The image signal includes a visible light image signal SV and an infrared light image signal SI. The light control unit 6 causes the display surface 2a to display a visible light image based on the visible light image signal SV, and causes the display surface 2a to mix infrared light based on the infrared light image signal SI. That is, the light control unit 6 controls the display device 2 so that infrared light is mixed in the visible light image.
[0051] The light control unit 6 may be composed of one or more processors. The processor may include a general-purpose processor configured to read a specific program and execute a specific function, and a dedicated processor that is particularly enhanced for a specific process. The dedicated processor may include an ASIC (Application Specific Integrated Circuit). The processor may include a PLD (Programmable Logic Device). The PLD may include an FPGA (Field-Programmable Gate Array). The light control unit 6 may be a SoC (System-on-a-Chip) or SiP (System Ina Package) configured with one or more processors working together.
[0052] The light control unit 6 may have the function of turning the display device 2 on and off, the function of sending an image signal to the display device 2, and the function of adjusting the brightness, chromaticity, frame frequency, etc. of the image. In addition, when the display device 2 is equipped with a heat dissipation component or a cooling component, the light control unit 6 may have the function of adjusting the temperature of the heat dissipation component or the cooling component.
[0053] When the image 4 displayed on the display surface 2a of the display device 2 includes a high temperature image portion 43 reflecting a high temperature object having a temperature higher than a predetermined temperature, the predetermined temperature can be defined by a normal temperature as described in detail below. In the following description of the embodiment, the case where the image 4 displayed on the display device 2 includes a normal temperature image portion 44 and a high temperature image portion 43 (in Figure 3 ). In addition, the normal temperature image portion 44 is a portion of the image 4 that is different from the high temperature image portion 43.
[0054] The aerial image display device 1 can distinguish between the normal temperature image portion 44 and the high temperature image portion 43 in the image displayed on the display device 2 as follows. The structure can be set to store the image data of each frame in the light emitting control unit 6, and the image data (also referred to as high temperature image data) of the high temperature image portion 43 can be distinguished in the image data. For example, it can be a structure in which start mark data, start label data, etc. indicating that it is the start of the high temperature image data are added to the head (start part) of the high temperature image data, and end mark data, end label data, etc. indicating that it is the end of the high temperature image data are added to the end (end part) of the high temperature image data. The processing of adding the start mark data, start label data, etc. to the high temperature image data and the processing of adding the end mark data, end label data, etc. can be performed manually. In addition, the image 4 displayed on the display device 2 can be photographed by a camera or other imaging device, and the photographed image (camera image) can be analyzed by the analysis program software. Based on the fact that the high-temperature image portion 43 is determined in the camera image, the processing of adding start mark data, start label data, etc. to the high-temperature image data, and the processing of adding end mark data, end label data, etc. can be performed. The analysis program software can include artificial intelligence (AI) program software that analyzes the camera image and detects and / or extracts image recognition of specific patterns. The AI program software can also directly analyze the image data and detect and / or extract image recognition of specific patterns.
[0055] In addition, similarly, a structure may be provided in which the image data (also referred to as normal temperature image data) of the normal temperature image portion 44 is stored in the light emitting control portion 6 in a manner that is distinguishable. For example, a structure may be provided in which start mark data, start label data, etc. indicating that it is the start of the normal temperature image data are added to the header portion (start portion) of the normal temperature image data, and end mark data, end label data, etc. indicating that it is the end of the normal temperature image data are added to the end portion (end portion) of the normal temperature image data. The processing of adding the start mark data, the start label data, etc. to the normal temperature image data and the processing of adding the end mark data, the end label data, etc. can be performed in the same manner as the above-mentioned method. In addition, the normal temperature can be, for example, 15°C to 25°C, or 20°C. Alternatively, the aerial image display device 1 may include a temperature sensor 60 (in Figure 1B), in which case, the normal temperature may be the ambient temperature detected by the temperature sensor 60. In addition, the normal temperature may be set by the user 5 to any temperature or any temperature range. This is because there is a tendency for differences in the temperature and temperature range recognized as the normal temperature depending on the birthplace and residence of the user 5. In this case, for example, the user 5 may set the normal temperature to any temperature or any temperature range within the range of about 0°C to 35°C, but is not limited to the range of about 0°C to 35°C.
[0056] The aerial image display device 1 may include a storage unit 50 in the light emission control unit 6, wherein the storage unit 50 stores the image data SD (in Figure 1B ), or the high temperature image data SDH of the high temperature image portion 43 (in Figure 1B ) and the normal temperature image data SDL (in Figure 1B The storage unit 50 can be configured to store the image data in a differentiated manner (shown in FIG. 1 ). The storage unit 50 can be configured, for example, by a line memory, a frame memory, or the like. The aerial image display device 1 can also be configured to have a storage unit 50 separately instead of the storage unit 50 in the light emitting control unit 6. The storage unit 50 can output the image data SD including the normal temperature image data SDL and the high temperature image data SDH as the visible light image signal SV to the light emitting control unit 6. In addition, the storage unit 50 can generate an infrared light image signal SI based on the high temperature image data SDH, and output the infrared light image signal SI to the light emitting control unit 6.
[0057] When the aerial image display device 1 includes a high temperature image portion 43 showing a high temperature object having a temperature higher than normal temperature (in Figure 3 An example is shown), and the high-temperature image portion 43 is displayed on the display surface 2a using light including infrared light. The light including infrared light may be visible light emitted from the visible light emitting portions 21a, 24a, and infrared light emitted from the infrared light emitting portions 21b, 24b. The aerial image display device 1 uses the visible light emitted from the visible light emitting portions 21a, 24a to display the normal temperature image portion 44 on the display surface 2a. The display device 2 emits image light L from the display surface 2a, wherein the image light L includes visible light L1 representing the normal temperature image portion 44, and visible light L1 representing the high-temperature image portion 43, and infrared light L2. The image light L is reflected by the reflective optical system 3 and formed as an aerial image R. The user 5 can perceive the visible light aerial image R1 formed by imaging the visible light L1 through vision, and can perceive the temperature of the infrared light aerial image R2 formed by imaging the infrared light L2 through skin sensation. The aerial image display device 1 can provide the user 5 with a new image experience using infrared light, and can also provide a realistic image experience.
[0058] The light emission control unit 6 or the storage unit 50 may store data (eg, data related to a specific image (eg, an image of a person, an image of a heater, etc.) that will become the high-temperature image unit 43. Figure 1B The temperature sensor 60 may be connected to at least one of the light emission control unit 6 and the storage unit 50.
[0059] The aerial image display device 1 can display a dynamic image of the high temperature image portion 43. In this case, the user 5 can perceive the movement of the high temperature image portion 43 (i.e., the high temperature object) not only through vision but also through skin sensation. Figure 3 As shown, when the high-temperature object is a bonfire, the user 5 can perceive the swaying of the flame through both vision and skin sensation. Therefore, the aerial image display device 1 can use infrared light to provide a new image experience for the user 5. The light control unit 6 can control the light emission and non-light emission of the multiple visible light emitting units 21a, 24a and the multiple infrared light emitting units 21b, 24b. In the dynamic image display of the high-temperature image unit 43, the light control unit 6 can control the light emission and non-light emission of the multiple visible light emitting units 21a, 24a and the multiple infrared light emitting units 21b, 24b.
[0060] The high temperature image portion 43 is composed of a visible light image 43a and an infrared light image 43b. Figure 3 As shown in FIG. 1 , the light control unit 6 can set the infrared light image 43b to a size that includes the visible light image 43a in the display surface 2a of the display device 2. As a result, the infrared light aerial image R2 can be set to a size that includes the visible light aerial image R1 in the virtual imaging surface 8 of the aerial image R. As a result, the user 5 can not only feel the heat of the high-temperature object itself, but also feel the radiant heat radiated (radiated) from the high-temperature object to the surroundings or the conductive heat transferred by heat conduction. Therefore, a more realistic image experience can be provided to the user 5.
[0061] The light control unit 6 can display the high-temperature image portion 43 on the display surface 2a so that the infrared light image 43b has a temperature inclination portion 43ba around the visible light image 43a. The temperature inclination portion 43ba is a portion where the intensity of the infrared light decreases as it moves away from the center (centroid) or edge of the visible light image 43a. Thus, the infrared light aerial image R2 having a temperature inclination portion around the visible light aerial image R1 can be imaged on the virtual imaging surface 8. The temperature inclination portion of the infrared light aerial image R2 is the same as the temperature inclination portion 43ba, and is a portion where the intensity of the infrared light L2 decreases as it moves away from the center (centroid) or edge of the visible light aerial image R1 perceived by the user 5. Thus, the user 5 can perceive not only the heat of the high-temperature object itself, but also the radiant heat radiated from the high-temperature object to the surroundings or the conductive heat transferred by heat conduction. Therefore, a more realistic image experience can be provided to the user 5.
[0062] The temperature gradient of the temperature gradient portion 43 ba may be approximately 0.1° C. / mm to 10° C. / mm, or approximately 0.1° C. / mm to 3° C. / mm, but is not limited to this range.
[0063] The aerial image display device 1 may include a time lag control unit 7. When the high temperature image unit 43 is displayed as a dynamic image, the time lag control unit 7 is configured to make the movement of the infrared light image 43b lag in time relative to the movement of the visible light image 43a. As a result, after the user 5 perceives the movement of the high temperature object through vision, he perceives the movement of the high temperature object through skin sensation. Since heat transfer includes components of convection and heat conduction, it sometimes lags in time relative to the movement of the object. In this embodiment, the lag of heat transfer relative to the movement of the object can be expressed. The time lag Δt of the movement of the infrared light image 43b relative to the movement of the visible light image 43a can be, for example, about 0.1 seconds to 1.0 seconds, but is not limited to this range. Δt can be determined based on, for example, the size (number of pixels) of the visible light image 43a, the distance between the user 5 and the virtual imaging plane 8, the thermal conductivity of the air, the assumed temperature of the high temperature object, etc. By lagging the movement of the infrared light image 43b relative to the movement of the visible light image 43a, a more realistic image experience can be provided to the user 5.
[0064] In addition, the time lag control unit 7 can gradually increase the infrared light intensity of the infrared light image 43b when the user 5 touches the high temperature image portion 43 displayed in a still image or a moving image with a finger or the like. That is, the temperature of the high temperature object felt by the user 5 through the skin sense can be gradually increased from the moment the user 5 touches the high temperature image portion 43 with a finger or the like while the user 5 is touching the high temperature image portion 43. Since heat transfer includes a heat conduction component and an object has a heat capacity, the heat transfer from the object of the high temperature object to the finger or the like of the user 5 and the temperature rise of the finger or the like of the user 5 may be delayed in time. By expressing the temperature rise in consideration of heat conduction and heat capacity, it is possible to express the skin feeling when the finger or the like of the user 5 actually touches the object. For example, when the finger of the user 5 touches the high temperature image portion 43 displaying an animal, the finger of the user 5 may gradually warm up. The temperature rise rate of the infrared light image 43b may be about 0.1°C / second to 1°C / second, but is not limited to this range. In addition, the range of the temperature rise may be about 3°C to 10°C, but is not limited to this range.
[0065] The high-temperature object may be at least one of a person, an animal, a character, and a heat source. The character may be a popular character in a cartoon, a video, or the like, or a character created by the creator of the aerial image display device 1. In addition, the character may be a character selected by the user 5 of the aerial image display device 1 from a plurality of samples displayed on a portion of the display surface 2a. The heat source may be, for example, a flame, hot water in a bathhouse or a hot spring, heated food and beverages, the sun, or the like. The heat source may be any of a self-heating body such as the sun, and a heated heat source such as hot water.
[0066] When the aerial image R includes a high temperature image portion 43 of a high temperature object reflecting a temperature higher than a given temperature (e.g., room temperature), if it is a liquid crystal display device, the infrared light emitting portion 21b corresponding to the high temperature image portion 43 in the backlight is made to emit light. If it is a self-luminous display device, the infrared light emitting portion 24b corresponding to the high temperature image portion 43 is made to emit light. The light emission intensity of the infrared light emitting portions 21b and 24b can also be controlled according to the assumed temperature of the high temperature image portion. The control of the light emission intensity of the infrared light emitting portions 21b and 24b can be performed, for example, by controlling the current input to the infrared light emitting portions 21b and 24b and the applied voltage by the light emission control portion 6 connected to the display device 2 or the light emission control portion 6 installed in the display device 2. If the high temperature image portion 43 is a person, an animal, a character, etc., the light emission intensity of the infrared light emitting portions 21b and 24b can be controlled so that the user 5 can feel a temperature equivalent to their body temperature (about 35°C to 37°C). If the high temperature image portion 43 is a heating element, such as hot water (about 38°C to 42°C), the emission intensity of the infrared light emitting portions 21b and 24b can be controlled so that the user 5 can feel the temperature equivalent to that of hot water. If the high temperature image portion 43 is a heating element, such as a flame, the emission intensity of the infrared light emitting portions 21b and 24b can be controlled so that the user 5 can feel the temperature equivalent to that of the hand mask when it is in the flame (about 40°C to 50°C). If the high temperature image portion 43 is a heating element, such as the sun, the emission intensity of the infrared light emitting portions 21b and 24b can be controlled so that the user 5 can feel the temperature equivalent to that of the sun's heat (about 30°C to 50°C).
[0067] When only the multiple visible light emitting units 24a emit light, only the visible light image can be displayed. When the multiple infrared light emitting units 24b emit light, only the infrared light image (temperature sensing unit) can be displayed, and the temperature sensing unit can be used as a heater in cold periods such as winter. It is also possible to make a part of the image 4 a visible light image and the other part of the image 4 a temperature sensing unit by making both the multiple visible light emitting units 24a and the multiple infrared light emitting units 24b emit light. In this case, by setting the visible light image to a bright image with high brightness such as the sun, a visual sense of warmth can be provided to the user.
[0068] like Figure 1A , Figure 1B As shown, the reflection optical system 3 may include a first concave mirror 31 , a convex mirror 32 , and a second concave mirror 33 .
[0069] The first concave mirror 31 is located on the optical path of the image light L emitted from the display device 2. The first concave mirror 31 is configured to reflect the image light L emitted from the display device 2 in a direction different from the direction toward the display device 2. The convex mirror 32 is located on the optical path of the image light L reflected by the first concave mirror 31. The convex mirror 32 is configured to reflect the image light L reflected by the first concave mirror 31 in a direction different from the direction toward the first concave mirror 31. The second concave mirror 33 is located on the optical path of the image light L reflected by the convex mirror 32. The second concave mirror 33 is configured to reflect the image light L reflected by the convex mirror 32 in a direction different from the direction toward the convex mirror 32, and to form an aerial image R as a real image. Since the reflective optical system 3 includes a plurality of reflective optical elements, it is possible to form an aerial image R with reduced distortion.
[0070] The first concave mirror 31 has a reflecting surface 31a with a curvature Sa1. The convex mirror 32 has a reflecting surface 32a with a curvature Sb. The second concave mirror 33 has a reflecting surface 33a with a curvature Sa2. In a cross section along the optical axis of the image light L incident on the first concave mirror 31, the length of the line segment LS connecting the two ends of the reflecting surface 31a is set to 2×H, and the maximum length of the point on the reflecting surface 31a and the line segment LS along the optical axis OA is set to D MAX When D MAX / H to define the curvature Sa1 (reference Figure 5 ). MAX When / H changes according to the method of taking the cross section, D when changing the position of the cross section can be MAX The maximum value of / H is defined as curvature Sa1. Curvature Sb and curvature Sa2 are also defined in the same manner as curvature Sa1.
[0071] The aerial image display device 1 may be a structure in which the curvature Sa1 of the first concave mirror 31 is greater than the curvature Sa2 of the second concave mirror 33, and the curvature Sa2 of the second concave mirror 33 is greater than the curvature Sb of the convex mirror 32. In this case, the first concave mirror 31 that reflects the image light L emitted from the display device 2 toward the convex mirror 32 can be arranged close to the display device 2. As a result, since the space occupied by the display device 2 and the reflective optical system 3 can be reduced, the aerial image display device 1 can be miniaturized. Furthermore, by miniaturizing the aerial image display device 1, the optical path length of the image light L between the display surface 2a of the display device 2 and the reflective surface 33a of the second concave mirror 33 can be shortened, thereby suppressing the loss of the image light L caused by unexpected scattering, interference, etc. As a result, the display quality of the aerial image display device 1 can be improved.
[0072] Since the aerial image display device 1 is a structure that displays the aerial image R using the reflective optical system 3 including the first concave mirror 31, the convex mirror 32, and the second concave mirror 33, the distortion of the aerial image R can be reduced by appropriately designing the shapes of the reflective surfaces 31a, 32a, and 33a of the first concave mirror 31, the convex mirror 32, and the second concave mirror 33. In addition, in the aerial image display device 1, since the reflective optical system 3 does not include an optical element (such as a beam splitter, a polarization filter, etc.) that transmits or separates a part of the incident image light L, it is possible to suppress a reduction in the brightness of the aerial image R. Alternatively, according to the aerial image display device 1, since the brightness of the image 4 displayed on the display surface 2a can be reduced while maintaining the sufficient flow brightness of the aerial image R, the power consumption of the aerial image display device 1 can be reduced.
[0073] The aerial image display device 1 can suppress the expansion of the image light L reflected by the convex mirror 32 because the curvature Sb of the convex mirror 32 is relatively small. As a result, the enlargement of the second concave mirror 33 that reflects the image light L reflected by the convex mirror 32 can be suppressed. In addition, the convex mirror 32 is the optical component that contributes most to the expansion of the aerial image R, and therefore, is the optical component that has the greatest influence on the distortion of the aerial image R. Since the curvature Sb of the convex mirror 32 is relatively small, the distortion of the aerial image R can be reduced.
[0074] The first concave mirror 31 may include an adjustment member for adjusting the distance from the display device 2, the tilt angle, and the like relative to the spatial configuration of the display device 2. The adjustment member may include, for example, a supporting member such as a rod provided on the back side of the first concave mirror 31, an axial member provided on the supporting member and rotating the supporting member and the first concave mirror 31, a sliding mechanism for parallel movement of the supporting member and the first concave mirror 31, and the like. The adjustment member may be adjusted manually or electrically by a stepping motor or the like. Such an adjustment member may also be provided in the convex mirror 32 and the second concave mirror 33.
[0075] The aerial image display device 1 may be a structure in which the size (e.g., diameter, etc.) of the second concave mirror 33 is larger than the size (e.g., diameter, etc.) of the first concave mirror 31. With this structure, it is easy to display the enlarged aerial image R. That is, the image light L is easy to propagate in the image space that is enlarged in sequence by the first concave mirror 31 and the convex mirror 32, and the image that is finally enlarged by the second concave mirror 33 is reflected toward the virtual imaging surface 8 of the aerial image R. In addition, when the second concave mirror 33 is relatively large, it is easy to set the shape of its reflection surface 33a to a shape corresponding to each of the multiple partial lights contained in the image light L. As a result, the distortion of the aerial image R can be effectively reduced.
[0076] The size of the first concave mirror 31 can be specified by the length of the maximum diameter of the reflecting surface 31a of the first concave mirror 31 (it can also be said to be the length of the maximum diameter when observed from the front). The size of the second concave mirror 33 can be specified by the length of the maximum diameter of the reflecting surface 33a of the second concave mirror 33 (it can also be said to be the length of the maximum diameter when observed from the front). For example, in the case where the first concave mirror 31 is partially spherical, the front-view shape of the reflecting surface 31a of the first concave mirror 31 becomes a circle. In this case, the size of the first concave mirror 31, so-called size, can be the length of the line segment LS that passes through the center of the reflecting surface 31a and connects the two ends, that is, 2H (in Figure 5 ). In addition, the center of the reflecting surface 31a is defined by the lowest point (maximum protruding point) of the curved reflecting surface 31a. In the case where the first concave mirror 31 is a partial elliptical surface, the main view observation shape of the reflecting surface 31a of the first concave mirror 31 becomes an ellipse. In this case, the size of the first concave mirror 31 may be the length of the major diameter of a line segment passing through the center of the reflecting surface 31a and connecting both ends. In the case where the main view observation shape of the reflecting surface 31a of the first concave mirror 31 is a rectangular shape or the like, the size of the first concave mirror 31 may be the length of the maximum diameter (e.g., diagonal diameter, etc.) of a line segment passing through the center of the reflecting surface 31a and connecting both ends. The size of the second concave mirror 33 and the size of the convex mirror 32 may be defined in the same way.
[0077] The maximum diameter length of the first concave mirror 31 may be, for example, about 150 mm to 200 mm. The maximum diameter length of the second concave mirror 33 may be, for example, about 200 mm to 350 mm. The maximum diameter length of the convex mirror 32 may be, for example, about 100 mm to 150 mm.
[0078] The size of the first concave mirror 31 can be specified by the area of the reflection surface 31a of the first concave mirror 31 or the area of the reflection surface 31a of the first concave mirror 31 in the front view. The size of the second concave mirror 33 can be specified by the area of the reflection surface 33a of the second concave mirror 33 or the area of the reflection surface 33a of the second concave mirror 33 in the front view.
[0079] The first concave mirror 31 and the second concave mirror 33 may be free-form concave mirrors whose reflection surfaces 31a and 33a are free-form surfaces. The convex mirror 32 may be a free-form convex mirror whose reflection surface 32a is free-form surface. When the reflection surfaces 31a, 32a, and 33a of the first concave mirror 31, the convex mirror 32, and the second concave mirror 33 are free-form surfaces, it is easy to set the reflection surfaces 31a, 32a, and 33a to shapes that effectively reduce the distortion of the aerial image R. As a result, the distortion of the aerial image R can be effectively reduced.
[0080] The free-form surface defining the reflection surfaces 31a, 32a, and 33a may be an XY polynomial surface (also referred to as an SPSXYP surface) defined by the following equations (1) and (2). The XY polynomial surface is expanded into a polynomial of order 10 added to the reference conical surface. Therefore, in equations (1) and (2), the sum of m and n is less than 10. In equation (1), z is the sag of the surface parallel to the z-axis (optical axis), c is the vertex curvature, and r is the distance in the radial direction (i.e., r 2 =x 2 +y 2 ), k is the cone constant, Cj is the monomial x m y n The coefficient of .
[0081] [Mathematical formula 1]
[0082]
[0083] [Mathematical formula 2]
[0084]
[0085] In the direction parallel to the virtual imaging plane 8 of the aerial image R ( Figure 1A , Figure 1B When the second concave mirror 33 is observed from the back side of the second concave mirror 33 (in the Y direction in the vertical direction), the reflection surface 33a of the second concave mirror 33 can overlap with the display surface 2a of the display device 2, the reflection surface 31a of the first concave mirror 31, and the reflection surface 32a of the convex mirror 32. In this case, since the space occupied by the display device 2 and the reflection optical system 3 can be reduced, the aerial image display device 1 can be miniaturized. As a result, since the optical path length of the image light L inside the aerial image display device 1 can be shortened, the loss of the image light L caused by unexpected scattering, interference, etc. can be suppressed. Furthermore, the display quality of the aerial image display device 1 can be improved.
[0086] When the second concave mirror 33 is observed from the back side of the second concave mirror 33 along the direction (Y direction) parallel to the virtual imaging plane 8 of the aerial image R, the reflection surface 33a of the second concave mirror 33 can include the display surface 2a of the display device 2, the reflection surface 31a of the first concave mirror 31, and the reflection surface 32a of the convex mirror 32. In this case, since the occupied space of the display device 2 and the reflection optical system 3 can be further reduced, the aerial image display device 1 can be further miniaturized.
[0087] Since the user 5 visually recognizes the aerial image R from a direction substantially perpendicular to the virtual imaging plane 8, the direction parallel to the virtual imaging plane 8 of the aerial image R ( Figure 1A , Figure 1BThe Y direction in the image plane 8 (in the Y direction) becomes the height direction of the aerial image display device 1. In addition, the direction orthogonal to the virtual imaging plane 8 of the aerial image R becomes the thickness direction (depth direction) of the aerial image display device 1. When the second concave mirror 33 is observed from the back side along the direction (Y direction) parallel to the virtual imaging plane 8, the reflection surface 33a overlaps with the display surface 2a, the reflection surface 31a, and the reflection surface 32a, or includes the display surface 2a, the reflection surface 31a, and the reflection surface 32a, thereby reducing at least the thickness (depth) of the aerial image display device 1.
[0088] Next, other examples of the aerial image display device 1 are described. Figure 6 As shown, the backlight 21 of the transmissive display device 2 may be a structure in which a plurality of visible light emitting units 21a are arranged in the first area 23a1 of the first surface 23a, and a plurality of infrared light emitting units 21b are arranged in the second area 23a2 of the first surface 23a. The second area 23a2 is an area that does not overlap with the first area 23a1 when viewed from above. By arranging the plurality of visible light emitting units 21a and the plurality of infrared light emitting units 21b in different areas, it is possible to suppress the situation in which the white light emitted from the visible light emitting unit 21a transmits the sub-pixel for infrared light emission. In addition, it is possible to suppress the situation in which the infrared light emitted from the infrared light emitting unit 21b transmits the sub-pixel for red light emission, the sub-pixel for green light emission, and the sub-pixel for blue light emission. Thus, the image quality of the visible light image and the infrared light image displayed on the display surface 2a can be improved. Even if multiple visible light emitting units 21a and multiple infrared light emitting units 21b are arranged in different areas, the visible light aerial image R1 and the infrared light aerial image R2 can be imaged at any position in the virtual imaging plane 8 by appropriately designing the reflective optical system 3.
[0089] By arranging the plurality of visible light emitting units 21a and the plurality of infrared light emitting units 21b in different areas, when only the plurality of visible light emitting units 21a emit light, only the visible light image can be displayed. When only the plurality of infrared light emitting units 21b emit light, only the infrared light image (temperature sensing unit) can be displayed, and the aerial image display device 1 can be used as a heater in cold periods such as winter. It is also possible to use a part of the image 4 as a visible light image and the other part of the image 4 as a temperature sensing unit by making both the plurality of visible light emitting units 21a and the plurality of infrared light emitting units 21b emit light. In this case, by setting the visible light image to a bright image with high brightness such as the sun, a visual sense of warmth can be provided to the user.
[0090] like Figure 7As shown, the self-luminous display device 2 can be a structure in which a plurality of visible light emitting units 24a are arranged in the first area 23a1 of the first surface 23a, and a plurality of infrared light emitting units 24b are arranged in the second area 23a2 of the first surface 23a. The second area 23a2 is an area that does not overlap with the first area 23a1 when viewed from above. By arranging the plurality of visible light emitting units 24a and the plurality of infrared light emitting units 24b in different areas, the arrangement of the plurality of visible light emitting units 24a can be optimized, and the arrangement of the plurality of infrared light emitting units 24b can be optimized. Thus, the image quality of the visible light image and the infrared light image displayed on the display surface 2a can be improved. Even in the case where the plurality of visible light emitting units 24a and the plurality of infrared light emitting units 24b are arranged in different areas, the visible light aerial image R1 and the infrared light aerial image R2 can be imaged at any position in the virtual imaging surface 8 by appropriately designing the reflective optical system 3.
[0091] By arranging the plurality of visible light emitting units 24a and the plurality of infrared light emitting units 24b in different areas, when only the plurality of visible light emitting units 24a emit light, only the visible light image can be displayed. When only the plurality of infrared light emitting units 24b emit light, only the infrared light image (temperature sensing unit) can be displayed, and the aerial image display device 1 can be used as a heater in cold periods such as winter. It is also possible to use a part of the image 4 as a visible light image and the other part of the image 4 as a temperature sensing unit by making both the plurality of visible light emitting units 24a and the plurality of infrared light emitting units 24b emit light. In this case, it is also possible to provide the user with a visual sense of warmth by setting the visible light image to a bright image with high brightness such as the sun.
[0092] Next, an aerial image display device according to another embodiment of the present disclosure will be described. Figure 8 It is a diagram showing the structure of an aerial image display device of another embodiment of the present disclosure. The aerial image display device 1A of this embodiment is different from the aerial image display device 1 in the structure of the reflective optical system, and has the same structure as the aerial image display device 1. Therefore, for the same structure, the same reference symbols as the aerial image display device 1 are marked and detailed description is omitted.
[0093] The aerial image display device 1A of this embodiment includes a display device 2 and a reflective optical system 3A. Figure 8As shown in the figure, the reflecting optical system 3A is composed of a first concave mirror 31 and a second concave mirror 33. The first concave mirror 31 is located on the optical path of the image light L emitted from the display device 2. The first concave mirror 31 reflects the image light L emitted from the display device 2 in a direction different from the direction toward the display device 2. The second concave mirror 33 is located on the optical path of the image light L reflected by the first concave mirror 31. The second concave mirror 33 reflects the image light L reflected by the first concave mirror 31 in a direction different from the direction toward the first concave mirror 31.
[0094] The first concave mirror 31 has a reflecting surface 31a with a curvature Sa1. The second concave mirror 33 has a reflecting surface 33a with a curvature Sa2. The curvature Sa1 of the first concave mirror 31 may be greater than the curvature Sa2 of the second concave mirror 33. Thus, the first concave mirror 31 that reflects the image light L emitted from the display device 2 toward the second concave mirror 33 can be arranged close to the display device 2. As a result, since the space occupied by the display device 2 and the reflecting optical system 3 can be reduced, the aerial image display device 1A can be miniaturized. Furthermore, since the aerial image display device 1A can be miniaturized, the optical path length of the image light L between the display surface 2a of the display device 2 and the reflecting surface 33a of the second concave mirror 33 can be shortened, and therefore, the loss of the image light L caused by unexpected scattering, interference, etc. can be suppressed. As a result, the display quality of the aerial image display device 1A can be improved.
[0095] The first concave mirror 31 and the second concave mirror 33 may be free-form concave mirrors whose reflection surfaces 31a and 33a are free-form surfaces. When the reflection surfaces 31a and 33a of the first concave mirror 31 and the second concave mirror 33 are free-form surfaces, it is easy to set the reflection surfaces 31a and 33a to shapes that effectively reduce the distortion of the aerial image R. As a result, the distortion of the aerial image R can be effectively reduced.
[0096] The aerial image display device 1A, like the aerial image display device 1 , can provide the user 5 with a new image experience by using infrared light.
[0097] The aerial image display device 1A may display only the infrared light image instead of the visible light image on the display surface 2a, similarly to the aerial image display device 1. In other words, the aerial image display device 1A may be used as a heater, similarly to the aerial image display device 1.
[0098] Next, an aerial image display device according to another embodiment of the present disclosure will be described. Fig. 91 is a diagram showing the structure of an aerial image display device 1B according to another embodiment of the present disclosure. The aerial image display device 1B according to this embodiment is different from the aerial image display device 1 in that it includes a stimulation signal irradiation unit 66 for irradiating a stimulation signal 66a to the body of the user. In addition, the aerial image display device 1B does not include a time lag control unit 7. As for the rest, since the aerial image display device 1B has the same structure as the aerial image display device 1, the same reference symbols as those of the aerial image display device 1 are marked for the same structures, and detailed descriptions are omitted.
[0099] The aerial image display device 1B is provided with a stimulation signal irradiation unit 66, wherein when a part of the body of the user 5 (for example, a part of the finger 5f of the hand 5h) contacts the high temperature image portion 43 in the aerial image R, the stimulation signal irradiation unit 66 irradiates a stimulation signal 66a to a part of the finger 5f of the user 5 that is deviated from the part of the finger 5f of the user 5. This structure provides the following effects. For example, Fig.10 As shown in FIG. 1 , if a temperature stimulus based on infrared light L2 is applied to a certain part f1 of the finger 5f, and a tactile stimulus based on stimulus signal 66a is applied to another part f2 of the finger 5f, an illusion phenomenon (also called mutual temperature reference effect) will occur that the temperature stimulus at part f1 moves to the part f2 to which the tactile stimulus is applied. Thus, by extending the temperature stimulus to the depth direction and giving depth to the temperature sensation, combined with an image having depth, a new image experience with a more realistic feeling can be provided to the user 5.
[0100] The part of the user 5's body to which the stimulation signal 66a is irradiated may be a part of the finger 5f of the user's hand 5h, a part of the palm of the user's hand 5h, a part of the nail of the user's hand 5h, a part of the arm of the user 5d, or the like.
[0101] The stimulation signal 66a may be a tactile inducing signal that induces tactile sensation in the user 5. The tactile inducing signal may be a sound wave signal, an ultrasonic signal, etc., which is air vibration, or may be wind (air flow), etc., which is air pressure. Among these, the ultrasonic signal has the advantage that it is difficult to interfere with the air image R because the user 5 cannot hear it. The frequency of the ultrasonic signal may be above about 20 kHz, and may be about 20 kHz to 20 MHz. In this case, the stimulation signal irradiation unit 66 may be an ultrasonic signal generating device. The ultrasonic signal generating device may be, for example, an air tactile prompting device (air tactile sensation), wherein the air tactile prompting device may include an electro-ultrasonic converter array (also referred to as an ultrasonic transducer array), which gathers a plurality of ultrasonic signals emitted from the ultrasonic transducer array through phase control, thereby generating tactile sensation in space.
[0102] The stimulation signal 66a may be a temperature-induced signal that induces a sense of temperature. The temperature-induced signal may be a near-infrared signal, an infrared signal, or the like, which are heat rays, or may be hot wind (hot air flow), or the like. When the temperature-induced signal is a near-infrared signal or an infrared signal, there is an advantage that the temperature-induced signal can be irradiated with a pinpoint with good accuracy at a part of the body of the user 5. The temperature-induced signal can give a temperature (temperature) higher than the temperature (temperature) of the high-temperature image portion 43 to a part of the body of the user 5. In this case, a mutual temperature reference can be more clearly given to a part of the body of the user 5. The temperature-induced signal can give a temperature (temperature) higher than 1 times and less than about 2 times the temperature (temperature) of the high-temperature image portion 43 to a part of the body of the user 5, but is not limited to this range.
[0103] The stimulation signal irradiation unit 66 irradiates the stimulation signal 66a to the part f2 of the user's finger 5f that deviates from the part f1 of the user's finger 5f. The deviation between the part f1 and the part f2 (the deviation of the distance) can be about 10 mm to about 80 mm. That is, the deviation of the distance that produces the mutual temperature reference effect can be about 10 mm to about 80 mm. When it is less than 10 mm, it tends to be difficult to give depth to the temperature sensation. If it exceeds 80 mm, it tends to be difficult to produce mutual temperature reference.
[0104] The aerial image display device 1B may also include a detection unit 65 for detecting that a part of the body of the user 5 (such as the finger 5f) is in contact with the high temperature image portion 43 in the aerial image R. The detection unit 65 may be, for example, an imaging device such as a camera. The detection unit 65 may be a light (electromagnetic wave) detection device that detects reflection, passage, or non-passage of visible light, laser light, infrared light, electromagnetic waves, etc. The light (electromagnetic wave) detection device may be a structure having a light emitting unit of visible light, etc. and a light receiving unit of visible light, etc., and detecting that the finger 5f, etc. is in contact with the high temperature image portion 43 in the aerial image R when the light receiving unit receives the reflected light reflected by the finger 5f, etc. (when the light receiving unit outputs the reflected light). In addition, the light detection device may be a structure having a light emitting unit of visible light, etc. and a light receiving unit of visible light, etc., and detecting that the finger 5f, etc. is in contact with the high temperature image portion 43 in the aerial image R when the light received by the hand in the light receiving unit is blocked by the finger 5f, etc. (when the light receiving unit outputs the disappeared). In addition, the detection unit 65 may be a sound wave detection device that detects reflection, passage, or non-passage of sound waves or ultrasonic waves. The operating principle may be the same as that of the light detection device.
[0105] Fig.111 is a diagram showing the structure of an aerial image display device 1C according to another embodiment of the present disclosure. The aerial image display device 1C according to this embodiment is different from the aerial image display device 1A in that it includes a stimulation signal irradiation unit 66 for irradiating a stimulation signal 66a to the body of the user. In addition, the aerial image display device 1C does not include the time lag control unit 7. As for the rest, the aerial image display device 1C has the same structure as the aerial image display device 1A, and therefore, the same reference symbols as those of the aerial image display device 1A are marked for the same structure, and detailed description is omitted.
[0106] The aerial image display device 1C includes a reflective optical system 3A. The reflective optical system 3A is composed of a first concave mirror 31 and a second concave mirror 33, and does not include a convex mirror 32. Thus, the aerial image display device 1C is miniaturized, and the temperature stimulation is expanded in the depth direction to give the temperature sense depth. By combining it with an image with depth, a new image experience with a more realistic feeling can be provided to the user 5.
[0107] The aerial image display device 1, 1A, 1B, 1C may be a head-up display provided in a vehicle. In this case, for example, a part of the front windshield of the vehicle may be provided as a reflective member, or the reflective member may be used instead of the second concave mirror 33. It may also be a structure in which the user visually recognizes the aerial image R via the reflective member. The reflective member may be a semi-transmissive reflective type (transmitting approximately half of the light and reflecting approximately half of the light).
[0108] The aerial image display device 1, 1A, 1B, 1C may have the following structure: Figure 1A , Figure 1B , Fig. 9 , Fig.11 In the longitudinal section shown, when the aerial image display device 1, 1A, 1B, 1C is viewed from the side, the display device 2 (and the convex mirror 32) is located between the first concave mirror 31 and the second concave mirror 33. In other words, the first concave mirror 31 may be located at the lowest position and the second concave mirror 33 may be located at the highest position. In this case, it is easy to reduce the height of the aerial image display device 1, 1A, 1B, 1C and miniaturize it.
[0109] The embodiments of the present disclosure are described in detail above, but the present disclosure is not limited to the above-mentioned embodiments, and various changes and improvements can be made within the scope of the gist of the present disclosure. For example, the size (dimension) of the infrared light emitting portion 21b can be smaller than the size of the visible light emitting portion 21a. The reason is that the transmittance of infrared light to the liquid crystal panel 22 is higher than the transmittance of visible light to the liquid crystal panel 22. By setting the infrared light emitting portion 21b to be small with low luminous intensity, the power consumption of the infrared light emitting portion 21b can be reduced.
[0110] As described above, according to the display device and the aerial image display device of the present disclosure, it is possible to provide users with a new image experience using infrared light.
[0111] The present disclosure can be implemented in the following configurations (1) to (19).
[0112] (1) A display device including a display unit, wherein when an image displayed by the display unit includes a high-temperature image portion reflecting a high-temperature object having a temperature higher than a predetermined temperature, the display device displays the high-temperature image portion using light including infrared light.
[0113] (2) An aerial image display device, comprising: a display unit having a display surface; and a reflective optical system that reflects image light of an image displayed on the display surface and forms an aerial image as a real image, wherein when the image includes a high-temperature image unit reflecting a high-temperature object having a temperature higher than a given temperature, the high-temperature image unit is displayed on the display surface using light including infrared light.
[0114] (3) In the aerial image display device according to the configuration (2), the high temperature image portion can be displayed as a dynamic image.
[0115] (4) In the aerial image display device according to the configuration (2) or (3), the device further comprises a temperature detection unit that detects an ambient temperature, wherein the predetermined temperature is a temperature detected by the temperature detection unit.
[0116] (5) In the aerial image display device recorded in any one of structures (2) to (4), it also includes a light control unit, and the display unit has multiple visible light emitting units and multiple infrared light emitting units. The light control unit can display a dynamic image of the high-temperature image unit by controlling the light emission and non-light emission of the multiple visible light emitting units and the multiple infrared light emitting units.
[0117] (6) In the aerial image display device according to the configuration (5), the plurality of visible light emitting sections and the plurality of infrared light emitting sections are alternately arranged in a matrix.
[0118] (7) In the aerial image display device described in any one of structures (2) to (6), the high-temperature image portion is composed of a visible light image displayed by visible light and an infrared light image displayed by infrared light, and the infrared light image has a size on the display surface that includes the visible light image.
[0119] (8) In the aerial image display device according to configuration (7), the infrared light image has a temperature gradient portion on the display surface around the visible light image, where the intensity of infrared light decreases as the distance from the center of the visible light image increases.
[0120] (9) The aerial image display device according to the configuration (7) or (8) further includes a time lag control unit which causes the movement of the infrared light image to lag in time relative to the movement of the visible light image when the high temperature image portion is displayed as a dynamic image.
[0121] (10) In the aerial image display device recorded in any one of structures (2) to (9), there is provided: a stimulation signal irradiation unit, which irradiates a stimulation signal to a part of the user's body that deviates from the part of the user's body when a part of the user's body contacts the high-temperature image part in the aerial image.
[0122] (11) In the aerial image display device according to the configuration (10), the stimulation signal is a tactile induction signal that induces tactile sensation.
[0123] (12) In the aerial image display device according to the configuration (10), the stimulation signal is a temperature inducing signal that induces a temperature sensation.
[0124] (13) In the aerial image display device according to any one of the configurations (2) to (12), the high-temperature object includes at least one of a person, an animal, a character, and a heat-generating object.
[0125] (14) In the aerial image display device described in any one of structures (2) to (13), the reflecting optical system comprises: a first concave mirror, which reflects the image light in a direction different from the direction toward the display unit; a convex mirror, which reflects the image light reflected by the first concave mirror in a direction different from the direction toward the first concave mirror; and a second concave mirror, which reflects the image light reflected by the convex mirror in a direction different from the direction toward the convex mirror and forms an aerial image as a real image.
[0126] (15) In the aerial image display device described in the configuration (14), when the curvature of the first concave mirror is set to Sa1, the curvature of the convex mirror is set to Sb, and the curvature of the second concave mirror is set to Sa2, Sa1>Sa2>Sb.
[0127] (16) In the aerial image display device described in configuration (14) or (15), the first concave mirror and the second concave mirror are free-form concave mirrors, and the convex mirror is a free-form convex mirror.
[0128] (17) In the aerial image display device described in any one of structures (2) to (13), the reflecting optical system comprises: a first concave mirror, which reflects the image light in a direction different from the direction toward the display device; and a second concave mirror, which reflects the image light reflected by the first concave mirror in a direction different from the direction toward the first concave mirror and forms an aerial image as a real image.
[0129] (18) In the aerial image display device according to configuration (17), the curvature of the first concave mirror is greater than the curvature of the second concave mirror.
[0130] (19) In the aerial image display device according to configuration (17) or (18), the first concave mirror and the second concave mirror are free-form surface concave mirrors.
[0131] Industrial application areas
[0132] The aerial image display device disclosed in the present invention can operate the aerial image without touching, and as a result, it can be used in various product fields such as the following, but is not limited to the following. For example, a communication device for conducting conversation / communication with aerial images, a medical consultation device for a doctor to consult a patient through aerial images, a navigation device / driving control device for a vehicle such as a car, an order receiving device / cash register device for a store, an operation panel for a building / elevator, a learning device for conducting or receiving lessons with aerial images, an office equipment for conducting business contact / instructions with aerial images, a game machine for playing games with aerial images, a projection device for projecting images on the ground / wall of a building in an amusement park / game center, a simulator device for conducting simulation experiments with aerial images in a university / medical institution, a large display for displaying prices in a market / stock exchange, an image viewing device for viewing images of aerial images, etc.
[0133] Explanation of symbols
[0134] 1.1A, 1B, 1C Aerial image display device
[0135] 2 Display unit (display device)
[0136] 2a Display surface
[0137] 21 Backlight
[0138] 21a Visible light emitting unit
[0139] 21b Infrared light emitting unit
[0140] 22 LCD Panel
[0141] 23 substrate
[0142] 23a Page 1
[0143] 23a1 Area 1
[0144] 23a2 Area 2
[0145] 24 pixels
[0146] 24a Visible light emitting unit
[0147] 24aR Red light emitting element
[0148] 24aG Green light emitting element
[0149] 24aB Blue light emitting element
[0150] 24b Infrared light emitting unit
[0151] 24bI infrared light emitting element
[0152] 3. 3A Reflective optical system
[0153] 31 No. 1 Concave Mirror
[0154] 31a Reflective surface
[0155] 32 Convex mirror
[0156] 32a Reflective surface
[0157] 33. Second concave mirror
[0158] 33a Reflective surface
[0159] 4 Images
[0160] 43 High temperature imaging department
[0161] 43a Visible light image
[0162] 43b Infrared image
[0163] 43ba Temperature slope
[0164] 44 Normal temperature image section
[0165] 5 Users
[0166] 6 Lighting control unit
[0167] 7 Delay Control Unit
[0168] 8 Virtual imaging surface
[0169] 50 Storage
[0170] 60 Temperature Sensor
[0171] 65 Testing Department
[0172] 66 Stimulation signal irradiation part
[0173] 66a Stimulation signal.
Claims
1. A display device, A display unit is provided. When the image displayed by the display unit includes a high-temperature image portion reflecting a high-temperature object having a temperature higher than a predetermined temperature, the high-temperature image portion is displayed using light including infrared light.
2. An aerial image display device, comprising: A display unit having a display surface; and A reflective optical system that reflects image light of an image displayed on the display surface to form an image as an aerial image of a real image, When the image includes a high-temperature image portion reflecting a high-temperature object having a temperature higher than a predetermined temperature, the high-temperature image portion is displayed on the display surface using light including infrared light.
3. The aerial image display device according to claim 2, wherein: The aerial image display device can display the high-temperature image portion as a dynamic image.
4. The aerial image display device according to claim 2 or 3, wherein: The aerial image display device comprises: a temperature detection unit, which detects the ambient temperature; The given temperature is a temperature detected by the temperature detection section.
5. The aerial image display device according to any one of claims 2 to 4, wherein: The aerial image display device further comprises a light emitting control unit, The display unit has a plurality of visible light emitting units and a plurality of infrared light emitting units. The light emission control unit can display a dynamic image of the high-temperature image unit by controlling the emission and non-emission of the plurality of visible light emitting units and the plurality of infrared light emitting units.
6. The aerial image display device according to claim 5, wherein: The plurality of visible light emitting portions and the plurality of infrared light emitting portions are arranged alternately in a matrix.
7. The aerial image display device according to any one of claims 2 to 6, wherein: The high temperature image portion is composed of a visible light image displayed by visible light and an infrared light image displayed by infrared light. The infrared light image on the display surface has a size that includes the visible light image.
8. The aerial image display device according to claim 7, wherein: The infrared light image has a temperature gradient portion on the display surface, around the visible light image, where the intensity of infrared light decreases as it moves away from the center of the visible light image.
9. The aerial image display device according to claim 7 or 8, wherein: The aerial image display device further comprises a time lag control unit, When the high-temperature image portion is displayed as a dynamic image, the time-lag control unit causes the movement of the infrared light image to be delayed in time relative to the movement of the visible light image.
10. The aerial image display device according to any one of claims 2 to 9, wherein: The aerial image display device includes a stimulation signal irradiation unit that irradiates a stimulation signal to a portion of the user's body that is separated from the portion of the user's body when the portion of the user's body comes into contact with the high-temperature image portion in the aerial image.
11. The aerial image display device according to claim 10, wherein: The stimulation signal is a tactile induced signal that induces tactile sensation.
12. The aerial image display device according to claim 10, wherein: The stimulation signal is a temperature-sensation inducing signal that induces temperature sensation.
13. The aerial image display device according to any one of claims 2 to 12, wherein: The high temperature object includes at least one of a person, an animal, a character, and a heat generating body.
14. The aerial image display device according to any one of claims 2 to 13, wherein: The reflective optical system comprises: a first concave mirror for reflecting the image light in a direction different from a direction toward the display unit; a convex mirror that reflects the image light reflected by the first concave mirror in a direction different from a direction toward the first concave mirror; and The second concave mirror reflects the image light reflected by the convex mirror in a direction different from the direction toward the convex mirror, and forms an image as an aerial image of a real image.
15. The aerial image display device according to claim 14, wherein: When the curvature of the first concave mirror is set to Sa1, the curvature of the convex mirror is set to Sb, and the curvature of the second concave mirror is set to Sa2, Sa1>Sa2>Sb.
16. The aerial image display device according to claim 14 or 15, wherein: The first concave mirror and the second concave mirror are free-form concave mirrors. The convex mirror is a free-form convex mirror.
17. The aerial image display device according to any one of claims 2 to 13, wherein: The reflective optical system comprises: a first concave mirror for reflecting the image light in a direction different from a direction toward the display unit; and The second concave mirror reflects the image light reflected by the first concave mirror in a direction different from the direction toward the first concave mirror, and forms an image as a real image in the air.
18. The aerial image display device according to claim 17, wherein: The curvature of the first concave mirror is greater than the curvature of the second concave mirror.
19. The aerial image display device according to claim 17 or 18, wherein: The first concave mirror and the second concave mirror are free-form surface concave mirrors.
Citation Information
Patent Citations
Noncontact operation detecting device
JP2020067707A
