Display system and display control method

Abstract

The display system includes a transparent display, a dimming plate located behind the transparent display with adjustable transmittance, and a processor. When the processor detects an object located behind the dimming plate, it causes the transparent display to display an image, increases the transmittance of the area in the dimming plate in front of the object compared to the transmittance of the area in the dimming plate behind the area displaying the image, and the degree of increase varies depending on the combination of the image and the object.

Description

Technical Field

[0001] This invention relates to a display system and a display control method. Background Technology

[0002] A vehicle transmission display device is known for its purpose of drawing the driver's attention to an object without obstructing the view of the scenery outside the vehicle (for example, see Patent Document 1).

[0003] However, the technology disclosed in Patent Document 1 is a security-oriented technology, not a technology for improving the visibility of both images and objects.

[0004] Existing technical documents

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Publication No. 2016-88187 Summary of the Invention

[0007] This invention was made to solve this problem, and its purpose is to provide a display system and display method that can ensure the visibility of both images and objects.

[0008] An embodiment of the present invention relates to a display system comprising: a transparent display; a dimming plate located behind the transparent display and having adjustable transmittance; and a processor, wherein the processor, upon detecting an object located behind the dimming plate, causes the transparent display to display an image, and increases the transmittance of a region of the dimming plate located in front of the object compared to the transmittance of a region of the dimming plate located behind the region displaying the image, and the degree of increase varies depending on the combination of the image and the object. Attached Figure Description

[0009] Figure 1 This is a perspective view of the display system according to Embodiment 1.

[0010] Figure 2 This is a side view of the monitor.

[0011] Figure 3 This is a block diagram illustrating the functional structure of the display system involved in Implementation Method 1.

[0012] Figure 4 This is a diagram representing an example of a table.

[0013] Figure 5 It is a flowchart representing the presentation process.

[0014] Figure 6 This is a diagram representing the first specific instance of the presentation process.

[0015] Figure 7 This is a diagram representing a specific instance compared to the first specific instance of the presentation process.

[0016] Figure 8 This is a diagram representing the second specific instance of the presentation process.

[0017] Figure 9 This is a diagram representing the third specific instance of the presentation process. Detailed Implementation

[0018] (Insights that form the basis of this invention)

[0019] In recent years, technologies utilizing transmissive displays with adjustable transmittance have become known. Specifically, such displays include a transparent display and a dimming panel located behind the transparent display with adjustable transmittance. The inventors have investigated the use of such displays to represent rooms (spaces) within buildings such as residences.

[0020] However, if the transmittance of the entire surface of the dimming plate is increased, the visibility behind the display improves, but the visibility of the image displayed on the transparent display deteriorates. On the other hand, if the transmittance of the entire surface of the dimming plate is decreased, the visibility of the image displayed on the transparent display improves, but the visibility of objects behind it deteriorates.

[0021] Patent Document 1 discloses a technique for attracting attention by directing the driver's gaze toward an object without obstructing the view of the scenery outside the vehicle, and for making the transmittance of the area containing the object relatively higher than that of other areas. However, while this technique ensures the visibility of the object, there is a risk that it may not ensure the visibility of the image.

[0022] In order to ensure the visibility of both the image and the object, the inventors conducted a detailed study and came up with the following methods.

[0023] An embodiment of the present invention relates to a display system comprising: a transparent display; a dimming plate located behind the transparent display and having adjustable transmittance; and a processor, wherein the processor, upon detecting an object located behind the dimming plate, causes the transparent display to display an image, and increases the transmittance of a region of the dimming plate located in front of the object compared to the transmittance of a region of the dimming plate located behind the region displaying the image, and the degree of increase varies depending on the combination of the image and the object.

[0024] One embodiment of the present invention relates to a display control method that utilizes a display system comprising a transparent display, a dimming plate located behind the transparent display and having adjustable transmittance, and a processor. In this method, when the processor detects an object located behind the dimming plate, it causes the transparent display to display an image, and increases the transmittance of the region of the dimming plate in front of the object compared to the transmittance of the region of the dimming plate behind the region displaying the image. The degree of this increase varies depending on the combination of the image and the object.

[0025] According to these methods, in the dimming panel, the transmittance of the area in front of the object is increased relative to the transmittance of the area behind the area displaying the image, corresponding to the combination of the image and the object. Therefore, this method, taking into account the visibility when the user views the image and object together, appropriately increases the transmittance of the area in front of the object relative to the transmittance of the area behind the area displaying the image. Accordingly, this method ensures the visibility of both the image and the object.

[0026] In this manner, the processor may also cause the transmittance of the area behind the area displaying the image in the dimming panel to change in accordance with the movement of the display position of the image when the display position of the image is moved.

[0027] According to this method, the transmittance of the area behind the region displaying the image changes as the image's display position moves. Therefore, this method can ensure the visibility of images, such as moving images, even when their display position changes.

[0028] In this manner, the processor may also cause the transmittance of the dimming plate to vary according to the distance from the area located behind the area where the image is displayed.

[0029] In this method, the transmittance of the dimming plate varies depending on the distance from the area behind the displayed image. Therefore, this method enables the image to harmonize with the space by increasing the transmittance of the dimming plate as it moves further away from the area behind the displayed image.

[0030] In this method, there may be multiple objects, and the correlation between the image and each object is defined separately. When the processor detects a first object located behind the dimming plate and a second object located behind the dimming plate with a lower correlation to the image compared to the first object, it increases the transmittance of the region in front of the first object in the dimming plate compared to the transmittance of the region in front of the second object.

[0031] In this method, the transmittance of the region in front of the first object is higher than the transmittance of the region in front of the second object, which has a lower correlation with the image compared to the first object. Therefore, this method can appropriately adjust the visibility of multiple objects according to their correlation with the image by, for example, blurring objects with low correlation with the image and making objects with high correlation with the image prominent.

[0032] In this manner, the processor can also cause the transmittance of the dimming plate to vary according to the distance from the region located in front of the object.

[0033] In this method, the transmittance of the dimming plate varies depending on its distance from the area in front of the object. Therefore, this method enables the object to harmonize with the space by increasing the transmittance of the dimming plate as it gets closer to the area in front of the object.

[0034] In this manner, the image may also comprise a first image and a second image, and the processor makes the transmittance of the region of the dimming plate located behind the region displaying the first image and the transmittance of the region of the dimming plate located behind the region displaying the second image different from each other.

[0035] In this method, the transmittance of the region behind the area displaying the first image and the transmittance of the region behind the area displaying the second image are different. Therefore, this method can, for example, blur images that are not desired to be seen with an object and make images that are desired to be seen with an object prominent, appropriately adjust the visibility of multiple images according to their combination with an object.

[0036] (Implementation Method 1)

[0037] [1-1. Structure of the display system]

[0038] First, refer to Figure 1 and Figure 2 The structure of the display system 2 according to Embodiment 1 is explained. Figure 1 This is a perspective view of the display system 2 according to embodiment 1. Figure 2 This is a side view of the monitor (60).

[0039] Additionally, in the following explanation, such as Figure 1 and Figure 2As shown, the X-axis, Y-axis, and Z-axis directions, which are parallel to each other and orthogonal, represent the three mutually orthogonal directions of display system 2. Specifically, let the left-right direction of display system 2 be the X-axis direction, with -X direction for the left and X direction for the right. Let the front-back direction (depth direction) of display system 2 be the Y-axis direction, with -Y direction for the front and +Y direction for the rear. Let the up-down direction of display system 2 be the Z-axis direction, with +Z direction for the top and -Z direction for the bottom.

[0040] Display system 2 presents, for example, rooms (hereinafter referred to as "spaces") within buildings such as residences. Specifically, such as Figure 1 As shown, the display system 2 includes a frame 4 and a display 60.

[0041] The frame 4 is rectangular in the XZ plan view (+Y direction view). The frame 4 is, for example, a window frame with a rectangular opening formed in a wall (not shown) of a building. The frame 4 has an upper wall portion 8, a lower wall portion 10, a left wall portion 12, and a right wall portion 14. The upper wall portion 8 and the lower wall portion 10 are arranged facing each other in the vertical direction (Z-axis direction). The left wall portion 12 and the right wall portion 14 are arranged facing each other in the horizontal direction (X-axis direction). The lower wall portion 10 functions as a shelf for placing objects 16.

[0042] Users can place object 16 on the lower wall 10 as part of the room's interior decoration. Figure 1 In the example shown, object 16 is a foliage plant (cactus). However, object 16 is not limited to this and can also be, for example, a picture frame, clock, book, decorative item, doll, vase, toy, model, or painting.

[0043] The display 60 is rectangular in the XZ plan view (+Y direction view), and its outer periphery is supported by the frame 4. The display 60 functions as, for example, a transparent exterior window located in an opening formed in the exterior wall of a building, or an interior window located between two adjacent rooms within a building, and also functions as a display panel for displaying images. The object 16 is disposed near the display 60, specifically near the lower part of the display 60 and behind the display 60 (in the +Y direction).

[0044] Furthermore, the term "transparent" in this invention is not necessarily limited to a state with a transmittance of 100%. Transmittance is expressed as a percentage of the ratio of the intensity of transmitted light (refracted light) to the intensity of incident light (= transmitted light (refracted light) / incident light). For example, a state with a transmittance of less than 100% or a state with a transmittance of approximately 80-90% can also be defined as "transparent." In addition, a semi-transparent state with a transmittance of 50% or more relative to visible light (specifically 550 nm) can also be defined as "transparent."

[0045] like Figure 2 As shown, the display 60 includes a transparent display 61, a dimming panel 62, and a front glass 63. The transparent display 61 displays an image for presenting a space or object 16. The transparent display 61 is, for example, a transmissive transparent display such as a transparent inorganic EL (Electroluminescence), a transparent organic EL, or a transmissive liquid crystal display. An optical clear adhesive sheet (OCA) 611 is attached to the front (-Y direction) side of the transparent display 61. Furthermore, an optical clear adhesive sheet 612 is also attached to the rear (+Y direction) side of the transparent display 61.

[0046] The dimming plate 62 is attached to the rear (+Y direction) side surface of the transparent display 61 via an optical adhesive sheet 612. The dimming plate 62 includes dimming glass that is approximately the same size as the transparent display 61 in the XZ plane view (+Y direction view). An anti-reflection film 621 is attached to the rear (+Y direction) side surface of the dimming plate 62. The dimming plate 62 uses technologies such as PDLC using liquid crystal and polymer, GHLC using liquid crystal and pigment, electrochromic technology, and SPD (Suspended Particle Device) technology to adjust the transmittance of the dimming glass in area units the same size as the pixels of the transparent display 61.

[0047] The front glass 63 is adhered to the front (-Y direction) side of the transparent display 61 via an optical adhesive sheet (OCA) 611. An anti-reflective film 631 is adhered to the front (-Y direction) side of the front glass 63.

[0048] In other words, the user can see the image displayed on the transparent display 61 through the front glass 63 from the front (-Y direction), and at the same time, can see the object 16 placed on the lower wall 10 through both the front glass 63 and the transparent display 61. Accordingly, a spatial presentation that coordinates the object 16 and the image is achieved.

[0049] While an image is displayed on the transparent display 61, the user can see the object 16 located behind (+Y direction) the display 60 from the front (-Y direction) through the rear (+Y direction). That is, regardless of whether an image is displayed on the transparent display 61, just like a window that serves as a normal door or window, the user indoors can look at the object 16 and the outdoor scenery through the display 60.

[0050] Furthermore, the image displayed on the transparent display 61 can be either a still image or a moving image, or it can be image content that includes both still and moving images. Alternatively, the image can also be an image linked to, for example, music output from a speaker (not shown) installed in the housing 4, etc. Accordingly, without requiring complex operations from the user, a pleasant spatial atmosphere is created, enhancing the user's mood.

[0051] [1-2. Functional Structure of the Display System]

[0052] Next, refer to Figure 3 The functional structure of the display system 2 involved in Implementation Method 1 is explained. Figure 3 This is a block diagram illustrating the functional structure of the display system 2 according to embodiment 1. For example... Figure 3 As shown, the display system 2 includes the aforementioned display 60, memory 20, sensor 30, communication unit 40, and processor 50.

[0053] The memory 20 is a storage device such as a hard disk or solid-state drive. The memory 20 stores various data and information used by the display system 2 for presentation.

[0054] Sensor 30 is used to detect the presence of a sensor located on display 60. Figure 1 The sensor 30 is positioned behind the object 16. For example, the sensor 30 is positioned within the frame 4. Figure 1 ) upper wall portion 8 ( Figure 1 Furthermore, the sensor 30 is not limited to being disposed on the upper wall portion 8; for example, it may also be disposed on the lower wall portion 10 of the frame 4. Figure 1 ), left side wall 12 ( Figure 1 ) and right side wall 14 ( Figure 1 (on any one of them)

[0055] Sensor 30 is, for example, a camera sensor with an imaging element. At this time, sensor 30 captures an image of display 60. Figure 1 The sensor 30 is located behind the camera element and outputs image data representing the captured image to the processor 50. In addition to the camera element, the sensor 30 may also have an infrared sensor. Furthermore, the sensor 30 may not be mounted on the display system 2.

[0056] Alternatively, sensor 30 can also be a distance sensor. In this case, sensor 30 measures the distance to object 16 located behind (in the +Y direction) of dimming plate 62. If the measured distance is within a specified range, data indicating that object 16 has been detected is output to processor 50. Furthermore, the distance sensor may utilize spatial recognition techniques such as Depth From Defocus to measure the distance to object 16. Depth From Defocus is a technique that identifies space based on multiple real-time images with different focus positions and calculates the distance to the object.

[0057] The communication unit 40 is a communication interface circuit used by the processor 50 to communicate with operating devices such as smartphones or touch panels via a network (not shown). The communication unit 40 sends and receives various data between the operating device and the processor 50.

[0058] Processor 50 includes circuits such as CPU and FPGA. Processor 50 controls memory 20, sensor 30, communication unit 40, and display 60.

[0059] For example, the processor 50 acquires image information (hereinafter, display image) input by the user using an operating device regarding the image displayed on the transparent display 61, object type information indicating the type of an object (hereinafter, display object) positioned behind the dimming plate 62 and seen together with the display image, and correlation information indicating the correlation between the display image and the display object, via the communication unit 40. In this embodiment, the correlation indicated by the correlation information is represented by a numerical value; the larger the value, the higher the correlation between the display image and the display object.

[0060] The image information includes image data representing the image to be presented, the content (e.g., "moon"), type (e.g., "celestial body") of the image to be presented, and the display position (e.g., "(X1, Z1)") in the transparent display 61. Alternatively, the processor 50 can also acquire image data from the network as image data representing the image to be presented. Specifically, suppose the processor 50 acquires a search instruction command input by a user using an operating device, containing keywords for searching for the image to be presented, via the communication unit 40. In this case, the processor 50 can also control the communication unit 40 to search for images on the network using the keywords contained in the acquired search instruction command. Furthermore, if an image corresponding to the keyword exists as a result of the search, the processor 50 acquires (downloads) image data representing the image corresponding to the keyword via the communication unit 40.

[0061] Figure 4 This is a diagram representing an example of Table 200. For example, as shown... Figure 4As shown, the memory 20 is provided with a presentation table 200, which is used to store image information, object type information and correlation information in correspondence with the transmittance (hereinafter, image transmittance) of the area behind the area of ​​the dimming plate 62 where the image is displayed and the transmittance (hereinafter, object transmittance) of the area of ​​the dimming plate 62 in front of the object to be displayed.

[0062] The processor 50 stores the image information, object type information, and correlation information acquired through the communication unit 40 in the presentation table 200. Furthermore, the processor 50 determines the image transmittance and object transmittance of each record in the presentation table 200 according to the following rules R1 to R3.

[0063] Rule R1: Increases the transmittance of the object compared to the transmittance of the image.

[0064] Rule R2: The higher the correlation between the image being presented and the object being presented, the greater the increase in the object's transmittance relative to the image's transmittance.

[0065] Rule R3: Among multiple records where the relevance between the image to be presented and the object to be presented is equal, the image transmittance of the record of the image to be presented of a specified type is increased relative to the image transmittance of the record of the image to be presented of a different type. In this embodiment, the specified type in Rule R3 is assumed to be "environment". However, the specified type is not limited to this.

[0066] For example, such as Figure 4 As shown, the processor 50 determines the transmittance of all recorded objects 21-24 (e.g., "50%)" according to rule R1 as a transmittance that is higher than the image transmittance (e.g., "10%)".

[0067] exist Figure 4 In the presentation table 200 shown, the correlation between the image and the object being presented is recorded in the order of 22, 21, 23, 24, with the numbers "5", "4", "3", and "3". Therefore, the processor 50, according to rule R2, increases the degree to which the transmittance of the object relative to the transmittance of the image increases in the order of 22, 21, 23, 24, with the numbers "50% (=70%-20%)", "40% (=50%-10%)", "30% (=50%-20%)", and "30% (=70%-40%)".

[0068] exist Figure 4In the presentation table 200 shown, the correlation "3" between the presentation image and the presentation object is equal in records 24 and 23. Furthermore, the type of the presentation image corresponding to record 24 is "environment," and the type of the presentation image corresponding to record 23 is "organism." Therefore, the processor 50, according to rule R3, increases the image transmittance of record 24 by "40%" compared to the image transmittance of record 23 by "20%."

[0069] For example, Figure 4 Records 21, 22, and 24 are used to display images of "moon," "butterfly," and "desert" on a transparent display 61 when an object 16 of the type "cactus" is positioned behind the dimming plate 62.

[0070] also, Figure 4 Records 22 and 23 are used to display an image on the transparent display 61 with the two objects 16 as the presentation objects, which are "cactus" and "building block" objects respectively, positioned behind the dimming plate 62. In other words, when multiple presentation objects are presented using a single presentation image, the image information related to the single presentation image includes object type information indicating the type of each presentation object and association information indicating the association between the single presentation image and the presentation object.

[0071] The processor 50 detects an object 16 located behind the display 60. Specifically, the processor 50 uses sensors 30 and the like to determine the type of object 16 located behind the display 60 and the area in the dimming panel 62 located in front of the object 16.

[0072] For example, suppose sensor 30 is a camera sensor. In this case, processor 50 uses machine learning techniques such as Mask R-CNN (Regions with Convolutional Neural Network) to detect the outline of object 16 contained in the image data input from sensor 30, and identifies the type of object 16. Furthermore, processor 50 determines the region in the dimming plate 62 located in front of object 16 based on the detected outline of object 16.

[0073] Mask R-CNN is a deep learning technique that can perform general object detection and segmentation simultaneously. In Mask R-CNN, each pixel in an image is assigned to a specific object level, and the outline of the object 16 contained in the image is detected. Furthermore, the detected object 16 is compared with pre-stored information representing object features in memory 20 to identify the type of object 16.

[0074] Additionally, the processor 50 can also control the communication unit 40 to use a service provided by an external device connected to the network to identify the types of objects contained in the image data, thereby determining the types of objects 16 contained in the image data input from the sensor 30. This reduces the processing load on the processor 50. Furthermore, since it is not necessary to pre-store information representing object features in the memory 20, the storage capacity of the memory 20 can be saved.

[0075] Furthermore, sensor 30 is assumed to be a distance sensor. At this time, after the processor 50 receives data from the sensor 30 indicating that the presence of object 16 has been detected, it remains in standby mode until the communication unit 40 obtains information from the user using an operating device or the like, indicating the type of object 16 and information indicating the area in the dimming plate 62 located in front of object 16.

[0076] Furthermore, even if the display system 2 does not include the sensor 30, an external device of the display system 2, such as the camera sensor of a user's smartphone, can be used to capture an image of the object 16 located behind the dimming plate 62. The communication unit 40 can also receive image data representing the captured image via a network. Moreover, similar to the case where the sensor 30 is a camera sensor, the processor 50 can use the image data acquired from the communication unit 40 to determine the type of object 16 and the area in the dimming plate 62 in front of the object 16.

[0077] The processor 50 performs rendering processing, rendering the object 16 located behind the dimming plate 62 and the space coordinated by the rendering image.

[0078] The following section details the presentation and processing. Figure 5 This is a flowchart representing the presentation process. Additionally, in the following explanation, we assume... Figure 4 The presentation table 200 shown is pre-stored in memory 20.

[0079] like Figure 5As shown, if the processor 50 detects an object 16 located behind the dimming plate 62 (step S1), it treats the object 16 as the object to be displayed and performs the display processing consisting of steps S2 and S3. Specifically, in step S1, the processor 50, as described above, determines the type of the object 16 located behind the display 60 and the area in the dimming plate 62 located in front of the object 16.

[0080] If the processor 50 starts the presentation process, it displays a presentation image corresponding to the type of presentation object obtained in step S1 on the transparent display 61 (step S2).

[0081] Specifically, in step S2, the processor 50 retrieves data from the presentation table 200 (…). Figure 4 The processor 50 acquires records containing the types of presentation objects identified in step S1. Furthermore, it is assumed that there are multiple records containing the types of presentation objects identified in step S1. In this case, the processor 50 acquires more than one record using a predetermined method, such as acquiring the last stored record, randomly acquiring a record, or acquiring a predetermined number of records from the last stored record. The processor 50 controls the transparent display 61 to display the presentation image shown by the image data contained in each acquired record at the display position of the presentation image contained in each acquired record.

[0082] Next, the processor 50 increases the transmittance of the region in front of the object to be displayed in the dimming plate 62, as determined in step S1, compared to the transmittance of the region in the dimming plate 62 behind the region displaying each image to be displayed. Furthermore, the processor 50 varies the degree of this increase depending on the combination of the image to be displayed and the object to be displayed (step S3).

[0083] Specifically, as mentioned above, Table 200 is presented ( Figure 4 The presentation table 200 stores image transmittance corresponding to the combination of the image and the object, and object transmittance corresponding to the combination of the image and the object, according to rule R1.

[0084] Therefore, in step S3, the processor 50 adjusts the transmittance of the region of the dimming plate 62 located behind the region where the image for presentation is displayed in step S2 to the image transmittance corresponding to the combination of the image for presentation and the object to be presented, which is included in the record obtained from the presentation table 200 in step S2. Furthermore, the processor 50 adjusts the transmittance of the region of the dimming plate 62 located in front of the object to be presented, which is obtained in step S1, to the object transmittance, which is higher than the image transmittance, corresponding to the combination of the image for presentation and the object to be presented, which is included in the record obtained from the presentation table 200 in step S2.

[0085] (Example 1)

[0086] Below, using Figure 6 and Figure 7 This describes the first specific example of the processing. Figure 6 This is a diagram representing the first specific instance of the presentation process. Figure 7 This is a diagram representing a specific instance compared to the first specific instance of the presentation process (hereinafter, Presentation Example 1). Figure 6 and Figure 7 The left image is a front view of the display 60 as seen from the front (-Y direction). Figure 6 and Figure 7 The right image is a side view of the display 60 and the object 90 as viewed from the right (+X direction).

[0087] In Example 1, it is explained that in step S1, the type of the object 90 is determined to be "cactus". In step S2, from Figure 4 The presentation table 200 shown is used to perform presentation processing when the content of the presentation image 80 is "moon" (record 21). Furthermore, as a specific example compared to presentation example 1, it is explained that in step S1, the type of the presentation object 90 is determined to be "cactus," and in step S2... Figure 4 The rendering table 200 shown shows the rendering process performed when the content of the rendering image 80 is "butterfly" recorded in record 22.

[0088] If record 21 is obtained in step S2, then as follows Figure 6 As shown in the left and right figures, the processor 50 displays the content of the still image data contained in the record 21 as a presentation image 80 of "moon" on the transparent display 61 at the display position "(X1, Z1)" contained in the record 21.

[0089] Next, in step S3, the processor 50 controls the dimming plate 62 in such a way that the transmittance of the region 628 located behind the area displaying the image 80 is 10% of the image transmittance contained in the record 21. Furthermore, the processor 50 controls the dimming plate 62 in such a way that the transmittance of the region 629 located in front of the object 90 in the dimming plate 62, as grasped in step 1, is 50% of the object transmittance contained in the record 21.

[0090] On the other hand, if record 22 is obtained in step S2, then as follows Figure 7 As shown in the left and right figures, the processor 50 displays the image 80 (animated image) containing the content "butterfly" from the display position "(X2, Z2)" contained in the record 22 in the transparent display 61. Then, the processor 50 controls the transparent display 61 to move the display position of the image 80 containing the content "butterfly" from "(X2, Z2)" through "(X5, Z5)" to "(X7, Z7)" based on the animated image data contained in the record 22.

[0091] Next, in step S3, the processor 50 controls the dimming plate 62 to adjust the transmittance of the region 628 located behind the area displaying the image 80 in the dimming plate 62 to the transmittance of the image contained in the record 22 as "20%". Furthermore, the processor 50 adjusts the transmittance of the region 629 located in front of the object 90 to the transmittance of the object contained in the record 22 as "70%".

[0092] Thus, in the presentation processing using record 21, processor 50 increases the transmittance of the region 629 in front of the object to be presented 50% compared to the transmittance of the region 628 behind the region displaying the image 80 by 40% (=50%-10%). Conversely, in the presentation processing using record 22, processor 50 increases the transmittance of the region 629 in front of the object to be presented 70% compared to the transmittance of the region 628 behind the region displaying the image 80 by 50% (=70%-20%). In other words, processor 50 increases the transmittance of region 629 by different amounts depending on the combination of the image 80 and the object to be presented 90.

[0093] Furthermore, when the display position of the image 80 containing the image of a "butterfly" is moved, the processor 50 follows the movement of the display position of the image 80 and changes the transmittance of the region 628 behind the area where the image 80 is displayed in the dimming panel 62. Therefore, even when the image 80 is a moving image and its display position is moved, the visibility of the image 80 can always be improved. Alternatively, the processor 50 can also follow the movement of the display position of the image 80 and increase the transmittance of the region 628 behind the area where the image 80 was displayed before the movement by a predetermined percentage. In this case, the visibility behind the dimming panel 62 can be improved.

[0094] Furthermore, the processor 50 can also vary the transmittance of the dimming plate 62 according to the distance from the area of ​​the image 80 to be displayed. For example, in Figure 6 In the left image, the processor 50 can also adjust the transmissivity of the region 628 of the dimming plate 62 that is further away from the area of ​​the display image 80 containing the image "moon". This allows for a display of the image 80 that is spatially coordinated.

[0095] Furthermore, the processor 50 can also vary the transmittance of the dimming plate 62 based on the distance from the region 629 located in front of the object being presented 90. For example, in Figure 6 In the left image, the processor 50 can also adjust the translucency of the area 629 of the dimming plate 62 that is further away from the object 90, which is of the "cactus" type, by increasing or decreasing its translucency. This allows for a more harmonious presentation of the object 90 within the space.

[0096] In other words, in these situations, the boundaries between the presented image 80 and the space, as well as the boundaries between the presented object 90 and the space, can be blurred. Accordingly, the sense of disharmony for the user viewing the display 60 can be reduced.

[0097] (Example 2)

[0098] Below, using Figure 8 This illustrates the second specific example of the presentation process. Figure 8 This is a diagram representing the second specific example of the presentation process (hereinafter, Presentation Example 2). Figure 8 The left image is a front view of the display 60 as seen from the front (-Y direction). Figure 8 The right figure is a side view of the display 60, the first object 90a, and the second object 90b as viewed from the right (+X direction).

[0099] In Example 2, we will describe the presentation of a space that coordinates a presentation image 80, a first presentation object 90a (first object), and a second presentation object 90b (second object) that has a lower correlation with the presentation image 80 compared to the first presentation object 90a.

[0100] Specifically, suppose in step S1 it is determined that the type of the first presented object 90a is "cactus" and the type of the second presented object 90b is "building blocks". In step S2, from Figure 4 The presentation table 200 shown retrieves a record containing the types of each presentation object 90 obtained in step S1. For example, suppose that in step S2, record 22 containing the type "cactus" for the first presentation object 90a and record 23 containing the same image information as record 22 and the type "building block" for the second presentation object 90b are retrieved. In addition, the correlation "3" contained in record 23 is lower than the correlation "5" contained in record 22. That is, the second presentation object 90b, which is of type "building block", has a lower correlation with the presentation image 80 compared to the first presentation object 90a, which is of type "cactus".

[0101] At this time, as Figure 8 As shown in the left and right figures, the processor 50 displays the image 80 (animated image) containing the content "butterfly" from the display position "(X2, Z2)" contained in the record 22 (23) on the transparent display 61. Then, the processor 50 controls the transparent display 61 to adjust the display position of the image 80 containing the content "butterfly" based on the animated image data contained in the record 22. Figure 8 As shown in the left figure, move to "(X9, Z9)".

[0102] Next, in step S3, the processor 50 controls the dimming plate 62 such that the transmittance of the region 628 located behind the region displaying the image 80 is equal to the image transmittance "20%" contained in record 22 (23). Furthermore, if the image transmittances contained in the multiple records obtained in step S2 are different, the processor 50, for example, obtains a minimum image transmittance, acquires an image transmittance using a predetermined method, and adjusts the transmittance of region 628 to that acquired image transmittance.

[0103] Furthermore, the processor 50 controls the dimming plate 62 in such a way that the transmittance of the region 629a located in front of the first object to be presented 90a in the dimming plate 62 grasped in step 1 is 70% of the object transmittance contained in the record 22. Moreover, the processor 50 controls the dimming plate 62 in such a way that the transmittance of the region 629b located in front of the second object to be presented 90b in the dimming plate 62 grasped in step 1 is 50% of the object transmittance contained in the record 23.

[0104] In this way, when the processor 50 detects a first presentation object 90a located behind the dimming plate 62 and a second presentation object 90b with a lower correlation to the presentation image 80 compared to the first presentation object 90a, it adjusts the transmittance of the region 629a in front of the first presentation object 90a to a transmittance "70" that is "50%" higher than the transmittance of the region 629b in front of the second presentation object 90b. Accordingly, it is possible to blur the second presentation object 90b, which has a low correlation with the presentation image 80 and is not desired to be seen with the presentation image 80, while making the first presentation object 90a, which has a high correlation with the presentation image 80 and is desired to be seen with the presentation image 80, stand out.

[0105] For example, if objects 16 of the types "wardrobe," "cactus," and "clock" are located behind the dimming panel 62, then these three objects 16 are used as presentation objects 90, and a presentation image 80 with the content "cat" is displayed. Furthermore, a record is stored in the presentation table 200 that corresponds to the object type information of "wardrobe," the highest correlation information, and the image information of the presentation image 80 with the content "cat."

[0106] At this time, the transmittance of the area 629 in front of the object 90 whose type is "wardrobe" can be increased, while the transmittance of the area 629 in front of the objects 90 whose types are "cactus" and "clock" has a lower correlation with the image 80 whose content is "cat" than the object 90 whose type is "wardrobe" can be decreased. Accordingly, it is possible to blur unwanted objects and make desired objects stand out.

[0107] (Example 3)

[0108] Below, using Figure 9 This illustrates the third specific example of the presentation process. Figure 9 This is a diagram representing the third specific example of the presentation process (hereinafter, Presentation Example 3). Figure 9 The left image is a front view of the display 60 as seen from the front (-Y direction). Figure 9The right image is a side view of the display 60 and the object 90 as viewed from the right (+X direction).

[0109] In Example 3, the presentation of a space that coordinates a presentation object 90, a first presentation image 80a (first image), and a second presentation image 80b (second image) is described.

[0110] Specifically, suppose that in step S1 it is determined that the type of the presented object 90 is "cactus". Suppose that in step S2... Figure 4 The presentation table 200 shown is as follows: Figure 4 Two records, 22 and 24, were obtained, which contain the type of "cactus" of the presented object 90 obtained in step S1.

[0111] At this time, as Figure 9 As shown in the left and right figures, the processor 50 displays the first presentation image 80a (animated image) containing the content "butterfly" from the display position "(X2, Z2)" in the transparent display 61, based on the animated image data contained in the record 22. Then, the processor 50 controls the transparent display 61 to adjust the display position of the presentation image 80a containing the content "butterfly" according to the animated image data contained in the record 22. Figure 9 The image on the left is moved to "(X10, Z10)". Furthermore, the processor 50 displays a second presentation image 80b, containing still image data of "desert" from the record 24, on the transparent display 61 at the display position "(X4, Z4)" of the record 24.

[0112] Next, in step S3, the processor 50 adjusts the transmittance of the region 628a in the dimming plate 62 located behind the region displaying the first image 80a to the image transmittance "20%" included in the record 22. The processor 50 adjusts the transmittance of the region 628b in the dimming plate 62 located behind the region displaying the second image 80b to the image transmittance "40%" included in the record 24.

[0113] Furthermore, the processor 50 adjusts the transmittance of the region 629 in the dimming plate 62 located in front of the object 90 in step 1 to the object transmittance "70%" included in record 22 (24). In addition, if the object transmittances included in the multiple records obtained in step S2 are different, the processor 50 obtains an object transmittance by a predetermined method, for example, obtaining the maximum object transmittance, and adjusts the transmittance of region 629 to the obtained object transmittance.

[0114] In this way, when the processor 50 is displaying the first image 80a and the second image 80b, the transmittance of the region 628a behind the region displaying the first image 80a and the transmittance of the region 628b behind the region displaying the second image 80b are different. For example, the content of the first image 80a may be "the lattice of a paper sliding door", and the content of the second image 80b may be "the paper of the paper sliding door".

[0115] Furthermore, in step S3, the processor 50 may further reduce the transmittance of the region 628a in the dimming plate 62 located behind the region displaying the first image 80a compared to the transmittance of the image stored in the presentation table 200. Similarly, the processor 50 may further increase the transmittance of the region 628b located behind the region displaying the second image 80b compared to the transmittance of the image stored in the presentation table 200.

[0116] Furthermore, depending on the types of the first and second display images 80a and 80b, the transmittance of the region 628a behind the region displaying the first display image 80a can be increased or decreased compared to the transmittance of the region 628b behind the region displaying the second display image 80b. For example, the transmittance of the region 628a behind the region displaying the first display image 80a (content: "tropical fish," type: "life") can be decreased compared to the transmittance of the region behind the region displaying the second display image 80b (content: "water tank," type: "environment"). Based on these considerations, a more spatially harmonious presentation can be achieved.

[0117] As explained above, according to the embodiment described, in the dimming plate 62, the transmittance of the region 629 in front of the object to be displayed 90 is increased to a degree corresponding to the combination of the image to be displayed 80 and the object to be displayed 90, compared to the transmittance of the region 628 behind the region displaying the image to be displayed 80. Therefore, this method takes into account the visibility when the user views the image to be displayed 80 and the object to be displayed 90 together, and can appropriately increase the transmittance of the region 629 in front of the object to be displayed 90 relative to the transmittance of the region 628 behind the region displaying the image to be displayed 80. Accordingly, this method can ensure the visibility of both the image to be displayed 80 and the object to be displayed 90.

[0118] (Modified Example)

[0119] (1) In the described embodiment, it is explained that before starting the rendering process, the processor 50 determines the image transmittance and object transmittance according to rules R1 to R3, and stores the determined image transmittance and object transmittance in advance in the rendering table 200 set in the memory 20. Figure 4 (Example ). However, instead, Table 200 can also be presented. Figure 4 The structure of the presentation table 200 is changed to one that does not store image transmittance and object transmittance. In conjunction with this, the processor 50 can also, after executing step S2 and before executing step S3, modify the presentation table 200 based on the modified structure. Figure 4 The image information, object type information, and correlation information of each record are used to determine the image transmittance and object transmittance included in each record according to rules R1 to R3.

[0120] (2) Table 200 can also be presented. Figure 4 The processor 50 determines the image transmittance and object transmittance according to rules R1 and R2 but not according to rule R3, even though the image does not include the type of image to be presented (e.g., "celestial body").

[0121] Industrial availability

[0122] The present invention can ensure the visibility of both the displayed image of a display with adjustable transmittance and the object behind the display, and is therefore useful, for example, in the case of presenting the space inside a building such as a residence.

Claims

1. A display system, characterized in that... include: Transparent display; A dimming panel, located behind the transparent display, is used to adjust the transmittance. as well as, processor, of which, When the processor detects an object located behind the dimming plate, it causes the transparent display to display an image, and increases the transmittance of the area of ​​the dimming plate in front of the object compared to the transmittance of the area of ​​the dimming plate behind the area displaying the image. The degree of this increase varies depending on the combination of the image and the type of object. There are multiple types of objects, and the association between the image and each type of object is defined separately. When the processor detects a first object located behind the dimming plate and a second object located behind the dimming plate that is of a type with low correlation to the image compared to the first object, the processor increases the transmittance of the region in front of the first object in the dimming plate compared to the transmittance of the region in front of the second object.

2. The display system according to claim 1, characterized in that, When the display position of the image is moved, the processor causes the transmittance of the area behind the area displaying the image in the dimming panel to change in accordance with the movement of the display position of the image.

3. The display system according to claim 1 or 2, characterized in that, The processor causes the transmittance of the dimming plate to vary according to the distance from the area located behind the area where the image is displayed.

4. The display system according to claim 1 or 2, characterized in that, The processor causes the transmittance of the dimming plate to vary according to the distance from the area located in front of the object.

5. The display system according to claim 1 or 2, characterized in that, The image includes a first image and a second image. The processor makes the transmittance of the region of the dimming plate behind the region displaying the first image and the transmittance of the region of the dimming plate behind the region displaying the second image different from each other.

6. A display control method, comprising a display system having a transparent display, a dimming plate located behind the transparent display and with adjustable transmittance, and a processor, characterized in that, When the processor detects an object located behind the dimming plate, it causes the transparent display to display an image, and increases the transmittance of the area of ​​the dimming plate in front of the object compared to the transmittance of the area of ​​the dimming plate behind the area displaying the image. The degree of this increase varies depending on the combination of the image and the type of object. There are multiple types of objects, and the association between the image and each type of object is defined separately. When the processor detects a first object located behind the dimming plate and a second object located behind the dimming plate that has a lower correlation with the image compared to the first object, the processor increases the transmittance of the region in the dimming plate in front of the first object compared to the transmittance of the region in front of the second object.

Images