Smart window device for spatial presentation, image display method and program for spatial presentation

Abstract

A smart window device (2) is provided with: a transparent window (6) that displays a presentation video (18); a request reception unit (24) that receives a stop request or a change request for display of the presentation video (18) from a user; a data acquisition unit (26) that acquires presentation video data indicating the presentation video (18) reflecting preference of the user, the presentation video data being obtained by performing learning on the basis of the type of an object (16) and a length of time period between when the presentation video (18) starts display and when the request reception unit (24) receives the stop request or the change request; and a control unit (28) that identifies, when a sensor (22) has detected the object (16), the type of the object (16) from the result of detection by the sensor (22), that selects the presentation video (18) to be displayed on the window (6) from among presentation video data on the basis of the type of the identified object (16), and that causes the window (6) to display the presentation video (18).

Description

[Technical field]

[0001] The present disclosure relates to a smart window device, an image display method, and a program. [Background technology]

[0002] Conventionally, when spatial presentation is performed in buildings such as houses and commercial facilities, for example, seasonal accessories are placed by the windows, ornaments or decorative lights are attached to the walls, windows are decorated, etc. In addition, spatial presentation is also performed by projecting images onto the walls or ceilings using a projector, or displaying images on a large display.

[0003] In recent years, a technology has become known for detecting the shape of an object placed in a space within a building, correcting projection distortion based on the detected shape of the object, and then projecting an image from a projector onto the object in order to create a spatial effect within the space (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-131319 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology disclosed in Patent Document 1, the image projected onto the object does not take into consideration the user's preferences, which causes a problem in that it is difficult to produce a space that meets the user's preferences.

[0006] Therefore, the present disclosure provides a smart window device, an image display method, and a program that can create a space according to a user's preferences. [Means for solving the problem]

[0007] A smart window device according to one aspect of the present disclosure includes a transparent window having a display surface for displaying a produced image, the window being visible through one side of the display surface to the other side while the produced image is displayed on the display surface, a request receiving unit for receiving a request from a user to stop or change the display of the produced image, a data acquisition unit for acquiring produced image data indicating the produced image that reflects the user's preferences, the data acquisition unit having learned the length of time from when the display of the produced image starts until when the request receiving unit receives the request to stop or change the image and the type of object located near the window, and (i) when a sensor detects the object. a control unit that (ii) determines the type of the object from the detection result of the sensor, selects a first performance image to be displayed on the display surface from the performance image data based on the determined type of the object, and displays the first performance image on at least a portion of the display surface, and if the request receiving unit receives the stop request, stops the display of the first performance image, and (iii) if the request receiving unit receives the change request, selects a second performance image different from the first performance image to be displayed on the display surface from the performance image data, and displays the second performance image on at least a portion of the display surface.

[0008] Furthermore, an image display method according to one aspect of the present disclosure is an image display method in a smart window system including a transparent window having a display surface for displaying a staged image, and a processor, the window being viewable from one side of the display surface to the other side while the staged image is displayed on the display surface, a sensor is used to detect an object located near the window, the processor receives a request from a user to stop or change the display of the staged image, and displays a staged image showing the staged image reflecting the user's preferences, learned based on the length of time from when the display of the staged image started to when the request to stop or change is received and the type of the object. the request receiving unit receives the request to stop, the display of the first performance image is stopped, and if the request receiving unit receives the request to change, the request receiving unit selects a second performance image different from the first performance image to be displayed on the display surface from the performance image data, and displays the second performance image on at least a portion of the display surface.

[0009] These comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM (Compact Disc-Read Only Memory), or may be realized by any combination of the system, the method, the integrated circuit, the computer program, and the recording medium. Effect of the Invention

[0010] According to a smart window device or the like according to one aspect of the present disclosure, it is possible to create a space according to a user's preferences. [Brief description of the drawings]

[0011] [Figure 1]FIG. 1 is a perspective view showing a smart window device according to the first embodiment. [Figure 2A] FIG. 2A is a diagram showing a display example of a produced image in the smart window device according to the first embodiment. [Figure 2B] FIG. 2B is a diagram showing a display example of a produced image in the smart window device according to the first embodiment. [Figure 2C] FIG. 2C is a diagram showing a display example of a produced image in the smart window device according to the first embodiment. [Diagram 3] FIG. 3 is a block diagram showing a functional configuration of the smart window device according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing a flow of operations of the smart window device according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing an example of a method for learning user preferences by the data acquiring unit according to the first embodiment. [Figure 6] FIG. 6 is a perspective view showing a smart window device according to the second embodiment. [Figure 7] FIG. 7 is a block diagram showing a functional configuration of the smart window system according to the second embodiment. [Figure 8] FIG. 8 is a sequence diagram showing the flow of operations of the smart window system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] A smart window device according to one aspect of the present disclosure includes a transparent window having a display surface for displaying a produced image, the window being visible through one side of the display surface to the other side while the produced image is displayed on the display surface, a request receiving unit for receiving a request from a user to stop or change the display of the produced image, and a data acquisition unit for acquiring produced image data showing the produced image that reflects the user's preferences, the data being learned based on the length of time from when the display of the produced image begins until the request receiving unit receives the request to stop or change the image and the type of object located near the window. a sensor for detecting the object; (i) The abovea control unit that, when a sensor detects the object, determines a type of the object from a detection result of the sensor, selects a first performance video to be displayed on the display surface from the performance video data based on the determined type of the object, and displays the first performance video on at least a portion of the display surface; (ii) stops the display of the first performance video if the request receiving unit receives the stop request; and (iii) selects a second performance video different from the first performance video to be displayed on the display surface from the performance video data, and displays the second performance video on at least a portion of the display surface if the request receiving unit receives the change request. The object is placed in a position where the user can see it through the window. .

[0013] According to this aspect, the data acquisition unit acquires the performance image data showing the performance image reflecting the user's preferences, which is learned based on the length of time from when the display of the performance image starts until the request acceptance unit accepts the stop request or the change request and the type of object. Also, the control unit selects a first performance image from the performance image data based on the type of the determined object, and displays the selected first performance image on the display surface of the window. As a result, the first performance image displayed on the display surface of the window reflects the user's preferences, so that the space can be produced according to the user's preferences. Furthermore, when the request acceptance unit accepts a change request, the control unit selects a second performance image different from the first performance image from the performance image data, and displays the selected second performance image on the display surface of the window. As a result, even if the user requests a change to the display of the first performance image, the second performance image reflecting the user's preferences can be displayed on the display surface of the window, and the space can be produced according to the user's preferences.

[0014] For example, the window may be configured to be any one of an exterior window installed in an opening formed in the exterior wall of a building, an interior window installed between two adjacent rooms within the building, and a partition window that divides one room within the building into multiple spaces.

[0015] According to this aspect, a space can be created according to the user's preferences by using any one of an exterior window, an interior window, and a partition window.

[0016] For example, at least one of the first staged image and the second staged image may be configured to include an image of a plurality of particles of light moving from the top to the bottom of the window.

[0017] According to this aspect, at least one of the first produced image and the second produced image can be an image that depicts, for example, a scene of falling snow or stars, thereby enhancing the spatial production effect.

[0018] For example, the control unit may be configured to display the first performance image and the second performance image on at least a portion of the display surface so that the motion direction of each of the first performance image and the second performance image is directed toward the object.

[0019] According to this aspect, it is possible to perform spatial presentation according to the user's preferences while harmonizing the first presentation image and the second presentation image with the object.

[0020] For example, the data acquisition unit may be configured to be connected to a network and acquire the performance video data from the network.

[0021] According to this aspect, the data acquisition unit acquires the performance video data from the network, so that the capacity of the internal memory of the smart window device can be saved.

[0022] For example, the data acquisition unit may further acquire user information indicating the user's schedule and / or the user's device operation history from the network, and the control unit may be configured to predict the time when the user will enter a room in which the window is installed based on the user information, and to start displaying the first performance image a first hour before the predicted time.

[0023] According to this aspect, the control unit starts displaying the first performance image before the time when the user is predicted to enter the room in which the window is installed, thereby eliminating the need for user operation to display the first performance image, thereby improving user convenience.

[0024] For example, the sensor may further detect whether or not the user is present in a room in which the window is installed, and the control unit may be configured to stop displaying the first performance image or the second performance image after a second time has elapsed after the sensor detects that the user is no longer present in the room.

[0025] According to this aspect, the control unit stops the display of the first performance image or the second performance image after the user leaves the room, thereby eliminating the need for user operation to stop the display of the first performance image or the second performance image, thereby improving user convenience.

[0026] For example, the sensor may further detect the illuminance near the window, and the control unit may be configured to adjust the brightness when displaying the first performance image or the second performance image on the window based on the illuminance detected by the sensor.

[0027] According to this aspect, it is possible to improve the visibility of the first performed image or the second performed image.

[0028] For example, the window may be configured to be a transmissive transparent display made up of any one of a transparent inorganic EL (Electro Luminescence), a transparent organic EL, and a transmissive liquid crystal display.

[0029] According to this aspect, there is almost no difference in appearance between a window configured with a transmission-type transparent display and a typical window as a fixture, so the user will not feel uncomfortable.

[0030] For example, the user's preferences may be further configured to be learned based on the user's operation history of the smart window device or the operation history of other devices other than the smart window device.

[0031] According to this aspect, it is possible to efficiently learn the preferences of the user.

[0032] For example, the control unit may be configured to acquire situation data indicating the situation of a room in which the window is installed, and select from the performance image data the first performance image or the second performance image that corresponds to the situation of the room indicated by the situation data.

[0033] According to this aspect, it is possible to perform an effective presentation according to the conditions of the room.

[0034] According to one aspect of the present disclosure, there is provided a method for displaying an image in a smart window system including a transparent window having a display surface for displaying a staged image, and a processor, the window being visible through one side of the display surface to the other side while the staged image is being displayed on the display surface, and a sensor is used to detect a position near the window. The device is installed in a position where the user can see it through the window. An object is detected, the processor The above receiving a request to stop or change the display of the produced image from a user, acquiring produced image data showing the produced image that reflects the user's preferences learned based on the length of time from when the display of the produced image started to when the request to stop or change was received and the type of the object, determining the type of the object from the detection result of the sensor when the sensor detects the object, selecting a first produced image to be displayed on the display surface from the produced image data based on the determined type of object, and displaying the first produced image on at least a portion of the display surface; The user can select whether or not to display the produced video. When the stop request is received, the display of the first performance image is stopped, The user can select whether or not to display the produced video.When the change request is received, a second performance image different from the first performance image to be displayed on the display surface is selected from the performance image data, and the second performance image is displayed on at least a portion of the display surface.

[0035] According to this aspect, the display device acquires display image data showing a display image reflecting the user's preferences, which is learned based on the length of time from when the display of the display image starts until the request receiving unit receives a stop request or a change request and the type of object. Also, based on the type of object determined, a first display image is selected from the display image data, and the selected first display image is displayed on the display surface of the window. As a result, the first display image displayed on the display surface of the window reflects the user's preferences, so that a space can be displayed according to the user's preferences. Furthermore, when the request receiving unit receives a change request, a second display image different from the first display image is selected from the display image data, and the selected second display image is displayed on the display surface of the window. As a result, even if the user requests a change to the display of the first display image, a second display image reflecting the user's preferences can be displayed on the display surface of the window, and a space can be displayed according to the user's preferences.

[0036] A program according to an aspect of the present disclosure is a program for causing a computer to execute the above-described video display method.

[0037] In addition, these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be realized by any combination of the system, method, integrated circuit, computer program, or recording medium.

[0038] Hereinafter, the embodiment will be specifically described with reference to the drawings.

[0039] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in an independent claim showing a top concept are described as optional components.

[0040] (Embodiment 1) [1-1. Structure of smart window device] First, the structure of a smart window device 2 according to embodiment 1 will be described with reference to Fig. 1 to Fig. 2C. Fig. 1 is a perspective view showing a smart window device 2 according to embodiment 1. Each of Figs. 2A to 2C is a diagram showing a display example of a produced video 18 in the smart window device 2 according to embodiment 1.

[0041] 1 to 2C, the left-right direction of the smart window device 2 is the X-axis direction, the depth direction of the smart window device 2 is the Y-axis direction, and the up-down direction of the smart window device 2 is the Z-axis direction.

[0042] The smart window device 2 is a device for creating a room (hereinafter also referred to as a "space") in a building such as a house. As shown in FIG. 1, the smart window device 2 includes a frame 4 and a window 6.

[0043] The frame 4 is formed in a rectangular shape in the XZ plane view. The frame 4 is, for example, a window frame installed in a rectangular opening formed in an outer wall (not shown) of a building. The frame 4 has an upper wall portion 8, a lower wall portion 10, a left side wall portion 12, and a right side wall portion 14. The upper wall portion 8 and the lower wall portion 10 are arranged facing each other in the vertical direction (Z axis direction). The left side wall portion 12 and the right side wall portion 14 are arranged facing each other in the horizontal direction (X axis direction). The lower wall portion 10 functions as a shelf for placing an object 16. A user can place the object 16 on the lower wall portion 10 as part of the interior of a room. In the example shown in FIG. 1, the object 16 is a potted plant (cactus), but is not limited thereto, and may be, for example, a photo frame, a wristwatch, a book, a decorative accessory, a doll, a vase, a toy, a model, or a painting. The object 16 may be placed on a shelf provided near the frame 4, not on the lower wall portion 10 of the frame 4.

[0044] The window 6 is formed in a rectangular shape in the XZ plane view, and the outer periphery of the window 6 is supported by the frame 4. The window 6 functions as an interior window installed between two adjacent rooms in a building, for example, and also functions as a transparent display panel for displaying a staged image 18 (described later). Note that "transparent" does not necessarily mean transparency with a transmittance of 100%, but may mean transparency with a transmittance of less than 100%, for example, transparency with a transmittance of about 80 to 90%, or may be semi-transparent with a transmittance of 30% to 50% or more for visible light (specifically, 550 nm). Note that the transmittance is the intensity ratio between incident light and transmitted light expressed as a percentage. The above-mentioned object 16 is disposed near the window 6, specifically, near the lower part of the window 6, facing the back side (outside the room) of the window 6.

[0045] The window 6 is composed of a transmissive transparent display such as a transparent inorganic EL (Electro Luminescence), a transparent organic EL, or a transmissive liquid crystal display. A display surface 20 for displaying a staged image 18 is formed on the front side (inside the room) of the window 6. The staged image 18 is an image for staged spatial effects. A user looks at the staged image 18 displayed on the display surface 20, and at the same time, looks at the object 16 placed on the lower wall 10 through the window 6. This creates a spatial effect in which the object 16 and the staged image 18 are in harmony with each other.

[0046] While the staged image 18 is displayed on the display surface 20, the window 6 can be seen through from the front side (one side) of the window 6 to the back side (the other side). In other words, regardless of whether the staged image 18 is displayed on the display surface 20 or not, a user in the room can view the object 16 and the view outside through the window 6, just like a window as a general fixture.

[0047] The produced image 18 may be either a still image or a moving image, or may be image content including both still images and moving images. Alternatively, the produced image 18 may be an image linked to music or the like output from a speaker (not shown) installed in the frame body 4 or the like. This improves the atmosphere of the space and lifts the user's spirits without requiring complex operations by the user.

[0048] Here, with reference to Figs. 2A to 2C, a display example of the staged image 18 (18a, 18b, 18c) will be described. In the example shown in Fig. 2A, staged image 18a is an image expressing a scene of snow falling toward object 16, and is an image in which an image resembling snowflakes (multiple light particles) moves from the top to the bottom of window 6 (from the positive side to the negative side of the Z axis). That is, in the example shown in Fig. 2A, staged image 18a is an image that moves in a direction toward object 16. Note that in the example shown in Fig. 2A, staged image 18a is displayed only on a portion of display surface 20, and the display range of staged image 18a is indicated by a dashed line.

[0049] In the example shown in Fig. 2B, staged image 18b is an image that depicts a scene of snowflakes falling towards object 16, and is an image in which an image resembling snowflakes moves from the top to the bottom of window 6. That is, in the example shown in Fig. 2B, staged image 18b is an image that moves in a direction towards object 16. Note that in the example shown in Fig. 2B, staged image 18b is displayed on only a portion of display surface 20, and the display range of staged image 18b is indicated by a dashed line.

[0050] In the example shown in FIG. 2C, the staged image 18c is an image expressing a scene of a crescent moon floating in the sky, and is an image in which an image imitating a crescent moon is displayed near the upper part of the window 6. Since the image of the crescent moon is semi-transparent, the user can view the object 16 and the outdoor scenery through the window 6 through the area of ​​the display surface 20 other than the image of the crescent moon. In the example shown in FIG. 2C, the staged image 18c is displayed only on a part of the display surface 20, and the display range of the staged image 18c is indicated by a dashed line. The image of the crescent moon may be stationary at a predetermined position on the display surface 20, or may move on the display surface 20 over time. Alternatively, the staged image 18c may be an image of the moon waxing and waning over time.

[0051] The produced image 18 is not limited to the examples shown in Figures 2A to 2C, and may be, for example, a) an image in which stars or shooting stars in the night sky are represented by multiple particles of light, b) an image in which small bubbles such as those in champagne or sparkling wine are represented by multiple particles of light and the inside of the bubbles can be seen through, or c) an image in which sand falling inside an hourglass is represented by multiple particles of light and the parts other than the sand can be seen through.

[0052] The produced image 18 may also be an animation image. Specifically, the produced image 18 may be, for example, an animation image expressing snowflakes dancing, in which only the outlines of the snowflakes are expressed by light particles or lines, and the other parts are transparent and visible. The produced image 18 may also be an animation image according to the season. Specifically, the produced image 18 may be, for example, a) an image of Santa Claus riding a sleigh and an image of a reindeer in the Christmas season, or b) an image of a pumpkin and an image of a ghost in the Halloween season. It is preferable that the above-mentioned produced image 18 is an image in which only the outline of a main image is displayed and the other parts are transparent and visible, rather than an image displayed in the entire display surface 20 of the window 6.

[0053] Moreover, the staged image 18 does not necessarily have to be an image displayed in only one color, but may be an image displayed in multiple colors. Also, the staged image 18 may be an image that displays decorative characters or figures, such as a neon sign.

[0054] The presentation image 18 may be any image that can produce spatial effects, and does not need to be an image that displays functional content such as a clock or weather forecast. By displaying the presentation image 18 specialized for producing spatial effects on the display surface 20 of the window 6, users who are exhausted by the flood of information in their daily lives can be relaxed.

[0055] On the other hand, for a user who prefers functional usage, the produced image 18 may include an image displaying functional content such as a clock or a weather forecast. Alternatively, the produced image 18 may include an image for notifying the user of a predetermined event. Specifically, in a case where the smart window device 2 is installed between a kitchen and a living room (or a hallway), for example, when a user leaves the kitchen while cooking in the kitchen, the produced image 18 including an image reminiscent of a flame may be displayed on the display surface 20 of the window 6. This makes it possible to notify the user that, for example, a cooking utensil is overheated.

[0056] [1-2. Functional configuration of smart window device] Next, a functional configuration of the smart window device 2 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing a functional configuration of the smart window device 2 according to the first embodiment.

[0057] As shown in FIG. 3, the smart window device 2 includes, as its functional components, a window 6, a sensor 22, a request receiving unit 24, a data acquiring unit 26, and a control unit 28.

[0058] As described above, the window 6 functions, for example, as a transparent exterior window, and also functions as a transparent display panel for displaying the staged image 18. As the window 6 has already been described, a detailed description thereof will be omitted here.

[0059] The sensor 22 is a sensor for detecting an object 16 placed on the lower wall portion 10. Although not shown in Fig. 1, the sensor 22 is disposed, for example, on the upper wall portion 8 of the frame body 4. Note that the sensor 22 is not limited to being disposed on the upper wall portion 8, and may be disposed, for example, on any of the lower wall portion 10, the left side wall portion 12, and the right side wall portion 14 of the frame body 4.

[0060] The sensor 22 is, for example, a camera sensor having an imaging element. The sensor 22 captures an image of the object 16 placed on the lower wall portion 10, and outputs image data indicating the captured image of the object 16 to the control unit 28. The sensor 22 may have an infrared sensor in addition to the imaging element. The sensor 22 does not need to be installed in the frame body 4. In this case, the object 16 may be detected using a device other than the smart window device 2, for example, a camera sensor of a smartphone owned by a user, and the smart window device 2 may receive information detected by the camera sensor from the smartphone via a network.

[0061] The request receiving unit 24 is a switch for receiving a request from a user to stop or change the display of the staged video 18. The request receiving unit 24 is configured, for example, with a physical switch or a GUI (Graphical User Interface). Although not shown in FIG. 1, the request receiving unit 24 is disposed, for example, on the upper wall portion 8 of the frame 4.

[0062] When the user wishes to stop the display of the produced video 18 on the display surface 20 of the window 6, the user operates the request receiving unit 24 to issue a request to stop the display of the produced video 18. When the user wishes to change the produced video 18 displayed on the display surface 20 of the window 6 to another produced video 18, the user operates the request receiving unit 24 to issue a request to change the display of the produced video 18. The request receiving unit 24 outputs information indicating the received stop request or change request to each of the data acquisition unit 26 and the control unit 28.

[0063] In the present embodiment, the sensor 22 and the request receiving unit 24 are configured separately, but the present invention is not limited to this, and the sensor 22 may also have the function of the request receiving unit 24. That is, the sensor 22 as the request receiving unit 24 may receive a stop request or a change request based on the captured user's movement. Specifically, the sensor 22 as the request receiving unit 24 receives a stop request, for example, when the user moves the position of the object 16 on the lower wall portion 10. Also, the sensor 22 as the request receiving unit 24 receives a change request, for example, when the user rotates the object 16 around the vertical direction (Z-axis direction) on the lower wall portion 10. At this time, the user does not necessarily need to rotate the object 16 around the vertical direction 360°, and may rotate it by any rotation angle, such as 45° or 90°. Also, the number of times or the speed of change of the performance image 18 may be controlled to be changed according to the rotation angle at which the user rotates the object 16.

[0064] The data acquisition unit 26 acquires produced video data indicating the produced video 18 reflecting the learned user preferences, to be displayed on the display surface 20 of the window 6. At this time, the data acquisition unit 26 acquires the produced video data indicating the produced video 18 reflecting the learned user preferences, from a plurality of produced video data stored in advance in a memory (not shown). The produced video data acquired by the data acquisition unit 26 is associated with the type of object 16 identified by the control unit 28. The data acquisition unit 26 may download a video hit in a search on a network (not shown) as produced video data and store it in advance in the memory.

[0065] Furthermore, the data acquisition unit 26 learns the user's preferences based on the length of time from when the display of the performance video 18 starts until the request reception unit 24 receives a stop request or a change request, and on the type of object 16 identified by the control unit 28. The method of learning the user's preferences by the data acquisition unit 26 will be described later.

[0066] The control unit 28 controls the display of the staged image 18 on the display surface 20 of the window 6. Specifically, when the sensor 22 detects the object 16, the control unit 28 determines the type of the object 16 based on the image data from the sensor 22 (i.e., the detection result of the sensor 22). At this time, the control unit 28 determines the type of the object 16 by collating the image data from the sensor 22 with image data previously stored in a memory (not shown). In the example shown in FIG. 1, the control unit 28 determines the type of the object 16 as a "foliage plant" based on the detection result of the sensor 22. The control unit 28 may transmit the image data from the sensor 22 to a network and determine the type of the object 16 through the network. This can reduce the processing load of the control unit 28 and save memory capacity.

[0067] Furthermore, the control unit 28 selects a performance image 18 (first performance image) to be displayed on the display surface 20 of the window 6 from the performance image data acquired by the data acquisition unit 26 based on the type of the identified object 16. Specifically, the control unit 28 selects a performance image 18 including an image that matches the type of the identified object 16 from the performance image data acquired by the data acquisition unit 26. That is, the performance image 18 selected by the control unit 28 is a performance image that reflects the user's preferences learned by the data acquisition unit 26 and is associated with the type of the identified object 16. The control unit 28 causes the selected performance image 18 to be displayed on the display surface 20 of the window 6.

[0068] Furthermore, when the request receiving unit 24 receives a stop request, the control unit 28 stops the display of the production image 18 (first production image) currently being displayed on the display surface 20 of the window 6.

[0069] Furthermore, when the request receiving unit 24 receives a change request, the control unit 28 selects another produced image 18 (a second produced image) different from the produced image 18 (a first produced image) currently displayed on the display surface 20 of the window 6 from the produced image data acquired by the data acquiring unit 26. Specifically, the control unit 28 selects another produced image 18 including an image that matches the type of the determined object 16 from the produced image data acquired by the data acquiring unit 26. That is, the other produced image 18 selected by the control unit 28 is a produced image that reflects the user's preferences learned by the data acquiring unit 26 and is associated with the type of the determined object 16. The control unit 28 causes the selected other produced image 18 to be displayed on the display surface 20 of the window 6.

[0070] In addition, the control unit 28 may select another performance video 18 from a plurality of performance video data that have been downloaded in advance from the network, or may select another performance video 18 from performance video data indicating videos that have been hit by the data acquisition unit 26 in a second search on the network.

[0071] [1-3. Operation of smart window device] Next, the operation of the smart window device 2 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of the operation of the smart window device 2 according to the first embodiment.

[0072] 4, when a user places an object 16 (e.g., a foliage plant) on the lower wall portion 10 of the frame body 4, the sensor 22 detects the object 16 placed on the lower wall portion 10 (S101). The sensor 22 outputs image data indicating the captured image of the object 16 to the control unit 28.

[0073] The control unit 28 determines the type of the object 16 based on the image data from the sensor 22 (S102). The control unit 28 selects a staged image 18 (first staged image) to be displayed on the display surface 20 of the window 6 from the staged image data acquired by the data acquisition unit 26 based on the determined type of the object 16 (S103). For example, as shown in FIG. 2A described above, the control unit 28 selects staged image 18a, which is an image expressing a scene in which snow is falling toward the object 16, as a staged image 18 that matches the type of the object 16, "foliage plant." The control unit 28 causes the selected staged image 18 to be displayed on the display surface 20 of the window 6 (S104).

[0074] When the request receiving unit 24 receives a stop request (YES in S105), the control unit 28 stops the display of the performance image 18 currently being displayed on the display surface 20 of the window 6 (S106).

[0075] On the other hand, when the request receiving unit 24 does not receive a stop request (NO in S105) but receives a change request (YES in S107), the control unit 28 selects another produced image 18 (a second produced image) different from the produced image 18 currently displayed on the display surface 20 of the window 6 from the produced image data acquired by the data acquisition unit 26 (S108). For example, as shown in FIG. 2B described above, the control unit 28 selects, as the other produced image 18, produced image 18b, which is an image expressing a scene of snowflakes falling toward the object 16. The control unit 28 causes the selected other produced image 18 to be displayed on the display surface 20 of the window 6 (S109).

[0076] Returning to step S107, if the request receiving unit 24 does not receive a change request (NO in S107), the process returns to step S105 described above.

[0077] Here, an example of a method for learning user preferences by the data acquiring unit 26 according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of a method for learning user preferences by the data acquiring unit 26 according to the first embodiment.

[0078] As shown in FIG. 5, the control unit 28 causes the performance image 18 to be displayed on the display surface 20 of the window 6 (S201), and thereafter the request receiving unit 24 receives a stop request or a change request (S202).

[0079] When the request receiving unit 24 receives a stop request, and the time from the start of displaying the produced video 18 to the reception of the stop request is equal to or less than a first threshold value (e.g., 5 seconds) (YES in S203), the data acquiring unit 26 learns that the user is not in a mode (mood) to enjoy the produced video 18 (S204). In this case, the control unit 28 stops the display of the produced video 18, and the data acquiring unit 26 does not acquire the produced video data to be displayed next time. This makes it possible to avoid giving unnecessary stress to a user who is not in a mode to enjoy the produced video 18.

[0080] Returning to step S203, when the request receiving unit 24 receives a change request, if the time from the start of displaying the produced video 18 to the reception of the change request is equal to or less than the second threshold (for example, 5 seconds) (NO in S203, YES in S205), the data acquiring unit 26 learns that the produced video 18 currently displayed on the display surface 20 of the window 6 is not to the user's liking (S206). Note that, when the request receiving unit 24 receives a change request multiple times in succession, the second threshold may be increased each time the number of times the change request is received increases. This is because, although it is clear that the user is requesting the display of another produced video 18, it is considered that the user is searching for a produced video 18 in the strike zone while trying similar types of produced video 18, so that the produced video 18 is highly likely to match the user's taste, and the user's taste can be learned more accurately.

[0081] Returning to step S203, if the request receiving unit 24 receives a change request and the time from the start of the display of the performance image 18 to the reception of the change request exceeds a third threshold (e.g., 5 minutes) that is longer than the second threshold (NO in S203, NO in S205, YES in S207), the data acquisition unit 26 learns that the performance image 18 currently being displayed on the display surface 20 of the window 6 is the user's preference (S208).

[0082] Returning to step S203, if the request receiving unit 24 receives a change request and the time from the start of displaying the performance image 18 to the reception of the change request exceeds the second threshold and is equal to or less than the third threshold (NO in S203, NO in S205, NO in S207), it is difficult to determine whether the performance image 18 currently being displayed on the display surface 20 of the window 6 is to the user's liking, so the data acquisition unit 26 terminates the processing without learning the user's preferences.

[0083] In this manner, each time the number of times the user uses the smart window device 2 increases, the data acquisition unit 26 accumulates the learning results of the user's preferences.

[0084] [1-4. Effects] As described above, the data acquisition unit 26 acquires the produced video data indicating the produced video 18 that reflects the user's preferences, learned based on the length of time from when the display of the produced video 18 starts until the request receiving unit 24 receives a stop request or a change request, and the type of object 16. In addition, the control unit 28 selects the produced video 18 to be displayed on the display surface 20 of the window 6 from the produced video data, based on the determined type of object 16, and causes the selected produced video 18 to be displayed on the display surface 20 of the window 6.

[0085] As a result, the produced image 18 displayed on the display surface 20 of the window 6 reflects the user's preferences, so that it is possible to produce a space according to the user's preferences.

[0086] Furthermore, when the request receiving unit 24 receives a change request, the control unit 28 selects another performance image 18 from the performance image data, which is different from the above-mentioned performance image 18 to be displayed on the display surface 20 of the window 6, and displays the selected other performance image 18 on the display surface 20 of the window 6.

[0087] As a result, even if the user requests a change in the display of the staged video 18, another staged video 18 that reflects the user's preferences can be displayed on the display surface 20 of the window 6, making it possible to stage a space according to the user's preferences.

[0088] (Embodiment 2) [2-1. Structure of smart window display] The structure of a smart window device 2A according to embodiment 2 will be described with reference to Fig. 6. Fig. 6 is a perspective view showing a smart window device 2A according to embodiment 2. Note that in this embodiment, the same components as those in embodiment 1 above are denoted by the same reference numerals, and the description thereof will be omitted.

[0089] 6, the smart window device 2A according to the second embodiment includes a light source 30 in addition to the components described in the first embodiment. The light source 30 is, for example, a light-emitting diode, and is disposed on the upper wall portion 8 of the frame body 4. The light source 30 illuminates an object 16A placed on the lower wall portion 10, and also illuminates a performance image 18 (18A) displayed on a display surface 20 of the window 6.

[0090] In the example shown in Fig. 6, object 16A is a photo frame. Moreover, staged image 18A is an image expressing a scene of stars falling toward object 16A, and is an image in which an image imitating stars moves from the top to the bottom of window 6. That is, in the example shown in Fig. 6, staged image 18A is an image that moves in a direction toward object 16A. Note that, in the example shown in Fig. 6A, staged image 18A is displayed only on a portion of display surface 20, and the display range of staged image 18A is indicated by a dashed line.

[0091] [2-2. Functional configuration of smart window system] Next, the functional configuration of the smart window system 32 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of the smart window system 32 according to the second embodiment.

[0092] 7, the above-mentioned smart window device 2A is incorporated into a smart window system 32. The smart window system 32 includes the smart window device 2A, a content server 34, and a manager 36. Each of the smart window device 2A, the content server 34, and the manager 36 is connected to a network 38 such as the Internet.

[0093] The data acquisition unit 26A of the smart window device 2A is connected to a network 38, and transmits and receives various data between the content server 34 and the manager 36 via the network 38. Specifically, the data acquisition unit 26A acquires, from the content server 34 via the network 38, performance video data showing the performance video 18 reflecting the user preferences learned by the manager 36. That is, unlike the above-mentioned embodiment 1, the data acquisition unit 26A does not learn the user preferences by itself. Also, the control unit 28A of the smart window device 2A controls the lighting of the light source 30. Each of the request reception unit 24, the data acquisition unit 26A, and the control unit 28A of the smart window device 2A functions as a processor.

[0094] The content server 34 is a server for delivering the performance video data to the smart window device 2A, and is, for example, a cloud server. The content server 34 includes a processor 40, a communication unit 42, and a performance video database 44. The processor 40 executes various processes for controlling the content server 34. The communication unit 42 transmits and receives various data between the smart window device 2A and the manager 36 via the network 38. The performance video database 44 stores a plurality of performance video data showing the performance video 18 that reflects the user preferences learned by the manager 36.

[0095] The manager 36 is a server for learning user preferences. The manager 36 includes a processor 46, a communication unit 48, and a user database 50. The processor 46 executes various processes for controlling the manager 36. The communication unit 48 transmits and receives various data between the smart window device 2A and the content server 34 via the network 38. The user database 50 stores data related to users who use the smart window device 2A.

[0096] [2-3. Operation of smart window system] Next, the operation of the smart window system 32 according to the second embodiment will be described with reference to Fig. 8. Fig. 8 is a sequence diagram showing the flow of the operation of the smart window system 32 according to the second embodiment.

[0097] 8, when a user places an object 16A (e.g., a photo frame) on the lower wall portion 10 of the frame body 4, the sensor 22 of the smart window device 2A detects the object 16A placed on the lower wall portion 10 (S301). The sensor 22 outputs image data indicating the captured image of the object 16A to the control unit 28A.

[0098] The control unit 28A of the smart window device 2A determines the type of the object 16A based on the image data from the sensor 22 (S302). The data acquisition unit 26A of the smart window device 2A transmits object information indicating the type of the object 16A determined by the control unit 28A to the manager 36 via the network 38 (S303).

[0099] The communication unit 48 of the manager 36 receives the object information from the smart window device 2A (S304) and stores the received object information in the user database 50 (S305). The user database 50 stores a data table in which identification information for identifying a user is associated with the received object information.

[0100] Based on the received object information, the processor 46 of the manager 36 selects a produced image 18 (first produced image) to be displayed on the display surface 20 of the window 6 from among a plurality of produced image data stored in the produced image database 44 of the content server 34 (S306). For example, as shown in FIG. 6 described above, the processor 46 selects the produced image 18A, which is an image expressing a scene in which stars are falling toward the object 16A, as the produced image 18 that matches the type of object 16A, "photo frame." The communication unit 48 of the manager 36 transmits a distribution instruction signal to the content server 34 via the network 38 to instruct the distribution of the produced image data showing the selected produced image 18 (S307).

[0101] The communication unit 42 of the content server 34 distributes (transmits) the produced video data indicating the produced video 18 selected by the manager 36 to the smart window device 2A via the network 38 based on the distribution instruction signal from the manager 36 (S308).

[0102] The data acquisition unit 26A of the smart window device 2A acquires (receives) the performance video data from the content server 34 (S309). The control unit 28A of the smart window device 2A selects the performance video 18 indicated by the acquired performance video data, and displays the selected performance video 18 on the display surface 20 of the window 6 (S310). In other words, the performance video 18 selected by the control unit 28A is a performance video that reflects the user's preferences learned by the manager 36 and is associated with the type of the identified object 16A.

[0103] The following describes a case where the request receiving unit 24 of the smart window device 2A receives a change request. When the request receiving unit 24 receives a change request (S311), the data acquisition unit 26A of the smart window device 2A transmits a change request signal to the manager 36 via the network 38 (S312).

[0104] The communication unit 48 of the manager 36 receives a change request signal from the smart window device 2A (S313). The processor 46 of the manager 36 selects another production video 18 (a second production video) different from the production video 18 currently displayed on the display surface 20 of the window 6 from among a plurality of production video data stored in the production video database 44 of the content server 34 based on the received change request signal (S314). At this time, the processor 46 learns the user's preferences in the same manner as described in the flowchart of FIG. 5 in the above-mentioned first embodiment.

[0105] The communication unit 48 of the manager 36 transmits a distribution instruction signal to the content server 34 via the network 38, instructing the content server 34 to distribute the production video data showing the selected other production video 18 (S315).

[0106] Based on a distribution instruction signal from the manager 36, the communication unit 42 of the content server 34 distributes (transmits) other production video data indicating other production videos 18 selected by the manager 36 to the smart window device 2A via the network 38 (S316).

[0107] The data acquisition unit 26A of the smart window device 2A acquires (receives) other performance video data from the content server 34 (S317). The control unit 28A of the smart window device 2A selects the other performance video 18 indicated by the acquired other performance video data, and displays the selected other performance video 18 on the display surface 20 of the window 6 (S318). In other words, the other performance video 18 selected by the control unit 28A is a performance video that reflects the user's preferences learned by the manager 36 and is associated with the type of the identified object 16A.

[0108] Incidentally, the operation of the smart window device 2A when the request receiving unit 24 receives a stop request is the same as that in the above-mentioned first embodiment, and therefore a description thereof will be omitted.

[0109] [2-4. Effects] As described above, in this embodiment, the manager 36 learns the preferences of the user, so that the processing load of the smart window device 2A can be reduced.

[0110] (Other variations) Although the smart window device and the image display method according to one or more aspects have been described based on the above-mentioned embodiments, the present disclosure is not limited to the above-mentioned embodiments. As long as it does not deviate from the spirit of the present disclosure, various modifications conceived by a person skilled in the art to the embodiments and forms constructed by combining components of different embodiments may also be included within the scope of one or more aspects.

[0111] In the above embodiments, the window 6 is described as an interior window, but the present invention is not limited to this and may be, for example, a transparent exterior window installed in an opening formed in the exterior wall of a building, or a partition window that divides a room in a building into multiple spaces. Also, the window 6 may be, for example, a window provided with a decorative shelf or the like, or a lattice window divided into multiple lattice-like spaces.

[0112] In each of the above embodiments, the object 16 (16A) is placed in a position facing the back side of the window 6, but this is not limited to this. For example, the object 16 (16A) may be placed in a position near the bottom of the window 6 facing the front side (inside the room) of the window 6, or may be placed in any position near the window 6.

[0113] In each of the above embodiments, the sensor 22 is configured to capture an image of the object 16 (16A), but this is not limited thereto, and the sensor 22 may be configured to optically read a barcode printed or affixed to the surface of the object 16. This barcode includes identification information for identifying the type of the object 16. In this case, the control unit 28 (28A) determines the type of the object 16 (16A) based on the identification information included in the barcode read by the sensor 22.

[0114] In each of the above embodiments, the control unit 28 (28A) displays the staged image 18 on a portion of the display surface 20 of the window 6, but this is not limiting and the staged image 18 may be displayed on the entire display surface 20.

[0115] Furthermore, the data acquisition unit 26 (26A) may acquire user information indicating the user's schedule and / or the user's operation history of a device (e.g., a home appliance or a mobile device) from the network. In this case, the control unit 28 (28A) may predict the time when the user will enter the room in which the window 6 is installed based on the user information, and start displaying the produced video 18 a first time (e.g., 5 minutes) before the predicted time.

[0116] Furthermore, the sensor 22 may detect whether or not a user is present in the room in which the window 6 is installed. In this case, the control unit 28 (28A) may stop displaying the produced video 18 after a second time period (e.g., one minute) has elapsed since the sensor 22 detected that the user is no longer present in the room.

[0117] Furthermore, the sensor 22 may detect the illuminance in the vicinity of the window 6. In this case, the control unit 28 (28A) may adjust the luminance when the staged image 18 is displayed on the display surface 20 of the window 6, based on the illuminance detected by the sensor 22. For example, when the illuminance detected by the sensor 22 is relatively high, the control unit 28 (28A) adjusts the luminance when the staged image 18 is displayed on the display surface 20 of the window 6 to be relatively high, and when the illuminance detected by the sensor 22 is relatively low, the control unit 28 (28A) adjusts the luminance when the staged image 18 is displayed on the display surface 20 of the window 6 to be relatively low.

[0118] In addition, the user's preferences may be learned based on the operation history of the smart window device 2 (2A) by the user. Specifically, the user may register his / her preferences in advance by operating the smart window device 2 (2A). Alternatively, the user's preferences may be learned based on the operation history of other devices (e.g., home appliances or mobile devices) other than the smart window device 2 (2A). Specifically, for example, if the user frequently views images of a starry sky on a smartphone, it may be learned that the user prefers a produced video 18 that depicts a starry sky.

[0119] Furthermore, the control unit 28 (28A) may obtain situation data indicating the situation of the room in which the window 6 is installed, and select from the staged video data a staged video 18 that corresponds to the situation of the room indicated by the situation data. Specifically, for example, when the situation of the room indicated by the situation data is a situation in which "a large number of people are in the room," the control unit 28 (28A) selects a flashy staged video 18. On the other hand, when the situation of the room indicated by the situation data is a situation in which "one person is in the room," the control unit 28 (28A) selects a calm staged video 18.

[0120] Furthermore, when the sensor 22 detects a plurality of objects 16 (16A), the control unit 28 (28A) may select only one object 16 (16A) suitable for the performance image 18 from among the plurality of objects 16 (16A). For example, when the sensor 22 detects three objects, i.e., a key, a wallet, and a Christmas tree, the control unit 28 (28A) selects the most decorative Christmas tree from among these three objects. This makes it possible to avoid displaying miscellaneous performance images 18 (i.e., performance images 18 related to keys or a wallet) that are unlikely to contribute to the performance of the space on the display surface 20 of the window 6.

[0121] When the sensor 22 detects a plurality of objects 16 (16A), a possible method for determining the decorativeness of the plurality of objects 16 (16A) is to have the control unit 28 (28A) distinguish the types of the plurality of objects 16 (16A) and exclude objects with high practicality (e.g., keys and wallets). Alternatively, a possible method is to search for performance video data on a network based on the distinguished types of the plurality of objects 16 (16A) and select an object associated with the performance video data with the strongest celebratory mood from the search results.

[0122] In the above embodiment, each component may be realized by a dedicated hardware or by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0123] Furthermore, some or all of the functions of the smart window device according to the above-described embodiment may be realized by a processor such as a CPU executing a program.

[0124] Some or all of the components constituting each of the above devices may be composed of an IC card or a standalone module that can be attached to each device. The IC card or the module is a computer system composed of a microprocessor, ROM, RAM, etc. The IC card or the module may include the above-mentioned ultra-multifunction LSI. The microprocessor operates according to a computer program, causing the IC card or the module to achieve its functions. The IC card or the module may be tamper-resistant.

[0125] The present disclosure may be the above-mentioned method. It may also be a computer program for implementing these methods by a computer, or a digital signal consisting of the computer program. The present disclosure may also be a computer program or a digital signal recorded on a computer-readable non-transitory recording medium, such as a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, or the like. It may also be the digital signal recorded on these recording media. The present disclosure may also be a computer program or a digital signal transmitted via a telecommunications line, a wireless or wired communication line, a network such as the Internet, data broadcasting, or the like. The present disclosure may also be a computer system having a microprocessor and a memory, in which the memory stores the computer program, and the microprocessor operates according to the computer program. It may also be implemented by another independent computer system by recording the program or the digital signal on the recording medium and transferring it, or by transferring the program or the digital signal via the network, or the like. [Industrial Applicability]

[0126] The present disclosure is useful, for example, in smart window devices for creating a spatial effect. [Explanation of symbols]

[0127] 2,2A Smart window device 4 Frame 6. Windows 8 Upper wall 10 Lower wall part 12 Left side wall 14 Right side wall 16,16A Object 18, 18a, 18b, 18c, 18A Production video 20 Display surface 22 Sensors 24 Request Reception Department 26,26A Data acquisition section 28, 28A Control section 30 light source 32 Smart Window System 34 Content Server 36 Manager 38 Network 40,46 processor 42,48 Communications Department 44 Production video database 50 User Database

Claims

1. A transparent window having a display surface for displaying a performance image, the window being visible through one side of the display surface to the other side while the performance image is being displayed on the display surface; a request receiving unit that receives a request from a user to stop or change the display of the production video; a data acquisition unit that acquires performance image data showing the performance image that reflects the user's preferences, the data being learned based on a length of time from when the display of the performance image starts until the request acceptance unit accepts the stop request or the change request and on a type of object located near the window; a sensor for detecting the object; (i) a control unit that, when the sensor detects the object, determines the type of the object from the detection result of the sensor, selects a first performance video to be displayed on the display surface from the performance video data based on the determined type of the object, and displays the first performance video on at least a portion of the display surface; (ii) stops the display of the first performance video if the request receiving unit receives the stop request; and (iii) selects a second performance video different from the first performance video to be displayed on the display surface from the performance video data if the request receiving unit receives the change request, and displays the second performance video on at least a portion of the display surface. The object is installed in a position where the user can see it through the window. A smart window device for spatial design.

2. The window is any one of an exterior window installed in an opening formed in the exterior wall of a building, an interior window installed between two adjacent rooms in the building, and a partition window that divides one room in the building into multiple spaces. The smart window device for spatial presentation according to claim 1.

3. At least one of the first and second staged images includes an image in which a plurality of light particles move from the top to the bottom of the window. The smart window device for spatial presentation according to claim 1 or 2.

4. The control unit displays the first effect image and the second effect image on at least a part of the display surface such that the motion directions of the first effect image and the second effect image are directed toward the object. The smart window device for spatial presentation according to any one of claims 1 to 3.

5. The data acquisition unit is connected to a network and acquires the performance video data from the network. The smart window device for spatial presentation according to any one of claims 1 to 4.

6. The data acquisition unit further acquires user information indicating a schedule of the user and / or an operation history of a device by the user from the network; The control unit predicts a time when the user will enter a room in which the window is installed, based on the user information, and starts displaying the first production video a first time before the predicted time. The smart window device for spatial presentation according to claim 5.

7. The sensor further detects whether the user is present in a room in which the window is installed; The control unit stops displaying the first production image or the second production image after a second time has elapsed since the sensor detected that the user was no longer present in the room. The smart window device for spatial presentation according to any one of claims 1 to 6.

8. The sensor further detects an illuminance near the window; The control unit adjusts the luminance when the first performance image or the second performance image is displayed on the window based on the illuminance detected by the sensor. The smart window device for spatial presentation according to any one of claims 1 to 7.

9. The window is a transmissive transparent display made up of any one of a transparent inorganic electroluminescence (EL), a transparent organic electroluminescence (EL), and a transmissive liquid crystal display. The smart window device for spatial presentation according to any one of claims 1 to 8.

10. The user's preferences are further learned based on the user's operation history of the smart window device or the operation history of other devices other than the smart window device. The smart window device for spatial presentation according to any one of claims 1 to 9.

11. The control unit acquires situation data indicating a situation of a room in which the window is installed, and selects, from the performance image data, the first performance image or the second performance image corresponding to the situation of the room indicated by the situation data. The smart window device for spatial presentation according to any one of claims 1 to 10.

12. A method for displaying images for spatial presentation in a smart window system including a transparent window having a display surface for displaying a presentation image and a processor, the window is visible through one side of the display surface to the other side while the staged image is being displayed on the display surface; Detecting an object located near the window using a sensor and installed in a position that is visible to a user through the window; The processor, receiving a request to stop or change the display of the produced video from the user; acquiring performance image data showing the performance image reflecting the user's preferences, which is learned based on the length of time from when the display of the performance image starts to when the stop request or the change request is received and the type of the object; When the sensor detects the object, a type of the object is determined from a detection result of the sensor, a first effect image to be displayed on the display surface is selected from the effect image data based on the determined type of the object, and the first effect image is displayed on at least a part of the display surface; When the request to stop displaying the effected video is received from the user, the display of the first effected video is stopped; When the request to change the display of the production image is received from the user, a second production image different from the first production image to be displayed on the display surface is selected from the production image data, and the second production image is displayed on at least a part of the display surface. A method for displaying video for spatial presentation.

13. A method for causing a computer to execute the image display method for spatial presentation according to claim 12. program.

Images