Space aggregation, aggregation of display medium, server, video image provision method, and program
The space set with synchronized image display across multiple spaces addresses the challenge of connecting diverse environments, facilitating collaboration and communication by using user information and selection conditions to create an immersive and coordinated experience.
Patent Information
- Application Number
- JP2023111364
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-07-06
- Publication Date
- 2025-01-20
AI Technical Summary
Existing technologies fail to provide a space set that is organically connected by images across multiple spaces, hindering collaboration and communication among individuals with different brain types or environments.
A space set comprising two or more spaces, each equipped with display media, where images are organically connected through user information, selection conditions, and synchronized video playback to facilitate collaboration and communication among users moving between spaces.
Enhances collaboration and communication among individuals with different backgrounds by providing a seamless and immersive experience across multiple spaces, allowing for coordinated work and discussion through synchronized and contextually relevant image display.
Smart Images

Figure 2025008824000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a spatial collection, which is two or more spaces organically connected by an image. [Background technology]
[0002] Conventionally, by decorating a room with paintings, a space where multiple people can relax and talk has been provided (see Non-Patent Document 1). Also, by having paintings in each of the multiple spaces through which a person moves, the person can relax in each space. [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] "Enrich your soul with a single painting ☆ Tips for creating an artistic space", [Retrieved May 20, 2023], Internet [URL: https: / / roomclip.jp / mag / archives / 52852] Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the past, it was not possible to provide a spatial collection, which is two or more spaces that are organically connected by images. [Means for solving the problem]
[0005] The spatial collection of the first invention is a spatial collection of at least two spaces, including a first space and a second space which exist in different locations, each of the two spaces being equipped with one or more display media for displaying images, and the two spaces being organically connected.
[0006] This configuration makes it possible to provide a spatial collection, which is two or more spaces that are organically linked by images.
[0007] In addition, in contrast to the first invention, the spatial collection of the second invention is a spatial collection in which a first space and a second space are organically connected, a second image displayed on a second display medium in the second space is an image related to the first image displayed on a first display medium in the first space, and the second image is an image selected using user information regarding a user present in the second space.
[0008] This configuration makes it possible to provide a spatial collection, which is two or more spaces that are organically linked by images.
[0009] Furthermore, the spatial set of the third invention is a spatial set in which, compared to the second invention, each of the two or more videos corresponds to a selection condition that is a condition under which the video is selected, the user information includes a first video identifier that identifies a first video viewed by the user or a first spatial identifier that identifies the first space, and the second video is a video that corresponds to the selection condition satisfied by the first video identifier possessed by the user information or the first spatial identifier possessed by the user information.
[0010] With this configuration, it is possible to provide a user moving between at least two spaces, with the at least two spaces being organically linked by images.
[0011] Furthermore, the spatial set of the fourth invention is a spatial set in which, compared to the third invention, the selection condition includes a viewing time condition which is a condition related to viewing time information which specifies the time when the video or another video was viewed, the user information includes viewing time information which specifies the time when the user viewed the first video, and the second video is a video selected using the first video identifier or the first spatial identifier when it satisfies the viewing time condition that the viewing time information held by the user information is information indicating a time within a predetermined period of time compared to the time when the second video is selected.
[0012] With this configuration, it is possible to more appropriately provide a user moving between at least two spaces with at least two spaces that are organically connected by images.
[0013] Furthermore, the spatial set of the fifth invention is a spatial set in which, compared to the third invention, the selection condition includes a user attribute value condition which is a condition related to one or more user attribute values of a user watching the video, the user information includes one or more user attribute values, and the second video is an video corresponding to a user attribute value condition satisfied by the one or more user attribute values possessed by the user information.
[0014] With this configuration, it is possible to more appropriately provide a user moving between at least two spaces with at least two spaces that are organically connected by images.
[0015] Furthermore, the spatial set of the sixth invention is a spatial set in which, compared to any one of the first to fifth inventions, the images displayed on the display media in each of the two spaces are the same image.
[0016] With this configuration, it is possible to provide a spatial collection of two spaces that are organically linked by displaying the same image in each of the two spaces.
[0017] In addition, the spatial set of the seventh invention is a spatial set in which, with respect to any one of the first to fifth inventions, at least two of the two or more images correspond to each other, and the images displayed on the display media in each of the two spaces are different images and correspond to each other.
[0018] With this configuration, it is possible to provide a spatial collection in which two spaces are organically linked by displaying different but related images in each of the two spaces.
[0019] In addition, the spatial set of the eighth invention, compared to any one of the first to fifth inventions, is a spatial set in which, in a first space and a second space, a first image viewed by a first user present in the first space on a first display medium provided in the first space and a second image viewed by a second user moving from the second space to the first space on a second display medium provided in the second space are identical or corresponding images, and the first image and the second image are images selected using schedule information specifying that the second user will join the first space in which the first user is present.
[0020] With this configuration, when a first user in one space is joined by another second user in another space, the video viewed by the first user in the one space and the video viewed by the second user in the other space can be controlled before the merging, thereby supporting collaborative work by two or more users after they have joined together in the one space.
[0021] Furthermore, the spatial set of the ninth invention is a spatial set in which, with respect to any one of the first to fifth inventions, the spatial set includes at least three spaces, a first space, a second space, and a third space, a first image viewed by a first user moving from the first space to the third space on a first display medium provided in the first space and a second image viewed by a second user moving from the second space to the third space on a second display medium provided in the second space are identical or corresponding images, and the first image and the second image are images selected using scheduled information specifying that the first user and the second user will meet in the third space from different spaces.
[0022] With this configuration, by controlling the images displayed in different spaces in which two or more users who join one space from another space exist, it is possible to support collaborative work by two or more users after they join one space.
[0023] Furthermore, the spatial set of the tenth invention is a spatial set in which, compared to any one of the first to fifth inventions, at least two spaces are different spaces in which at least two users who intend to communicate with each other exist, and a first image displayed by a first display medium in the first space and a second image displayed by a second display medium in the second space are images selected using reservation information indicating that two users will communicate.
[0024] With this configuration, by controlling the images displayed in different spaces in which two or more users who plan to communicate exist, it is possible to support cooperative work by two or more users during communication.
[0025] In addition, the spatial set of the eleventh invention is a spatial set in which processing conditions, which are conditions for performing specific processing for any one of the first to tenth inventions, are stored, and the specific processing is performed when the video identifier of a video previously viewed by a user present in the second space or the spatial identifier of a space in which the user was present satisfies the processing condition.
[0026] With this configuration, processing can be performed according to the video the user has viewed in the past or the space in which the user has been in the past.
[0027] The set of display media of the twelfth aspect of the present invention is a set of display media included in at least two spaces of the spatial set of any one of the first to eleventh aspects of the present invention.
[0028] This configuration makes it possible to provide a collection of display media for constructing a spatial collection, which is two or more spaces organically linked by images.
[0029] In addition, the server of the thirteenth invention is a server comprising: a server receiving unit that receives user information including a first video identifier that identifies a first video displayed on a first display medium provided in a first space of the at least two spaces and a user identifier of a user who viewed the first video; a server processing unit that selects a video that pairs with a selection condition satisfied by the user information from a video storage unit in which two or more videos that pair with the selection conditions are stored; and a server transmitting unit that transmits the video selected by the server processing unit to a second display medium provided in a second space in which the user is present.
[0030] This configuration can provide a platform for offering a spatial collection, which is two or more spaces organically linked by video. Effect of the Invention
[0031] According to the space collection of the present invention, it is possible to provide a space collection that is two or more spaces that are organically connected by an image. [Brief description of the drawings]
[0032] [Figure 1] Conceptual diagram of spatial system A in embodiment 1. [Diagram 2] Block diagram of the same space system A [Diagram 3] A diagram showing an example of the space 1 [Figure 4] A diagram showing an example of the space 1 [Diagram 5] A diagram showing an example of the space 1 [Figure 6] Block diagram of spatial system B in embodiment 2 [Figure 7] A diagram showing an example of the same space 3 [Figure 8] Block diagram of a video output device 5 according to a fourth embodiment. [Figure 9] A flowchart for explaining an example of the operation of the video output device 5. [Figure 10] A flowchart illustrating an example of the conversion process [Figure 11] A flowchart illustrating an example of the control information change process. [Figure 12] A diagram explaining the LUT [Figure 13] A diagram showing an example of the LUT structure. [Figure 14] FIG. 2 shows the control information management table. [Figure 15] FIG. 2 is a diagram for explaining an example of the operation of the video output device 5. [Figure 16] A diagram showing an example of the screen [Figure 17] FIG. 2 shows the control information management table. [Figure 18] FIG. 2 is a diagram for explaining an example of the operation of the video output device 5. [Figure 19] A diagram showing an example of the screen [Figure 20] FIG. 2 shows the control information management table. [Figure 21] FIG. 2 is a diagram for explaining an example of the operation of the video output device 5. [Figure 22] Block diagram of system C in embodiment 5. [Figure 23] Conceptual diagram of spatial system F in embodiment 7 [Figure 24]Block diagram of the same space system F [Diagram 25] A flowchart for explaining an example of the operation of the server 9 [Figure 26] A flowchart illustrating an example of the video selection process [Figure 27] A flowchart illustrating an example of the addition process. [Figure 28] Image of the spatial system F [Figure 29] A diagram showing the video management table [Diagram 30] A diagram showing the selection condition management table [Diagram 31] FIG. 2 shows the processing condition management table. [Diagram 32] FIG. 13 shows the user registration management table. [Diagram 33] FIG. 13 shows the viewing information management table. [Diagram 34] A diagram showing the schedule information management table [Diagram 35] A diagram showing the web conference information management table [Diagram 36] A diagram showing a specific example of operation in the spatial system F. [Figure 37] A diagram showing a specific example of operation in the spatial system F. [Figure 38] A diagram showing a specific example of operation in the spatial system F. [Figure 39] A diagram showing a specific example of operation in the spatial system F. [Diagram 40] Block diagram of the display medium 10 [Diagram 41] Overview of the computer system according to the above embodiment. [Diagram 42] Block diagram of the computer system DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0033] Hereinafter, embodiments of the space set and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.
[0034] (Embodiment 1) In this embodiment, a space that allows people with different brains to cooperate by reproducing a natural environment will be described. Note that people's brains are different depending on the environment in which they were raised and their past experiences, and as a result, it has not been easy for multiple people to cooperate in the past. Here, cooperation means, for example, each person bringing different values to the table to create new value. Cooperation also means, for example, each person working together to work together, and each person being able to communicate smoothly in discussions.
[0035] In this embodiment, a space having two or more display media will be described, in which each of the two or more display media displays an image of the same location or an image related to the same location. It is preferable that each of the two or more display media displays a different image according to the position of the display medium.
[0036] In the present embodiment, a space having three or more side walls, and at least one display medium on each of at least two or more side walls, will be described. However, it is preferable that the space has four side walls.
[0037] In the present embodiment, a space whose role changes by changing the image displayed on the display medium will be described. It is preferable that the image be changed automatically.
[0038] In this specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc.
[0039] 1 is a conceptual diagram of a spatial system A according to the present embodiment. The spatial system A includes one or more spaces 1 and a server 2.
[0040] In the space 1, there are one or more display media 11. In the space 1, there are usually two or more display media 11.
[0041] It is preferable that the space 1 has three or more side walls 12. It is preferable that the space 1 is a closed space. It is preferable that the space 1 has a ceiling. The space 1 may be a partially open space. A partially open space is, for example, a space with an open door or a space without a ceiling. The space 1 is, for example, a structure or a vehicle. A structure is an artificially created space. A structure is, for example, a house, a room, or a tent. A vehicle is something that transports people. A vehicle is, for example, a train, a car, or an airplane, but the type is not important.
[0042] Usually, one or more display media 11 are arranged on the side wall surfaces 12 of the space 1. It is preferable that one or more display media 11 are arranged on each of the two or more side wall surfaces 12 in the space 1. Note that, among the three or more side wall surfaces 12 in the space 1, there may be a side wall surface 12 on which a display medium 11 is not arranged.
[0043] The display medium 11 is a medium that displays an image. The display medium 11 is a device that displays an image. The display medium 11 is usually a display, but may also be a projector or an area onto which a projector projects an image. The display may be, for example, a liquid crystal display or an organic electroluminescence display, but the type is not important. In addition, it is preferable for the display medium to have a frame such as that in Design Registration No. 1648658.
[0044] The image here is usually a natural image. A natural image is an image acquired based on a natural environment. A natural image is an image that reproduces a natural environment. A natural image is, for example, a video of nature. An artificial object may be captured in the natural image. It is preferable that the natural image is an image that has been processed as in the fourth or fifth embodiment. Nature is, for example, a mountain, a forest, a lake, a pond, a river, or the sea.
[0045] It is preferable that the display medium 11 displays the video transmitted from the server 2, but it may also display the video originally stored in the display medium 11. The display medium 11 may also be called a display device. The display medium 11 receives the video from the server 2, for example. The display medium 11 stores the received video, for example, in the storage unit 111, at least temporarily. The display medium 11 may transmit an instruction to transmit the video to the server 2, and receive the video from the server 2 in response to the transmission instruction.
[0046] The server 2 is a device that supplies images to one or more display media 11. The server 2 is, for example, a cloud server or an ASP server, but the type is not important.
[0047] It is preferable that the server 2 and one or more display media 11 are capable of communicating with each other via a network such as the Internet.
[0048] 2 is a block diagram of a spatial system A in this embodiment. The spatial system A includes one or more spaces 1 and a server 2. The space 1 includes three or more side wall surfaces 12. One or more display media 11 are disposed on one or more of the three or more side wall surfaces 12. The display medium 11 includes, for example, a storage unit 111, a display unit 112, and a switching unit 113.
[0049] The server 2 includes a server storage unit 21, a server receiving unit 22, a server processing unit 23, and a server transmitting unit 24.
[0050] One or more videos are stored in the storage unit 111. It is preferable that the videos in the storage unit 111 are videos received from the server 2. It is preferable that the storage unit 111 stores videos of two or more locations.
[0051] It is preferable that two or more display media 11 are arranged on one or more side wall surfaces 12 of the space 1. It is also preferable that the two or more display media 11 are arranged at different positions. It is also preferable that the two or more display media 11 are the same size, but they may be different sizes. In other words, it is preferable that the areas in which images are displayed are the same size, but they may be different sizes. It is also preferable that the heights at which the two or more display media 11 are arranged are the same. By arranging the two or more display media 11 at the same height, the human brain can easily connect the images displayed by the two or more display media 11 and recognize one natural image.
[0052] It is preferable that the images displayed by the two or more display media 11 in the space 1 are images of the same location. The images displayed by the two or more display media 11 in the space 1 are, for example, images related to the same location. Images of the same location are images of the same natural scenery. Images related to the same location are, for example, images of nature and images of the local specialties of the location where the images were taken. Local specialties are, for example, the local specialty of the location, food that can be eaten at the location, events held at the location, activities that can be experienced at the location, buildings that exist at the location, etc.
[0053] It is preferable that the images displayed by the two or more display media 11 arranged at different positions in the space 1 are different images corresponding to the different positions of the two or more display media 11. The different images corresponding to the different positions of the two or more display media 11 are images of a part of an image of one location, and are images of an area corresponding to a different position of the display media 11. It is preferable that the different images corresponding to the different positions of the two or more display media 11 are, for example, partial images cut out from a wide-angle image of one location to an area corresponding to a different position of the display media 11. It is also preferable that the images are images actually taken in a direction corresponding to a different position of the display media 11 from one location. As a result, the brain of a person who sees the images displayed by the two or more display media 11 is misled into thinking that the area (e.g., a display) in which the image is displayed is a scene that spreads beyond the space (e.g., a room), and the person thinks that the nature of the location of the image spreads beyond the space. In other words, the human brain is misled into thinking that the space 1 in which a person who sees the images displayed by the two or more display media 11 is a space that exists in the location of the image. In other words, the brain of a person in the space 1 connects the images displayed on each of the two or more display media 11, creating the illusion that nature is spreading out beyond the walls between the two or more display media 11, and the person feels as if he or she is in that nature.
[0054] The position of the display medium 11 is preferably a position where a window is usually installed in the space 1. The position where the window is installed is, for example, a position where the bottom side of the display medium 11 is approximately 600 mm or more and less than approximately 1200 mm from the floor surface. The position where the window is installed is, for example, a position where, when a person of average sitting height sits on a sofa, the eye height of the person is the same height as any point in the area of the display medium 11.
[0055] In addition, it is preferable that each of the two or more display media 11 displays a natural image of a different partial area of a natural image at a certain location according to a different position of each display medium 11.
[0056] For example, the display medium 11 arranged on the left side of one side wall surface 12 displays a natural image of a left part of a natural image of a certain place, the display medium 11 arranged in the center of one side wall surface 12 displays a natural image of a central part of a natural image of a certain place, and the display medium 11 arranged on the right side of one side wall surface 12 displays a natural image of a right part of a natural image of a certain place. As a result, the brain of a person in the space 1 connects the natural image on the left display medium 11, the natural image on the central display medium 11, and the natural image on the right display medium 11 in their brain, giving the person the illusion that they are in that place.
[0057] For example, display medium 11(1) arranged on one side wall surface 12(1) and display medium 11(2) arranged on another side wall surface 12(2) that is perpendicular to the one side wall surface 12(1) each display images in different directions, which are images of a partial area of the nature of the place when viewed from a representative point in space 1 (for example, a point at the central position).
[0058] The display unit 112 displays an image of the storage unit 111. The display unit 112 is, for example, a display. The display unit 112 may project the image of the storage unit 111 onto the side wall surface 12. Such projection is also a display. In such a case, the display medium 11 may be a projector or may be the area of the side wall surface 12 onto which the image is projected. It is preferable that the color of the side wall surface 12 and the color of the display frame are the same color.
[0059] The switching unit 113 switches the image displayed by the display unit 112. The switching unit 113 switches an image of one location to an image of another location. It is preferable that the switching unit 113 switches an image of one location to an image of another location simultaneously in all of two or more display media 11.
[0060] It is preferable that the switching unit 113 switches the image displayed by the display unit 112 to another image when a switching condition is satisfied. The switching condition is, for example, that the same image has been displayed for a certain period of time or longer. The switching condition is, for example, that an instruction from a user has been accepted.
[0061] It is preferable that all of the two or more display media 11 switch the natural image displayed from one location to another location at the same timing by the switching unit 113. In other words, it is preferable that all of the two or more display media 11 change the natural image displayed in synchronization. This creates the illusion in the brain of a person in the space 1 that he or she has moved from one location to another.
[0062] The server storage unit 21 constituting the server 2 stores one or more videos. It is preferable that each of the one or more videos is associated with a medium identifier that identifies the display medium 11. The medium identifier is, for example, the IP address of the display medium 11, but it does not matter. The server storage unit 21 stores, for example, two or more videos that are associated with a location identifier and a medium identifier. The location identifier is information that identifies the location of the video. The location identifier is, for example, a location name or a location ID.
[0063] The server receiving unit 22 receives, for example, an instruction to transmit a video from the display medium 11.
[0064] The server processing unit 23 acquires the video to be transmitted to the display medium 11 from the server storage unit 21. The server processing unit 23 acquires the video from the server storage unit 21 in response to, for example, receiving an instruction to transmit the video.
[0065] The server transmitting unit 24 transmits the video acquired by the server processing unit 23 to the display medium 11 identified by the medium identifier paired with the video.
[0066] The storage unit 111 and the server storage unit 21 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0067] There is no restriction on the process by which information is stored in the storage unit 111 etc. For example, information may be stored in the storage unit 111 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 111 etc., or information inputted via an input device may be stored in the storage unit 111 etc.
[0068] The switching unit 113 and the server processing unit 23 can usually be realized by a processor, a memory, etc. The processing procedure of the switching unit 113, etc. is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type is not important.
[0069] The server receiving unit 22 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.
[0070] The server transmitting unit 24 is usually realized by a wireless or wired communication means, but may also be realized by a broadcasting means.
[0071] A specific operation example of the spatial system A in this embodiment will be described below. Now, the space 1 is a closed space. The space 1 is a reception room. The space 1 is shown in Figs. 3, 4, and 5.
[0072] Three display media 11 are arranged on a first side wall surface 12(1) of the space 1. The three display media 11 are designated 11(1), 11(2), and 11(3) (see FIG. 3). One display medium 11 is arranged on a second side wall surface 12(2) which is a right-side wall surface that is in contact with the first side wall surface 12(1) of the space 1 at a right angle. The one display medium 11 is designated 11(4) (see FIG. 4). One display medium 11 is arranged on a third side wall surface 12(3) which is a left-side wall surface that is in contact with the first side wall surface 12(1) of the space 1 at a right angle. The one display medium 11 is designated 11(5) (see FIG. 5).
[0073] The display media 11(1)-(5) are disposed at a height on the side wall surface 12 where a window would normally be located. The display media 11(1)-(5) are disposed at the same height from the floor. The display media 11(1)-(5) have the same size here. The display medium 11 does not need to be in contact with the side wall surface 12, and may be disposed at a position close to the side wall surface 12. In this case, the side wall surface 12 may be considered to have the display medium 11.
[0074] The display media 11(1)-(5) display one natural video. The one natural video here is a video captured of a place where cherry blossom trees line the river on both sides of the river. The display media 11(1)-(5) output a video of a region corresponding to each position in the space 1, which is a partial region of the one natural video (referred to as a partial video as appropriate). The storage units 111 of the display media 11(1)-(5) store partial videos of different regions in the one natural video, and the display units 112 of the display media 11(1)-(5) acquire the partial videos of different regions in the one natural video from the storage units 111 and display them. It is preferable that the display units 112 of the display media 11(1)-(5) display partial videos that are synchronized in time.
[0075] Furthermore, in this embodiment, the space 1 can switch its role by changing the image displayed by each of the two or more display media 11.
[0076] It is preferable that, even when switching roles, the images displayed by the two or more display media 11 are images of the same location or images related to the same location. Below, an example of roles in Space 1 will be described. Here, the same place is, for example, Hakodate.
[0077] The two or more display media 11 in the space 1 display, for example, an image of a panoramic view of the ocean from Tatematsu Cape at the foot of Mt. Hakodate. In the space 1, two or more people are shown an image of the vast ocean spreading out in front of them while being served dishes that are specialties of Hakodate (for example, a seafood bowl containing sea urchin, salmon roe, squid, etc.). As a result, the multiple people in the space 1, although they have different brains, are placed in a situation that allows them to cooperate. For example, compared to when no image is displayed on the display media 11, they can get the feeling that they are eating together while enjoying the same scenery, which allows them to have lively conversations and enjoy their meals.
[0078] Furthermore, one of the two or more display media may display images related to Hakodate, such as images of the dishes being prepared or images of obtaining ingredients for the dishes (for example, images of fishing for seafood), which allows customers to enjoy their meal even more.
[0079] Such a space 1 is referred to as the "dining space."
[0080] Two or more display media 11 in space 1 display, for example, an image of the shores of Lake Onuma, a scenic spot near Hakodate. In space 1, two or more people hold a discussion while watching the image of the lakeside. As a result, the brains of the people in space 1 feel as if they are having a relaxed discussion while strolling along the lakeside in the great outdoors. In such a space, people can listen to and accept the opinions of others and gain further ideas, compared to a closed-off conference room. This allows two or more people to bring different values to the table and create new value.
[0081] Such a space 1 is called the "work space."
[0082] The two or more display media 11 in the space 1 display, for example, an image of the scenery from the top of Mt. Hakodate. In the space 1, two or more people are having a conversation while enjoying the view from Mt. Hakodate. At this time, one or more of the display media 11 may display an image related to Hakodate, for example, an image of a tourist spot in Hakodate. As a result, for example, the brains of the two or more people in the space 1 feel as if they are actually sightseeing in Hakodate together, and they have lively conversations about Hakodate. As a result, the two or more people in the space 1 have different brains, but are in a situation that allows them to cooperate. For example, by showing each other their knowledge about Hakodate and sharing their experiences, it becomes possible for them to grow together. It also becomes possible for them to share the desire to actually go to Hakodate and experience the real thing.
[0083] Such a space 1 is called a "growth space."
[0084] Two or more display media 11 in space 1 display, for example, an image of cherry blossoms blooming all over Goryokaku, a famous cherry blossom viewing spot in Hakodate. A sofa is placed in space 1. Two or more people sitting on the sofa rest and chat while looking at the cherry blossoms in full bloom. As a result, it enables people with different brains to cooperate. For example, by sharing the gorgeous feeling of cherry blossom viewing and talking to each other, it becomes possible for both people to refresh both their minds and bodies.
[0085] Such a space 1 is called a "rest space."
[0086] The two or more display media 11 in the space 1 display, for example, an image of dusk as seen from Mt. Hakodate. Then, as time passes, the sun sets and the scene turns into a night scene. And, two or more beds are placed in the space 1. Two or more people lying on the beds go to sleep while watching the sun set from dusk and turn into a night scene. As a result, it enables people with different brains to cooperate. That is, even if two or more people originally have different life rhythms, when they see the displayed image, they feel like it's about time to go to bed because the sun has set, and their life rhythms naturally align, allowing each person to sleep soundly. Also, when they wake up, an image of dawn may be presented in the same way.
[0087] Such a space 1 is called the "sleeping space."
[0088] Furthermore, it is preferable that the images displayed on the display medium 11 for each role are different, but they may be the same.
[0089] As described above, according to this embodiment, a natural environment can be reproduced in the space 1 such as a room. As a result, for example, cooperation between two or more people having different brains can be facilitated in the space such as a room.
[0090] Moreover, according to the present embodiment, a natural environment can be reproduced in the space 1 such as a room. As a result, in the space 1 such as a room, it is possible to support a plurality of people with different brains bringing together different values to create new values.
[0091] Moreover, according to this embodiment, it is possible to provide the display medium 11 that reproduces a natural environment in the space 1 such as a room.
[0092] Furthermore, according to this embodiment, a server 2 that provides moving images to the display medium 11 can be realized.
[0093] The processing of the display medium 11 and the server 2 in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments in this specification.
[0094] (Embodiment 2) The difference between this embodiment and embodiment 1 is that in this embodiment, the space has two or more subspaces. In this embodiment, each of the two or more subspaces has one or more display media. It is preferable that each of the two or more display media here displays an image of the same place or an image related to the same place. Note that the subspace is also a space.
[0095] In this embodiment, a space that allows people with different brains to cooperate with each other by reproducing a natural environment will also be described.
[0096] Furthermore, in this embodiment, a space that constitutes a transporter and has two or more sub-spaces that can each independently switch roles will be described.
[0097] 6 is a block diagram of a spatial system B in this embodiment. The spatial system B includes a space 3 and a server 2. The space 3 includes two or more subspaces 31. The subspace 31 includes one or more display media 11.
[0098] The sub-space 31 is, for example, a space provided in the transport body. The sub-space 31 is, for example, a room in the transport body. The display medium 11 in the sub-space 31 is also usually disposed on a side wall surface in the sub-space 31.
[0099] The space 3 has a passage 32 (see FIG. 7) connecting two or more sub-spaces 31.
[0100] The space 3 has air control units 33 (see FIG. 7) that perform ventilation and air conditioning for each sub-space 31. The air control units 33 are usually disposed above and below the sub-spaces 31 and the passages 32.
[0101] A specific operation example of the spatial system B in this embodiment will be described below. The space 3 here is a space inside the vehicle. The space 3 of the vehicle can be said to be a moving space. The vehicle here is a train. It is assumed that the train is traveling toward one destination. It is assumed that the train is traveling, for example, from Tokyo to Hakodate.
[0102] Here, the space 3 has subspaces 31(1)-(5) and the like (see FIG. 7). The subspaces 31(1)-(5) can each switch their role as described in the first embodiment. In the subspaces 31(1)-(5), the display media 11 displays an image. The image is a natural image of Hakodate or a natural image related to Hakodate. It is preferable that the images displayed by the display media 11 in the subspaces 31(1)-(5) are different depending on the role of the subspace 31, but they may be the same.
[0103] Depending on the image displayed by the display medium 11 in one subspace 31, the subspace 31 can become a dining space, a working space, a growth space, a resting space, or a sleeping space.
[0104] At this time, it is preferable that each of the sub-spaces 31(1)-(5) is individually ventilated and air-conditioned by air control 33. It is also preferable that the state of ventilation and air-conditioning in each of the sub-spaces 31(1)-(5) is controlled according to its respective role.
[0105] As described above, according to this embodiment, a natural environment can be reproduced in the sub-space 31 of the space 3 such as a vehicle or a room. As a result, for example, cooperation between two or more people having different brains becomes easy in the sub-space 31 of the vehicle. Note that the space 3 may have only one sub-space 31.
[0106] Furthermore, according to this embodiment, in the subspace 31 of the space 3 of the transporter or the like, it is possible to support two or more people having different brains bringing together different values to create new values.
[0107] Furthermore, according to this embodiment, a person can move around in the space 3 of the vehicle while viewing natural images of the destination to which the vehicle is heading. As a result, after getting on the vehicle, the person's brain has the illusion that he or she is at the destination. This makes it easier for two or more people with different brains to cooperate with each other.
[0108] (Embodiment 3) An embodiment will be described in which one or more display media 11 are provided in a space 4 in which two or more people exist.
[0109] Here, two or more people are having a face-to-face conversation. One of the people is a customer and the other is a store clerk. For example, if space 4 is a tourist information center, the people would be a tourist and a store clerk.
[0110] The display medium 11 displays an image of a product or service that a salesperson is about to explain to a customer. For example, if the space 4 is a tourist information center, the display medium 11 displays an image of a tourist spot that the salesperson is about to explain to a tourist.
[0111] In this way, the salesperson and the customer can place themselves in a space that recreates the same natural environment, which can encourage conversation and facilitate smooth business negotiations. For example, if the space is a tourist information center, the recreation of a natural environment allows the guide to talk about his or her own experiences when he or she actually went there. In addition, the recreation of a natural environment allows tourists to feel as if they are in that natural environment, which makes them even more eager to go there in person.
[0112] In this way, coordination between two or more people with different brains is facilitated.
[0113] As described in paragraphs
[0040] to
[0042] , it is preferable that there are a plurality of display media 11 in the space 1. In this case, it is preferable to display natural images of different partial areas according to different positions of each display medium 11, as described in paragraphs
[0055] to
[0057] .
[0114] Also, there may be one display medium 11 in the space 4 .
[0115] At this time, it is preferable to switch and display a plurality of natural images, which were originally created for a space having a plurality of display media 11, at regular intervals.
[0116] In this way, images can be stored in the brains of two or more people with different brains, making it possible to achieve an effect similar to that achieved when there are multiple display media.
[0117] (Embodiment 4) In this embodiment, a video output device that converts a video into a supernatural scene and outputs the converted video will be described. The video output device described in this specification may be, for example, a television or a video playback device, and the type does not matter. It is also preferable to have a frame such as that in Design Registration No. 1648658 around the surface on which the video is displayed. The video output device is also an example of the display medium 11 in the first to third embodiments.
[0118] The "process of converting into a supernatural scene" refers to a process of obtaining, for each of one or more images constituting the received video, two or more features from one or more target images constituting the image, determining a class of each target image using the two or more features, determining one or more lookup tables (hereinafter referred to as "LUTs" as appropriate) corresponding to the class from the LUT control table, converting each target image using the one or more LUTs, and obtaining an integrated converted image.
[0119] 8 is a block diagram of video output device 5 in the present embodiment. Video output device 5 includes a storage unit 51, a reception unit 52, a processing unit 53, and an output unit 54. Storage unit 51 includes an LUT storage unit 511, and a control information storage unit 512. Reception unit 52 includes a video acquisition unit 521, and an input reception unit 522. Processing unit 53 includes a conversion unit 531, and a control change unit 532. Conversion unit 531 includes a division means 5311, a classification means 5312, a conversion means 5313, and an integration means 5314. Output unit 54 includes an image output unit 541.
[0120] Various types of information are stored in the storage unit 51. The various types of information are, for example, an LUT, control information, a class management table, and one or more moving images. The storage unit 51 may store moving images that have been converted into supernatural scenes in advance.
[0121] The class management table is a table for managing classes. The class management table has, for example, two or more records each having a class identifier and a feature vector. The class identifier is information for identifying the class of the target image. The target image is the image to be transformed. The target image is the image to be transformed or a partial image to be transformed. The target image is usually a partial image, but may be the entire image (which may also be called a field or frame) that constitutes a video. The partial image is an image of a partial area of an image that constitutes a video. The shape and size of the area are not important. The feature vector is a vector whose elements are two or more features extracted from the target image.
[0122] The feature amount is, for example, a neighborhood feature amount or an overall feature amount. The neighborhood feature amount is a feature amount of a part of an image. The neighborhood feature amount is, for example, brightness, pixel value, pixel coordinates, activity, spatiotemporal correlation, motion vector, frequency distribution, and the like. The activity is, for example, a maximum value and a minimum value of a plurality of pixels, a dynamic range (DR), a difference value between a plurality of pixels, and the like. The difference value between a plurality of pixels may be a difference value between a plurality of pixels in space, a difference value between a plurality of pixels in a time direction, or a difference value between a plurality of pixels in space and in a time direction. The overall feature amount is a feature amount of the entire image. The overall feature amount is, for example, a pixel value distribution of the entire image, a motion vector distribution of the entire image, a spatiotemporal correlation of one or more images, a noise amount of the entire image, an image format, content information related to a content that is one or more images, a pattern detection result (such as a face), and the like. Here, the content information is, for example, a shooting location of the content, a shooting date and time, a weather at the time of shooting, a name and a type of a subject, a camera parameter (such as a lens aperture and a shutter speed), and the like.
[0123] The feature amount is, for example, the magnitude of the frame difference, the flatness in space, the amount of mid to high frequency components in space, the amount of low frequency components in space, and the degree of blur in space. The degree of blur is a feature amount related to the smoothness of changes in pixel values. Note that, since the method of acquiring such feature amounts is a publicly known technique, a description of the method of acquiring such feature amounts will be omitted. Note that, it goes without saying that the feature amounts are not limited to the feature amounts described above.
[0124] A moving image in storage unit 51 is usually associated with a moving image identifier. The moving image identifier is information for identifying a moving image, such as the title, ID, shooting location, shooting date and time, weather at the time of shooting, name and type of subject, and camera parameters (lens aperture, shutter speed, etc.).
[0125] Two or more lookup tables are stored in the LUT storage unit 511. Usually, an LUT is associated with an LUT identifier for identifying the LUT. The LUT identifier is, for example, an ID or a name of the lookup table.
[0126] The LUT has one or more pieces of correspondence information. The correspondence information is information for establishing correspondence between a first image or a first partial image and a second image or a second partial image. The first image is an image before conversion. The second image is an image different from the first image and is an image after conversion. The first partial image is a part of the first image. The second partial image is a part of the second image.
[0127] The correspondence information may be, for example, an arithmetic expression for converting an image, one or more parameter sets to be given to the arithmetic expression for converting an image, one or more parameter sets of a conversion filter for converting an image, a second image or a second partial image itself corresponding to the first image or the first partial image, or a formula for calculating a median of pixel values of a spatiotemporal block.
[0128] Each of the two or more pieces of correspondence information contained in the LUT corresponds to, for example, two or more feature amounts. The two or more feature amounts may be called a feature amount vector having each feature amount as an element.
[0129] Moreover, all or a first partial image of one or more first images and all or a second partial image of one or more second images may be an image of one screen to be output, an image of a part of a block of one screen, a single pixel, a plurality of screens successive in time, a part in space of a plurality of screens successive in time (a spatiotemporal block to be described later), or a set of consecutive single pixels of a plurality of screens successive in time. That is, the unit of the amount of information of the first image and the second image does not matter. Note that a spatiotemporal block usually refers to a part obtained by dividing a moving image (which may also be called a video) spatially, temporally, or both spatially and temporally. However, the spatiotemporal block may be a set of pixels. That is, the spatiotemporal block is not limited to a rectangular continuous area. The spatiotemporal block may be a non-rectangular and discontinuous image area. Furthermore, the plurality of spatiotemporal blocks obtained by dividing an image may have overlapping pixels in part.
[0130] Here, the first image and the second image are different images of the same object. For example, the first image is an image with a lot of distortion (for example, an image that is greatly affected by noise mixed into the image when photographed by a camera), and the second image is an image with less distortion than the first image (for example, an image that is less affected by noise mixed into the image when photographed by a camera). In such a case, the lookup table indicates, for example, the correlation between two image signals with different amounts of distortion, which are coded for each block. Moreover, the first image is an image of a normal natural environment, and the second image is an image of a natural environment that occurs rarely, such as once in 1000 years. This conversion process will be described later.
[0131] It is preferable that each of the two or more LUTs has a different ability to be achieved, such as a LUT that can improve the smoothness of motion, a LUT that can improve transparency, a LUT that can improve texture, a LUT that can improve grandiosity, a LUT that can remove foreign objects, etc.
[0132] The control information storage unit 512 stores two or more pieces of control information. The control information is information about the LUT used when converting the target image. The control information is information specifying the use of one or more LUTs. The control information is information associated with a class identifier. The information associated with the class identifier may be synonymous with the information associated with the feature vector. The class identifier is information identifying the class of the target image. When the control information is information specifying the use of two or more LUTs, it is preferable that the information also specifies the order in which the two or more LUTs are used. The control information is, for example, "LUT1, LUT2". In this case, the control information is information indicating that, for example, a first conversion process is performed on the target image using a lookup table identified by "LUT1", and then a second conversion process is performed on the image resulting from the first conversion process using a lookup table identified by "LUT2", to obtain a converted image that is an image to be output.
[0133] The reception unit 52 receives various information and instructions. The various information and instructions are, for example, videos and input from a user. The input means for the various information and instructions may be anything, such as a numeric keypad, a keyboard, a mouse, or a menu screen. The reception unit 52 may be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen.
[0134] The video acquisition unit 521 acquires a video having two or more images. The video acquisition unit 521 receives a video from, for example, a broadcasting device (not shown). The video acquisition unit 521 acquires a video from, for example, a video management device (server) (not shown). The video acquisition unit 521 reads out a video stored in the storage unit 51, for example.
[0135] The input receiving unit 522 receives input from a user, such as an output instruction, a video switching instruction, a video identifier, a characteristic identifier, a region identifier, an LUT, an instruction to change the LUT, control information, or an instruction to change the control information.
[0136] The output instruction is an instruction to output a moving image, and preferably includes information identifying the moving image (e.g., a moving image identifier). The moving image switching instruction is an instruction to switch moving images being output, and preferably includes information identifying the moving image to be switched (e.g., a moving image identifier). The characteristic identifier is information that identifies the characteristics of the moving image, such as "smoothness of movement," "transparency," "texture," "grandeur," "removal of foreign matter," etc. The area identifier is information that identifies an area. The area is, for example, a rectangular area specified by the user, but may also be a non-rectangular area or an object.
[0137] Here, reception is a concept that includes reception of information input from input devices such as a keyboard, mouse, or touch panel, reception of information transmitted via a wired or wireless communication line, and reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.
[0138] The processing unit 53 performs various types of processing. The various types of processing are, for example, processing performed by a conversion unit 531 and a control change unit 532.
[0139] When the input receiving unit 522 receives an LUT, the processing unit 53 stores the LUT in the LUT storage unit 511. When the input receiving unit 522 receives an instruction to change the LUT, the processing unit 53 changes the LUT in accordance with the instruction to change the LUT.
[0140] When the input receiving unit 522 receives control information, the processing unit 53 stores the control information in the control information storage unit 512. When the input receiving unit 522 receives an instruction to change the control information, the processing unit 53 changes the control information in accordance with the instruction to change the control information.
[0141] The conversion unit 531 performs a process of converting one or more images constituting the video into a supernatural scene, and obtains a converted image. This process is called a conversion process.
[0142] The division means 5311 divides one or more images constituting the moving image to obtain two or more partial images. The division means 5311 usually performs division processing on all images (still images) constituting the moving image, but may perform division processing on only some of the images.
[0143] The division means 5311 divides, for example, each image constituting a moving image into partial images of the same size. The division means 5311 divides, for example, an image constituting a moving image into partial images of vertical X and horizontal Y size. The division means 5311 may divide each image constituting a moving image into partial images of different sizes but the same shape (for example, rectangular).
[0144] The division means 5311, for example, extracts one or more objects from each image constituting the video, and acquires each of the one or more objects and the background as a partial image. The division means 5311, for example, extracts two or more objects from each image constituting the video, and acquires each of the two or more objects as a partial image. Note that the technology for extracting objects from an image is a well-known technology, and therefore a detailed description thereof will be omitted.
[0145] The classification means 5312, for example, first acquires two or more feature amounts from a target image. The target image is, for example, a partial image acquired by the division means 5311. The target image is, for example, an image acquired by the video acquisition unit 521. The image acquired by the video acquisition unit 521 may be called a first image. The image acquired by the video acquisition unit 521 is an image before conversion.
[0146] Next, the classification means 5312 acquires a class identifier of the target image using two or more feature amounts. For example, the classification means 5312 acquires two or more feature amounts from the target image, configures a feature vector using the two or more feature amounts, and determines a class identifier that pairs with the feature vector that is most similar to the feature vector. Note that the class identifier is usually determined from the class management table of the storage unit 51. The class identifier may also be determined by acquiring the class identifier.
[0147] The conversion means 5313 acquires, for each target image, control information corresponding to the class identifier determined by the classification means 5312 from the control information storage unit 512. Next, the conversion means 5313 converts the target image using one or more lookup tables specified by the acquired control information for each target image, and acquires a converted target image.
[0148] The conversion means 5313, for example, determines correspondence information corresponding to two or more features (feature vectors) acquired by the classification means 5312 for each target image, for each of one or more lookup tables specified by the control information, and converts the target image using the correspondence information to acquire a conversion target image.
[0149] The process of determining correspondence information corresponding to the feature vector acquired by the classification means 5312 is, for example, a process of determining correspondence information corresponding to a feature vector that is most similar to the feature vector acquired by the classification means 5312.
[0150] The integrating means 5314 integrates two or more conversion target images acquired by the converting means 5313 to acquire a converted image. Integrating two or more conversion target images may be considered as synthesizing. Integrating two or more conversion target images is to compose an image including two or more conversion target images.
[0151] The integration means 5314 typically synthesizes two or more conversion target images without changing the positional relationship between the two or more target images that are the basis of the two or more conversion target images, to form a converted image that constitutes the converted video.
[0152] The control change unit 532 changes the control information corresponding to one or more of the two or more class identifiers based on the input received by the input receiving unit 522.
[0153] For example, the control change unit 532 first determines one or more pieces of control information to be changed. Next, the control change unit 532 changes the control information to be changed. The control change unit 532 may change all of the control information.
[0154] Determining the control information to be changed is, for example, acquiring a class identifier of a class to be changed. For example, when the input received by the input receiving unit 522 is a characteristic identifier that specifies a characteristic that is insufficient, the control change unit 532 determines one or more pieces of control information that do not have a LUT identifier of a LUT corresponding to the characteristic identifier as the control information to be changed. For example, the control change unit 532 determines control information corresponding to one or more class identifiers that are determined by the classification means 5312 with a high frequency that satisfies a frequency condition in one or more images that are a video corresponding to the input received by the input receiving unit 522 and are output as the control information to be changed. Note that the characteristic identifier is information that specifies the characteristics of the LUT, for example, information that identifies an effect that can be improved by the LUT, such as "smoothness of movement," "transparency," "texture," "grandeur," and "foreign object removal." In addition, the frequency condition is that the number of times that the class identifier has been determined is equal to or greater than a threshold value, that the number of times that the class identifier has been determined is the largest, and that the number of times that the class identifier has been determined is within the top N (N is a natural number equal to or greater than 2).
[0155] When the input received by the input receiving unit 522 is a characteristic identifier that identifies a characteristic that is insufficient, the control change unit 532 adds the LUT identifier of the LUT corresponding to the characteristic identifier to the control information. It is preferable that the control information to which the LUT identifier is added is the control information determined by the control change unit 532 as the control information to be changed. However, the control change unit 532 may add the LUT identifier to all control information.
[0156] For example, if the input received by the input receiving unit 522 is a characteristic identifier that identifies a characteristic that is insufficient and information indicating an area, the control change unit 532 determines one or more partial images corresponding to the information indicating the area, acquires two or more feature amounts from each of the one or more partial images, and acquires a class identifier corresponding to the two or more feature amounts. Then, the control change unit 532 determines one or more pieces of control information corresponding to each of the one or more acquired class identifiers as the control information to be changed. Next, the control change unit 532 adds the LUT identifier of the LUT corresponding to the characteristic identifier received by the input receiving unit 522 to the control information to be changed.
[0157] The output unit 54 outputs various types of information, such as the converted image.
[0158] Here, output means display on a display or projection using a projector, but also includes the concept of transmission to an external device, storage in a recording medium, delivery of processing results to other processing devices or other programs, etc. The output may be recorded in a storage unit (not shown) and output according to a playback instruction.
[0159] The image output unit 541 sequentially outputs each of the one or more converted images acquired by the conversion unit 531. The image output unit 541 outputs the converted moving image.
[0160] The storage unit 51, the LUT storage unit 511, and the control information storage unit 512 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0161] There is no restriction on the process by which information is stored in the storage unit 51, etc. For example, information may be stored in the storage unit 51, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 51, etc., or information inputted via an input device may be stored in the storage unit 51, etc.
[0162] The reception unit 52, video acquisition unit 521, and input reception unit 522 are realized, for example, by wireless or wired communication means, but may also be realized by a means for receiving broadcasts, a device driver for an input means such as a touch panel or keyboard, or control software for a menu screen.
[0163] The processing unit 53, the conversion unit 531, the control change unit 532, the division means 5311, the classification means 5312, the conversion means 5313, and the integration means 5314 can usually be realized by a processor, a memory, etc. The processing procedure of the processing unit 53, etc. is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). The processor may be a CPU, an MPU, a GPU, etc., and the type is not important.
[0164] The output unit 54 and the image output unit 541 may or may not include an output device such as a display or a speaker. The output unit 54 and the like may be realized by driver software for an output device, or a combination of driver software for an output device and an output device, etc.
[0165] Next, an example of the operation of the video output device 5 will be described with reference to the flowchart of FIG.
[0166] (Step S901) The accepting unit 52 judges whether or not an instruction to output a moving image has been accepted. If an instruction to output a moving image has been accepted, the process proceeds to step S902, and if an instruction to output a moving image has not been accepted, the process returns to step S901.
[0167] (Step S902) The video acquisition unit 521 sequentially acquires images from the video corresponding to the output instruction. Then, the video acquisition unit 521 judges whether or not the images have been acquired. If the images have been acquired, the process proceeds to step S903, and if the images have not been acquired, the process proceeds to step S905.
[0168] (Step S903) The conversion unit 531 performs conversion processing on the image acquired in step S902 to acquire a converted image. An example of the conversion processing will be described with reference to the flowchart of FIG.
[0169] (Step S904) The image output unit 541 outputs the converted image acquired in step S903. Then, the process returns to step S902.
[0170] (Step S905) Input receiving unit 522 judges whether or not an input has been received. If an input has been received, the process proceeds to step S906, and if an input has not been received, the process proceeds to step S907.
[0171] (Step S906) The control change unit 532 performs a control information change process. Return to step S902. An example of the control information change process will be described with reference to the flowchart of FIG.
[0172] (Step S907) Processing unit 53 judges whether or not to end the process. If the process is to be ended, the process returns to step S901, and if the process is not to be ended, the process returns to step S902. The process is ended, for example, when a converted image corresponding to the last image of the video is output, or when an end instruction is accepted. However, any trigger for ending the process is acceptable.
[0173] In the flowchart of FIG. 9, the process ends when the power is turned off or an interrupt occurs to end the process.
[0174] Next, an example of the conversion process in step S903 will be described with reference to the flowchart in FIG.
[0175] (Step S1001) The division means 5311 divides an image to obtain one or more partial images. A partial image is a target image to be transformed.
[0176] (Step S1002) The classification means 5312 assigns 1 to a counter i.
[0177] (Step S1003) The classification means 5312 judges whether or not the i-th target image exists.
[0178] (Step S1004) The classification means 5312 acquires the i-th target image divided and acquired by the division means 5311.
[0179] (Step S1005) The integration means 5314 acquires position information of the target image. The position information is information indicating the relative position of the i-th target image in the image, and is usually (x, y) equal to or greater than 1. When the target image is a rectangle, for example, the position information is the top left coordinate and bottom right coordinate of the rectangle. When the target image is an object, for example, the position information is the center of gravity coordinate of the object, or a set of three or more coordinates indicating the contour of the object.
[0180] (Step S1006) The classification means 5312 acquires two or more feature amounts (feature amount vectors) of the i-th target image.
[0181] (Step S1007) The classification means 5312 determines a feature vector that is most similar to the feature vector acquired in step S1006 from the feature vectors held in the class management table of the storage unit 51. Next, the classification means 5312 acquires a class identifier that pairs with the determined feature vector from the class management table.
[0182] (Step S1008) The conversion means 5313 acquires, from the control information storage unit 512, control information paired with the class identifier acquired in step S1007.
[0183] (Step S1009) 1 is substituted into counter j.
[0184] (Step S1010) The conversion means 5313 judges whether or not the j-th LUT identifier to be used exists in the control information acquired in step S1008. If the j-th LUT identifier exists, the process proceeds to step S1011, and if not, the process proceeds to step S1014.
[0185] (Step S1011) The conversion means 5313 determines a feature vector that is most similar to the feature vector acquired in step S1006 from the correspondence information held by the LUT identified by the j-th LUT identifier, and determines correspondence information corresponding to the feature vector.
[0186] (Step S1012) The conversion means 5313 converts the image to be converted using the correspondence information determined in step S1011. The image to be converted is the i-th target image or the image obtained by conversion in step S1012 in the immediately preceding loop process. The process of converting an image using correspondence information is disclosed in, for example, published patent applications (JP Patent Publication No. 2012-252687 and JP Patent Publication No. 2014-154046).
[0187] (Step S1013) The counter j is incremented by 1. The process returns to step S1010.
[0188] (Step S1014) The integration unit 5314 finally arranges the conversion target image, which is the image acquired in step S1012, at the position indicated by the position information acquired in step S1005.
[0189] (Step S1015) The classification means 5312 increments the counter i by 1. The process returns to step S1003.
[0190] Next, an example of the control information change process in step S906 will be described with reference to the flowchart in FIG.
[0191] (Step S1101) The control change unit 532 determines one or more pieces of control information to be changed.
[0192] (Step S1102) The control change unit 532 assigns 1 to a counter i.
[0193] (Step S1103) The control change unit 532 judges whether or not the i-th control information to be changed exists. If the i-th control information to be changed exists, the process proceeds to step S1104, and if not, the process returns to the upper level process.
[0194] (Step S1104) The control change unit 532 acquires the i-th control information to be changed.
[0195] (Step S1105) The control change unit 532 acquires the changed control information.
[0196] (Step S1106) The control change unit 532 rewrites the i-th control information to be changed to the changed control information acquired in step S1105.
[0197] (Step S1107) The control change unit 532 increments the counter i by 1. The process returns to step S1103.
[0198] Specific examples of the operation of the video output device 5 in this embodiment will be described below. Two specific examples will be described below. Specific example 1 is a case where a video that reproduces a natural environment in a space such as a room is output by performing a process of converting the video into a supernatural scene. Specific example 2 is a case where the control information is changed.
[0199] In this specific example, it is assumed that the LUT storage unit 511 of the video output device 5 stores a large number of LUTs including the five LUTs shown in FIG. 12. FIG. 13 shows an example of the structure of the LUT. The LUT in FIG. 13 has a large number of pieces of correspondence information. The correspondence information here has feature vectors and filter coefficients. In FIG. 13, a "feature vector" is a combination of one or more overall features (e.g., "A1=(V1, V2, V3, V4)") and one or more neighboring features (e.g., "α 01 =(p 01-1 ,p 01-2 ,p 01-3 ,p 01-4)" in the corresponding information. The process of acquiring the overall feature amount and the neighborhood feature amount from an image is a known technique, and is disclosed, for example, in Japanese Patent Publication (JP 2012-252687). The filter coefficient is a coefficient used by the conversion filter of the image. The "filter coefficient" (for example, "F 01 ") is a set of filter coefficients. As mentioned above, various LUT structures are possible and any structure is acceptable.
[0200] The control information storage unit 512 also stores a control information management table shown in FIG. 14. The control information management table is a table for managing control information. The control information management table has two or more records each having a "class identifier," a "feature vector," and "control information." A "feature vector" in the control information management table is a table that includes one or more overall features (e.g., "a1=(v1,v2,v3,v4)") and one or more neighboring features (e.g., "β 01 =(P 01-1 ,P 01-2 ,P 01-3 ,P 01-4 )" is a vector having the following structure:
[0201] (Example 1) In this situation, it is assumed that an output instruction is given to the video output device 5. Next, the receiving unit 52 of the video output device 5 receives the video output instruction.
[0202] Next, the video acquisition unit 521 sequentially acquires images from the video corresponding to the output instruction. For example, the video acquisition unit 521 acquires an image 1501 in Fig. 15 (an image of Mt. Fuji).
[0203] The conversion unit 531 performs the following conversion process on the image 1501 to obtain a converted image. That is, the division means 5311 constituting the conversion unit 531 divides the image 1501 into spatio-temporal blocks to obtain partial images. Next, the classification means 5312 obtains a feature vector of each partial image (for example, "feature vector for the partial image of the bird's position: (8,0,···,3,0,0)"). Furthermore, the integration means 5314 obtains position information of each spatio-temporal block (target image). Note that instead of dividing the image 1501 into spatio-temporal blocks, the division means 5311 may perform object recognition process on the image 1501 to obtain partial images of birds, sky, mountains, and insects.
[0204] Next, the classification means 5312 determines, for each target image, a feature vector that is most similar to the acquired feature vector from the feature vectors in the control information management table of Fig. 14. Then, it is assumed that the classification means 5312 acquires a class identifier "C1" for the target image "bird", a class identifier "C2" for the target image "sky", a class identifier "C3" for the target image "mountain", and a class identifier "C4" for the target image "insect".
[0205] Next, the conversion means 5313 obtains control information paired with the class identifier for each target image. That is, for example, the conversion means 5313 obtains control information "LUT1, LUT3" for the target image "bird". The conversion means 5313 also obtains control information "LUT2" for the target image "sky". The conversion means 5313 also obtains control information "LUT4" for the target image "mountain". Furthermore, the conversion means 5313 obtains control information "LUT5" for the target image "insect".
[0206] Next, the conversion means 5313 applies one or more LUTs to each target image in order to obtain a converted image. That is, the conversion means 5313 performs image conversion on the target image "bird" using LUT1 to obtain an image with improved smoothness of movement. Next, the conversion means 5313 performs image conversion on the image resulting from the conversion using LUT3 to obtain a conversion target image with improved texture. Next, the integration means 5314 places the conversion target image at the position indicated by the position information obtained for the target image "bird".
[0207] Moreover, the conversion means 5313 performs image conversion on the target image "sky" using LUT2 to obtain a conversion target image with improved transparency. Next, the integration means 5314 places the conversion target image at the position indicated by the position information obtained for the target image "sky".
[0208] The conversion means 5313 also performs image conversion on the target image "mountain" using LUT4 to obtain a conversion target image with improved grandeur. Next, the integration means 5314 places the conversion target image at the position indicated by the position information obtained for the target image "mountain".
[0209] Furthermore, the conversion means 5313 performs image conversion on the target image "insect" using the LUT5, and obtains a conversion target image from which foreign objects (insects) have been removed. Next, the integration means 5314 places the conversion target image at a position indicated by the position information obtained for the target image "insect". Through the above processing, a conversion image is obtained.
[0210] Next, the image output unit 541 outputs the converted image (1502). By performing the above process on each image constituting the moving image specified by the output instruction, two or more converted images that have been subjected to the conversion process are output in sequence. As a result, a viewer of the moving image can reproduce a natural environment in a space such as a room by performing the process of converting the images into a supernatural scene. As a result, for example, cooperation between two or more people with different brains in a space such as a room becomes easier.
[0211] (Example 2) Suppose that while watching the video of Mt. Fuji (see 1502) output in concrete example 1, the viewer thinks that the characteristic "texture" is lacking in the output of Figure 16, and selects the "texture" button 1601 and the "area" 1602 where texture is lacking.
[0212] Next, the input receiving unit 522 acquires the LUT identifier "LUT3" corresponding to the "Texture" button 1601 from the storage unit 51. Note that it is assumed that the storage unit 51 stores one or more LUT identifiers corresponding to each button in FIG.
[0213] Next, the classification means 5312 acquires two or more feature amounts of the partial image included in the designated area, and determines a class identifier that is paired with a feature amount vector having the two or more feature amounts. Here, for example, it is assumed that the class identifier "C3" is selected.
[0214] When a region contains multiple partial images, a class identifier may be determined for all of them (i.e., there will be multiple class identifiers), or one class identifier may be determined for the center of gravity of their feature vectors.
[0215] Next, the control change unit 532 adds the LUT identifier "LUT3" acquired by the input reception unit 522 to the control information corresponding to the relevant class identifier (here, for example, the class identifier "C3") (see FIG. 17). Note that the order of the LUTs may be instructed by a means not shown here.
[0216] Thereafter, the conversion unit 531 converts the image using the updated control information management table to obtain the converted image (see FIG. 18). Moreover, the image output unit 541 outputs the converted image.
[0217] Furthermore, suppose that the viewer looks at the converted image output from image output unit 541 and thinks that the sky lacks "transparency," so designates "area" 1901 (part of the sky) that lacks transparency and presses "Transparency" button 1902 (see Figure 19).
[0218] Next, the input receiving unit 522 acquires from the storage unit 51 the LUT identifier “LUT2” corresponding to the “Transparency” button.
[0219] Next, the classification means 5312 obtains the feature amount of the partial image included in the specified region, and determines the class identifier that pairs with the feature amount vector. In this example, it is assumed that the class identifier "C2" is found to be the corresponding one.
[0220] Next, the control change unit 532 adds the LUT identifier "LUT2" acquired by the input reception unit 522 to the control information corresponding to the relevant class identifier (here, for example, the class identifier "C2") (see FIG. 20). Here, the same LUT may be selected twice.
[0221] Thereafter, the conversion unit 531 converts the image using the updated control information management table to obtain the converted image (see FIG. 21). Moreover, the image output unit 541 outputs the converted image.
[0222] With the above process, even while watching a video, the texture of Mt. Fuji can be improved and the transparency of the sky can be further improved. By repeating this process, it becomes possible to easily output images that viewers find more valuable, which could not be achieved with conventional processing.
[0223] As described above, according to the present embodiment, the viewer can reproduce a natural environment in a space such as a room by performing a process of converting the scene into a supernatural scene. As a result, for example, cooperation between two or more people with different brains in a space such as a room can be facilitated.
[0224] Furthermore, according to this embodiment, a video can be converted into one that the viewer finds more valuable, based on input from the viewer.
[0225] The processing in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software that realizes the information processing device in this embodiment is a program as follows. That is, this program is a program that causes a computer to function as a video acquisition unit that acquires a video having two or more images, a conversion unit that performs a process of converting one or more images constituting the video into a supernatural scene and acquires a converted image, and an image output unit that sequentially outputs each of the one or more converted images acquired by the conversion unit.
[0226] (Embodiment 5) In this embodiment, a system C that reproduces a natural environment in a space such as a room will be described. FIG. 22 is a block diagram of the system C. The system C includes one or more video output devices 6. The system C may be called a video output system. It is preferable that the system C has two or more video output devices 6.
[0227] It is preferable that video output device 6 is the same device as video output device 5, but it may be another video output device. Video output device 6 may output the video acquired by video acquisition unit 621 without converting it.
[0228] The video output device 6 includes, for example, a storage unit 61, a reception unit 62, a processing unit 63, and an output unit 64. The reception unit 62 includes a video acquisition unit 621.
[0229] For example, one or more moving images are stored in the storage unit 61. The storage unit 61 may store moving images that have been converted into supernatural scenes in advance.
[0230] The processing unit 63 passes, for example, the video acquired by the video acquisition unit 621 to the output unit 64. Note that the video to be output may be acquired from the storage unit 61, or may be received from a broadcasting device, a server, or the like (not shown).
[0231] The output unit 64 outputs the moving image passed from the processing unit 63. The output unit 64 may be the same as the image output unit 41.
[0232] The storage unit 61 is preferably a non-volatile recording medium, but may also be realized as a volatile recording medium.
[0233] There is no restriction on the process by which information is stored in the storage unit 61. For example, information may be stored in the storage unit 61 via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 61, or information inputted via an input device may be stored in the storage unit 61.
[0234] The processing unit 63 can usually be realized by a processor, a memory, etc. The processing procedure of the processing unit 63 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type is not important.
[0235] The output unit 64 may or may not include an output device such as a display, a speaker, etc. The output unit 4, etc. may be realized by driver software for an output device, or a combination of driver software for an output device and an output device, etc.
[0236] It is preferable that the two or more video output devices 6 constituting system C are arranged in a predetermined positional relationship. It is preferable that the two or more video output devices 6 constituting system C are arranged side by side. It is preferable that the two or more video output devices 6 are arranged side by side at the same height with respect to a horizontal floor. It is preferable that the two or more video output devices 6 have the same screen size. Note that the two or more video output devices 6 constituting system C may be arranged vertically.
[0237] In system C, it is preferable that each of the two or more video output devices 6 is installed in the same environment (one environment). The environment here refers to a space, a room, a location, etc. The one environment is, for example, the same room or the same space. It is also preferable that the video acquired by the video acquisition unit 621 of the two or more video output devices 6 is a video shot in another environment. The other environment is an environment different from the one environment in which the video output device 6 is installed.
[0238] It is preferable that the videos output from each of the two or more video output devices 6 are synchronized videos. It is preferable that the videos output from each of the two or more video output devices 6 are videos captured of another environment by two or more cameras that are in the same positional relationship as the positional relationship when each of the two or more video output devices 6 is installed in one environment.
[0239] It should be noted that there is no restriction on the method of synchronization when outputting videos among the two or more video output devices 6. The two or more video output devices 6 may start outputting synchronized images at the same time. One video output device 6 may transmit an instruction to another video output device 6, and the other video output devices 6 may output images corresponding to the same timing information. Furthermore, timing information may be transmitted from a server (not shown) to the two or more video output devices 6, and the two or more video output devices 6 may output synchronized images at the same timing.
[0240] As described above, according to this embodiment, a natural environment can be reproduced in a space such as a room by using two or more video output devices 6. As a result, for example, cooperation between two or more people with different brains can be facilitated in a space such as a room.
[0241] According to this embodiment, system C may be a room in which two or more video output devices 6 are installed, a house in which two or more video output devices 6 are installed, an apartment building in which two or more video output devices 6 are installed, etc.
[0242] (Embodiment 6) In this embodiment, a system E that switches between and outputs videos captured in a plurality of environments in response to an input from a user will be described. Note that the system E may also be called a video output system.
[0243] The system E includes one or more video output devices 6. Each of the one or more video output devices 6 outputs one of two or more different videos based on a user's instruction. The video output device 6 may be the video output device 5.
[0244] In addition, it is preferable that each of the two or more videos is a video taken at a scenic spot in an environment different from the one environment in which the video output device 6 is installed. It is preferable that each of the two or more different videos is a video taken at a different scenic spot.
[0245] It is also preferable that each video be shot under the best conditions for the respective natural environments (for example, a clear, cloudless day, when the air is highly transparent, at the moment of sunset, when a sea of clouds has appeared, etc.).
[0246] As described above, according to this embodiment, it is possible to provide a system that reproduces a natural environment in a space such as a room.
[0247] More specifically, being able to see the best moments of multiple scenic spots scattered across the country while staying in one place can give people a sense of excitement that they cannot get in their everyday lives, and this can feed back into their own behavioral norms in their social environment (for example, making them reflect on themselves and revise their life beliefs, or deciding to visit those scenic spots).
[0248] Furthermore, when two or more people in a space feel such an emotion simultaneously, it becomes easier for two or more people with different brains to cooperate with each other.
[0249] (Embodiment 7) In this embodiment, we describe a spatial collection which is a collection of two or more spaces that each exist in a different physically located location, and in which a selected video is displayed on a display medium of one or more of the two or more spaces for one or more users who may exist in the two or more spaces.
[0250] In addition, in this embodiment, a space set is described, which is a set of two or more spaces that exist in physically different places and are organically combined. Note that organically combining two or more spaces means, for example, outputting a video selected using user information related to one or more users existing in each of the two or more spaces to a display medium in the space where the users exist.
[0251] It is preferable that the space has three or four or more side walls. It is preferable that the space is a closed space. It is preferable that the space has a ceiling. The space may be a space that is partially open. A partially open space is, for example, a space with an open door or a space without a ceiling. The space is, for example, a building or a vehicle. A building is an artificially created space. A building is, for example, a house, a room, or a tent. A building is, for example, a hotel, a station, an airport, a tourist facility, a shopping center, an office, or a residence. A space is, for example, a hotel banquet hall, a hotel restaurant, a hotel guest room, a hotel lobby, a lounge at a station or an airport, a waiting room at a station or an airport, a conference room at an office, or a reception room at an office. A vehicle is an object that transports people. A vehicle is, for example, a train, a car, or an airplane. However, the type of space does not matter. The type of building or vehicle does not matter.
[0252] The user information also includes, for example, a video identifier of a video previously viewed by the user, and a space identifier of a space previously viewed by the user. The user information also includes, for example, viewing time information that identifies the time when the video was viewed. The user information also includes, for example, one or more user attribute values.
[0253] Furthermore, it is preferable that the images output to the display media of each of the two or more spaces are the same images. However, the images output to the display media of each of the two or more spaces may be different images. Furthermore, it is preferable that the images output to the display media of each of the two or more spaces are different images, but have related content. Images with related content are, for example, images shot in the same location or images shot of the same environment (e.g., a mountain). Images with related content are, for example, associated images.
[0254] In this embodiment, a space set is described in which images that satisfy a predetermined condition are output to the display media of different spaces in which two or more users who join one space from another space exist, making it easier for the two or more users to perform a collaborative work in the space after joining. Note that the images that satisfy the predetermined condition are, for example, the same image or associated images.
[0255] In addition, in this embodiment, we will explain a spatial collection that makes it easier to have smooth discussions when communicating by outputting images that meet predetermined conditions to display media in different spaces where two or more users who are communicating, such as through web conferences or telephone conferences, are present.
[0256] In addition, in this embodiment, a device that performs a specific process according to the video viewed by the user or the space the user was in is described. The specific process is, for example, a ticket reservation, a restaurant reservation, or a delivery request.
[0257] In this embodiment, a set of display media installed in each of the two or more spaces will be described.
[0258] Furthermore, in this embodiment, a server that selects the video in each of the two or more spaces will be described.
[0259] 23 is a conceptual diagram of a spatial system F in this embodiment. The spatial system F includes two or more spaces, and a server 9. The two or more spaces include, for example, a first space 5, a second space 6, ..., an Nth space (N is a natural number equal to or greater than 2).
[0260] In addition, each of the two or more spaces has one or more display media. In Fig. 23, each space has three display media, but each space may have only one or two display media, or may have four or more display media.
[0261] A display medium is a medium that displays an image. A display medium is a device that displays an image. A display medium is usually a display, but may also be a projector or an area onto which a projector projects an image. The display may be, for example, a liquid crystal display or an organic electroluminescence display, but the type is not important. It is also preferable for the display medium to have a frame such as that in Design Registration No. 1648658.
[0262] It is preferable that the display medium in each of the two or more spaces display the video transmitted from the server 9, but it may also display the video originally stored in the display medium. The display medium may also be called a display device. The display medium receives video from the server 9, for example. The display medium stores the received video in a storage unit, for example, at least temporarily. The display medium may transmit an instruction to transmit the video to the server 9, and receive the video from the server 9 in response to the transmission instruction.
[0263] The image here is usually a natural image. A natural image is an image acquired based on a natural environment. A natural image is an image that reproduces a natural environment. A natural image is, for example, a video of nature. An artificial object may be captured in the natural image. It is preferable that the natural image is an image that has been processed as in the fourth or fifth embodiment. Nature is, for example, a mountain, a forest, a lake, a pond, a river, or the sea.
[0264] The server 9 is a device that supplies images to one or more display media in one or more spaces. The server 9 is, for example, a cloud server or an ASP server, but the type is not important.
[0265] For example, each display medium provided in each of the two or more spaces and the server 9 can communicate with each other via a network such as the Internet. For example, an image transmitted from the server 9 is directly or indirectly transmitted to the display medium, and the display medium displays the image. Note that the display medium may hold in advance one or more images that may be displayed, or may receive images from an image server (not shown) or the like.
[0266] Fig. 24 is a block diagram of a spatial system F in this embodiment. Each of the two or more spaces includes one or more display media and one or more side wall surfaces. The first space 7 includes at least a first display medium 71. The second space 8 includes at least a second display medium 81. The Nth space includes at least an Nth display medium. Each display medium has, for example, a storage section, a display section, and a switching section. The storage section, the display section, and the switching section have been described above.
[0267] For example, the first display medium 71 has a first storage section 711, a first display section 712, and a first switching section 713. For example, the second display medium 81 has a second storage section 811, a second display section 812, and a second switching section 813.
[0268] The server 9 includes a server storage unit 91, a server receiving unit 92, a server processing unit 93, and a server transmitting unit 94. The server storage unit 91 includes a video storage unit 911 and a condition storage unit 912.
[0269] In the storage unit (e.g., first storage unit 711, second storage unit 811) of each display medium provided in each of the one or more spaces, one or more images are stored. It is preferable that the images in the storage unit are images received from the server 9. The images in the storage unit may be stored in advance. It is preferable that the storage unit stores images of two or more locations.
[0270] It is preferable that one or more display media are arranged on one or more side wall surfaces (e.g., side wall surface 72, side wall surface 82) of each of the two or more spaces. Furthermore, when one space has two or more display media, it is preferable that the two or more display media are arranged at different positions. Furthermore, it is preferable that the two or more display media in one space are the same size, but they may be different sizes. In other words, it is preferable that the areas in which images are displayed are the same size, but they may be different sizes. Furthermore, it is preferable that the heights at which the two or more display media are arranged are the same. By arranging the two or more display media at the same height, the human brain can easily connect the images displayed by the two or more display media to recognize one natural image.
[0271] It is preferable that the images displayed by two or more display media arranged at different positions in one space are different images corresponding to the different positions of the two or more display media. It is preferable that each of the different images corresponding to the different positions of the two or more display media is an image of a part of an image of one place, and is an image of an area corresponding to a different position of the display media. It is preferable that each of the different images corresponding to the different positions of the two or more display media is, for example, a part of an image obtained by cutting out an area corresponding to a different position of the display media from a wide-angle image of one place. It is also preferable that each image is an image actually taken in a direction corresponding to a different position of the display media from one place. As a result, the brain of a person who sees the images displayed by two or more display media is under the illusion that the area in which the image is displayed (e.g., a display) is a scene that spreads beyond the space (e.g., a room), and the person thinks that the nature of the place of the image spreads beyond the space. In other words, the human brain is under the illusion that the space in which a person who sees the images displayed by two or more display media is a space that exists at the place of the image. In other words, the brains of people in the space connect the images displayed on two or more display media, creating the illusion that nature is spread out beyond the walls between the two or more display media, making them feel as if they are immersed in that nature.
[0272] It is preferable that the position of each of the one or more display media present in a space is a position where a window is usually installed in the space. The position where the window is installed, that is, the position of the display medium, is, for example, a position where the bottom side of the display medium is approximately 600 mm or more and less than approximately 1200 mm from the floor surface. The position where the window is installed, that is, the position of the display medium, is, for example, a position where the eye height of a person of average sitting height sitting on a sofa is the same height as any point in the area of the display medium.
[0273] It is also preferable that each of two or more display media included in one space displays a natural image of a different part of a natural image in a certain location according to a different position of each display medium.
[0274] It is preferable that each of the two or more spaces exists in a physically different place. The physically different places are, for example, Hakodate and Tokyo, or a station and an office, and have different positions (latitude, longitude). It is preferable that each of the two or more spaces constitutes a spatial collection that is organically connected.
[0275] For example, in a first space and a second space that are organically combined, it is preferable that a second image displayed on a display medium in the second space is an image related to the first image displayed on the display medium in the first space, and the second image is an image selected using user information related to a user present in the second space. The related image is, for example, an identical image, a similar image, or an image taken at the same location.
[0276] The second video is, for example, a video corresponding to a selection condition satisfied by a first video identifier contained in the user information or a first space identifier contained in the user information. Here, each of the two or more videos corresponds to a selection condition under which the video is selected. The received user information includes a first video identifier that identifies the first video viewed by the user or a first space identifier that identifies the first space in which the user viewed the first video.
[0277] The selection condition includes, for example, a viewing time condition that is a condition related to viewing time information that specifies the time when the video or another video was viewed. The user information includes, for example, viewing time information that specifies the time when the user viewed the first video. The second video is selected using the first video identifier or the first spatial identifier when it satisfies the viewing time condition that the viewing time information held by the user information is information indicating a time within a predetermined period of time compared to the time when the second video is selected.
[0278] The selection condition includes, for example, a user attribute value condition that is a condition related to one or more user attribute values of the viewing user. The user information includes, for example, one or more user attribute values. The second video is a video corresponding to the user attribute value condition that is satisfied by one or more user attribute values of the user information.
[0279] The spatial set includes at least two spaces, for example, a first space 7 and a second space 8. A first image viewed by a first user present in the first space 7 on a first display medium 71 provided in the first space 7, and a second image viewed by a second user moving from the second space 8 to the first space 7 on a second display medium 81 provided in the second space 8 are images that satisfy a predetermined condition. Such first image and second image are images selected using schedule information.
[0280] The spatial set includes at least three spaces, for example, a first space 7, a second space 8, and a third space 11. A first image viewed by a first user moving from the first space 7 to the third space 11 on a first display medium 71 included in the first space 7, and a second image viewed by a second user moving from the second space 8 to the third space 11 on a second display medium 81 included in the second space 8 are images that satisfy a predetermined condition. The first image and the second image are images selected using schedule information.
[0281] The predetermined conditions are conditions for multiple users who join one space from another space to be able to cooperate well in a collaborative task (e.g., a discussion) after joining, and are conditions for determining the video to be viewed by each of the multiple users. The predetermined conditions are, for example, that the video is the same or that the video is associated. Corresponding videos are usually videos with related content.
[0282] Schedule information is information about a user's schedule. Schedule information is usually information that specifies that multiple users will meet in one space. Schedule information includes, for example, user identifiers of two or more users who will meet and a space identifier that specifies the meeting space.
[0283] Various types of information are stored in a server storage unit 91 constituting the server 9. The various types of information are, for example, user registration information, user information, video, and various conditions. It goes without saying that the various conditions may be embedded in a program.
[0284] User registration information is information about a registered user. User registration information is usually associated with a user identifier. User registration information has one or more user attribute values.
[0285] A user identifier is information that identifies a user. For example, a user identifier is a user ID, a name, a telephone number, or an email address. A user attribute value is an attribute value of a user. For example, a user attribute value is gender, age, job title, or place of origin, but it is not important.
[0286] User information is information about a user. User information is usually associated with a user identifier. User information may, for example, include one or more user attribute values, one or more viewing information, one or more schedule information, or one or more reservation information. Reservation information may, for example, be web conference information or telephone conference information.
[0287] The viewing information is information about a video viewed by a user. The viewing information corresponds to a user identifier of the user who viewed the video. The viewing information has, for example, viewing time information, a space identifier of the viewing space, and a video identifier of the viewed video. The viewing time information is information that specifies the time when the video was viewed. The viewing time information is, for example, one or two pieces of information: the viewing start date and time, and the viewing end date and time.
[0288] Schedule information is information that specifies a user's schedule. Schedule information may be said to be calendar information. Schedule information is usually associated with a user identifier. Schedule information includes, for example, a start date and time of the schedule, an end date and time of the schedule, and a location identifier of the location where the schedule will take place. The location identifier is, for example, a location name or a location ID.
[0289] The reservation information is information about a reservation for communication between multiple people. The communication is, for example, a web conference or a telephone conference. The web conference may be broadly considered to include a television conference or a video conference.
[0290] The web conference information is information about a web conference that is scheduled to be held, and includes, for example, user identifiers of two or more users who will participate in the web conference, the start date and time of the web conference, and the end date and time of the web conference.
[0291] The conference call information is information about a conference call that is scheduled to be held, and includes, for example, user identifiers of two or more users who will participate in the conference call, the start date and time of the conference call, and the end date and time of the conference call.
[0292] The video storage unit 911 stores one or more videos that can be output by a spatial display medium. Each of the one or more videos may be associated with video conditions. The video conditions are conditions for selecting a video, and include conditions related to the location and / or conditions related to the space in which it is displayed. The video conditions may be conditions that constitute the selection conditions. It is preferable that the video is video acquired by the video output device 5. The video may include sound.
[0293] Various conditions are stored in the condition storage unit 912. The various conditions are, for example, one or more selection conditions and one or more processing conditions.
[0294] The selection conditions are conditions for selecting a video to be displayed, and include, for example, viewing conditions and user attribute value conditions.
[0295] The viewing condition is a condition related to the time when the video is viewed. The user attribute value condition is information related to one or more user attribute values of the user who views the video.
[0296] The processing conditions are conditions for determining the processing to be performed, and include, for example, conditions related to the space in which the video is viewed, or conditions related to the viewed video.
[0297] The server receiving unit 92 receives various instructions and information, such as an output instruction and a user registration instruction.
[0298] The output instruction is an instruction to output a video. The output instruction includes, for example, a space identifier. The output instruction includes, for example, a user identifier.
[0299] A user registration instruction is an instruction to register user registration information. A user registration instruction has one or more user attribute values.
[0300] The server receiving unit 92 receives, for example, user information. The server receiving unit 92 receives, for example, user information from a display medium. The server receiving unit 92 receives, for example, user information from a user terminal not shown. The server receiving unit 92 is, for example, a device not shown, and receives user information from a device (e.g., an IC card reader) present in the space. The server receiving unit 92 receives, for example, schedule information from a schedule management server (e.g., a Google Calendar server). The server receiving unit 92 receives, for example, reservation information from a reservation management server (e.g., a Zoom (registered trademark) server).
[0301] The user information received here is, for example, viewing information, schedule information, or reservation information. The viewing information is information on the history of videos viewed by a user. The viewing information is, for example, information including a first video identifier that identifies a first video displayed by a first display medium 71 provided in a first space 7 of the at least two spaces, and a user identifier of a user who viewed the first video. The viewing information includes, for example, viewing time information. The viewing time information typically includes one or more pieces of information of a start date and time or an end date and time.
[0302] The server processing unit 93 selects one or more videos that match the selection conditions satisfied by the user information from the video storage unit 911 in which two or more videos that match the selection conditions are stored. The selection of a video includes, for example, obtaining a video identifier, obtaining a video, and obtaining a link to the video. It is preferable that the server processing unit 93 selects a video in response to receiving an output instruction.
[0303] The selection conditions include, for example, viewing time conditions that are conditions related to viewing time information that specifies when a video or other video was viewed, and user attribute value conditions that are conditions related to one or more user attribute values of a viewing user.
[0304] The server processing unit 93 performs a user registration process in response to receiving the user registration instruction. The user registration process is a process of forming user registration information including one or more user attribute values included in the received user registration instruction and storing the information in the server storage unit 91.
[0305] The server processing unit 93 accumulates the user information received by the server receiving unit 92 in the server storage unit 91. Such user information is, for example, viewing information, schedule information, or reservation information.
[0306] The server transmission unit 94 transmits one or more images selected by the server processing unit 93 to a display medium 1 included in the space in which the user exists. The server transmission unit 94 transmits, for example, one or more images selected by the server processing unit 93 to a second display medium 81 included in a second space 8 in which the user exists.
[0307] The server storage unit 91, the video storage unit 911, and the condition storage unit 912 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0308] There is no restriction on the process by which information is stored in the server storage unit 91 etc. For example, information may be stored in the server storage unit 91 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the server storage unit 91 etc., or information inputted via an input device may be stored in the server storage unit 91 etc.
[0309] The server receiving unit 92 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.
[0310] The server processing unit 93 can usually be realized by a processor, a memory, etc. The processing procedure of the server processing unit 93 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type is not important.
[0311] The server transmitting unit 94 is usually realized by a wireless or wired communication means, but may also be realized by a broadcasting means.
[0312] Next, an example of the operation of the server 9 constituting the spatial system F will be described with reference to the flowchart of FIG.
[0313] (Step S2501) The server receiving unit 92 judges whether or not user information corresponding to a user identifier has been received from a display medium or a user terminal (not shown). If user information has been received, the process proceeds to step S2502, and if user information has not been received, the process proceeds to step S2504. The user information here is, for example, viewing information, schedule information, or reservation information.
[0314] (Step S2502) The server processing unit 93 acquires a user identifier associated with the user information.
[0315] (Step S2503) The server processing unit 93 stores the user information received in step S2501 in the server storage unit 91 in association with the user identifier acquired in step S2502. The process returns to step S2501.
[0316] (Step S2504) The server receiving unit 92 judges whether or not an output instruction corresponding to the user identifier and the space identifier has been received from the display medium, a user terminal (not shown), or a device (not shown). If an output instruction has been received, the process proceeds to step S2505, and if an output instruction has not been received, the process proceeds to step S2511.
[0317] The device not shown is, for example, a device existing in the space, and is, for example, a device that acquires a user identifier from a card (e.g., an IC card) held by a user or a user terminal, and transmits an output instruction that corresponds to the user identifier and the stored space identifier. The device not shown includes, for example, the function of an IC card reader.
[0318] Also, for example, a user intentionally transmits an output instruction from a user terminal. Also, for example, a user uses a remote control for the display medium to input an output instruction into the display medium, and the output instruction is transmitted from the display medium. Also, for example, when a user enters a space, a device not shown acquires a user identifier from a user terminal (for example, a smartphone or an IC card), composes an output instruction, and transmits it. In other words, the path taken until the server receiving unit 92 receives the output instruction does not matter. Also, the trigger or timing for transmitting the output instruction does not matter.
[0319] (Step S2505) The server processing unit 93 acquires a user identifier associated with the output instruction.
[0320] (Step S2506) The server processing unit 93 acquires a space identifier associated with the output instruction.
[0321] (Step S2507) The server processing unit 93 acquires from the server storage unit 91 one or more pieces of user information associated with the user identifier acquired in step S2505.
[0322] The user information here is, for example, one or more types of information selected from the group consisting of one or more user attribute values, viewing information, schedule information, and reservation information.
[0323] (Step S2508) The server processing unit 93 selects one or more videos to be viewed by the user, using the one or more pieces of user information acquired in step S2507. An example of such video selection processing will be described with reference to the flowchart in FIG.
[0324] (Step S2509) The server transmission unit 94 acquires the one or more images selected in step S2508. Next, the server transmission unit 94 transmits the one or more images so that the acquired one or more images can be displayed on one or more display media in the space identified by the space identifier acquired in step S2506.
[0325] Information that associates a space with one or more display media that exist in the space is stored in the server storage unit 91. Such association information is, for example, a space identifier and one or more display medium identifiers (for example, IP addresses). Then, the server transmission unit 94 acquires, for example, one or more display medium identifiers (for example, IP addresses) that are paired with the space identifier acquired in step S2506, and transmits the acquired one or more videos to one or more display media in the space identified by the space identifier using the one or more display medium identifiers. Also, the server transmission unit 94 acquires, for example, a device identifier (for example, IP address) that is paired with the space identifier acquired in step S2506, and transmits the acquired one or more videos to a device (not shown) identified by the device identifier. Note that such a device (not shown) is a server for displaying videos on one or more display media in the space identified by the space identifier. In other words, the server transmission unit 94 may be configured so that the acquired one or more videos can be displayed on one or more display media in the space identified by the space identifier acquired in step S2506.
[0326] Furthermore, the server transmission unit 94 normally acquires the one or more videos selected in step S2508 from the video storage unit 911, but may acquire the one or more videos from a device (e.g., a video server) not shown in the figure. In other words, the device in which the one or more videos are stored is not important.
[0327] (Step S2510) The server processing unit 93 performs the addition process. Return to step S2501. An example of the addition process will be described with reference to the flowchart in FIG.
[0328] The additional process is an additional process based on the display of the image or on entering the user's space, for example, a ticket reservation, a restaurant reservation, or a meal order, but is not limited thereto.
[0329] (Step S2511) The server receiving unit 92 judges whether or not a user registration instruction has been received from a user terminal (not shown). If a user registration instruction has been received, the process proceeds to step S2512, and if a user registration instruction has not been received, the process returns to step S2501.
[0330] (Step S2512) The server processing unit 93 performs a user registration process using the user registration instruction received in step S251. Then, the process returns to step S2501.
[0331] The server processing unit 93 generates, for example, a unique user identifier. Next, the server processing unit 93 stores the user identifier in the server storage unit 91 in association with one or more user attribute values included in the received user registration instruction.
[0332] In the flowchart of FIG. 25, the process ends when the power is turned off or an interrupt occurs to end the process.
[0333] Next, an example of the video selection process in step S2511 will be described with reference to the flowchart in FIG.
[0334] (Step S2601) The server processing unit 93 assigns 1 to a counter i.
[0335] (Step S2602) The server processing unit 93 judges whether or not the i-th selection condition exists in the condition storage unit 912. If the i-th selection condition exists, the process proceeds to step S2603, and if the i-th selection condition does not exist, the process returns to the upper processing.
[0336] (Step S2603) The server processing unit 93 acquires one or more pieces of information to be used for determining the i-th selection condition. The one or more pieces of information are, for example, one or more pieces of information among the user information acquired in step S2507.
[0337] For example, information for identifying information to be used for determining whether the selection condition is satisfied is stored in association with the selection condition. For example, information for identifying information to be used for determining whether the selection condition is satisfied is included in the selection condition. For example, an identifier of a module for determining whether the selection condition is satisfied (for example, a module name) is stored in association with the selection condition.
[0338] (Step S2604) The server processing unit 93 judges whether or not the one or more pieces of information acquired in step S2603 satisfy the i-th selection condition. If the i-th selection condition is satisfied, the process proceeds to step S2605, and if the i-th selection condition is not satisfied, the process proceeds to step S2606.
[0339] (Step S2605) The server processing unit 93 acquires one or more video identifiers corresponding to the i-th selection condition from the video storage unit 911, and temporarily stores them in a buffer (not shown). Note that the video identifiers temporarily stored in the buffer (not shown) are the video identifiers of the selected videos.
[0340] (Step S2606) The server processing unit 93 increments the counter i by 1. The process returns to step S2602.
[0341] 26, when two or more video identifiers are acquired in step S2605, the server processing unit 93 may select one video identifier randomly or may select one video identifier based on some condition. Also, when two or more video identifiers are acquired in step S2605, the server processing unit 93 may not select some of the two or more video identifiers.
[0342] Next, an example of the addition process in step S2510 will be described with reference to the flowchart in FIG.
[0343] (Step S2701) The server processing unit 93 assigns 1 to a counter i.
[0344] (Step S2702) Server processing unit 93 determines whether or not the i-th processing condition exists in condition storage unit 912. If the i-th processing condition exists, the process proceeds to step S2703; if the i-th processing condition does not exist, the process returns to the upper processing.
[0345] (Step S2703) The server processing unit 93 acquires one or more pieces of information to be used for determining the i-th processing condition. The one or more pieces of information are, for example, one or more pieces of information among the user information acquired in step S2507.
[0346] For example, information for identifying information to be used for determining the processing condition is stored in association with the processing condition. For example, information for identifying information to be used for determining the processing condition is included in the processing condition. For example, an identifier of a module for determining the processing condition (for example, a module name) is stored in association with the processing condition.
[0347] (Step S2704) The server processing unit 93 judges whether or not the one or more pieces of information acquired in step S2703 satisfy the i-th processing condition. If the i-th processing condition is satisfied, the process proceeds to step S2705, and if the i-th processing condition is not satisfied, the process proceeds to step S2706.
[0348] (Step S 2705 ) The server processing unit 93 acquires a processing identifier corresponding to the i-th processing condition from the condition storage unit 912 .
[0349] (Step S2706) The server processing unit 93 acquires one or more parameters to be given to the module identified by the processing identifier acquired in step S2705. Note that, here, if the module identified by the processing identifier acquired in step S2705 does not require any parameters, this step is omitted.
[0350] (Step S2707) The server processing unit 93 executes the module identified by the processing identifier acquired in step S2705. Note that the server processing unit 93 provides, for example, one or more parameters acquired in step S2706 to the module identified by the processing identifier acquired in step S2705, and executes the module.
[0351] (Step S2708) The server processing unit 93 increments the counter i by 1. The process returns to step S2702.
[0352] A specific example of the operation of the space system F in this embodiment will be described below. What the space system F achieves is to construct a space collection that organically integrates spaces in two or more different locations. Such a space collection will construct an integrated society. FIG. 28 shows such an image. In FIG. 28, for example, in two or more different spaces such as an office conference room 2801, a restaurant 2803 in a hotel 2802, a hotel banquet hall, a hotel lounge, a station waiting room 2804, a train room in a train 2805, and a shopping mall 2806, a display medium in the space displays a selected video and allows one or more users to view the video, thereby making the space collection, which is two or more different spaces, an organically integrated space for the one or more users. In organically integrating the spaces, it is preferable for a concierge 2807 in a hotel, station, etc. to select a video space (video to be displayed) and perform additional processing (arranging tickets for the train 2805, making reservations for the restaurant 2803, delivering luggage 2808, introducing tourist spots, etc.).
[0353] Here, the video storage unit 911 of the server 9 of the spatial system F stores the video management table shown in FIG. 29. The video management table is a table that manages candidate videos to be displayed by the display medium. The video management table has two or more records each having an "ID", "video identifier", "video condition", and "corresponding video". The "video condition" has a "location identifier" and a "space identifier". Note that the "ID" is information that identifies the record. The "video identifier" here is the file name of the video. The "corresponding video" is the video identifier of one or more videos that correspond to one or more videos identified by the "video identifier". The "video condition" may be considered to be included in the selection conditions. The "location identifier" is a condition related to the location. The "space identifier" is a condition related to the space. The attribute value "-" indicates "NULL".
[0354] The condition storage unit 912 stores a selection condition management table shown in FIG. 30. The selection condition management table is a table for managing one or more selection conditions. The selection condition management table has "ID", "selection condition identifier", "priority", "selection condition", and "target video". The "selection condition identifier" is information for identifying the selection condition, and is an ID here. The "priority" is a priority for applying the selection condition. That is, the server processing unit 93 checks whether the selection condition is satisfied in order of priority here, and when the selection condition is satisfied, determines one or more videos corresponding to the selection condition. The "selection condition" here is a condition related to schedule information, a condition related to web conference information, a condition related to viewing information, a condition related to one or more user attribute values, a condition related to the number of users viewing (the number of users present in the space), or a combination of two or more of these conditions. The "target video" is information for determining the video to be selected. The "target video" is, for example, information or a variable indicating that it is a module identifier of a module for selecting a video, or a video identifier of a viewed video.
[0355] "num (schedule information, user identifier)" in the "selection condition" of "ID=1" in Figure 30 indicates that the number of user identifiers of users who are participants in the schedule identified by the schedule information is two or more. "Schedule information.start date=$today" indicates that the start date in the schedule information is today. "select (schedule information, location)" in the "target video" of "ID=1" in Figure 30 indicates that this is a module that obtains the video identifier that pairs with the information "location" held by the schedule information that satisfies the selection condition.
[0356] The "selection condition" for "ID=2" indicates that it is true if the date and time in the web conference information is after the current time and within 3 hours of the current time. The "target video" for "ID=2" indicates that the video identified by the video identifier "M01" is to be selected.
[0357] The "selection condition" of "ID=3" indicates that it is true if the video was last viewed within two hours before the current time. The "target video" of "ID=3" indicates that the video identified by the video identifier included in the viewing information that satisfies the selection condition (viewing information that specifies that it was viewed within the past two hours) will be selected.
[0358] The "selection condition" for "ID=4" indicates that it is true if the time the video was first viewed is within six hours before the current time, the user identifier included in the output instruction is two or more (two or more people have joined), and the genders of the users identified by the user identifiers included in the output instruction are different (if "diff()=1"). The "corresponding video (viewing information.video identifier)", which is the "target video" for "ID=4", indicates that the video identifier of the video corresponding to the previously viewed video is to be obtained. The video corresponding to the previously viewed video is video that is related to the previously viewed video.
[0359] The "selection condition" for "ID=5" indicates that the result is true if the time the video was first viewed was within six hours before the current time, the user identifier included in the output instruction is two or more (two or more people have joined), and the users identified by the user identifiers included in the output instruction are of the same gender (if "diff()=0"). The "target video" for "ID=5" indicates that the video identifier included in the viewing information that satisfies the selection condition will be obtained. In other words, the "target video" for "ID=5" indicates that the same video as the video first viewed will be selected.
[0360] The "selection condition" of "ID=XX" indicates that if none of the selection conditions are met, an image corresponding to the space the user is in will be selected according to the target image "Select (output instruction.space identifier)".
[0361] Furthermore, the condition storage unit 912 stores a processing condition management table shown in FIG. 31. The processing condition management table is a table for managing one or more processing conditions. The processing condition management table manages one or more records having "ID", "processing condition", and "processing information". The "processing condition" includes "space condition", which is a condition related to the spatial identifier of the space in which the user exists, and "video condition", which is a condition related to the video identifier of the video that the user will watch or has watched. The "processing information" is information that specifies the processing. Here, the "processing information" includes both the module name and information that specifies one or more parameters to be given to the module.
[0362] "ID=1" in Figure 31 indicates that when a user enters a space identified by spatial identifier "SP05" (here, a hotel room), processing for ordering a meal is performed. "ID=2" indicates that when a video identified by video identifier "M02" is displayed in a space identified by spatial identifier "SP02" (usually when the display starts), processing for reserving a ticket from the station specified by spatial identifier "SP02" (XXXX Station) to "Hakodate", the location of the video identified by video identifier "M02", is performed.
[0363] "ID=3" indicates that when the video identified by the video identifier "M08" is displayed (usually when the display starts), the process of reserving seats for the number of users who will be watching the video one hour later will be carried out at the restaurant closest to the location where the space identified by the spatial identifier exists. Note that "num (user identifier)" is a module that returns the number of users.
[0364] It is also assumed that the server storage unit 91 stores a user registration management table as shown in FIG. 32. The user registration management table is a table that manages user registration information. The user registration management table is a table that manages one or more records having an "ID," "user identifier," and "user attribute value." The "user attribute value" here includes "gender" and "age." The user registration management table is a table that is constructed by the user registration process.
[0365] Also, it is assumed that the server storage unit 91 stores the viewing information management table shown in FIG. 33. The viewing information management table is a table that manages viewing information indicating the viewing history of a video. The viewing information management table manages one or more records having an "ID", "user identifier", and "viewing information". The "viewing information" has a "start date and time", "end date and time", "space identifier", and "video identifier". The "start date and time" and "end date and time" have a date and time. A record in the viewing information management table has a video viewed by one or more users, the space where the video was viewed, and viewing time information. The viewing time information is information that specifies the time when the video was viewed, and in this case is the "start date and time" and the "end date and time".
[0366] Also, it is assumed that the server storage unit 91 stores a schedule information management table shown in FIG. 34. The schedule information management table is a table that manages one or more pieces of schedule information. The schedule information management table manages one or more records having an "ID" and "schedule information". The "schedule information" has a "user identifier", "start date and time", "end date and time", and "location". The "user identifier" is the user identifier of one or more users who will participate in the schedule. The "location" is the identifier of the location where the schedule will take place. The "location" here is the location ID or location name. Also, the schedule information management table shown in FIG. 34 exists, for example, in a schedule management server (not shown) (for example, a Google Calendar server).
[0367] Also, it is assumed that the server storage unit 91 stores a web conference information management table shown in FIG. 35. The web conference information management table is a table that manages one or more pieces of web conference information. The web conference information management table manages one or more records having an "ID" and "web conference information". The "web conference information" has a "user identifier", a "start date and time", and an "end date and time". The "user identifier" is an identifier for each of two or more users that are scheduled to participate in the web conference. The "start date and time" is the scheduled start date and time of the web conference, and the "end date and time" is the scheduled end date and time of the web conference. Also, the schedule information management table shown in FIG. 35 exists, for example, in a web conference server (not shown) (for example, a Zoom (registered trademark) server).
[0368] In the above situation, four specific examples of operations in the spatial system F are given below.
[0369] Concrete example 1 is a spatial system in which, when a user moves sequentially through two or more spaces, the user is made to recognize that he or she is creating an integrated society in which the two or more spaces are organically integrated by viewing the same video in each space.
[0370] Concrete example 2 is a spatial system in which, when a user moves sequentially through two or more spaces, the user is able to perceive that he or she is creating an integrated society in which two or more spaces are organically integrated by viewing different related images in the multiple spaces.
[0371] Concrete example 3 is an example in which two or more users are in different spaces and, when they join one space, the two or more users watch the same or related video in the different spaces before joining, so that the two or more users can proceed with appropriate collaborative work after joining the one space. Appropriate collaborative work is, for example, smooth communication.
[0372] Specific example 4 is a case in which two or more users are each in a different space and then hold a web conference, in which the two or more users watch the same video or related video in each of the different spaces before the web conference, allowing the two or more users to smoothly conduct the web conference.
[0373] (Example 1) A specific example of the operation of the spatial system F in the specific example 1 will be described with reference to Fig. 36. It is assumed that a user identifier "U01" is stored in a user terminal (e.g., a smartphone or an IC card) of user A (not shown). It is also assumed that user A holds the user terminal and enters the office (3601). Next, a device (e.g., a server, an IC card reader) (not shown) in the office (3601) receives the user identifier "U01" from the user terminal, and transmits an output instruction (e.g., "output instruction (SP01, U01)") having the space identifier "SP01" and the user identifier "U01" stored in the device (not shown) to the server 9.
[0374] Next, the server 9 receives the output instruction and determines through the above-mentioned process that the selection conditions such as "ID=1", "ID=2", "ID=4", "ID=3", and "ID=5" in the selection condition management table of FIG. 30 are not satisfied. Next, the server 9 executes "select(SP01)" using the target video "select(output instruction.space identifier)" of the record of "ID=XX" to obtain video identifiers "M05, M06" from the video management table of FIG. 29. Next, the server 9 obtains the video identified by the video identifiers "M05, M06" and transmits the video identified by the video identifiers "M05, M06" to the display medium installed in the space identified by the space identifier "SP01". The video identified by the video identifiers "M05, M06" is a natural video that can be refreshing while working. It is preferable that the natural video here is a video converted into a supernatural scene by the video output device 5.
[0375] Next, the display medium in the office (3601) receives the two images and displays the two images sequentially and repeatedly.
[0376] Then, assume that after performing work in the office (3601) for a while, user A leaves the office (3601) and heads to the waiting room (3602) at the station. Then, a device (not shown) in the office (3601) detects that user A has left the office (3601) and stops the display of the image on the display medium. The device (not shown) also transmits information about the stop of the image display (for example, "output stopped (U01, SP01)") to the server.
[0377] Next, the server 9 receives the information of the stop of the display of the video, composes the viewing information "<user identifier> U01 <start date and time> T11 <end date and time> T12 <space identifier> SP01 <video identifier> M05, M06", and stores the viewing information in the viewing information management table (FIG. 33). Note that the viewing information is the record of "ID=1" in FIG. 33.
[0378] Next, assume that user A enters the station waiting room (3602) one hour after leaving the office (3601). The user terminal then receives the space identifier "SP04" from a device (not shown) in the station waiting room (3602), and configures an output instruction (for example, "output instruction (SP04, U01)") together with the stored user identifier "U01", and transmits the output instruction to the server 9.
[0379] Next, it is assumed that the server 9 determines, by the above-mentioned process, using the record of "ID=1" in the viewing information management table (Fig. 33), that the selection condition of "ID=3" in the selection condition management table (Fig. 30) is met. Next, the server 9 acquires video identifiers "M05, M06" from the record of "ID=1" in the viewing information management table (Fig. 33) based on the target video "viewing information.video identifier" of "ID=3" in the selection condition management table (Fig. 30). Next, the server 9 acquires the video identified by the video identifiers "M05, M06" from the server storage unit 91, and transmits the two videos to a display medium installed in a space identified as the station waiting room (3602).
[0380] Next, the display medium in the station waiting room (3602) receives the two videos and displays the two videos sequentially and repeatedly. As a result, user A can view the same video in the station waiting room (3602) that he or she viewed in the office (3601).
[0381] Then, after watching the video in the station waiting room (3602), it is shortly before the departure time of the reserved train, so User A leaves the station waiting room (3602) and heads to the train compartment (3603).
[0382] Then, a device (not shown) in the station waiting room (3602) detects that user A has left the station waiting room (3602) and sends information to the server to stop displaying the video to user A (for example, "output stopped (U01, SP04)").
[0383] Next, the server 9 receives information about the stopping of the display of the video, composes the viewing information "<user identifier> U01 <start date and time> T51 <end date and time> T52 <space identifier> SP04 <video identifier> M05, M06", and stores the viewing information in the viewing information management table (Figure 33).
[0384] Next, assume that user A enters the train compartment (3603) 5 minutes after leaving the station waiting room (3602). The user terminal then receives the spatial identifier "SP03" from a device (not shown) in the train compartment (3603), and configures an output instruction (for example, "output instruction (SP03, U01)") together with the stored user identifier "U01", and transmits the output instruction to the server 9.
[0385] Next, it is assumed that the server 9 determines, through the above-mentioned process, that the viewing information paired with the user identifier "U01" in the viewing information management table matches the selection condition of "ID=3" in the selection condition management table (Fig. 30). Next, the server 9 obtains video identifiers "M05, M06" from the viewing information management table (Fig. 33) based on the target video "viewing information.video identifier" of "ID=3" in the selection condition management table (Fig. 30). Next, the server 9 transmits the video identified by the video identifiers "M05, M06" to a display medium installed in a space identified by a train compartment (3603).
[0386] Next, the display medium in the train compartment (3603) receives the two videos and displays the two videos sequentially and repeatedly. As a result, user A can view the same video in the train compartment (3603) that he or she viewed in the office (3601) and the station waiting room (3602).
[0387] As described above, in this specific example, even if a user moves between multiple spaces, the user can view the same video in each space, and as a result, the user can recognize the multiple spaces as a single collection of spaces that are organically connected.
[0388] As a result, users can easily continue their activities even when moving between multiple spaces.
[0389] (Example 2) A specific example of the operation of the spatial system F in the specific example 2 will be described with reference to Fig. 37. As in the specific example 1, it is assumed that a user A holds a user terminal and enters an office (3701). Then, the process described in the specific example 1 is performed, and the display medium in the office (3701) receives the two videos and displays the two videos sequentially and repeatedly.
[0390] It is assumed that after performing work for a while in the office (3701), user A leaves the office (3701) to go on a trip with his wife, and heads to a waiting room at the station (3702). It is assumed that user A is to meet his wife in the waiting room at the station (3702).
[0391] Next, assume that user A and his wife (user identifier=U02) enter the station waiting room (3702) one hour after user A leaves the office (3701). Then, the user terminal of user A receives the space identifier "SP04" from a device (not shown) in the station waiting room (3702), and configures an output instruction (for example, "<space identifier>SP04 <user identifier>U01, U02") together with the stored user identifier "U01" and the wife's user identifier "U02", and transmits the output instruction to the server 9.
[0392] Next, the server 9 receives the output instruction. Then, the server 9 determines that the selection condition of "ID=4" in the selection condition management table (FIG. 30) is met through the above-mentioned process. The server 9 obtains the genders of the user A and his wife from the user registration management table (FIG. 32) and uses them to determine the selection condition. Next, the server 9 obtains the video identifiers "M25, M26" of the corresponding video paired with the video identifiers "M05, M06" from the video management table (FIG. 29) based on the target video "corresponding video (viewing information. video identifier)" of "ID=4" in the selection condition management table (FIG. 30). Next, the server 9 obtains the video identified by the video identifiers "M25, M26" from the server storage unit 91 and transmits the two videos to a display medium installed in the waiting room (3702) of the station.
[0393] Next, the display medium in the station waiting room (3702) receives the two videos identified by the video identifiers "M25, M26" and displays the two videos sequentially and repeatedly. As a result, user A can view in the station waiting room (3702) a video related to the video he was viewing in the office (3701) and that is in line with his next action purpose (for example, a video related to sightseeing).
[0394] Then, after User A and his wife have watched the video in the station waiting room (3702), it is shortly before the departure time of the reserved train, so they leave the station waiting room (3702) and head to the train compartment (3703).
[0395] Then, a device (not shown) in the station waiting room (3702) detects that user A has left the station waiting room (3603) and sends information to the server to stop displaying the video to user A (for example, "output stopped (U01, SP04)").
[0396] Next, the server 9 receives information about the stopping of the display of the video, constructs the viewing information "<user identifier> U01, U02 <start date and time> T61 <end date and time> T62 <space identifier> SP04 <video identifier> M25, M26", and stores the viewing information in the viewing information management table (Figure 33).
[0397] Next, assume that User A and his wife enter the train compartment (3703) 5 minutes after leaving the station waiting room (3702). The user terminal then receives the space identifier "SP03" from a device (not shown) in the train compartment (3703), and configures an output instruction (for example, "<space identifier> SP03 <user identifier> U01, U02") together with the stored user identifiers "U01, U02", and transmits the output instruction to the server 9.
[0398] Next, the server 9 receives the output instruction. Then, it is assumed that the server 9 has determined through the above-mentioned process that the selection condition of "ID=4" is met. The server 9 acquires the genders of the user A and his wife from the user registration management table (Fig. 32) and uses them to determine the selection condition. Next, it is assumed that the server 9 acquires the video identifiers "M35, M36" of the corresponding video paired with the video identifiers "M25, M26" from the video management table (Fig. 29) based on the target video "corresponding video (viewing information.video identifier)" of "ID=4" in the selection condition management table (Fig. 30). Next, the server 9 acquires the video identified by the video identifiers "M35, M36" and transmits the two videos to a display medium installed in a compartment (3703) of the train.
[0399] Next, the display medium in the train compartment (3703) receives the two videos identified by the video identifiers "M35, M36" and displays the two videos sequentially and repeatedly. As a result, User A and his wife can view videos related to the videos they viewed in the office (3701) and the station waiting room (3702) in the train compartment (3703).
[0400] Next, assume that the train arrives at the destination, and User A and his wife leave the train compartment (3703), move on, and enter the hotel room (3704) 10 minutes later. The user terminal then receives the spatial identifier "SP05" from a device (not shown) in the hotel room (3704), and configures an output instruction (for example, "<spatial identifier>SP05 <user identifier>U01,U02") together with the stored user identifiers "U01,U02", and transmits the output instruction to the server 9.
[0401] Next, the server 9 receives the output instruction. Then, it is assumed that the server 9 has determined through the above-mentioned process that the selection condition of "ID=4" is met. The server 9 acquires the genders of the user A and his wife from the user registration management table (Fig. 32) and uses them to determine the selection condition. Next, it is assumed that the server 9 acquires the video identifiers "M45, M46" of the corresponding video paired with the video identifiers "M35, M36" from the video management table (Fig. 29) based on the target video "corresponding video (viewing information.video identifier)" of "ID=5" in the selection condition management table (Fig. 30). Next, the server 9 acquires the video identified by the video identifiers "M45, M46" and transmits the two videos to a display medium installed in the hotel guest room (3704).
[0402] Next, the display medium in the hotel room (3704) receives the two videos identified by the video identifiers "M45, M46" and displays the two videos sequentially and repeatedly. As a result, User A and his wife can view, in the hotel room (3704), videos related to the videos they viewed in the office (3701), the station waiting room (3702), and the train compartment (3703).
[0403] Furthermore, the server 9 detects that the spatial identifier "SP05" matches the record of "ID=1" in the processing condition management table (FIG. 31), and executes the processing information "meal order (SP05)". As a result, meals for two are delivered by room service to the hotel room where User A and his wife are staying.
[0404] As described above, in this specific example, even if one or more users move between multiple spaces, they can view related video in each space, and as a result, the multiple spaces can be recognized by the users as a single collection of spaces that are organically connected.
[0405] Furthermore, in this specific example, a process (here, ordering food) according to the space to which the user has moved is automatically performed.
[0406] As a result, users can experience a visual space that changes as they move, while also enjoying traveling and dining.
[0407] (Example 3) A specific operation example of the spatial system F in the specific example 3 will be described with reference to Fig. 38. A user A identified by a user identifier "U01" and a user B identified by a user identifier "U04" are scheduled to hold a conference at a place "P01". Here, "P01" is, for example, the office (3801) of the user A.
[0408] Then, assume that on the day indicated by the date "D11" in the start date and time of the meeting "D11T11" (the day of the meeting), at a time before the meeting, user A enters the office (3801), and user B boards a train to head to user A's office and enters a train compartment (3802).
[0409] The server 9 then receives an output instruction "<space identifier>SP01 <user identifier>U01" from the user terminal of user A. The server 9 also receives an output instruction "<space identifier>SP03 <user identifier>U04" from the user terminal of user B.
[0410] Next, the server 9 refers to the record of "ID=1" in the schedule information management table (Fig. 34) and determines that the selection condition of "ID=1" in the selection condition management table (Fig. 30) is met. Next, the server 9 constructs "select(P01)" from the target video "select(schedule information·location)" of "ID=1" in the selection condition management table (Fig. 30) and the location "P01" of the record of "ID=1" in the schedule information management table (Fig. 34), and obtains the video identifier "M04" that pairs with "P01" from the video management table (Fig. 29) based on the "select(P01)". Next, the server 9 obtains the video identified by the video identifier "M04" and transmits the video to the display medium in the office (3801). Similarly, the server 9 transmits the video to the display medium in the train compartment (3802).
[0411] Next, the video is received and displayed on a display medium in the office (3801), and also on a display medium in a train compartment (3802).
[0412] After viewing the video, user A and user B meet at the office (3801) which is the conference location "P01" at the start date and time "D11T11" and hold the conference.
[0413] As described above, in this specific example, when two or more users who are to join move from different spaces to one space, the two or more users can be supported to watch the same video in the different spaces. As a result, after the two or more users join, the collaborative work can be easily carried out. In other words, in this specific example, by making the different spaces in which the two or more users who are to join are present into one space collection that is organically combined, the collaborative work can be easily carried out appropriately after the two or more users join.
[0414] Needless to say, the meeting point "P01" need not be the location where user A is or the location where user B is, but may be a third location.
[0415] (Example 4) A specific operation example of the spatial system F in the specific example 4 will be described with reference to Fig. 39. Assume that two people, including a user A identified by a user identifier "U01" and a user C identified by a user identifier "U07", are planning to hold a web conference. Assume that such web conference information is the record of "ID=2" in the web conference information management table (Fig. 35).
[0416] Let us suppose that user A enters the office (3901) one hour before the web conference, and user C enters the waiting room (3902) at the station one hour before the web conference.
[0417] The server 9 then receives an output instruction "<space identifier>SP01 <user identifier>U01" from the user terminal of user A. The server 9 also receives an output instruction "<space identifier>SP04 <user identifier>U07" from the user terminal of user C.
[0418] Next, in response to an output instruction sent from the user terminal of user A, the server 9 refers to the record of "ID=2" in the web conference information management table (Fig. 35) and determines that it matches the selection condition of "ID=2" in the selection condition management table (Fig. 30). Next, the server 9 acquires the target video "M01" of "ID=2" in the selection condition management table (Fig. 30). Next, the server 9 acquires the video identified by the video identifier "M01" and transmits the video to a display medium in the office (3901) identified by the spatial identifier "SP01".
[0419] Next, the display medium in the office (3901) receives and displays the video of "M01."
[0420] Also, in response to an output instruction sent from the user terminal of user C, the server 9 refers to the record of "ID=2" in the web conference information management table (Fig. 35) and determines that it matches the selection condition of "ID=2" in the selection condition management table (Fig. 30). Next, the server 9 acquires the target video "M01" of "ID=2" in the selection condition management table (Fig. 30). Next, the server 9 acquires the video identified by the video identifier "M01" and transmits the video to the display medium of the station waiting room (3902) identified by the space identifier "SP04".
[0421] Next, the display medium in the station waiting room (3902) receives and displays the image of "M01."
[0422] As a result, multiple participants in a web conference can feel as if they are in the same space before and during the web conference, even though they are in different locations. This allows smooth discussion in the web conference. In other words, in this specific example, by making the different spaces in which two or more users are present before the web conference into one space collection that is organically combined, appropriate collaboration can be easily carried out during a web conference by two or more users. Note that appropriate collaboration is, for example, smooth communication.
[0423] As described above, according to this embodiment, it is possible to provide a spatial collection, which is two or more spaces organically linked by images.
[0424] Also, according to this embodiment, at least two spaces organically connected by video can be provided to a user who communicates between at least two spaces. That is, for example, according to this embodiment, a space set of two spaces that are organically connected can be provided by displaying the same video in each of the two spaces. Also, for example, according to this embodiment, a space set of two spaces that are organically connected can be provided by displaying different but related videos in each of the two spaces.
[0425] Furthermore, according to this embodiment, before and while each of the two or more users is communicating in a different space, the images displayed in the different spaces in which the two or more users are present can be controlled, thereby supporting collaborative work by two or more users after they join one space.
[0426] Furthermore, according to this embodiment, for example, before and during communication by two or more users via a web conference, telephone conference, or the like, it is possible to support collaborative work between two or more users in communication by controlling images displayed in different spaces in which the two or more users are present.
[0427] In this embodiment, the processing performed by the server 9 may be performed by another device such as a display medium or a device installed in a space. A block diagram of the display medium 10 in such a case is shown in FIG. 40. Such a display medium 10 includes a storage unit 101, a receiving unit 102, a processing unit 103, and a display unit 104. The storage unit 101 includes a video storage unit 911 and a condition storage unit 912. In other words, the storage unit 101 may have the same configuration as the server storage unit 91. The processing unit 103 may perform the same processing as the server processing unit 93.
[0428] The processing in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software for realizing the server 9 in this embodiment is a program as follows. That is, this program is a program for making a computer function as a server receiving unit that receives user information including a first video identifier that identifies a first video displayed by a first display medium included in a first space of at least two spaces and a user identifier of a user who viewed the first video, a server processing unit that selects a video that matches a selection condition satisfied by the user information from a video storage unit in which two or more videos that match a selection condition are stored, and a server transmitting unit that transmits the video selected by the server processing unit to a second display medium included in a second space in which the user exists.
[0429] Fig. 41 shows the appearance of a computer that executes the programs described in this specification to realize the server 9 and the like of the various embodiments described above. The above-mentioned embodiments can be realized by computer hardware and a computer program executed thereon. Fig. 41 is an overview of this computer system 300, and Fig. 42 is a block diagram of the system 300.
[0430] In FIG. 41, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.
[0431] 42, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.
[0432] A program for causing computer system 300 to execute functions of server 9 and the like in the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and further transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may be loaded directly from CD-ROM 3101 or the network.
[0433] The program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the server 9 of the above-mentioned embodiment. The program only needs to include an instruction portion that calls appropriate functions (modules) in a controlled manner to obtain a desired result. How the computer system 300 operates is well known, and a detailed description will be omitted.
[0434] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmitting step (processing that is performed only by hardware).
[0435] The program may be executed by a single computer or a plurality of computers. That is, the program may be executed by a centralized processing or a distributed processing.
[0436] Furthermore, in each of the above embodiments, it goes without saying that two or more communication means present in one device may be physically realized by one medium.
[0437] In each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.
[0438] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]
[0439] As described above, the present invention has the effect of being able to provide a spatial collection, which is two or more spaces organically linked by images, and is useful as a spatial system that provides a spatial collection. [Explanation of symbols]
[0440] F Space System 7 First space 8 Second space 9 Server 10 Display media 71 First display medium 81 Second display medium 72, 82 Side wall 91 Server Storage 92 Server Reception Unit 93 Server Processing Unit 94 Server transmission section 101 Storage area 102 Receiving unit 103 Processing section 104 Display section 711 First Storage Area 712 First display section 713 First change section 811 Second Storage Unit 812 Second display section 813 Second Switching Section 911 Video Storage Unit 912 Condition Storage Section 1031 Switching part
Claims
1. a spatial set that is at least two spaces including a first space and a second space that exist in different locations; Each of the two spaces includes one or more display media for displaying an image; The two spaces are organically combined to form a spatial collection.
2. In the first space and the second space which are organically connected, The spatial collection of claim 1, wherein a second image displayed on a second display medium in the second space is an image related to a first image displayed on a first display medium in the first space, and the second image is an image selected using user information regarding a user present in the second space.
3. Each of the two or more images is associated with a selection condition under which the image is selected; The user information includes a first video identifier that identifies the first video viewed by the user or a first space identifier that identifies the first space, The spatial collection according to claim 2 , wherein the second video is a video corresponding to a selection condition satisfied by the first video identifier possessed by the user information or the first spatial identifier possessed by the user information.
4. the selection condition includes a viewing time condition that is a condition related to viewing time information that specifies a time when the video or another video was viewed; The user information includes viewing time information that identifies a time when the user viewed the first video, The spatial collection of claim 3, wherein the second video is an image selected using the first video identifier or the first spatial identifier when the viewing time condition is satisfied that the viewing time information held by the user information is information indicating a time within a predetermined period of time compared to the time when the second video is selected.
5. the selection condition includes a user attribute value condition which is a condition related to one or more user attribute values of a user who watches the video; the user information includes one or more user attribute values; The spatial set according to claim 3 , wherein the second image is an image corresponding to a user attribute value condition satisfied by the one or more user attribute values possessed by the user information.
6. The spatial collection according to claim 1 , wherein the images displayed on the display media of each of the two spaces are the same image.
7. At least two of the two or more images are in correspondence with each other; The space set according to claim 1 , wherein the images displayed on the display media in each of the two spaces are different images and correspond to each other.
8. In the first space and the second space, a first image viewed by a first user present in the first space on a first display medium included in the first space and a second image viewed by a second user moving from the second space to the first space on a second display medium included in the second space are the same or correspond to each other; The spatial collection described in any one of claims 1 to 5, wherein the first image and the second image are images selected using schedule information specifying that the second user will join the first space in which the first user is present.
9. The set of spaces includes at least three spaces: a first space, a second space, and a third space; a first image viewed by a first user moving from the first space to the third space on a first display medium provided in the first space and a second image viewed by a second user moving from the second space to the third space on a second display medium provided in the second space are the same or correspond to each other; The spatial collection described in any one of claims 1 to 5, wherein the first image and the second image are images selected using schedule information specifying that the first user and the second user will join the third space from different spaces.
10. Each of the at least two spaces is a different space in which at least two users who intend to communicate with each other are present; A spatial collection as described in any one of claims 1 to 5, wherein a first image displayed by a first display medium in the first space and a second image displayed by a second display medium in the second space are images selected using reservation information indicating that the two users will communicate.
11. It stores the processing conditions, which are the conditions for performing a specific process. The spatial collection according to any one of claims 1 to 10, wherein the specific processing is performed when a video identifier of a video previously viewed by a user present in the second space or a spatial identifier of a space in which the user was present satisfies the processing condition.
12. A set of display media each of the at least two spaces included in the spatial set according to any one of claims 1 to 11.
13. a server receiving unit that receives user information including a first video identifier that identifies a first video displayed on a first display medium included in a first space of the at least two spaces and a user identifier of a user who viewed the first video; a server processing unit that selects a video that matches the selection condition satisfied by the user information from a video storage unit in which two or more videos that match the selection condition are stored; a server transmitting unit that transmits the image selected by the server processing unit to a second display medium included in a second space in which the user is present.
14. A video providing method implemented by a server receiving unit, a server processing unit, and a server transmitting unit, comprising: a server receiving step in which the server receiving unit receives user information including a first video identifier that identifies a first video displayed by a first display medium included in a first space of the at least two spaces and a user identifier of a user who viewed the first video; a server processing step of selecting, by the server processing unit, a video paired with the selection condition satisfied by the user information from a video storage unit in which two or more videos paired with the selection condition are stored; a server transmitting step in which the server transmitting unit transmits the image selected in the server processing step to a second display medium included in a second space in which the user exists.
15. Computer, a server receiving unit that receives user information including a first video identifier that identifies a first video displayed on a first display medium included in a first space of the at least two spaces and a user identifier of a user who viewed the first video; a server processing unit that selects a video that matches the selection condition satisfied by the user information from a video storage unit in which two or more videos that match the selection condition are stored; A program for causing the server processing unit to function as a server transmitting unit that transmits the video selected by the server processing unit to a second display medium provided in a second space in which the user is present.