Information output device, design support system, information output method, and information output program

Abstract

To enable understanding perception of a user for a space.SOLUTION: An information output device 3 includes: an acquisition unit 341 that acquires detection information indicating a detection state of a predetermined reaction of a user when the user visually recognizes a predetermined space that is a virtual reality space or an augmented reality space; and an output unit 342 that outputs information indicating the predetermined space and the detection information acquired by the acquisition unit 341 in association with each other. The acquisition unit 341 acquires the detection information that associates the detection state of the predetermined reaction when the user visually recognizes a moving image indicating the predetermined space with information indicating a playback position of the moving image, and the output unit 342 outputs information indicating the detection state of the predetermined reaction at each playback position of the moving image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information output device, a design support system, an information output method, and an information output program that output information related to a user who views a virtual reality space.

Background Art

[0002] Conventionally, when performing a layout design of a building, the layout design has been advanced while exchanging information between a designer and a user. For example, Patent Document 1 discloses a layout design support device that allows a user to view a virtual reality space corresponding to a layout related to the floor plan of a building and receives a layout change operation in the virtual reality space from the user. The layout design support device analyzes the tendency of layout changes based on the layout change operation and identifies a recommended layout aspect.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, building users live while recognizing buildings and cities on a daily basis and have life experiences in various types of spaces such as open spaces and stable spaces. And users recognize space based on individual experiences. For example, users recognize the sense of openness and security associated with a space based on individual experiences.

[0005] In recent years, designs have been made to reflect the user's perception of space. For this reason, it is required to enable the user to identify their perception of space. However, the layout design support device described in Patent Document 1 can only identify the layout mode recommended based on the user's layout change operation, and cannot identify the user's perception of space.

[0006] An object of the present invention is to provide an information output device, a design support system, an information output method, and an information output program that can grasp the user's perception of space.

Means for Solving the Problems

[0007] The present inventor has found that, based on the detection status of a predetermined reaction of a user in a virtual reality (VR) space or an augmented reality (AR) space, the cognitive status of the space included in the space of the user can be identified.

[0008] An information output device according to a first aspect of the present invention includes an acquisition unit that acquires detection information indicating a detection status of a predetermined reaction of the user when the user visually recognizes a predetermined space that is a virtual reality space or an augmented reality space, an output unit that outputs the information indicating the predetermined space in association with the detection information acquired by the acquisition unit.

[0009] The acquisition unit may acquire the detection information in which the detection status of the predetermined reaction when the user visually recognizes a video indicating the predetermined space is associated with information indicating the reproduction position of the video, and the output unit may output the detection information indicating the detection status of the predetermined reaction for each reproduction position of the video.

[0010] The output unit may reproduce the video and display it on a display unit, and display on the display unit the information indicating the detection status of the predetermined reaction at each reproduction position of the video in association with the information indicating the current reproduction position of the video.

[0011] Of the information indicating the playback position of the video, the output unit may display the information indicating the playback position where the predetermined reaction is detected in a display mode different from the information indicating the playback position where the predetermined reaction is not detected. Of the plurality of images corresponding to the video, the output unit may cause the display unit to display one or more images corresponding to the playback position where the predetermined reaction is detected.

[0012] Of the plurality of images different from the images included in the video, the output unit may display one or more images corresponding to the image at the playback position where the predetermined reaction is detected in the video. The output unit may accept selection of an image from among one or more images corresponding to each of the one or more playback positions where the predetermined reaction is detected, and display an image similar to the selected image.

[0013] The output unit may identify the position in the predetermined space when the predetermined reaction is detected, and display information indicating the identified position on a map showing the predetermined space.

[0014] The acquisition unit may acquire the detection information corresponding to each of the plurality of users, and the output unit may output in association with each other the information indicating the predetermined space and the detection information corresponding to each of the plurality of users acquired by the acquisition unit.

[0015] The output unit may accept selection of at least any one of the plurality of users, and output in association with each other the information indicating the predetermined space and the detection information corresponding to the selected user.

[0016] The acquisition unit may acquire prediction information indicating the playback position of the video that is predicted to detect the predetermined reaction when the user views the video showing the predetermined space, and the output unit may cause the display unit to display the detection information acquired by the acquisition unit and the prediction information.

[0017] When the user visually recognizes the first predetermined space, the acquisition unit acquires first detection information which is the detection information in this case, and second detection information which is the detection information when the user visually recognizes the second predetermined space. The output unit may cause the display unit to display the first detection information and the second detection information acquired by the acquisition unit.

[0018] The information output device further includes a storage unit that stores information indicating the user's emotion corresponding to each of a plurality of detection patterns of the predetermined reaction. The output unit may output information indicating the user's emotion corresponding to the detection pattern included in the detection information.

[0019] For each of the plurality of predetermined spaces, the acquisition unit associates and stores in the storage unit result information obtained by associating information indicating the predetermined space with the acquired detection information, and information indicating whether to publish the result information. When the output unit receives a request to acquire the result information to be published, which is stored in the storage unit, from the terminal, the output unit may output the result information to the terminal.

[0020] The information output device may further include a charging unit that charges the user of the terminal for the output of the result information. The acquisition unit may acquire, as detection information indicating the detection status of the predetermined reaction, detection information indicating the detection status of a looking-around operation which is an operation of the user looking around the predetermined space.

[0021] When the user visually recognizes the predetermined space, the acquisition unit may use, as the looking-around operation, a head-shaking operation in which the user shakes the head in a predetermined direction, and acquire the detection information indicating the detection status of the looking-around operation. When the user visually recognizes the predetermined space, the acquisition unit may use, as the looking-around operation, the movement of the user's line of sight in a predetermined pattern, and acquire the detection information indicating the detection status of the looking-around operation.

[0022] The acquisition unit may acquire, as detection information indicating the detection status of a predetermined reaction, detection information indicating the detection status of a fixation operation, which is an operation in which the user fixates on the predetermined space for a predetermined time or longer. The acquisition unit may acquire, as detection information indicating the detection status of a predetermined reaction, detection information indicating the detection status of the brain waves of the user when the user visually recognizes the predetermined space.

[0023] A design support system according to a second aspect of the present invention is a design support system including a display device worn by a user and an information output device, wherein the display device includes a display unit, a display control unit that causes the display unit to display a predetermined space that is a virtual reality space or an augmented reality space, and a detection information generation unit that generates detection information indicating the detection status of a predetermined reaction of the user when the user visually recognizes the predetermined space, and the information output device includes an acquisition unit that acquires the detection information generated by the detection information generation unit, and an output unit that outputs, in association with each other, information indicating the predetermined space and the detection information acquired by the acquisition unit.

[0024] The display device may further include a space information acquisition unit that acquires information indicating the predetermined space from an information disclosure device that discloses information, and the display control unit may cause the display unit to display the predetermined space indicated by the information acquired by the space information acquisition unit.

[0025] An information output method according to a third aspect of the present invention includes steps of: a computer acquiring detection information indicating the detection status of a predetermined reaction of a user when the user visually recognizes a predetermined space that is a virtual reality space or an augmented reality space; and outputting, in association with each other, information indicating the predetermined space and the acquired detection information.

[0026] An information output program according to a fourth aspect of the present invention causes a computer to function as an acquisition unit that acquires detection information indicating the detection status of a predetermined reaction of a user when the user views a predetermined space that is a virtual reality space or an augmented reality space, and an output unit that associates and outputs information indicating the predetermined space with the detection information acquired by the acquisition unit. [Effects of the Invention]

[0027] According to the present invention, it is possible to obtain an effect of making it possible to grasp a user's perception of a space. [Brief description of the drawings]

[0028]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

[0029] <First Embodiment> [Overview of Design Support System S] FIG. 1 is a diagram showing an overview of a design support system S according to the first embodiment. The design support system S includes a generation device 1, a display device 2, and an information output device 3, and is a system for supporting the design of a space related to a building.

[0030] In the first embodiment, the generation device 1 is, for example, a computer 1A or an imaging device 1B. A designer D who designs a space operates the generation device 1 to generate a model of a virtual reality space or a video showing the virtual reality space as information showing the virtual reality space ((1) in FIG. 1). Each of the model of the virtual reality space and the video showing the virtual reality space corresponds to an actual space or a space to be designed. The video showing the virtual reality space is, for example, virtual reality content that allows a free viewing experience while staying still or moving within the virtual reality space, a 360° viewable video that allows the same experience as the above experience, or a video related to VR content such as a 180° viewable video. In the following description, the virtual reality space is referred to as a VR space, the model of the virtual reality space is referred to as a VR model, or the video showing the virtual reality space is referred to as a VR video. Also, the VR model and the VR video are collectively referred to as VR information. The generation device 1 uploads, for example, the VR information to a publishing device 4 that publishes information ((2) in FIG. 1).

[0031] The display device 2 is a wearable device, such as VR goggles or a VR headset, that allows a user to view a VR space. The VR goggles or the VR headset may be a collapsible VR goggles or a VR headset that allows a smartphone or the like to function as VR goggles. A user U, who is a user or a subject using the space, operates the display device 2 to display the VR space indicated by the VR information uploaded to the publishing device 4 on the display unit of the display device 2 ((3) in FIG. 1). The user U then wears the display device 2 and views the VR space displayed on the display unit of the display device 2. The display device 2 detects a predetermined reaction of the user U while the user U is viewing the VR space ((4) in FIG. 1). The predetermined reaction is the user U's looking around or gazing movement, or the generation of theta waves from the user U. The display device 2 may be a personal computer. In this case, a device capable of detecting theta waves from the user U's brain waves is connected to the display device 2. The display device 2 may detect the predetermined reaction based on the detection of the generation of theta waves by the device.

[0032] The display device 2 may detect theta waves in a state where no device capable of detecting theta waves is connected to the display device 2. For example, the display device 2 may create a database of operations on a personal computer performed by the user U viewing the VR space at the time when theta waves are detected, and may determine that theta waves have occurred when the user U performs an operation on a personal computer that the user U is likely to perform at the time when theta waves are detected.

[0033] The information output device 3 is, for example, a mobile terminal such as a smartphone or a personal computer. The information output device 3 acquires detection information indicating a detection status of a predetermined reaction of the user U when the user U views the VR space from the display device 2 ((5) in FIG. 1). The information output device 3 outputs information that associates information indicating the predetermined space with the acquired detection information as recognition result information that indicates the result of the space recognition of the user U ((6) in FIG. 1). For example, as shown in FIG. 1, the information output device 3 associates video information indicating a VR video with information indicating a detection status of a predetermined reaction at each playback position of the VR video and displays the association result information as recognition result information, or displays the recognition result information in which information indicating the detection status of the predetermined reaction is displayed on a map that indicates the VR space.

[0034] When the user U makes a predetermined reaction in the VR space, that is, when the user U looks around, gazes, or theta waves are detected in the VR space, it is considered that the user U is trying to recognize the space to which the user U is moving, which is displayed in the VR space. Therefore, the predetermined reaction is a reaction in which the user U tries to recognize the space.

[0035] Furthermore, if user U's looking around, gazing, or theta waves are detected, it is considered that user U is either moving forward while recognizing that he or she exists in the space he or she perceives, or that the space he or she perceives is ahead of his or her line of sight and that he or she is not in that space. Furthermore, if user U's looking around, gazing, or theta waves are not detected, it is considered that user U is moving forward while recognizing that he or she does not exist in the space he or she perceives. Therefore, by checking the recognition result information that associates the VR space information output by the information output device 3 with the acquired detection information, designer D can understand user U's perception of the space contained in the VR space. This allows designer D to evaluate the actual space or the space to be designed corresponding to the VR space and use it in space design. The configurations of the display device 2 and the information output device 3 will be described below.

[0036] [Configuration example of display device 2] First, a description will be given of the configuration of the display device 2. Fig. 2 is a diagram showing the configuration of the display device 2 according to the first embodiment. The display device 2 includes an input unit 21, a display unit 22, a detection unit 23, a storage unit 24, and a control unit 25.

[0037] The input unit 21 is configured with, for example, buttons, a contact sensor superimposed on the display unit 22, and the like, and receives operational inputs from the user of the display device 2. The display unit 22 is configured by, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. The display unit 22 displays various information under the control of the control unit 25. The detection unit 23 is, for example, a three-dimensional acceleration sensor, and detects the acceleration applied to the display device 2. When the detection unit 23 detects the acceleration, it outputs to the control unit 25 information indicating the detected acceleration.

[0038] The storage unit 24 is, for example, a read-only memory (ROM) and a random access memory (RAM). The storage unit 24 stores various programs for causing the display device 2 to function. For example, the storage unit 24 stores programs for causing the control unit 25 of the display device 2 to function as an acquisition unit 251, a display control unit 252, a detection information generation unit 253, and a transmission unit 254, which will be described later.

[0039] The control unit 25 is, for example, a CPU (Central Processing Unit). The control unit 25 controls functions related to the display device 2 by executing various programs stored in the storage unit 24. The control unit 25 executes the programs stored in the storage unit 24, thereby functioning as an acquisition unit 251 as a spatial information acquisition unit, a display control unit 252, a detection information generation unit 253, and a transmission unit 254. Details of these functions will be described later.

[0040] In addition, if the display device 2 is a personal computer, it is assumed that a device worn on the head of the user U and that detects the acceleration acting on the head of the user U and a device that detects the brain waves (θ waves) of the user U are connected to the display device 2.

[0041] [Configuration example of information output device 3] Next, a description will be given of the configuration of the information output device 3. Fig. 3 is a diagram showing the configuration of the information output device 3 according to the first embodiment.

[0042] The information output device 3 includes an input unit 31, a display unit 32, a storage unit 33, and a control unit . The input unit 31 is configured with, for example, buttons, a contact sensor superimposed on the display unit 32, and the like, and receives operation inputs from the user of the information output device 3. The display unit 32 is configured by, for example, a liquid crystal display, an organic EL display, etc. The display unit 32 displays various information under the control of the control unit .

[0043] The storage unit 33 is, for example, a ROM, a RAM, etc. The storage unit 33 stores various programs for causing the information output device 3 to function. For example, the storage unit 33 stores an information output program that causes the control unit 34 of the information output device 3 to function as an acquisition unit 341 and an output unit 342, which will be described later.

[0044] The control unit 34 is, for example, a CPU. The control unit 34 controls functions related to the information output device 3 by executing various programs stored in the storage unit 33. The control unit 34 executes the information output programs stored in the storage unit 33, thereby functioning as an acquisition unit 341 and an output unit 342.

[0045] [Process flow for outputting recognition result information] Hereinafter, the functions of the control unit 25 and the control unit 34 will be described with reference to a sequence diagram showing the flow of processing when the information output device 3 outputs recognition result information that associates VR space information with acquired detection information. Fig. 4 is a sequence diagram showing the flow of processing until the information output device 3 in the first embodiment outputs recognition result information.

[0046] First, the generation device 1 generates a VR space model or a VR video as VR space information in response to an operation from the designer D (S1). Note that the generation device 1 generates a VR space model or a VR video, but this is not limited to this. The generation device 1 may generate, as VR space information, a plurality of still images, a video, or a plurality of still images showing parts of the VR video corresponding to the VR space indicated by the VR space model. The generation device 1 uploads the generated VR space information to the publication device 4 in response to an operation by the operator of the generation device 1 (S2). Here, if the VR space information is a VR video, the generation device 1 may upload the VR video to a video sharing site.

[0047] Next, when the input unit 21 accepts an operation to acquire the VR space information, the acquisition unit 251 of the display device 2 acquires the VR space information generated by the generation device 1 from the publication device 4 (S3). Note that, although the acquisition unit 251 acquires the VR space information from the publication device 4, this is not limitative. The acquisition unit 251 may acquire the VR space information from the generation device 1 via a storage medium such as an SD (registered trademark) card.

[0048] Next, the display control unit 252 of the display device 2 displays the VR space indicated by the acquired VR space information on the display unit 22 (S4). Note that the display control unit 252 may display the VR space indicated by the VR space information on the display unit 22 while receiving the VR space information stored in the external device.

[0049] Next, the detection information generating unit 253 of the display device 2 generates detection information indicating the detection status of a predetermined reaction to the VR space of the user U who is wearing the display device 2 and viewing the VR space (S5). Here, the predetermined reaction is, as described above, a look-around motion, a gaze motion, or the generation of theta waves, but here, the explanation will be focused on the case where a look-around motion or a gaze motion is detected.

[0050] The detection information generation unit 253 generates detection information indicating a detection state of a look around action and a gaze action of the user U viewing the VR space as detection information indicating a predetermined reaction. A look around action is a head-swaying action in which the user U shakes his / her head in a predetermined direction when viewing the VR space. The predetermined direction is, for example, a direction horizontal to the ground and perpendicular to the direction of travel. A gaze action is an action in which the user U gazes at the VR space for a certain period of time or more. Hereinafter, the predetermined direction will be referred to as the horizontal direction and the explanation will proceed.

[0051] A look-around behavior is likely to be detected, for example, when the user U is in a "selection state" indicating a state in which the user U is searching for information about a destination location. A gaze behavior is likely to be detected, for example, when the user U is in a "progress state" indicating a state in which the user U has found information about a destination location and has decided on a direction of travel, or when the user U is in an "arrival state" indicating a state in which the user U is proceeding while looking directly at the destination location itself. For this reason, the detection information generation unit 253 may classify a predetermined reaction based on whether the state of the look-around behavior is a "selection state," a "progress state," or an "arrival state." Alternatively, the detection information generation unit 253 may identify a predetermined reaction based on only any one of the three elements of the "selection state," "progress state," or "arrival state" depending on the building configuration or the user's purpose. In this way, the detection information generation unit 253 can classify and quantify the user's exploration behavior using the look-around behavior.

[0052] The detection information generation unit 253 identifies the traveling direction based on, for example, the acceleration indicated by the acceleration information output from the detection unit 23. Then, the detection information generation unit 253 determines that a state in which the acceleration in the horizontal direction, among the accelerations indicated by the acceleration information, exceeds a first threshold value as a detected state of a look around motion. Furthermore, the detection information generation unit 253 determines that a state in which the acceleration in the horizontal direction, indicated by the acceleration information, is less than a predetermined threshold value for a certain period of time or more as a detected state of a gaze motion. Note that the detection information generation unit 253 may also determine that a state in which the acceleration in the vertical direction, among the accelerations indicated by the acceleration information, exceeds a second threshold value as a detected state of a look around motion.

[0053] In this way, the detection information generation unit 253 can detect a case where the user U looks up at an atrium in a building or a tall building as a look-around action. Here, the case where the detection information generation unit 253 detects a look-around action and a gaze action based on the acceleration indicated by the acceleration information output from the detection unit 23 has been exemplified, but the present invention is not limited to this, and the detection information generation unit 253 may detect a look-around action and a gaze action based on a change in an area in the VR space viewed by the user U.

[0054] When a user U views the VR space indicated by the VR space model, the detection information generation unit 253 stores in the memory unit 24 as detection information information that associates position information indicating the position of the user U in the VR space with acceleration information indicating the lateral acceleration that indicates the detection state of the looking around or gazing action at each position.

[0055] In addition, when user U views the VR video, the detection information generation unit 253 stores in the memory unit 24 as detection information information that associates playback position information indicating each playback position in the VR video with acceleration information indicating the lateral acceleration that indicates the detection state of the looking around or gazing action at each playback position.

[0056] The detection information generating unit 253 may detect that the user U has performed a look action when the lateral acceleration is equal to or greater than a predetermined amount, and may detect that the user U has performed a gaze action when the lateral acceleration is less than a predetermined threshold for a certain period of time or more. The detection information generating unit 253 may identify the position in the VR space or the playback position of the VR video when the look action or gaze action of the user U is detected, and store information in the storage unit 24 as detection information that associates the detection state when the look action or gaze action is detected with position information indicating the position in the VR space or playback position information indicating the playback position of the VR video.

[0057] For example, the detection information includes space identification information that identifies VR space information (VR space model or VR video) corresponding to the VR space being viewed by the user U, type information that indicates the type of user U's action (looking around and gazing), and a user ID that identifies the user U. The space identification information is, for example, the name of a building or the like that corresponds to the VR space indicated by the VR space information, and is set by the designer D. Note that the VR space information may be viewed by multiple users U. In this case, the detection information generation unit 253 generates detection information corresponding to each of the multiple users U.

[0058] Note that the looking-around operation is defined as the head-shaking motion in which the user U shakes their head in a predetermined direction when viewing the VR space, but it is not limited to this. For example, the looking-around operation may be the movement of the user's line of sight in a predetermined pattern when the user views the VR space. In this case, it is assumed that the display device 2 is provided with a line-of-sight detection sensor for detecting the line of sight of the user U. Then, the detection information generation unit 253 detects that the pattern of the line of sight of the user U output from the line-of-sight detection sensor is a predetermined pattern. Here, the predetermined pattern means a pattern indicating that after the line of sight moves in the direction of the first predetermined angle range (for example, 60 degrees to 120 degrees) with the traveling direction as 0 degrees, it moves in the direction of the second predetermined angle range (for example, -60 degrees to -120 degrees) within a predetermined time, or a pattern indicating that after the line of sight moves in the direction of the second predetermined angle range, it moves in the direction of the first predetermined angle range within a predetermined time. This predetermined pattern is called a soccer card.

[0059] The detection information generation unit 253 may specify the position of the VR space or the playback position of the VR video when the user U performs the head-shaking motion and the pattern of the line of sight indicates a soccer card. The detection information generation unit 253 may further store, in the storage unit 24 as detection information, information associating the detection state of the looking-around operation when the head-shaking motion is performed and the pattern of the line of sight indicates a soccer card with the position information indicating the position of the VR space or the playback position information indicating the playback position of the VR video. By considering the detection status of the soccer card, the display device 2 can detect with higher accuracy the timing when the user U is trying to recognize the space to which the user U in the VR space is moving compared to the case where only the head-shaking motion is used.

[0060] The detection information generating unit 253 stores detection information including position information indicating the position of the VR space or playback position information indicating the playback position of the VR video when the predetermined reaction is detected in the storage unit 24, but this is not limited to this. For example, when the detection information generating unit 253 detects the predetermined reaction, the detection information generating unit 253 may include, as a captured image, an image indicating the VR space or a display image of the VR video that the display control unit 252 has displayed in the detection information. Furthermore, the detection information generating unit 253 may include, in the detection information, a video indicating the VR space or a VR video within a predetermined period including the timing at which the predetermined reaction is detected.

[0061] Furthermore, the display device 2 may include an electroencephalogram (EEG) detection unit that detects the electroencephalogram of the user wearing the display device 2 in order to detect the occurrence of θ waves, which is an example of a predetermined reaction. The detection information generation unit 253 may generate detection information indicating the detection state of the electroencephalogram when the user U views the VR space as detection information indicating the detection status of the predetermined reaction. Furthermore, if the display device 2 includes an EEG detection unit, the display device 2 does not need to include the detection unit 23.

[0062] In this case, the detection information generating unit 253 identifies the position in the VR space or the playback position of the VR video when theta waves, which are a type of brain wave, are detected. The detection information generating unit 253 stores information that associates the detection state of theta waves with position information indicating the position in the VR space or playback position information indicating the playback position of the VR video in the storage unit 24 as detection information.

[0063] In addition, it may be a predetermined reaction that the pattern of the user U's line of sight is a predetermined pattern and the user is in a sweating state. Further, it may be a predetermined reaction that the pattern of the user U's line of sight is a predetermined pattern, the user is in a sweating state, and further, theta waves are being detected. For example, the display device 2 may include a sweating detection unit that detects the sweating of the user wearing the display device 2 in order to detect the user's sweating. Then, the detection information generation unit 253 may generate detection information indicating a sweating state as detection information indicating the detection status of a predetermined reaction when the user U views the VR space. Here, when the display device 2 includes a sweating detection unit, the display device 2 may not include the detection unit 23.

[0064] Subsequently, the transmission unit 254 of the display device 2 transmits one or more pieces of detection information indicating the detection status of a predetermined reaction to the information output device 3 when one or more users U view the VR space (S6). Specifically, first, the acquisition unit 341 of the information output device 3 transmits an acquisition request for requesting the acquisition of detection information to the display device 2. When the transmission unit 254 of the display device 2 receives the acquisition request for detection information from the information output device 3, it transmits one or more pieces of detection information stored in the storage unit 24 to the information output device 3.

[0065] The acquisition unit 341 of the information output device 3 acquires detection information corresponding to each of one or more users U by receiving one or more pieces of detection information indicating the detection status of a predetermined reaction of the user U when the user U views the VR space, and also acquires VR space information corresponding to the detection information from the disclosure device 4 (S7). When the user views the VR space corresponding to the VR space model, the acquisition unit 341 acquires detection information including position information indicating the position of the VR space when a predetermined reaction is detected and information indicating the detection state of the predetermined reaction. Further, when the user U views the VR video, the acquisition unit 341 acquires detection information including reproduction position information indicating the reproduction position of the VR video when a predetermined reaction is detected and information indicating the detection state of the predetermined reaction.

[0066] The acquisition unit 341 stores, in the storage unit 33, recognition result information that associates the VR space information with the detection information and indicates the result of the space recognition of the user U. The acquisition unit 341 stores, for each of the multiple pieces of VR space information, recognition result information that associates the VR space information with the acquired detection information.

[0067] The output unit 342 associates the VR space information with the detection information acquired by the acquisition unit 341 and outputs it as recognition result information indicating the result of the space recognition of the user U. For example, in response to receiving a display operation for the recognition result information via the input unit 31, the output unit 342 causes the display unit 32 to display the recognition result information stored in the storage unit 33 (S8).

[0068] [Example of recognition result information for one user] 5 is a diagram showing a display example of recognition result information for one user. Here, a display example of the recognition result information when the user views a VR video as the VR space indicated by the VR space information will be described. In addition, a display example of the recognition result information will be described assuming that the predetermined reaction is a look-around action.

[0069] For example, as shown in Fig. 5(a), the output unit 342 displays the user IDs included in the detection information stored in the storage unit 33 on the display unit 32, and accepts selection of a user ID via the input unit 31. In the example shown in Fig. 5(a), three user IDs are displayed, and the output unit 342 accepts selection of any one of the three user IDs.

[0070] When the output unit 342 receives the selection of one user ID, it identifies the VR video corresponding to the space identification information included in the detection information corresponding to the user ID. Then, the output unit 342 outputs information indicating the detection status of the look movement for each playback position of the identified VR video. Specifically, as shown in FIG. 5(b), the output unit 342 plays the identified VR video and displays it on the display unit 32, and also displays a graph G, which is information indicating the detection status of the look movement at each playback position of the VR video, and a playback position mark M, which is information indicating the current playback position of the VR video, on the display unit 32. Here, the horizontal axis of the graph G indicates the playback position of the VR video, and the vertical axis indicates the magnitude of the horizontal acceleration. Note that, when the display device 2 detects theta waves instead of the look movement, the vertical axis of the graph G indicates the detection status of theta waves.

[0071] The output unit 342 may extract still images from the identified VR video at predetermined time intervals (for example, every 1 second or every 3 seconds) and display the still images on the display unit 32. The output unit 342 may also extract still images corresponding to a position where a user who is watching the VR video stopped, a position where it is determined that the user gazed into space, or a position where the user performed a predetermined operation, and display the still images on the display unit 32. If a captured image is included in the detection information, the output unit 342 may display the captured image on the display unit 32. Here, the predetermined operation may be, but is not limited to, an operation of the user nodding their head or an operation of a button that is the input unit 21 of the display device 2. It may also be determined that the predetermined operation has been performed when a microphone (not shown) provided in the display device 2 detects a predetermined sound. In this case, the recognition result information is associated with operation information indicating that the predetermined operation has been performed.

[0072] Furthermore, the output unit 342 may display information indicating the playback position of the VR video when a look motion is detected on a graph G displayed on the display unit 32. In FIG. 5(c), character strings "01," "02," "03," and "04" are displayed as information indicating the playback position of the VR video when a look motion is detected (when the lateral acceleration is equal to or greater than a predetermined amount). Note that, if the display device 2 detects theta waves instead of a look motion, the output unit 342 may display information indicating the playback position of the VR video when theta waves having a predetermined amplitude or greater are detected on a graph G displayed on the display unit 32.

[0073] Furthermore, the output unit 342 may display, among the information indicating the playback positions of the video, information indicating a playback position where a look motion was detected in a different display mode from information indicating a playback position where a look motion was not detected. For example, as shown in FIG. 5(c), the output unit 342 may display areas indicating playback positions where a look motion was detected, corresponding to the character strings "01," "02," "03," and "04," in a different color from areas indicating playback positions where a look motion was not detected. Furthermore, as shown in FIG. 5(c), the output unit 342 may display, on the display unit 32, detection images i1, i2, and i3 indicating one or more images corresponding to playback positions where a look motion was detected among multiple images corresponding to the video. In this way, the designer D viewing the screen displayed on the display unit 32 can easily identify the space corresponding to the VR video where a look motion was detected. In addition, when the display device 2 detects theta waves instead of a scanning movement, the output unit 342 may display, among the information indicating the playback position of the video, information indicating the playback position where theta waves of a predetermined amplitude or greater are detected in a display mode different from information indicating the playback position where theta waves of a predetermined amplitude or greater are not detected.

[0074] Furthermore, the output unit 342 may display one or more images corresponding to the image at the playback position where a predetermined reaction was detected in the VR video, among a plurality of other images different from the VR video corresponding to the selected user ID. Here, the other plurality of images may include a plurality of images corresponding to other VR videos and a plurality of images stored in advance in a database. Furthermore, the plurality of images stored in a database may include, for example, images extracted and stored in advance from other videos, a database in another company's image posting and storage service, and images provided as search results by a web search site.

[0075] Furthermore, the one or more images corresponding to the image at the playback position where the predetermined reaction was detected may be, for example, an image showing a space that is a proposal for improving the space included in the image, or an image when a similar predetermined reaction was detected. For example, the output unit 342 displays a button for displaying a detection image included in another VR video or multiple images stored in a database near the detection image corresponding to the VR video corresponding to the selected user ID. Then, in response to pressing the button, the output unit 342 displays a detection image corresponding to the other VR video or the database. In this way, the designer D can check the detection images in multiple VR videos and understand the tendency of the space in which a predetermined reaction, such as a look-around movement, is detected.

[0076] Furthermore, each of the multiple images included in the VR video may be associated with tag information indicating the attributes of the image. The tag information may be, for example, location information that identifies the type of building shown in the image or a location inside the building. The type of building may be, for example, a detached house or a commercial facility. The location information may be, for example, an entrance, a corridor, an interior, etc.

[0077] Then, the output unit 342 accepts the selection of the detected image and accepts the pressing operation of a button for displaying the detected image included in other VR videos. The output unit 342 causes the display unit 32 to display one or more detected images corresponding to the tag information associated with the selected image among the detected images corresponding to other VR videos. By doing so, the designer D can check images that are likely to be similar to the detected image selected by the designer D, and grasp the tendency of the space where a predetermined reaction such as a looking-around operation is detected.

[0078] In addition, when an image different from the detected image is being displayed, the output unit 342 may display the selection of the image and a button for displaying a detected image different from the selected image. Then, the output unit 342 causes the display unit 32 to display one or more detected images corresponding to the tag information associated with the selected image. By doing so, the designer D can easily compare an image different from the detected image with the detected image, and examine the differences between the space where a predetermined reaction such as a looking-around operation is detected and the space where such a reaction is not detected.

[0079] In addition, the output unit 342 may display a button for displaying an image similar to these images near the detected image. Then, the output unit 342 may accept the selection of an image from among the detected images and accept the pressing operation of the button. Then, the output unit 342 may display an image similar to the selected detected image. For example, the output unit 342 may search for an image similar to the selected detected image from a plurality of other VR videos stored in the storage unit 33, or may input the selected image to an external search engine and cause the search engine to search for a similar image.

[0080] In addition, as shown in FIG. 5(d), the output unit 342 may cause the display unit 32 to display a VR video, a graph G which is information indicating the detection state of the looking-around operation at each of the playback positions of the video, and one or more detected images corresponding to the playback positions at which the looking-around operation is detected, all at once.

[0081] [Example of displaying recognition result information for one or more users] The output unit 342 may accept a selection of at least one of the one or more users U acquired by the acquisition unit 341, and output the VR space indicated by the VR space information in association with the detection information corresponding to the user U whose selection was accepted. Fig. 6 is a diagram showing a display example of recognition result information of one or more users.

[0082] For example, as shown in FIG. 6(a), the output unit 342 displays on the display unit 32 the user ID contained in the detection information stored in the memory unit 33, and accepts the selection of one or more users U from among the multiple users U via the input unit 31.

[0083] Then, the output unit 342 displays, in an overlapping manner, a graph G, which is information indicating the detection state of a look around action and a gaze action at each playback position of the VR video, as recognition result information corresponding to each of the selected one or more users U. Fig. 6(b) is an example of the display of the graph G when two users U are selected. As shown in Fig. 6(b), the graphs indicating the detection state of each of the look around actions of the two users U are displayed in an overlapping manner, so that the designer D can easily grasp at which playback position a look around action tends to occur.

[0084] In addition, as shown in Figure 6(c), the output unit 342 may display detection information corresponding to each user ID included in the detection information stored in the memory unit 33 in the first area A1 of the display unit 32, and may also superimpose the detection result corresponding to the selected user ID in the second area A2 of the display unit 32.

[0085] Further, the output unit 342 may cause the display unit 32 to display, at the same timing, information indicating the prediction of the user's looking-around operation and gazing operation by the designer D or the like and detection information corresponding to the selected user ID. In this case, the acquisition unit 341 acquires, via the input unit 31, prediction information indicating a reproduction position at which the user U is predicted to perform a looking-around operation and a gazing operation when the user U views the VR video. For example, the reproduction position corresponding to a place where a scenery similar to the scenery viewed by the user when the looking-around operation and the gazing operation are actually performed can be viewed is predicted as the reproduction position at which the looking-around operation and the gazing operation are performed. The prediction information is information associating reproduction position information indicating each reproduction position with a detection state (lateral acceleration) predicted at each reproduction position.

[0086] As shown in FIG. 6(d), the output unit 342 superimposes and displays a graph G which is information indicating the detection state of the looking-around operation at each reproduction position of the VR video and a graph G2 which is information indicating the prediction result of the looking-around operation at each reproduction position of the VR video. By doing so, the designer D can compare the predicted state of the looking-around operation with the detected state of the actual looking-around operation and conduct deliberation.

[0087] Further, the acquisition unit 341 may acquire first detection information which is detection information when the user U views the first VR space and second detection information which is detection information when the user U views a second VR space different from the first VR space. Then, the output unit 342 may cause the display unit 32 to display the first detection information and the second detection information at the same timing. For example, the first VR space is a building before renewal, and the second VR space is a building after renewal. Also, the first VR space may be the first consideration plan for the building, and the second VR space may be the second consideration plan for the building.

[0088] For example, the output unit 342 may cause the display unit 32 to display the first detection information and the second detection information in parallel or superimposed. Further, the output unit 342 may cause the display unit 32 to display the detection-time image of the first VR video corresponding to the playback position at which the panning operation indicated by each detection information is detected and the detection-time image of the second VR video. By doing so, the designer D can, for example, examine in what situations the panning operation is detected while confirming the detection state of the panning operation in the space before and after renewal or in the spaces corresponding to each of a plurality of plans.

[0089] Also, it is considered that if the detection pattern of the panning operation is different, the user U's perception of the space included in the VR space will be different. Therefore, the storage unit 33 may store information indicating the user's emotion corresponding to each of a plurality of detection patterns of the panning operation. Then, the output unit 342 may analyze the detection information and specify any one of the plurality of detection patterns stored in the storage unit 33. And the information indicating the emotion of the user U corresponding to the specified detection pattern may be output in association with the detection information. By doing so, the designer D can grasp what emotion the user U has towards the VR space.

[0090] [Reflection of Detection Results on Map Information] The output unit 342 may specify the position in the VR space when the panning operation by the user U is detected. The acquisition unit 341 may acquire in advance map information indicating the VR space and cause the storage unit 33 to store the map information. The output unit 342 causes the map indicated by the map information stored in the storage unit 33 to display the information indicating the specified position. FIG. 7 is a diagram showing an example of the display of the map corresponding to the VR space.

[0091] When the user U visually recognizes the VR space by freely moving around in the VR space, the output unit 342 displays information indicating the detection state at a position in the VR space indicated on a map corresponding to the VR space, based on position information indicating the position of the VR space included in the detection information and the detection state of the look around motion or the gaze motion at that position. For example, as shown in FIG. 7, the output unit 342 displays a mark M2 indicating the detection state on the map corresponding to the VR space. In this way, the designer D can easily confirm the position where the look around motion or the gaze motion was detected.

[0092] 7 may display the movement trajectory of the user U in the VR space. Furthermore, the positions of objects such as furniture, product shelves, and signs to be placed in the VR space may be received in advance from the designer D. Then, the output unit 342 may display marks indicating the objects on the map shown in FIG. 7 based on the positions of the objects to be placed in the VR space.

[0093] Furthermore, when allowing the user U to view a VR video, playback position information indicating the playback position of the VR video and position information indicating the position in the VR space corresponding to the VR video are stored in the storage unit 33 in association with each other. The output unit 342 identifies the playback position of the VR video when a look-around motion by the user U is detected, based on the detection information corresponding to the VR video. The output unit 342 refers to the storage unit 33, identifies position information associated with the playback position information indicating the identified playback position, and identifies a detection state associated with the playback position information, thereby identifying the position in the VR space corresponding to the playback position and the detection state at that position. Then, the output unit 342 displays information indicating the detection state at the identified position on a map indicated by the map information stored in the storage unit 33.

[0094] Note that the output unit 342 may display the VR video and graph G shown in FIGS. 5(b) to 5(d) and the map corresponding to the VR space shown in FIG. 7 in parallel, and may display information indicating the position on the VR space corresponding to the playback position on the map. By displaying the VR video and the map in parallel, the designer D can easily confirm the position corresponding to the VR video.

[0095] [Relationship between brain waves and looking-around motion] Subsequently, the relationship between brain waves and looking-around motion and fixation motion will be described. FIG. 8 is a diagram showing the detection status of the θ waves of a user who viewed a VR video and the detection status of the head-shaking motion as a looking-around motion. FIG. 8(a) shows the detection status of the θ waves, and FIG. 8(b) shows the detection status of the head-shaking motion and fixation motion. Note that the horizontal axis of the graph shown in FIG. 8(a) and the horizontal axis of the graph shown in FIG. 8(b) are assumed to be a common time axis. Also, the vertical axis shown in FIG. 8(a) indicates the magnitude of the θ waves, and the vertical axis shown in FIG. 8(b) indicates the lateral acceleration. As shown in FIG. 8, it can be confirmed that the detection status of the head-shaking motion and fixation motion changes significantly in response to the detection of the θ waves, and a certain correlation is recognized between the θ waves and the head-shaking motion and fixation motion.

[0096] [Modification example] The detection information generation unit 253 may generate detection information based on a predetermined reaction detected when the user is not walking. In this case, for example, the information output device 3 analyzes the correlation between the looking-around motion and brain waves detected in a series of actions while the user is seated, and defines that when there are many lookings-around, it is an unstable state with many segmentations of the space, when there are few lookings-around such as when the line of sight moves slowly without being as fast as saccades, or when there are many fixations, it is a stable state with few segmentations of the space, and may output the result of evaluating the indoor area or the like.

[0097] In the above description, the case where the design support system S uses the generation of theta waves as a predetermined reaction has been exemplified. However, brain waves other than theta waves may also be used. For example, when the looking-around motion is repeated at regular time intervals, alpha waves indicating relaxation often show a value equal to or greater than a certain level. Therefore, the information output device 3 may estimate that the user is in a relaxed state based only on the looking-around motion. Also, since beta waves indicating concentration often show a value equal to or greater than a certain level when a certain period of time has elapsed during the fixation motion, the information output device 3 may estimate that the user is in a concentrated state based only on the fixation motion.

[0098] [Effect in the First Embodiment] As described above, the information output device 3 according to the first embodiment acquires detection information indicating the detection status of a predetermined reaction of the user when the user views the VR space, and outputs the VR space information in association with the acquired detection information. Since there is a correlation between the looking-around motion or the generation of theta waves, which are predetermined reactions in the space, and the space recognition, the designer who confirms these information by outputting the VR space information in association with the acquired detection information can grasp the user's recognition of the space included in the VR space.

[0099] [Second Embodiment] [Disclosing Recognition Result Information] Next, the second embodiment will be described. In the first embodiment, the designer D who designs the space checks the recognition result information. However, the recognition result indicated by the recognition result information is also effective for the occupants of the dwelling who consider the indoor layout such as the arrangement of furniture in the space. Therefore, the information output device 3 according to the second embodiment is different from the first embodiment in that it provides a public service for disclosing the recognition result information. Hereinafter, the information output device 3 according to the second embodiment will be described. Note that the description of the same parts as in the first embodiment will be omitted as appropriate.

[0100] FIG. 9 is a diagram showing an overview of the design support system S according to the second embodiment. In the second embodiment, the information output device 3 is, for example, a server and is communicably connected to the terminal 5 used by the second user U2. Here, the second user U2 of the terminal 5 is a user of a public service that publishes recognition result information. In the second embodiment, the information output device 3 outputs recognition result information to the terminal 5. The processing flow from (1) to (5) shown in FIG. 9 is the same as the processing flow in the design support system S according to the first embodiment shown in (1) to (5) of FIG. 1. The design support system S according to the second embodiment is such that the information output device 3 outputs recognition result information in response to receiving a request for acquisition of recognition result information from the terminal 5 ((6) and (7) in FIG. 9).

[0101] FIG. 10 is a diagram showing the configuration of the information output device 3 according to the second embodiment. The information output device 3 according to the second embodiment is different from the information output device 3 according to the first embodiment in that it does not include the input unit 31 and the display unit 32. Further, the control unit 34 of the information output device 3 according to the second embodiment is different from the information output device 3 according to the first embodiment in that it further includes a charging unit 343.

[0102] Also, in the second embodiment, the information output device 3 receives a setting from a person related to the VR space information corresponding to the recognition result information (for example, a designer D or an administrator) as to whether to permit the disclosure of the recognition result information and the VR space information. The information output device 3 associates a permission flag indicating whether disclosure is permitted with the recognition result information stored in the storage unit 33. The value of the permission flag is, for example, 1 when the disclosure of the recognition result information and the VR space information is permitted, and 0 when it is not permitted.

[0103] The charging unit 343 charges the second user U2 who uses the terminal 5 for the output of the recognition result information. For example, the charging unit 343 may set a fixed fee for the output of the recognition result information within a predetermined period and charge the second user U2 with the fixed fee at regular intervals. Also, charging may be performed after the recognition result information is output. Here, the charging unit 343 may return at least a part of the profit obtained by charging to the relevant person of the VR space information corresponding to the recognition result information.

[0104] In the second embodiment, when the charging by the charging unit 343 is completed, for example, the output unit 342 receives a request to acquire the recognition result information stored in the storage unit 33 from the terminal 5 used by the second user U2. For example, the output unit 342 presents on the terminal 5 some images or space identification information indicating the VR space information corresponding to one or more recognition result information for which public permission has been granted, and receives a request to acquire at least any one of the one or more recognition result information. When the output unit 342 receives a request to acquire the recognition result information, the output unit 342 outputs at least any one of the screens shown in FIGS. 5(b) to 5(d) as the recognition result information to the terminal 5.

[0105] Here, the charging unit 343 may change the amount to be charged according to the output form of the recognition result information to the terminal 5. For example, when the screen shown in FIG. 5(b) is output, the charging unit 343 may charge the first amount or may not charge.

[0106] Also, when the charging unit 343 outputs the screen shown in FIG. 5(c) or FIG. 5(d), since it is considered that the convenience is higher than when the screen shown in FIG. 5(b) is output, the charging unit 343 may charge a second amount higher than the first amount.

[0107] In FIGS. 5(c) or 5(d), when the user uses a function of searching for a detection-time image corresponding to other VR space information or searching for an image similar to the detection-time image, the charging unit 343 may charge a third amount higher than the second amount because it is considered that the convenience is higher than when the screen shown in FIGS. 5(c) or 5(d) is output.

[0108] Note that a person involved in the VR space information corresponding to the recognition result information may wish to make only the image at the time of detection public, without making public the VR video showing the VR space information. Therefore, when the information output device 3 receives permission for disclosure from a person involved in the VR space information corresponding to the recognition result information, the information output device 3 may receive a selection of whether or not to make only the image at the time of detection public, and store information indicating the selection in association with the recognition result information in the storage unit 33. In this case, the output unit 342 may control whether or not to output the screen shown in FIG. 5(b) based on the information indicating the selection.

[0109] [Effects of the second embodiment] As described above, the information output device 3 according to the second embodiment charges the second user U2 who uses the terminal 5 for the output of the recognition result information, and therefore, the second user U2 can receive compensation for the output of the recognition result information. Furthermore, the information output device 3 outputs, to the terminal 5, VR space information corresponding to the recognition result information that is permitted to be made public, and therefore, it is possible to prevent recognition result information that is not desired to be made public from being made public to the outside.

[0110] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and alterations are possible within the spirit and scope of the present invention. For example, in the above-described embodiments, the display device 2 is a wearable device such as VR goggles or a VR headset that allows the user to view a VR space, but this is not limited thereto. The display device 2 may also be an augmented reality projection device that projects a VR space onto a real space. In this case, the information output device 3 may be configured such that a detection device equipped with an acceleration detection sensor that detects acceleration is worn on the user's head, and the acceleration detected by the detection device when the VR space is projected onto the real space may be acquired as detection information of a look-around motion or a gaze motion.

[0111] In addition, in the above-described embodiment, the embodiment in the case where the user views the VR space has been described. However, the present invention is not limited thereto, and it may be applied to the case where the user views the AR space instead of the VR space. That is, when the user views the AR space in which virtual objects are arranged in the real space, the display device 2 generates detection information associating the detection status of a predetermined reaction of the user with a captured image showing the AR space that the user was viewing when the predetermined reaction was detected, and may transmit the detection information to the information output device 3. Then, the information output device 3 may output the information indicating the AR space in association with the detection information acquired from the information output device 3. For example, the information output device 3 may display, on the display unit 32, in association with a captured image showing the AR space when a predetermined reaction is detected, information indicating that the user has shown a predetermined reaction with respect to the captured image.

[0112] In addition, the information output device 3 may further include a determination unit that determines a position suitable for installing objects such as home appliances, furniture, and potted plants or signs such as labels based on the position on the VR space where the user U has shown a predetermined reaction. For example, the information output device 3 determines whether the position is suitable for installing an object based on the size of the space corresponding to the position where the user U has shown a predetermined reaction. The determination unit may determine the position immediately before or after the user U shows a predetermined reaction, that is, the position at the boundary of the space, as a position suitable for arranging the sign.

[0113] In addition, the information output device 3 determines whether the position is suitable for installing an object based on the viewing frequency of each of a plurality of positions where the user U has shown a predetermined reaction. For example, the information output device 3 determines, as a position suitable for designer furniture, a position with a high viewing frequency among the plurality of positions where the user U has shown a fixation motion among the predetermined reactions. In addition, the information output device 3 determines, as a position suitable for installing furniture with an unrefined design, a position with a low viewing frequency among the plurality of positions where the user U has shown a scanning motion among the predetermined reactions.

[0114] Furthermore, the information output device 3 may determine whether a position where the user U does not show a predetermined reaction is a position suitable for installing an object. In this case, the information output device 3 may determine whether a position is suitable for installing an object based on the viewing frequency of the position. Then, the information output device 3 may display the position determined to be suitable for installing an object on the display unit 32 as a candidate position for installing the object.

[0115] The information output device 3 may also generate a VR space in which a virtual object is placed at a candidate installation position of the object, and output a video of the VR space in which the virtual object is not placed so that the video can be compared with a video of a VR space in which the virtual object is not placed. Furthermore, the information output device 3 may identify a predetermined reaction when the user U views each of the VR space in which the virtual object is placed and the VR space in which the virtual object is not placed, and evaluate these spaces based on the predetermined reaction. In this way, the information output device 3 can also assist in the installation of the object.

[0116] In the above embodiment, the design support system S has been described as supporting the design of architectural spaces, but is not limited thereto. For example, it may support the design of virtual spaces in a game. For example, the information output device 3 plays and outputs VR videos as shown in FIGS. 5(b) to 5(d), but is not limited thereto. The control unit 34 of the information output device 3 may function as a reception unit and receive comments and annotations from users of the information output device 3 for each playback position. The control unit 34 may then store the received comments and annotations and the playback position of the VR video in the storage unit 33, so that when the VR video is played, the received comments and annotations can be displayed in association with the playback position. In this way, the designer D can understand what impressions the users of the information output device 3 who viewed the VR video have of the space in the VR video.

[0117] For example, the specific embodiments of the distribution and integration of the device are not limited to the above embodiments, and all or part of them can be configured by functionally or physically distributing and integrating them in any unit. In addition, new embodiments generated by any combination of a plurality of embodiments are also included in the embodiments of the present invention. The effects of the new embodiments generated by the combination have the combined effects of the original embodiments.

Description of Reference Numerals

[0118] 1... generating device, 2... display device, 21... input unit, 22... display unit, 23... detection unit, 24... storage unit, 25... control unit, 251... acquisition unit, 252... display control unit, 253... detection information generation unit, 254... transmission unit, 3... information output device, 31... input unit, 32... display unit, 33... storage unit, 34... control unit, 341... acquisition unit, 342... output unit, 343... charging unit, 4... disclosure device, S... design support system

Claims

1. When the user views a predetermined space that is a virtual reality space or an augmented reality space corresponding to an actual space or a space to be designed, a head shaking motion in which the user shakes the head in a direction horizontal to the ground and perpendicular to the traveling direction, and after moving the user's line of sight in a direction included in a first angular range with respect to the traveling direction of the user, within a predetermined time, moving the line of sight in a direction included in a second angular range on the opposite side of the first angular range with respect to the traveling direction, at least either of the movements of the line of sight is defined as a looking-around motion indicating that the user is trying to recognize the space. A detection information indicating the detection status of the looking-around motion, and an acquisition unit that acquires the detection information including an image corresponding to the timing at which the looking-around motion is detected among a plurality of images included in a video showing the predetermined space. An output unit that outputs in association with each other information indicating the predetermined space and the detection information including an image corresponding to the timing at which the looking-around motion detected by the acquisition unit is detected. An information output device comprising the same.

2. The output unit specifies a position in the predetermined space when the looking-around motion is detected, and displays information indicating that the looking-around motion has been detected as the detection information at the specified position included in a map showing the predetermined space as information indicating the predetermined space. The information output device according to Claim 1.

3. A design support system comprising a display device worn by a user and an information output device, wherein the display device comprises a display unit, a display control unit that causes the display unit to display a predetermined space that is a virtual reality space or an augmented reality space corresponding to an actual space or a space to be designed, when the user views the predetermined space, a head shaking motion in which the user shakes the head in a direction horizontal to the ground and perpendicular to the traveling direction, and after moving the user's line of sight in a direction included in a first angular range with respect to the traveling direction of the user, within a predetermined time, moving the line of sight in a direction included in a second angular range on the opposite side of the first angular range with respect to the traveling direction, at least either of the movements of the line of sight is defined as a looking-around motion indicating that the user is trying to recognize the space. A detection information generation unit that generates detection information indicating the detection status of the looking-around motion, and the detection information includes an image corresponding to the timing at which the looking-around motion is detected among a plurality of images included in a video showing the predetermined space. and has The information output device includes an acquisition unit that acquires the detection information generated by the detection information generation unit, and an output unit that outputs in association with each other information indicating the predetermined space and the detection information including an image corresponding to the timing at which the acquisition unit detected the looking-around motion, and a design support system

4. When a user visually recognizes a predetermined space that is a virtual reality space or an augmented reality space corresponding to an actual space or a space to be designed, the computer executes: regarding at least either a head shaking motion in which the user shakes the head in a direction horizontal to the ground and perpendicular to the traveling direction, or a movement of the user's line of sight, after moving the line of sight in a direction included in a first angular range with respect to the traveling direction of the user, moving the line of sight within a predetermined time in a direction included in a second angular range on the side opposite to the first angular range with respect to the traveling direction, as a looking-around motion indicating that the user has reacted to try to recognize the space; a step of acquiring detection information indicating the detection status of the looking-around motion, the detection information including an image corresponding to the timing at which the looking-around motion was detected among a plurality of images included in a moving image indicating the predetermined space; and a step of outputting in association with each other information indicating the predetermined space and the detection information including the image corresponding to the timing at which the looking-around motion was detected that has been acquired.

5. A computer is configured to: When a user visually recognizes a predetermined space that is a virtual reality space or an augmented reality space corresponding to an actual space or a space to be designed, regarding at least either a head shaking motion in which the user shakes the head in a direction horizontal to the ground and perpendicular to the traveling direction, or a movement of the user's line of sight, after moving the line of sight in a direction included in a first angular range with respect to the traveling direction of the user, moving the line of sight within a predetermined time in a direction included in a second angular range on the side opposite to the first angular range with respect to the traveling direction, as a looking-around motion indicating that the user has reacted to try to recognize the space; an acquisition unit that acquires detection information indicating the detection status of the looking-around motion, the detection information including an image corresponding to the timing at which the looking-around motion was detected among a plurality of images included in a moving image indicating the predetermined space; and an output unit that outputs in association with each other information indicating the predetermined space and the detection information including the image corresponding to the timing at which the looking-around motion was detected that has been acquired by the acquisition unit. An information output program that functions as...

Images