Guidance assistance method, guidance assistance apparatus, and program

Abstract

To provide a guidance support method and the like capable of efficiently guiding a user in a virtual space.SOLUTION: The guidance assistance method is a guidance assistance method executed by a guidance assistance device that is communicably connected to a reproduction device reproducing a virtual space and assists in guiding a user in the virtual space, the method including acquiring log information of the user in the virtual space acquired from a sensor mounted on the reproduction device (S16), determining an interest region in which the user is interested in the virtual space based on the log information (S17), and dynamically changing a guidance pattern for guiding the user in accordance with the interest region of the user (S18).SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a guidance support method, a guidance support device, and a program in a virtual space. [Background technology]

[0002] In recent years, technologies have emerged that allow users to experience virtual spaces as if they were real spaces using devices such as HMDs (Head Mounted Displays). A concept has also emerged in which real spaces are reproduced in virtual spaces, enabling business to be completed in the virtual space. For example, it is being considered to reproduce the interior spaces of buildings exhibited at housing exhibitions in virtual spaces, allowing users to view the homes. For example, Patent Document 1 discloses an image processing method that allows users to easily construct highly realistic interior space models in virtual spaces. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-40053 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, since virtual space is larger than real space, users are guided through it by calling up warp points on a GUI (Graphical User Interface) screen. However, when guiding a user using warp points or the like, there is a problem in that it is difficult to efficiently guide the user through the virtual space. Furthermore, Patent Document 1 does not disclose a technology for efficiently guiding the user through the virtual space.

[0005] Therefore, the present disclosure provides a guidance support method, a guidance support device, and a program that can efficiently guide a user in a virtual space. [Means for solving the problem]

[0006] A guidance support method according to one aspect of the present disclosure is a guidance support method executed by a guidance support device that is communicatively connected to a playback device that reproduces a virtual space and that supports guiding a user within the virtual space, the method acquiring log information of the user within the virtual space obtained from a sensor mounted on the playback device, determining an area of ​​interest in the virtual space in which the user is interested based on the log information, and dynamically changing a guidance pattern for guiding the user according to the area of ​​interest of the user.

[0007] A guidance support device according to one aspect of the present disclosure is a guidance support device that is communicatively connected to a playback device that reproduces a virtual space and that supports guiding a user within the virtual space, and includes a log acquisition unit that acquires log information of the user within the virtual space acquired from a sensor mounted on the playback device, an interest area determination unit that determines an interest area in which the user is interested within the virtual space based on the log information, and a guidance determination unit that dynamically changes a guidance pattern that guides the user according to the interest area of ​​the user.

[0008] A program according to one aspect of the present disclosure is a program for causing a computer to execute the above-described guidance support method. [Effects of the Invention]

[0009] According to one aspect of the present disclosure, it is possible to realize a guidance support method or the like that can efficiently guide a user in a virtual space. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing a configuration of a guidance support system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of an image of a house in a virtual space according to the embodiment. [Figure 3] FIG. 3 is a flowchart showing the operation of the guidance support system according to the embodiment. [Figure 4A] FIG. 4A is a diagram showing warp points on a conventional GUI screen. [Figure 4B] FIG. 4B is a diagram showing warp points on the GUI screen according to the embodiment. [Figure 5A] FIG. 5A is a diagram illustrating an example of a graphic for guiding a user according to the embodiment. [Figure 5B] FIG. 5B is a diagram showing another example of a graphic for guiding a user according to the embodiment. [Figure 6A] FIG. 6A is a diagram illustrating an example of a method for lowering the visibility of a non-target area relative to a target area according to an embodiment. [Figure 6B] FIG. 6B is a diagram showing another example of a method for lowering the visibility of a non-target area relative to a target area according to the embodiment. [Figure 7] FIG. 7 is a diagram for explaining sound being emitted from a target area according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of guidance by an avatar according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] (Background to this disclosure) Before describing the embodiments of the present disclosure, the background to the present disclosure will be described.

[0012] As described in the "Background Art" above, home viewings and other commercial transactions in virtual spaces are being considered. Conventionally, guiding users using functions such as warping at warp points has been considered, but because the guidance method cannot be dynamically changed, it is difficult to efficiently guide users through a vast virtual space. Since efficient guidance through a vast virtual space can facilitate commercial transactions such as home sales, it is desirable to efficiently guide users through the virtual space. Here, efficient guidance means preferentially guiding users to areas of interest to them.

[0013] Therefore, the inventors of the present application have conducted extensive research into guidance support methods that can efficiently guide users in virtual spaces, and have devised the following guidance support methods, etc. For example, they have devised a guidance support method that can change the guidance method depending on the user's interests, attributes, etc.

[0014] A guidance support method according to a first aspect of the present disclosure is a guidance support method executed by a guidance support device that is communicatively connected to a playback device that reproduces a virtual space and that supports guiding a user within the virtual space, the method acquiring log information of the user within the virtual space obtained from a sensor mounted on the playback device, determining an area of ​​interest in which the user is interested within the virtual space based on the log information, and dynamically changing a guidance pattern for guiding the user according to the area of ​​interest of the user.

[0015] This allows the guidance pattern to be dynamically changed according to the region of interest, so that the user can be guided more efficiently in the virtual space than when the guidance pattern is fixed. Since the region of interest may differ from user to user, using the region of interest of the user makes it possible to guide the user according to the user.

[0016] Also, for example, a guidance support method according to a second aspect may be the guidance support method according to the first aspect, wherein the log information includes location information indicating the user's location, and in determining the area of ​​interest, the time spent in one or more areas within the virtual space may be obtained from the location information, and the area of ​​interest may be determined based on the time spent.

[0017] This allows the user to determine whether the area is an area of ​​interest based on the length of stay, making it possible to provide guidance according to the length of stay. For example, if the user's stay time is long, it is possible to dynamically change the guidance pattern based on the user's interest in the area.

[0018] Also, for example, a guidance support method according to a third aspect may be the guidance support method according to the first or second aspect, and in determining the region of interest, an area where the staying time is equal to or longer than a first threshold time may be determined to be the region of interest.

[0019] As a result, since the determination is made using the first threshold time, it is possible to make a more accurate determination using the stay time.

[0020] Also, for example, a guidance support method according to a fourth aspect is a guidance support method according to any one of the first to third aspects, wherein the log information includes gaze information indicating the user's gaze, and in determining the region of interest, the region of interest may be determined based on the gaze information.

[0021] This allows the user's line of sight to be used to determine whether or not the area is an area of ​​interest, making it possible to guide the user in accordance with the object they are looking at.

[0022] Also, for example, a guidance support method according to a fifth aspect may be the guidance support method according to the fourth aspect, and in determining the region of interest, the gaze time of one or more areas in the virtual space may be obtained from the gaze information, and an area where the gaze time is equal to or longer than a second threshold time may be determined to be the region of interest.

[0023] This allows for determining whether or not a region is an area of ​​interest using the gaze time. In addition, since the determination is made using the second threshold time, it is possible to make a more accurate determination.

[0024] Also, for example, a guidance support method according to a sixth aspect is a guidance support method according to any one of the first to fifth aspects, wherein the log information includes audio information indicating audio uttered by the user, and in determining the area of ​​interest, the area of ​​interest may be determined based on the audio information.

[0025] This allows the user's voice information to be used to determine whether or not the area is an area of ​​interest, making it possible to provide guidance according to the user's voice.

[0026] Also, for example, a guidance support method according to a seventh aspect may be the guidance support method according to the sixth aspect, wherein the voice information includes a predetermined keyword uttered by the user, and in determining the area of ​​interest, the area of ​​interest may be determined based on a detection result of the predetermined keyword of the user included in the voice information.

[0027] This allows a determination as to whether or not a region is of interest using a keyword, making it possible to guide the user in accordance with the content of the user's speech.

[0028] Also, for example, a guidance support method according to an eighth aspect is a guidance support method according to the seventh aspect, wherein the predetermined keywords include words that indicate the user's emotions, and in determining the area of ​​interest, an area in which the user is staying may be determined to be the area of ​​interest when a word that indicates the user's emotions is detected in the audio information.

[0029] This makes it possible to determine whether the area the user is currently in is an area of ​​interest based on the user's emotions, thereby enabling guidance based on the user's emotions.

[0030] Furthermore, for example, a guidance support method according to a ninth aspect may be the guidance support method according to the seventh or eighth aspect, wherein the predetermined keyword includes a word indicating a specific area, and in determining the area of ​​interest, if a word indicating the specific area contained in the audio information is detected a first threshold number of times or more, the specific area may be determined to be the area of ​​interest.

[0031] This allows a specific area to be determined to be an area of ​​interest if a word in the specific area is detected a first threshold number of times or more, thereby improving the accuracy of the determination compared to, for example, determining whether an area is an area of ​​interest based on whether or not a word is detected in the specific area.

[0032] Furthermore, for example, a guidance support method according to a tenth aspect is a guidance support method according to any one of the seventh to ninth aspects, wherein the predetermined keywords include a first word indicating a specific area and a second word indicating interest behavior in the specific area, and in determining the area of ​​interest, if the first word and the second word included in the audio information are detected a second threshold number of times or more, the specific area may be determined to be the area of ​​interest.

[0033] This allows the user's area of ​​interest to be determined using both the area and the behavior of interest, thereby improving the accuracy of the determination compared to when the determination is made using only one of the area and the behavior of interest, for example.

[0034] Also, for example, a guidance support method according to an eleventh aspect is a guidance support method according to any one of the first to tenth aspects, wherein the log information includes posture information indicating the posture of the user, and in determining the region of interest, an area in which the user is staying when a specific posture is detected from the posture information may be determined to be the region of interest.

[0035] This allows the guidance pattern to be changed depending on whether the user is interested in the area in the virtual space where he or she is currently located, thereby enabling the user to be guided efficiently in the virtual space.

[0036] Also, for example, a guidance support method according to a twelfth aspect is a guidance support method according to any one of the first to eleventh aspects, and further, acquiring attribute information of the user and dynamically changing the guidance pattern may include determining a guidance pattern that serves as a reference for guiding the user based on the attribute information, and changing the guidance order of the reference guidance pattern based on the log information of the user.

[0037] This allows the standard guidance pattern determined by the user's attribute information to be dynamically changed according to the interests of the user who is being guided by the standard guidance pattern, thereby making it possible to efficiently guide the user in the virtual space.

[0038] Furthermore, for example, a guidance support method according to a thirteenth aspect is the guidance support method according to the twelfth aspect, and dynamically changing the guidance pattern may include, when an area other than the area in the guidance order of the reference guidance pattern is determined as the region of interest, prioritizing guidance of the area determined as the region of interest.

[0039] This allows the user to be guided preferentially to areas that interest them.

[0040] Furthermore, for example, the guidance support method according to the 14th aspect is the guidance support method according to the 12th or 13th aspect, and may further change the order of the warp points in each area displayed on the GUI (Graphical User Interface) screen according to the guidance order of the updated guidance pattern.

[0041] This allows the user to be guided effectively by changing the position of the warp point button.

[0042] Also, for example, the guidance support method according to the 15th aspect may be the guidance support method according to the 14th aspect, in which the warp point corresponding to the area to be guided next in the guidance order may be changed to the upper left position on the GUI screen.

[0043] This makes it easier for the user to focus on the button for the area to which the user is next directed, thereby enabling the user to be guided effectively.

[0044] Furthermore, for example, a guidance support method according to a 16th aspect may be the guidance support method according to the 14th or 15th aspect, in which a plurality of buttons corresponding to a plurality of areas are arranged two-dimensionally on the GUI screen, and the plurality of buttons displayed on the GUI screen may be rearranged in order from the upper left to the lower right in the order of the guidance sequence of the updated guidance pattern.

[0045] This allows the user to be guided effectively by changing the position of the warp point button.

[0046] Also, for example, a guidance support method according to a seventeenth aspect is a guidance support method according to any one of the first to sixteenth aspects, and may further include displaying a figure on the floor of the virtual space to guide the user to an area to which the user is next to be guided.

[0047] This makes it possible to effectively guide the user by displaying the graphic.

[0048] Furthermore, for example, the guidance support method according to the 18th aspect is a guidance support method according to any one of the 1st to 17th aspects, and may further reduce the visibility of non-target areas other than the target area to which the user wishes to be guided next relative to the target area.

[0049] This allows the user to be guided effectively by relatively changing the visibility.

[0050] Also, for example, the guidance support method according to the 19th aspect may be the guidance support method according to the 18th aspect, in which the visibility of the non-target area is relatively reduced by lowering the brightness of the non-target area or by increasing the brightness of the non-target area.

[0051] This allows the user to be guided effectively by changing the brightness of the area.

[0052] Furthermore, for example, the guidance support method according to the 20th aspect may be the guidance support method according to the 18th or 19th aspect, in which the visibility of the non-target area is relatively reduced by dimming the lighting placed in the non-target area or by brightening the lighting.

[0053] This allows the user to be effectively guided by changing the brightness of the lighting.

[0054] Furthermore, for example, the guidance support method according to the 21st aspect may be a guidance support method according to any one of the 18th to 20th aspects, and may relatively reduce the visibility of the non-target area by at least one of lowering the resolution of objects in the non-target area and increasing the resolution of objects in the target area.

[0055] This allows the user to be effectively guided by changing the resolution.

[0056] Also, for example, a guidance support method according to a 22nd aspect is the guidance support method according to any one of the 18th to 21st aspects, and may further include emitting a sound from the target area.

[0057] This makes it possible to effectively guide the user by generating a sound.

[0058] Furthermore, for example, a guidance support method according to a 23rd aspect is the guidance support method according to the second or third aspect, and the one or more areas may be rooms of a house provided in the virtual space.

[0059] This allows efficient guidance to rooms in a house, which is useful when, for example, viewing a house.

[0060] Also, for example, a guidance support method according to a 24th aspect may be a guidance support method according to any one of the 1st to 23rd aspects, and may further include displaying an avatar in the virtual space to guide the user to the next area to which the user is to be guided.

[0061] This makes it possible to effectively guide the user by displaying the avatar.

[0062] A guidance support device according to one embodiment of the present disclosure is communicably connected to a playback device that reproduces a virtual space, and supports guiding a user in the virtual space, and includes: a log acquisition unit that acquires log information of the user in the virtual space acquired from a sensor mounted on the playback device; an interest region determination unit that determines an interest region in the virtual space in which the user is interested based on the log information; and a guidance determination unit that dynamically changes a guidance pattern for guiding the user according to the interest region of the user. A program according to one embodiment of the present disclosure is a program for causing a computer to execute the guidance support method according to any one of the first to twenty-fourth embodiments.

[0063] As a result, the same effects as those of the above-mentioned guidance support method can be achieved.

[0064] These general or specific aspects may be realized as a system, a method, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or as any combination of the system, method, integrated circuit, computer program, or recording medium. The program may be pre-stored in the recording medium, or may be supplied to the recording medium via a wide area communication network including the Internet.

[0065] Hereinafter, the embodiments will be specifically described with reference to the drawings.

[0066] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components not described in independent claims are described as optional components.

[0067] Furthermore, each figure is a schematic diagram and is not necessarily an exact illustration. Therefore, for example, the scales of the figures do not necessarily match. Furthermore, in each figure, substantially the same components are given the same reference numerals, and redundant explanations are omitted or simplified.

[0068] Furthermore, in this specification, terms indicating relationships between elements such as "same," terms indicating the shapes of elements such as "circle," numerical values, and numerical ranges are not expressions that express only the strict meaning, but are expressions that also include a substantially equivalent range, for example, a difference of about a few percent (or about 10%).

[0069] Furthermore, in this specification, ordinal numbers such as "first" and "second" do not refer to the number or order of components unless otherwise specified, but are used for the purpose of avoiding confusion and distinguishing between components of the same type.

[0070] (Embodiment) Hereinafter, a guidance support method and the like according to this embodiment will be described with reference to FIGS.

[0071] [1. Guidance support system configuration] First, the configuration of a guidance support system that executes a guidance support method according to this embodiment will be described with reference to Figs. 1 and 2. Fig. 1 is a block diagram showing the configuration of guidance support system 1 according to this embodiment. Guidance support system 1 is used, for example, in cases where an experience in a virtual space is linked to business in the real space, and the following describes an example in which a house is viewed in a virtual space. Note that Fig. 1 shows an exemplary functional configuration of guidance support system 1, and the functional configuration of guidance support system 1 is not limited to that shown in Fig. 1.

[0072] 1, the guidance support system 1 includes a virtual space reproduction device 10 and a virtual space presentation device 20. The virtual space reproduction device 10 and the virtual space presentation device 20 are connected to each other so that they can communicate with each other. The communication method is not particularly limited, and may be wired communication or wireless communication.

[0073] The virtual space reproduction device 10 includes a log transmission unit 11 and a virtual space generation unit 12. The virtual space reproduction device 10 is mounted on a device that is worn by a user and reproduces a virtual space, such as an HMD. The HMD is an example of a reproduction device that reproduces a virtual space.

[0074] Here, the HMD is a display device for VR (Virtual Reality) that uses the parallax between the left and right eyes to create a 3D image, and includes a display unit and a sound output unit (not shown). The display unit is, for example, a liquid crystal display, and the sound output unit is, for example, but not limited to, a speaker. VR creates a virtual world using images using CG (Computer Graphics) or special effects, allowing users to experience activities in the virtual space as if they were in the real world. For example, a user wears the HMD on their head and holds dedicated controllers in both hands to view, move, and operate images in the virtual space.

[0075] The HMD is also equipped with various sensors for sensing the user wearing it. Examples of the various sensors include, but are not limited to, a gaze detection sensor that detects the user's gaze, a position detection sensor that detects the user's position, a posture detection sensor that detects the user's posture, and a sound collection sensor that collects the user's voice. The gaze detection sensor may be a sensor that detects the gaze by detecting eye movement (e.g., a sensor using technology such as eye tracking). The position detection sensor may be, for example, a sensor that can detect coordinates in a virtual space. The position detection sensor may also treat the user's center of gravity as the position. The posture detection sensor may be, for example, a sensor that detects posture using a three-axis angular velocity sensor (also called a gyro sensor). The sound collection sensor may be, for example, a microphone.

[0076] Furthermore, the HMD may accept input of user attribute information when the user wears the HMD and launches an app. The attribute information includes, but is not limited to, at least one of family attributes and age attributes. Family attributes include father (father attribute), mother (mother attribute), child (child attribute), etc. Age attributes include teens, twenties, thirties, etc.

[0077] The log transmission unit 11 acquires log information obtained by sensing the user from various sensors while the HMD is worn by the user, and transmits the acquired log information to the virtual space presentation device 20. The log transmission unit 11 also transmits attribute information to the virtual space presentation device 20. For example, the attribute information is transmitted to the virtual space presentation device 20 before the log information. The log transmission unit 11 is configured to include, for example, a communication circuit (or a communication module). It is sufficient that the log transmission unit 11 transmits at least the log information to the virtual space presentation device 20.

[0078] The log information includes sensing data from various sensors, such as at least one of gaze information indicating the user's gaze, position information indicating the user's position, posture information indicating the user's posture, and voice information indicating the voice uttered by the user.

[0079] Virtual space generation unit 12 displays a virtual reality image on the display unit of the HMD based on an external image signal. The display unit displays an image to the user based on the control signal generated by virtual space generation unit 12. As will be described in detail later, virtual space generation unit 12, for example, changes the brightness of a part of the virtual space or superimposes a figure or the like used to guide an object in the virtual space.

[0080] The image relating to a house generated by the virtual space generation unit 12 will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining an example of an image of a house in a virtual space according to this embodiment.

[0081] As shown in Fig. 2, the house has rooms such as an entrance hall, a dining room, a kitchen, and a living room. An example of previewing a house with the layout shown in Fig. 2 will be described below.

[0082] The virtual space generation unit 12 displays on the display unit an image according to the user's position in the house, line of sight, etc. FIG. 2 shows, as examples, an image of the house viewed from the entrance, an image of the kitchen viewed from the dining room entrance, an image of the dining room viewed from the kitchen entrance, an image of the living room viewed from the kitchen, an image of the garden viewed from the kitchen, an image of the living room viewed from the living room entrance, and an image of the garden viewed from the living room. The images may be moving images or still images. The tour starts from the entrance, but is not limited to this.

[0083] Referring again to FIG. 1 , the virtual space presentation device 20 is an example of a guidance support device that supports user guidance within a virtual space. Its functional configuration includes a log acquisition unit 21, a region of interest determination unit 22, a guidance determination unit 23, and an output unit 24. The virtual space presentation device 20 also includes, as its hardware configuration, a non-volatile memory storing a program, a volatile memory serving as a temporary storage area for executing the program, an input / output port, a communication interface, a processor for executing the program, and the like. The memory may be a read-only memory (ROM) or a random access memory (RAM), and can store a program executed by the processor. The log acquisition unit 21, the region of interest determination unit 22, the guidance determination unit 23, and the output unit 24 are implemented by a processor that executes a program stored in the memory. The virtual space presentation device 20 may be implemented by a stationary personal computer (PC), a mobile terminal such as a smartphone or tablet, a dedicated computer, a server (e.g., a cloud server), or a combination thereof. The virtual space presentation device 20 may also be mounted on an HMD.

[0084] The log acquisition unit 21 acquires the log information and attribute information transmitted by the log transmission unit 11. The log acquisition unit 21 may acquire the log information and attribute information directly from the log transmission unit 11, or may acquire the log information and attribute information via another device. The log acquisition unit 21 is configured to include, for example, a communication circuit (or a communication module). Note that the timing at which the log acquisition unit 21 acquires the log information and attribute information is not limited, but the log information may be acquired after the attribute information is acquired. Furthermore, the log information is acquired, for example, periodically. Furthermore, it is sufficient for the log acquisition unit 21 to acquire at least the log information.

[0085] The interest region determination unit 22 is a processing unit that determines an interest region in which the user is interested in the virtual space based on the log information. When the house is divided into rooms (an example of an area), the interest region determination unit 22 determines which room the user is interested in based on the log information. The interest region may be the room itself (for example, the kitchen, the living room, etc.) or a part of the room (for example, an object installed in the room, etc.).

[0086] The guidance determination unit 23 is a processing unit that dynamically determines guidance content for the user based on the determination result of the interest region determination unit 22. The guidance determination unit 23 determines a guidance pattern (reference guidance pattern) that serves as a reference for guiding the user based on, for example, user attribute information, and changes the guidance order of the reference guidance pattern based on user log information. The guidance determination unit 23 sequentially changes the guidance order of the reference guidance pattern so as to prioritize guidance to the user's interest region based on, for example, user log information acquired during guidance with the reference guidance pattern.

[0087] The output unit 24 outputs the guidance pattern determined by the guidance determination unit 23 to the virtual space reproduction device 10. The output unit 24 is configured to include, for example, a communication circuit (or a communication module).

[0088] [2. Operation of the Guidance Support System] Next, the operation of the guidance support system 1 configured as above will be described with reference to Fig. 3 to Fig. 7. Fig. 3 is a flowchart showing the operation (guidance support method) of the guidance support system 1 according to this embodiment. Each process shown in Fig. 3 is executed by the virtual space presentation device 20.

[0089] 3, first, the log acquisition unit 21 acquires attribute information of the user wearing the HMD from the log transmission unit 11 (S11). The log acquisition unit 21 outputs the acquired attribute information to the guidance determination unit 23. For example, the attribute information is acquired before the user starts viewing a house.

[0090] Next, the guidance determination unit 23 determines a reference guidance pattern for guiding the user based on the attribute information of the user. The example of Fig. 3 shows an example in which the reference guidance pattern differs depending on whether the user has a mother attribute or not. Therefore, in the example of Fig. 3, the guidance determination unit 23 determines whether the user's attribute is a mother attribute or not based on the attribute information (S12).

[0091] Next, when the guidance determination unit 23 determines that the user's attribute is a mother attribute (Yes in S12), that is, when the attribute information includes that the user's attribute is a mother, it reads out a guidance pattern for the mother attribute (reference guidance pattern) (S13). When the guidance determination unit 23 determines that the user's attribute is other than a mother attribute (No in S12), that is, when the attribute information includes that the user's attribute is other than a mother, it reads out a guidance pattern for other than a mother attribute (reference guidance pattern) (S14). The reference guidance pattern for each attribute is set in advance and stored in a storage unit (not shown) included in the virtual space presentation device 20. For example, the guidance pattern read out in step S13 and the guidance pattern read out in step S14 have at least a part of a different guidance order.

[0092] Next, the guidance determination unit 23 causes the HMD to perform guidance in the determined reference guidance pattern (S15). When the user's attribute is the mother attribute, the guidance determination unit 23 generates control information indicating guidance in the guidance pattern of "front door entrance → dining room entrance → kitchen entrance → from kitchen to living room → from kitchen to garden → ...", and outputs the control information to the virtual space generation unit 12 via the output unit 24. The guidance pattern is a guidance pattern centered around the kitchen. Furthermore, when the user's attribute is not the mother attribute, the output unit 24 outputs control information indicating guidance in the guidance pattern of "front door entrance → living room entrance → from living room to garden → dining room entrance → ..." to the virtual space generation unit 12.

[0093] Next, the log acquisition unit 21 acquires log information of the user being guided by the reference guidance pattern from the log transmission unit 11 (S16). The log information may be acquired periodically at predetermined time intervals, or may be acquired when a predetermined event is detected. The predetermined event may be, for example, the user performing a predetermined action or uttering a predetermined sound. The log acquisition unit 21 outputs the acquired log information to the interest region determination unit 22.

[0094] Next, the interest area determination unit 22 determines whether or not the user is interested in a particular area based on the log information (S17).

[0095] When the log information includes the user's location information, the interest region determination unit 22 acquires the user's stay time in one or more rooms in the virtual space from the location information, and determines the interest region based on the stay time. The stay time is the time the user is in the room, and can be acquired from time-series data of the location information. The stay time is, for example, the time the user's center of gravity is located in the room. The interest region determination unit 22 may, for example, determine an area where the stay time is equal to or longer than a first threshold time as the interest region. In this way, the interest region determination unit 22 determines, for example, whether the user is interested in the room in the virtual space where the user is currently located.

[0096] Furthermore, if the log information includes the user's line of sight information, the region of interest determination unit 22 determines the region of interest based on the line of sight information. The region of interest determination unit 22 may, for example, acquire the gaze time of one or more rooms in the virtual space from the line of sight information, and determine a room whose gaze time is equal to or longer than a second threshold time as the region of interest. The room here may be the entire room or a part of the room. The gaze time is the time spent gazing at a room where a 3D object that intersects with the user's line of sight is present. In this way, the region of interest determination unit 22 determines, for example, where the user will be interested next.

[0097] Furthermore, if the log information includes voice information of the user, the region of interest determination unit 22 determines the region of interest based on the voice information. If the voice information includes a predetermined keyword uttered by the user, the region of interest determination unit 22 determines the region of interest based on the detection result of the predetermined keyword of the user included in the voice information. The predetermined keyword is a keyword that indicates interest in the room. The predetermined keyword may include, for example, a word that indicates the user's emotion. In this case, when the region of interest determination unit 22 detects a word that indicates the user's emotion included in the voice information, it determines the room in which the user is currently staying as the region of interest. For example, if the region of interest determination unit 22 detects the word a threshold number of times or more (for example, three times or more), it may determine the room in which the user is currently staying as the region of interest. Words that indicate the user's emotion include, for example, words that indicate empathy, excitement, or excitement, such as "amazing," "beautiful," "comfortable," and "like the real thing."

[0098] The predetermined keyword may include a word indicating a specific area. In this case, if the interest area determination unit 22 detects a word indicating a specific area included in the audio information a first threshold number of times or more, the interest area determination unit 22 determines the specific area as a region of interest. The words include words associated with a specific room. For example, words associated with a kitchen include "kitchen," "induction cooker," and "refrigerator." If these words are detected, it can be determined that the user is interested in kitchens. For example, words associated with a living room include "TV," "sofa," and "living room." If these words are detected, it can be determined that the user is interested in living rooms. For example, words associated with a dining room include "table," "dining table," and "dining room." If these words are detected, it can be determined that the user is interested in dining rooms. Note that the words are not limited to these. The first threshold number of times is, for example, three times, but it may be one or more times.

[0099] The predetermined keyword may include a first word indicating a specific area and a second word indicating an interest behavior toward the specific area. The interest behavior is a behavior indicating that the user is interested in the specific area. In this case, the interest region determination unit 22 determines the specific area as an interest region when the first word and the second word included in the voice information are detected a second threshold number of times or more. The interest behavior is a behavior indicating the user's interest, such as, but not limited to, "want to see," "want to sit," "interested," "want to touch," and "want to go." When "kitchen" is detected as the first word and "want to see" is detected as the second word, the interest region determination unit 22 can determine that the user is interested in the kitchen. When "living room" is detected as the first word and "want to sit" is detected as the second word, the interest region determination unit 22 can determine that the user is interested in the living room. When "dining room" is detected as the first word and "interested" is detected as the second word, the interest region determination unit 22 can determine that the user is interested in the dining room. For example, if a user says that they do not want to see the kitchen, determining whether they are interested based on the detection result of "kitchen" alone may not accurately determine the user's area of ​​interest. By using both the first word and the second word, the user's area of ​​interest can be determined more accurately.

[0100] The predetermined keywords may be generated by voice recognition (e.g., voice recognition using AI (Artificial Intelligence)). Each word may be set in advance and stored in a storage unit. Each word may be set for each user attribute or room.

[0101] The specific area may be the area where the user is currently located, an area that the user has not yet visited, or an area that the user has already visited. The specific area may be set in advance. The specific area may change dynamically depending on, for example, the attributes of the user.

[0102] Furthermore, if the log information includes user posture information, the region of interest determination unit 22 determines the region of interest based on the posture information. For example, the region of interest determination unit 22 may determine, as the region of interest, an area in which the user is staying when a specific posture is detected from the posture information. Examples of specific postures include, but are not limited to, crouching, lying down, stretching out, and raising one's hand. For example, if the user crouches near an object such as a sofa in the living room, the region of interest determination unit 22 can determine that the user is interested in the living room. Furthermore, if the user stretches out his or her hand and touches the kitchen countertop, the region of interest determination unit 22 can determine that the user is interested in the kitchen. Note that crouching, lying down, etc. can be detected from the position of the user's center of gravity. For example, crouching, lying down, etc. can be detected from a change in the coordinates of the head (e.g., a change in the position of the HMD). Furthermore, stretching out and raising one's hand can be detected from the coordinates (e.g., wrist coordinates) of dedicated controllers held in both hands by the user. Stretching out a hand or raising a hand can be detected by, for example, a change in wrist coordinates (for example, coordinates of both wrists). Note that the wrist coordinates may be acquired by, for example, image recognition.

[0103] When the interest area determination unit 22 determines that the user is interested in a specific area (Yes in S17), in this case, when the user is interested in any room, the guidance determination unit 23 changes the guidance pattern from the guidance pattern for the mother attribute (S18). It can also be said that the guidance determination unit 23 dynamically changes the guidance pattern that guides the user according to the user's interest area.

[0104] The guidance determination unit 23 changes the guidance order of the reference guidance pattern based on the user's log information. For example, when a room other than the room in the guidance order of the reference guidance pattern is determined to be a region of interest, the guidance determination unit 23 changes the guidance pattern so as to prioritize guidance to the room in the region of interest. Prioritizing may mean guiding the room in the region of interest before the room to be guided next in the reference guidance pattern. When a user with a mother attribute is at the entrance to the dining room and the dining room is a region of interest, the guidance determination unit 23 changes the next guidance destination from the kitchen entrance to the dining room (for example, the dining room entrance). The guidance destination after the change (i.e., the guidance destination that is the user's region of interest) may be a room to which the user has not yet been guided, or may be a room to which the user has already been guided.

[0105] Furthermore, if the interest area determining unit 22 determines that the user is not interested in a particular area (No in S17), the guidance determining unit 23 proceeds to step S20.

[0106] Next, the guidance determination unit 23 causes the HMD to perform guidance according to the changed guidance pattern (S19). The guidance determination unit 23 causes the HMD to perform guidance to the next guidance destination in the changed guidance pattern, for example. For example, the guidance determination unit 23 generates control information indicating that guidance will be performed using the changed guidance pattern, and outputs the control information to the virtual space generation unit 12 via the output unit 24.

[0107] The guidance determination unit 23 may cause the display unit to display information indicating that the guidance pattern has been changed from the reference guidance pattern. Also, the guidance determination unit 23 may cause the display unit to display information indicating whether or not changing the guidance pattern from the reference guidance pattern is permitted, and may cause the HMD to perform guidance using the changed guidance pattern when the user inputs permission.

[0108] Here, examples of the guidance methods executed in steps S15 and S19 will be described with reference to FIGS. 4A to 7. FIG.

[0109] FIG. 4A is a diagram showing warp points on a conventional GUI screen. FIG. 4B is a diagram showing warp points on a GUI screen according to this embodiment. The GUI screens shown in FIGS. 4A and 4B are screens displayed to the user via the display unit of the HMD. These screens are generated by the virtual space generation unit 12. By clicking a button corresponding to a room, the user can warp to that room in the virtual space.

[0110] As shown in Figure 4A, at the warp point on a conventional GUI screen, buttons are arranged in order from the entrance. Figure 4A shows an example of the arrangement of each button in the case of the standard guidance pattern. In the conventional system, the arrangement of each button is fixed regardless of the user's position.

[0111] As shown in FIG. 4B, in this embodiment, the arrangement of the buttons at the warp point on the GUI screen changes. In this embodiment, the button corresponding to the room to which the user wants to be guided next is displayed in the upper left. FIG. 4B shows an example in which the kitchen button is displayed in the upper left when the next room to which the user wants to be guided is the kitchen. This takes advantage of the tendency for people to unconsciously look at buttons from the upper left to the lower right. In other words, the button for the area to which the user wants to be guided next is placed in a position at the warp point that is easiest for the user to focus first.

[0112] For example, if the interest region determination unit 22 determines that the user is interested in a specific area, a button corresponding to the specific area (specific room) determined to be of interest is displayed in the upper left position of the GUI screen. It can also be said that the guidance determination unit 23 changes the display position of each button on the GUI screen based on the determination result of the interest region determination unit 22. For example, the guidance determination unit 23 determines whether or not a button corresponding to a specific area determined by the interest region determination unit 22 to be of interest to the user is displayed in the upper left position of the GUI screen, and if it is not displayed, the guidance determination unit 23 may change the position of the button corresponding to the specific area to the upper left position.

[0113] In this way, the guidance determination unit 23 may change the position of the warp point button corresponding to the next room to be guided to in the guidance order to the upper left position on the GUI screen. When multiple warp points corresponding to multiple areas are arranged two-dimensionally on the GUI screen, the guidance determination unit 23 may rearrange the multiple buttons displayed on the GUI screen in order from the upper left to the lower right in the guidance order of the updated guidance pattern.

[0114] Displaying a button for the next area to which the user wishes to be guided in the upper left corner is an example of highlighting the button. The highlighting is not limited to the position of the button, and may be, for example, by changing the color of the button or changing the display mode (for example, by blinking).

[0115] Furthermore, the guidance determination unit 23 may display, for example, a graphic on the surface of an object in the virtual space to guide the user to the next room. The graphic may be, for example, an arrow, a collection of circles, or the like, but is not limited to these. The surface of the object may be, for example, a floor, but may also be a ceiling, a wall, or the like.

[0116] Fig. 5A is a diagram showing an example of a graphic P1 for guiding a user according to this embodiment. Fig. 5B is a diagram showing another example of a graphic P2 for guiding a user according to this embodiment. Graphic P1 is a set of circles, and graphic P2 is an arrow.

[0117] As shown in Fig. 5A, the guide determination unit 23 may display a flow line from the current position to the kitchen to which the user is next guided as a set of circles on the floor (for example, on the floor). Also, as shown in Fig. 5B, the guide determination unit 23 may display an arrow on the floor indicating the direction of travel from the current position to the kitchen to which the user is next guided.

[0118] Furthermore, the guidance determination unit 23 may, for example, relatively reduce the visibility of non-target areas other than the target area (here, the kitchen) to which the user is next to be guided, compared to the target area.

[0119] 6A and 6B are diagrams showing examples of methods for reducing the visibility of a non-target area A2 relative to a target area A1 according to the present embodiment. For convenience, the non-target area A2 is enclosed in a thick line in FIGS. 6A and 6B. In addition, in FIG. 6A, the areas with increased brightness are indicated by dashed lines, and in FIG. 6B, the areas with decreased brightness are indicated by dotted hatching.

[0120] As shown in FIG. 6A, the guidance determination unit 23 may increase the brightness of the non-target area A2 to reduce the visibility (here, contrast) of the non-target area A2, thereby guiding the user to the kitchen where the visibility (here, contrast) is higher. Increasing the brightness of the non-target area A2 may mean, for example, uniformly increasing the pixel values ​​of the images that make up the non-target area A2. In other words, the guidance determination unit 23 may add the same or similar values ​​to the pixel values ​​of each image that makes up the non-target area A2.

[0121] 6B, the guidance determination unit 23 may lower the luminance of the non-target area A2 to make it darker, thereby reducing the visibility of the non-target area A2 and guiding the user to the kitchen, which has high visibility. Lowering the luminance of the non-target area A2 may mean, for example, uniformly lowering the pixel values ​​of pixels that have pixel values ​​equal to or greater than a predetermined value in each image that constitutes the non-target area A2.

[0122] The method for reducing visibility is not limited to increasing or decreasing the brightness of the non-target area A2, and may be, for example, turning on or off lighting arranged in the space. The guidance determination unit 23 may reduce the visibility of the non-target area A2 relatively to the target area A1 by darkening or brightening the lighting arranged in the non-target area A2. Furthermore, the guidance determination unit 23 may reduce the visibility of the non-target area A2 relatively to the target area A1 by at least one of lowering the resolution of the texture of the objects in the non-target area A2 and raising the resolution of the texture of the objects in the target area A1.

[0123] Furthermore, the guidance determination unit 23 may, for example, guide the user in the direction of the sound by making a sound from the target area to which the user is next to be guided. The sound may be a sound that corresponds to the target area. For example, if the target area is the entrance, a chime may be sounded from near the entrance. If the target area is the dining room, the conversation of people in the dining room may be played. If the target area is the living room, the sound of the TV in the living room may be played. Also, for example, if the target area is the kitchen, the sound of running water may be played from the kitchen sink faucet. If the target area is a garden, the sound of birds chirping may be played.

[0124] FIG. 7 is a diagram for explaining sound S being emitted from a target area according to this embodiment.

[0125] 7, when guiding to the kitchen, the guidance determination unit 23 may emit a sound S from the kitchen. Specifically, the guidance determination unit 23 may use a sound output unit of the HMD to emit the sound S from the direction of the kitchen.

[0126] The guidance determination unit 23 generates control information for guiding the user to the next area to which the user is to be guided by any of the guidance methods, and outputs the control information to the virtual space generation unit 12 via the output unit 24.

[0127] 3 again, the guidance determination unit 23 next determines whether or not the process has ended (S20). The guidance determination unit 23 determines that the process has ended when all of the guidance patterns have been guided, when all areas have been guided, or when an operation to end the process has been received from the user. If the guidance determination unit 23 determines that the process has ended (Yes in S20), it ends the process, and if it determines that the process has not ended (No in S20), it returns to step S16 and continues the process.

[0128] The guidance determination unit 23 may also display an avatar in the virtual space to guide the user to the next area to which the user is to be guided. For example, the guidance determination unit 23 may display an avatar in the target area to which the user is to be guided next, and have the displayed avatar guide the user by waving or calling out to the user. The avatar may be a salesperson in a suit, or may be a person (e.g., a salesperson) whose gender, age, etc. are changed by inferring the user's general preferences from attribute information included in the log information. Furthermore, if information indicating that the user likes animals, characters, etc. can be read from the log information, the guidance determination unit 23 may use a non-human avatar (e.g., an animal, character, etc.) for guidance.

[0129] Furthermore, initially, guidance may be provided by a method other than the avatar, but if guidance to the desired location cannot be provided after a certain period of time, guidance may be provided by the avatar from partway through. Conversely, guidance may be provided by the avatar at first, but from partway through, guidance may be provided by sounds or figures other than the avatar.

[0130] An avatar is an alter-ego character that appears in the online world and acts and speaks in virtual space in response to the actions and speech of a person in the real world (a simple avatar), but it can also be an avatar that is a modified version of "yourself" generated by AI using a photograph of a person (for example, a so-called AI avatar). An AI avatar can also be an avatar created using a generating AI.

[0131] 8 is a diagram for explaining an example of guidance by avatar A according to the present embodiment. In FIG. 8, an example is shown in which avatar A is guiding to the kitchen, which is the target area to which avatar A wants to be guided next.

[0132] As shown in FIG. 8, avatar A may be a salesperson wearing a suit whose entire body is displayed, but it may also be an avatar that shows only the upper half of the body, for example. Also, while avatar A is shown positioned next to a kitchen, the location is not limited to this, and for example, avatar A may be displayed inside the kitchen (i.e., the target area to which the user is next directed) or around the kitchen. Also, while avatar A is shown extending its right hand toward the kitchen as if to guide the user through the kitchen, the movement is not limited to this, and it may be waving its hand, as described above, for example.

[0133] (Other embodiments) While the guidance support method and the like according to one or more aspects have been described above based on the embodiments, the present disclosure is not limited to these embodiments. As long as they do not deviate from the spirit of the present disclosure, various modifications conceivable by those skilled in the art to the present embodiments and forms constructed by combining components of different embodiments may also be included in the present disclosure.

[0134] For example, in the above embodiment, an example was described in which one or more areas are rooms in a house, but this is not limited to this. For example, one or more areas may be a store such as a commercial facility within the virtual space, or an outdoor area within the virtual space.

[0135] Furthermore, in the above embodiment, when it is determined that the user is interested in the area where the user is currently located, the guidance determination unit 23 may, for example, guide the user to another point within the area where the user is currently located, or may extend the time spent in the area longer than the time set in the reference guidance pattern.

[0136] In the above embodiment, an example has been described in which a reference guidance pattern according to the user's attributes is determined based on the attribute information, but the present invention is not limited to this. For example, guidance may be started with a fixed guidance pattern regardless of the attributes, or guidance may be started after the user's region of interest is determined. Starting guidance from a state in which guidance has not been performed is also included in dynamically changing the guidance pattern.

[0137] In the above embodiment, an example has been described in which determining whether or not a region of interest exists is performed using any one of position information, gaze information, voice information, and posture information. However, the present invention is not limited to this example. Determining whether or not a region of interest exists may be performed using a combination of at least two of position information, gaze information, voice information, and posture information. Furthermore, determining whether or not a region of interest exists may be performed using other information acquired by a sensor mounted on the HMD instead of or in addition to any one of position information, gaze information, voice information, and posture information. Examples of other information include, but are not limited to, speed information indicating the user's walking speed and biological information such as the user's heart rate.

[0138] Furthermore, in the above embodiment, an HMD (head mounted display) has been described as an example of a display device, but the display device is not limited to this. The display device may be a projector, and may be configured, for example, with multiple projectors. By using multiple projectors to display a life-size image of an entire room, it is possible to display a realistic image similar to that of wearing an HMD. Using one or more (e.g., multiple) projectors to display a space different from the room over the entire room is an example of reproducing a virtual space.

[0139] Furthermore, the virtual space reproduction device and the virtual space presentation device in the above-described embodiments may be an integrated device or may be separate devices.

[0140] In the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0141] The order in which the steps in the flowchart are executed is merely an example for specifically explaining the present disclosure, and an order other than the above may be used. Also, some of the steps may be executed simultaneously (in parallel) with other steps, or some of the steps may not be executed.

[0142] The division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as a single functional block, one functional block may be divided into multiple blocks, or some functions may be moved to another functional block.Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in time-sharing by a single piece of hardware or software.

[0143] Furthermore, the guidance support device according to the above-described embodiment may be realized as a single device or may be realized by multiple devices. When the guidance support device is realized by multiple devices, the components of the guidance support device may be distributed among the multiple devices in any manner. When the guidance support device is realized by multiple devices, the communication method between the multiple devices is not particularly limited, and may be wireless communication or wired communication. Furthermore, wireless communication and wired communication may be combined between the devices.

[0144] Furthermore, each component described in the above embodiments may be implemented as software or, typically, as an LSI, which is an integrated circuit. These components may be individually integrated into a single chip, or some or all of them may be integrated into a single chip. While LSI is used here, it may also be referred to as an IC, system LSI, super LSI, or ultra LSI depending on the level of integration. Furthermore, the integration method is not limited to LSI; it may be implemented using a dedicated circuit (a general-purpose circuit that executes a dedicated program) or a general-purpose processor. It is also possible to use a field programmable gate array (FPGA), which can be programmed after LSI fabrication, or a reconfigurable processor, which allows the connection or settings of circuit cells within an LSI to be reconfigured. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology or a derivative technology, that technology may naturally be used to integrate the components.

[0145] A system LSI is an ultra-multifunctional LSI manufactured by integrating multiple processing units on a single chip, and is specifically a computer system consisting of a microprocessor, ROM, RAM, etc. The ROM stores computer programs. The system LSI achieves its functions when the microprocessor operates in accordance with the computer programs.

[0146] Another aspect of the present disclosure may be a computer program that causes a computer to execute each of the characteristic steps included in the guidance support method shown in FIG.

[0147] Furthermore, for example, the program may be a program to be executed by a computer. Another aspect of the present disclosure may be a computer-readable non-transitory recording medium on which such a program is recorded. For example, such a program may be recorded on a recording medium and distributed or circulated. For example, the distributed program may be installed in a device having another processor, and the program may be executed by the processor, thereby causing the device to perform each of the above processes. [Industrial Applicability]

[0148] The present disclosure is useful for an information processing device or the like for guiding a user in a virtual space. [Explanation of symbols]

[0149] 1 Guidance support system 10 Virtual Space Reproduction Device 11 Log transmission unit 12 Virtual space generation unit 20 Virtual space presentation device 21 Log acquisition section 22 Region of interest determination unit 23 Guidance decision unit 24 Output section A1 Target area A2 Non-target area P1, P2 shapes S sound

Claims

1. A guidance support method executed by a guidance support device that is communicably connected to a playback device that reproduces a virtual space and that supports guiding a user within the virtual space, comprising: acquiring log information of the user in the virtual space acquired from a sensor mounted on the playback device; determining an area of ​​interest in the virtual space in which the user is interested based on the log information; dynamically changing a guidance pattern for guiding the user in accordance with the region of interest of the user; Guidance support method.

2. the log information includes location information indicating a location of the user; In determining the region of interest, a stay time in one or more areas in the virtual space is acquired from the position information, and the region of interest is determined based on the stay time. The guidance support method according to claim 1 .

3. In determining the region of interest, an area where the staying time is equal to or longer than a first threshold time is determined to be the region of interest. The guidance support method according to claim 2 .

4. the log information includes gaze information indicating a gaze of the user, In determining the region of interest, the region of interest is determined based on the line-of-sight information. The guidance support method according to any one of claims 1 to 3.

5. In determining the region of interest, a gaze time of one or more areas in the virtual space is acquired from the line-of-sight information, and an area where the gaze time is equal to or longer than a second threshold time is determined to be the region of interest. The guidance support method according to claim 4.

6. the log information includes voice information indicating a voice uttered by the user, In determining the region of interest, the region of interest is determined based on the audio information. The guidance support method according to any one of claims 1 to 3.

7. the voice information includes a predetermined keyword uttered by the user; In determining the region of interest, the region of interest is determined based on a detection result of the predetermined keyword of the user included in the voice information. The guidance support method according to claim 6.

8. the predetermined keywords include words that indicate the emotions of the user; In determining the region of interest, an area where the user is staying is determined to be the region of interest when a word indicating an emotion of the user is detected from the voice information. The guidance support method according to claim 7.

9. The predetermined keyword includes a word indicating a specific area, In determining the region of interest, if a word indicating the specific area included in the audio information is detected a first threshold number of times or more, the specific area is determined to be the region of interest. The guidance support method according to claim 7.

10. the predetermined keyword includes a first word indicating a specific area and a second word indicating an interest behavior in the specific area, In the determination of the region of interest, when the first word and the second word included in the audio information are detected a second threshold number of times or more, the specific area is determined to be the region of interest. The guidance support method according to claim 7.

11. the log information includes posture information indicating a posture of the user; In determining the region of interest, an area where the user is staying when a specific posture is detected from the posture information is determined to be the region of interest. The guidance support method according to any one of claims 1 to 3.

12. Furthermore, attribute information of the user is acquired, Dynamically changing the guidance pattern includes determining a reference guidance pattern for guiding the user based on the attribute information, and changing a guidance order of the reference guidance pattern based on the log information of the user. The guidance support method according to any one of claims 1 to 3.

13. Dynamically changing the guidance pattern includes, when an area other than the area in the guidance order of the reference guidance pattern is determined as the region of interest, giving priority to guidance of the area determined as the region of interest. The guidance support method according to claim 12.

14. Furthermore, the order of the warp points in each area displayed on the GUI (Graphical User Interface) screen is changed according to the guidance order of the updated guidance pattern. The guidance support method according to claim 12.

15. changing a warp point corresponding to the next area to be guided in the guidance order to a top left position on the GUI screen; The guidance support method according to claim 14.

16. a plurality of buttons corresponding to a plurality of areas are arranged two-dimensionally on the GUI screen; rearrange the plurality of buttons displayed on the GUI screen in the order of the guidance order of the updated guidance pattern from the top left to the bottom right; The guidance support method according to claim 14.

17. Furthermore, a graphic for guiding the user to a next desired area is displayed on the floor of the virtual space. The guidance support method according to any one of claims 1 to 3.

18. Furthermore, the visibility of non-target areas other than the target area to which the user is next directed is reduced relative to the target area. The guidance support method according to any one of claims 1 to 3.

19. Relatively reducing the visibility of the non-target area by reducing the brightness of the non-target area or increasing the brightness of the non-target area. The guidance support method according to claim 18.

20. By dimming or brightening the lighting disposed in the non-target area, the visibility of the non-target area is relatively reduced. The guidance support method according to claim 18.

21. Relatively reducing the visibility of the non-target area by at least one of reducing the resolution of the object in the non-target area and increasing the resolution of the object in the target area; The guidance support method according to claim 18.

22. Furthermore, sound is emitted from the target area. The guidance support method according to claim 18.

23. the one or more areas are rooms of a house provided in the virtual space; The guidance support method according to claim 2 or 3.

24. Furthermore, an avatar for guiding the user to a next desired area is displayed in the virtual space. The guidance support method according to any one of claims 1 to 3.

25. A guidance support device that is communicably connected to a playback device that reproduces a virtual space and that supports guiding a user in the virtual space, a log acquisition unit that acquires log information of the user in the virtual space acquired from a sensor mounted on the playback device; an interest area determination unit that determines an interest area in which the user is interested within the virtual space based on the log information; a guidance determination unit that dynamically changes a guidance pattern for guiding the user in accordance with the region of interest of the user, Guidance support device.

26. A program for causing a computer to execute the guidance support method according to any one of claims 1 to 3.

Images