Virtual rest room providing system, virtual rest room providing device, and virtual rest room providing method

The virtual break room system addresses the need for telecommuting communication by detecting user movement and connecting them to virtual spaces for interaction, improving social interaction among remote workers.

JP7767836B2Active Publication Date: 2025-11-12JVC KENWOOD CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2021179028
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-11-01
Publication Date
2025-11-12
Estimated Expiration
2041-11-01

AI Technical Summary

Technical Problem

There is a need for technology that automatically guides users in a telecommuting environment to a virtual break room for appropriate communication when they leave their work area to take a break.

Method used

A virtual break room providing system that includes a detection device to track user movement along predefined traffic lines, connecting the user to a virtual space for communication upon detection, and providing information about the virtual break room.

Benefits of technology

Enables appropriate communication in a telecommuting environment by guiding users to virtual break rooms based on their movement, enhancing social interaction among remote workers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007767836000001
    Figure 0007767836000001
  • Figure 0007767836000002
    Figure 0007767836000002
  • Figure 0007767836000003
    Figure 0007767836000003
Patent Text Reader

Abstract

To enable appropriate communication under a telecommuting environment.SOLUTION: A virtual rest room provision system comprises: a detection device which is provided with a flow line movement detection unit for determining, on the basis of a detection result of a user's position by a position detection sensor, whether or not the user has moved along a flow line that is set between areas; and a terminal device which is provided with a flow line setting unit for setting a flow line that indicates a trajectory when the user moves between areas, a virtual rest room connection unit for connecting to a virtual rest room where the user can communicate other users in a virtual space when it is determined that the user has moved along the flow line, a virtual rest room information acquisition unit for acquiring information regarding the virtual rest room, and an output control unit for outputting information regarding the virtual rest room.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a virtual rest room providing system, a virtual rest room providing device, and a virtual rest room providing method. [Background technology]

[0002] In recent years, opportunities to work from home have been increasing. Patent Document 1 discloses a technology that enables informal communication within a group of workers who work from home. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-142850 Summary of the Invention [Problem to be solved by the invention]

[0004] When working in an office, there are opportunities to communicate with other users through casual conversation or chat away from their desks. Even in a telecommuting environment, there is a need for technology that automatically guides users to a virtual break room and enables them to communicate with other users when they leave their work area to take a break or move to a break area.

[0005] The present invention aims to provide a virtual break room providing system, a virtual break room providing device, and a virtual break room providing method that enable appropriate communication in a telecommuting environment. [Means for solving the problem]

[0006] The virtual rest room providing system of the present invention comprises a detection device having a traffic line movement detection unit that determines whether the user has moved along a traffic line set between areas based on the detection result of the user's position by a position detection sensor; a traffic line setting unit that sets a traffic line indicating the trajectory of the user when moving between areas; a virtual rest room connection unit that, when it is determined that the user has moved along the traffic line, connects to a virtual rest room where the user can communicate with other users in a virtual space; a virtual rest room information acquisition unit that acquires information about the virtual rest room; and an output control unit that outputs information about the virtual rest room.

[0007] The virtual rest room providing device of the present invention comprises a traffic line setting unit that sets a traffic line indicating the trajectory of a user when moving between areas; a location information acquisition unit that determines whether the user has moved along the traffic line set between the areas; a virtual rest room connection unit that, when it is determined that the user has moved along the traffic line, connects to a virtual rest room where the user can communicate with other users in a virtual space; a virtual rest room information acquisition unit that acquires information about the virtual rest room; and an output control unit that outputs information about the virtual rest room.

[0008] The virtual rest room providing method of the present invention includes the steps of setting a traffic line indicating the trajectory of a user when moving between areas, determining whether the user has moved along the traffic line set between areas based on the detection result of the user's position by a position detection sensor, connecting the user to a virtual rest room where the user can communicate with other users in a virtual space if it is determined that the user has moved along the traffic line, a virtual rest room information acquisition unit that acquires information about the virtual rest room, and outputting information about the virtual rest room. [Effects of the Invention]

[0009] According to the present invention, it is possible to communicate appropriately in a telecommuting environment. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a virtual break room providing system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a terminal device according to the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of the detection device according to the first embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of the server device according to the first embodiment. [Figure 5] FIG. 5 is a flowchart showing the flow of processing in the virtual rest room providing system according to the first embodiment. [Figure 6] FIG. 6 is a diagram for explaining an example of a method for setting a flow line according to the first embodiment. [Figure 7] FIG. 7 is a diagram for explaining an example of a method for setting a flow line according to the first embodiment. [Figure 8] FIG. 8 is a diagram for explaining an example of a method for detecting movement along a flow line according to the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a virtual rest room according to the first embodiment. [Figure 10] FIG. 10 is a diagram for explaining a method for selecting another user according to the first embodiment. [Figure 11] FIG. 11 is a flowchart showing the flow of processing in the virtual rest room providing system according to the first modified example of the first embodiment. [Figure 12] FIG. 12 is a flowchart showing the flow of processing in a virtual rest room providing system according to a second modified example of the first embodiment. [Figure 13] FIG. 13 is a diagram for explaining a method for checking whether or not to connect to a virtual rest room according to a modification of the first embodiment. [Figure 14] FIG. 14 is a block diagram showing an example of the configuration of a terminal device according to the second embodiment. [Figure 15] FIG. 15 is a block diagram showing an example of the configuration of a detection device according to the second embodiment. [Figure 16] FIG. 16 is a flowchart showing the flow of processing in the virtual rest room providing system according to the second embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of a method for detecting movement between areas according to the second embodiment. [Figure 18] FIG. 18 is a flowchart showing the flow of processing in a virtual rest room providing system according to a modified example of the second embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of the configuration of a virtual rest room providing system according to the third embodiment. [Figure 20] FIG. 20 is a flowchart showing the flow of processing in the virtual rest room providing system according to the third embodiment. [Figure 21] FIG. 21 is a diagram for explaining an example of a method for setting a flow line according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to this embodiment, and in the following embodiments, the same components are designated by the same reference numerals, and redundant explanations will be omitted.

[0012] [First embodiment] An example of the configuration of a virtual break room providing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of a virtual break room providing system according to the first embodiment.

[0013] As shown in Fig. 1, the virtual rest room providing system 1 includes a terminal device 10, a detection device 12, and a server device 14. The terminal device 10, the detection device 12, and the server device 14 are communicably connected via, for example, a wireless network N. The virtual rest room providing system 1 is a system that provides a virtual rest room (hereinafter referred to as a virtual rest room) to a user when the user moves between predetermined areas along a flow line that is set in advance between the areas. The user can communicate with other users in the virtual rest room.

[0014] (Terminal Device) An example of the configuration of a terminal device according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of a terminal device according to the first embodiment.

[0015] 2, the terminal device 10 includes an input unit 20, a display unit 22, an audio output unit 24, a storage unit 26, a GNSS (Global Navigation Satellite System) receiving unit 28, a communication unit 30, and a control unit 32. The terminal device 10 is, for example, an information processing terminal such as a smartphone or a tablet terminal.

[0016] The input unit 20 accepts various input operations for the terminal device 10. The input unit 20 outputs an input signal corresponding to the accepted input operation to the control unit 32. The input unit 20 includes, for example, a touch panel, buttons, switches, a keyboard, a microphone, etc. When a touch panel is used as the input unit 20, the input unit 20 is disposed on the display unit 22.

[0017] The display unit 22 displays various types of video including text and images. The display unit 22 is, for example, a display including a liquid crystal display (LCD) or an organic electroluminescence (EL) display. The display unit 22 may be provided in a device different from the terminal device 10. For example, the display unit 22 may be a television, a head mounted display (HMD), a mobile terminal, a wearable device, or the like. The terminal device 10 may also be an information processing terminal that does not include the display unit 22, such as a smart speaker.

[0018] The audio output unit 24 is a speaker that outputs audio. The audio output unit 24 outputs audio corresponding to the image displayed on the display unit 22. The audio output unit 24 outputs the audio of other users.

[0019] The storage unit 26 stores, for example, information about the flow lines set by the flow line setting unit 40 (described later), the calculation contents of the control unit 32, programs, and other information. The storage unit 26 includes, for example, at least one of a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive).

[0020] The GNSS receiver 28 receives GNSS signals containing information for identifying location information from GNSS satellites (not shown). The GNSS receiver 28 can be realized, for example, by a GNSS receiver circuit or a GNSS receiver device.

[0021] The communication unit 30 communicates with an external device via the network N. The communication unit 30 communicates with, for example, the detection device 12 via the network N. The communication unit 30 communicates with, for example, the server device 14 via the network N.

[0022] The control unit 32 controls each unit of the terminal device 10. The control unit 32 has, for example, an information processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM or a ROM. The control unit 32 executes a program that controls the operation of the terminal device 10 according to the present invention. The control unit 32 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 32 may be realized by a combination of hardware and software.

[0023] The control unit 32 includes a flow line setting unit 40 , a virtual break room connection unit 42 , a virtual break room information acquisition unit 44 , an output control unit 46 , a position information acquisition unit 48 , and a communication execution unit 50 .

[0024] The flow line setting unit 40 sets a flow line that indicates the trajectory of a user when moving between predetermined areas. The flow line setting unit 40 may set the flow line according to a user's operation, or may set a conductor automatically. The flow line setting unit 40 will be described in detail later.

[0025] The virtual rest room connection unit 42 connects to a virtual rest room where the user can communicate with other users in a virtual space. When the flow line movement detection unit 82 of the detection device 12 determines that the user has moved along a flow line, the virtual rest room connection unit 42 connects to a virtual rest room provided by the server device 14.

[0026] The virtual rest room information acquisition unit 44 acquires information about the virtual rest room from the server device 14. The virtual rest room information acquisition unit 44 acquires information about the virtual rest room when the virtual rest room connection unit 42 connects to the virtual rest room. The information about the virtual rest room includes information about images and sounds in the virtual rest room.

[0027] The output control unit 46 causes the display unit 22 to display various types of information. The output control unit 46 causes the display unit 22 to display information about the virtual break room acquired by the virtual break room information acquisition unit 44. The output control unit 46 causes the display unit 22 to display an image of the virtual break room. Details of the image of the virtual break room will be described later. If the terminal device 10 does not have a display unit 22, the output control unit 46 causes the audio output unit 24 to output various types of information by audio.

[0028] The position information acquisition unit 48 acquires the GNSS signal from the GNSS receiving unit 28. The position information acquisition unit 48 calculates the current position information of the user (terminal device 10) based on the GNSS signal. The position information acquisition unit 48 calculates the current position information of the user (terminal device 10) in terrestrial coordinates, for example.

[0029] The communication execution unit 50 executes communication between users using the touch panel, keyboard, microphone, and the like provided in the input unit 20.

[0030] (Detection device) An example of the configuration of the detection device according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the detection device according to the first embodiment.

[0031] 3, the detection device 12 includes an input unit 60, an audio output unit 62, a position detection sensor 64, a storage unit 66, a communication unit 68, and a control unit 70. The detection device 12 is configured, for example, as a smart speaker.

[0032] The input unit 60 accepts various input operations for the detection device 12. The input unit 60 outputs an input signal corresponding to the accepted input operation to the control unit 70. The input unit 60 includes, for example, a button, a switch, etc. The input unit 60 includes, for example, a microphone that detects the user's voice.

[0033] The audio output unit 62 is a speaker that outputs audio, and outputs various sounds that prompt the user for confirmation.

[0034] The position detection sensor 64 detects the position of the user. The position detection sensor 64 is realized, for example, by a single or multiple cameras that capture an image of the user. The position detection sensor 64 is realized, for example, by a human presence sensor that detects a person based on changes in reflected waves such as infrared rays or ultrasonic waves. The position detection sensor 64 is realized, for example, by a pressure sensor that detects the weight of an object.

[0035] The storage unit 66 stores information such as programs and the contents of calculations performed by the control unit 70. The storage unit 66 includes at least one of a RAM, a main storage device such as a ROM, and an external storage device such as an HDD.

[0036] The communication unit 68 communicates with an external device via the network N. The communication unit 68 communicates with, for example, the terminal device 10 via the network N. The communication unit 68 communicates with, for example, the server device 14 via the network N.

[0037] The control unit 70 controls each unit of the detection device 12. The control unit 70 has, for example, an information processing device such as a CPU or an MPU, and a storage device such as a RAM or a ROM. The control unit 70 executes a program that controls the operation of the detection device 12 according to the present invention. The control unit 70 may be realized by, for example, an integrated circuit such as an ASIC or an FPGA. The control unit 70 may also be realized by a combination of hardware and software.

[0038] The control unit 70 includes a sensor control unit 80 , a flow line movement detection unit 82 , a confirmation unit 84 , and a determination unit 86 .

[0039] The sensor control unit 80 controls the position detection sensor 64 to detect the position of the user.

[0040] The flow line movement detection unit 82 detects the movement of the user along a flow line that is set in advance between predetermined areas. The flow line movement detection unit 82 detects whether the user has moved along a predetermined flow line based on the detection result of the user's position by the position detection sensor 64. The flow line movement detection unit 82 will be described in detail later.

[0041] The confirmation unit 84 performs various confirmations for the user. The confirmation unit 84 performs various confirmations for the user by outputting audio from the audio output unit 62. The confirmation unit 84 confirms with the user whether or not to connect to the virtual break room.

[0042] The determination unit 86 performs various determinations. The determination unit 86 performs user determination. The determination unit 86 determines whether or not a user moving along the flow line is a predetermined user. If the position detection sensor 64 is a camera, the determination unit 86 determines whether or not a user moving along the flow line is a predetermined user based on an image captured by the camera.

[0043] (Server device) An example of the configuration of the server device according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the server device according to the first embodiment.

[0044] 4, the server device 14 includes a storage unit 90, a communication unit 92, and a control unit 94. The server device 14 is located at a location remote from the terminal device 10 and the detection device 12. The server device 14 is an information terminal such as a PC (Personal Computer). The server device 14 performs a process of providing a virtual rest room to the user.

[0045] The storage unit 90 stores information such as programs and the contents of calculations performed by the control unit 94. The storage unit 90 includes at least one of a RAM, a main storage device such as a ROM, and an external storage device such as an HDD.

[0046] The storage unit 90 stores information about the virtual break room. The information about the virtual break room includes information for identifying the virtual break room, information about the number of users who have entered the virtual break room, and information about the users. The information about the virtual break room may include, for example, information about images and audio of the virtual break room. The storage unit 90 stores information about users who use the virtual break room. The information about the users includes identification information for uniquely identifying the users. The information about the users includes, for example, names, seats, icon images, and connection destination information.

[0047] The communication unit 92 communicates with an external device via the network N. The communication unit 92 communicates with, for example, the terminal device 10 via the network N. The communication unit 92 communicates with, for example, the detection device 12 via the network N.

[0048] The control unit 94 controls each unit of the server device 14. The control unit 94 has, for example, an information processing device such as a CPU or an MPU, and a storage device such as a RAM or a ROM. The control unit 94 executes a program that controls the operation of the server device 14 according to the present invention. The control unit 94 may be realized by an integrated circuit such as an ASIC or an FPGA. The control unit 94 may be realized by a combination of hardware and software.

[0049] The control unit 94 includes a virtual break room management unit 100 .

[0050] The virtual rest room management unit 100 manages the virtual rest rooms. The virtual rest room management unit 100 executes various processes related to the virtual rest rooms. The virtual rest room management unit 100 provides the virtual rest rooms to the terminal devices 10.

[0051] (Processing contents of the virtual rest room provision system) The processing content of the virtual rest room providing system according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of processing of the virtual rest room providing system according to the first embodiment.

[0052] The process shown in FIG. 5 shows a process for providing a virtual rest room when a user moves along a preset flow line.

[0053] The terminal device 10 sets a flow line indicating a route when the user moves between areas (step S10). Specifically, the flow line setting unit 40 sets the flow line according to an input operation input by the user to the input unit 20. The flow line setting unit 40 may set the flow line automatically based on a floor plan or the like. FIGS. 6 and 7 are diagrams for explaining an example of a method for setting a flow line according to the first embodiment.

[0054] FIG. 6 shows an example of a home environment of a user U. Area AR1 is, for example, an area where the user U works at home. Area AR2 is, for example, a toilet. Area AR3 is, for example, a kitchen. As shown in FIG. 6, a flow line L1 is set between areas AR1 and AR3. The output control unit 46 displays video data corresponding to FIG. 6 on the display unit 22. The user U can set the flow line L1 by tracing the path between areas AR1 and AR3 on the display unit 22. The flow line setting unit 40 sets the path traced by the user U between areas AR1 and AR3 on the display unit 22 as the flow line L1. The flow line setting unit 40 may automatically set the flow line L1 by predicting, for example, the flow line of the user U during a break in the video data displayed on the display unit 22 using machine learning or the like. For example, multiple flow lines may be set in FIG. 6.

[0055] FIG. 7 shows an example of the environment of the workplace of user U. Area AR11 is, for example, the work area where user U sits. Area AR12 is, for example, a conference room. Area AR13 is, for example, a kitchen. As shown in FIG. 7, a flow line L2 is set between area AR11 and area AR13. The method for setting flow line L2 is the same as the method for setting flow line L1 shown in FIG. 6, and therefore a description thereof will be omitted. Below, an example will be described in which it is determined whether user U has moved along flow line L1 in a home environment.

[0056] The detection device 12 goes into a standby state to detect the movement of the user U along the flow line L1 (step S12), and then the process proceeds to step S14.

[0057] The detection device 12 determines whether the user U has moved along the flow line L1 (step S14). FIG. 8 is a diagram illustrating an example of a method for detecting movement along a flow line according to the first embodiment. As illustrated in FIG. 8, for example, position detection sensors 64 are disposed at the four corners of the area AR1. The position detection sensors 64 may also be disposed in the passages leading from the area AR1 to the areas AR2 and AR3. The position detection sensors 64 are cameras that capture images of the user U. In this case, the flow line movement detection unit 82 determines that the user U has moved along the flow line L1 when, for example, an image of the user U walking along the route along which the flow line L1 is set is captured. Note that the image of the user U walking along the route along which the flow line L1 is set does not necessarily mean that the user's position and the flow line L1 exactly match, but may also include a case where there is a deviation within a predetermined range. The direction in which the user is walking may or may not be taken into consideration when determining whether the user U has moved along the flow line L1. In other words, it may be determined that user U has moved along flow line L1 only when user U is walking along flow line L1 in the direction of the arrow in Figure 8, or it may be determined that user U has moved along flow line L1 when user U is walking along flow line L1 in the opposite direction of the arrow.

[0058] The flow line movement detection unit 82 may determine that the user U has moved on the flow line L1 when the path the user U walked matches the path from the start point to the end point of the flow line L1. The flow line movement detection unit 82 may determine that the user U has moved on the flow line L1 when the path the user U walked matches the flow line L1 at an arbitrary rate. For example, the flow line movement detection unit 82 may determine that the user U has moved on the flow line L1 when the user U has moved about half of the flow line L1.

[0059] The position detection sensor 64 may be a human presence sensor that detects the user U or a pressure sensor placed on the floor. In this case, the flow line movement detection unit 82 can detect that the user U has moved along the flow line L1 when pressure is detected on the route along which the flow line L1 is set. The number of position detection sensors 64 placed to detect that the user U has moved along the flow line L1 may be arbitrary. If it is determined that the user U has moved along the flow line L1 (step S14; Yes), proceed to step S18. If it is not determined that the user U has moved along the flow line L1 (step S14; No), proceed to step S16.

[0060] If the determination in step S14 is No, the detection device 12 determines whether or not to end the process (step S16). Specifically, the detection device 12 determines to end the process when it receives an operation to turn off the power or an operation to end the detection process. If it is determined to end the process (step S16; Yes), the process in Fig. 5 ends. If it is not determined to end the process (step S16; No), the process proceeds to step S12.

[0061] If the determination in step S14 is Yes, the terminal device 10 connects to the server device 14 that provides the virtual rest room (step S18). Specifically, the virtual rest room connection unit 42 connects to the server device 14 via the communication unit 30. Then, the process proceeds to step S20.

[0062] The terminal device 10 acquires virtual rest room information (step S20). Specifically, the virtual rest room information acquisition unit 44 acquires information about the virtual rest room from the server device 14 via the communication unit 30. The information about the virtual rest room includes information for identifying the virtual rest room, information about the number of users who have entered the virtual rest room, and information about the users. The information about the virtual rest room may include, for example, information such as images and audio of the virtual rest room. Then, the process proceeds to step S22.

[0063] The terminal device 10 outputs the virtual rest room to the display unit 22 (step S22). Specifically, the output control unit 46 causes the display unit 22 to display the virtual rest room based on the information about the virtual rest room acquired by the virtual rest room information acquisition unit 44. If the terminal device 10 does not include the display unit 22, the output control unit 46 causes the audio output unit 24 to output the information about the virtual rest room by voice. The information about the virtual rest room output by the audio output unit 24 includes information for identifying the virtual rest room, information about the names of each user who has entered the virtual rest room, and information about the status of each user who has entered the virtual rest room. Here, the information about the status of a user is, for example, information about which users are currently talking to each other.

[0064] An example of a virtual break room according to the first embodiment will be described with reference to FIG. 9. FIG. 9 is a diagram illustrating an example of a virtual break room according to the first embodiment. As shown in FIG. 9, a plurality of tables 202 and a plurality of chairs 204 are arranged in the virtual break room 200. Users U1, U2, U3, U4, U5, and U6 are present in the virtual break room 200. User U1 is an icon representing the user himself / herself. Users U2 to U6 are icons representing other users. Names may be displayed above users U1 to U6. The output control unit 46 may display information indicating the number of users connected to the virtual break room 200. The output control unit 46 may display a list of the names of all users connected to the virtual break room 200.

[0065] Returning to FIG. 5, the terminal device 10 determines whether the user has selected another user (step S24). FIG. 10 is a diagram for explaining a method for selecting another user according to the first embodiment. As shown in FIG. 10, the communication execution unit 50 determines whether, for example, the user has selected an icon of a communication partner from among users U2 to U6. For example, if the input unit 20 is a touch panel arranged on the display unit 22, the user can select a communication partner by touching the icon of user U2 to U6. The communication partner to be selected may be one or more. A predetermined gesture may be performed before selecting a communication partner from among users U2 to U6. For example, in the example shown in FIG. 9, selection buttons for action A and action B may be displayed to the left of user U1. In this case, for example, when action A is selected, user U1 may perform a gesture of waving their hand to user U2. For example, when action B is selected, user U1 may perform a gesture of calling out to user U2, such as saying, "Heyyy!" If it is determined that the user has selected another user (step S24; Yes), the process proceeds to step S26. If it is not determined that the user has selected another user (step S24; No), the process proceeds to step S32.

[0066] If the determination in step S24 is Yes, the terminal device 10 determines whether or not the selected other user has given permission to communicate with the terminal device 10 (step S26). If it is determined that the selected other user has given permission to communicate with the terminal device 10 (step S26; Yes), the process proceeds to step S28. If it is not determined that the selected other user has given permission to communicate with the terminal device 10 (step S26; No), the process proceeds to step S32.

[0067] If the determination in step S26 is Yes, the communication execution unit 50 starts execution of communication (step S28). Specifically, in the example shown in FIG. 9, when starting communication with user U2, the communication may be started on the spot, or the user may move to a nearby chair 204 and start the communication. For example, when starting communication with user U5 or user U6, the user may move to a chair 204 near user U5 or user U6 and start the communication, or the user may have user U5 or user U6 come nearby and start the communication. For example, when starting communication with two users, user U3 and user U4, since there are more people on the other side, user U3 and user U4 move to chairs 204 near user U4 and start the communication. The communication may be a voice call or a chat using a chat tool. Then, the process proceeds to step S30.

[0068] The terminal device 10 determines whether the communication has ended (step S30). Specifically, the communication execution unit 50 determines whether the communication started in step S30 has ended. If it is determined that the communication has ended (step S30; Yes), the process proceeds to step S32. If it is not determined that the communication has ended (step S30; No), the process of step S30 is repeated.

[0069] If the determination is No in step S24, No in step S26, or Yes in step S30, the terminal device 10 determines whether to end the process (step S32). Specifically, the terminal device 10 determines to end the process when, for example, the user leaves the virtual break room 200. If it is determined to end the process (step S32; Yes), the process of FIG. 5 ends. If it is not determined to end the process (step S32; No), the process proceeds to step S24.

[0070] As described above, in the first embodiment, when it is determined that the user has moved along a predetermined path, a virtual break room is automatically provided to the user. The user can appropriately communicate with other users in the virtual break room, even in a telecommuting environment. This allows the first embodiment to resolve the lack of communication in a telecommuting environment.

[0071] [First Modification of the First Embodiment] A first modified example of the first embodiment will be described. In the first embodiment, when a user moving along a traffic line is detected, the user is connected to a virtual rest room. In the first modified example of the first embodiment, before providing the user with a virtual rest room, it is determined whether the user is a pre-registered user.

[0072] The configuration of the virtual rest room providing system according to the first modified example of the first embodiment is the same as the configuration of the virtual rest room providing system shown in FIG. 1, and therefore a description thereof will be omitted.

[0073] (Processing of virtual rest room provision system) The processing contents of the virtual rest room providing system according to the first modified example of the first embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of processing of the virtual rest room providing system according to the first modified example of the first embodiment.

[0074] The processes from step S40 to step S44 are the same as the processes from step S10 to step S14 shown in FIG. 5, respectively, and therefore will not be described here.

[0075] If the determination in step S44 is Yes, the detection device 12 determines whether the user moving along the flow line is a predetermined user (step S46). Specifically, the determination unit 86 determines whether the user moving along the flow line is a registered user to whom a virtual rest room should be provided. In this case, the storage unit 66 may store, for example, identification information including a facial image of the user to whom the virtual rest room is provided. For example, if the position detection sensor 64 is a camera, the determination unit 86 determines whether the user moving along the flow line is a predetermined user by comparing an image of the user's face detected by the position detection sensor 64 in the rest area with the identification information stored in the storage unit 66. If it is determined that the user moving along the flow line is a predetermined user (step S46; Yes), the process proceeds to step S50. If it is not determined that the user moving along the flow line is a predetermined user (step S46; No), the process proceeds to step S48.

[0076] The processes from step S48 to step S64 are the same as the processes from step S16 to step S32 shown in FIG. 5, respectively, and therefore will not be described here.

[0077] As described above, the first modification of the first embodiment provides a virtual rest room to a user only when it is determined that the user is a pre-registered user. This makes it possible to prevent the virtual rest room from being provided to an incorrect user, thereby more appropriately providing the virtual rest room.

[0078] [Second Modification of the First Embodiment] A second modified example of the first embodiment will be described. In the first embodiment, when it is determined that the user has moved along the flow line, the virtual rest room is automatically connected. In the second modified example of the first embodiment, before providing the virtual rest room to the user, the user is asked whether or not to connect to the virtual rest room.

[0079] The configuration of the virtual rest room providing system according to the second modified example of the first embodiment is the same as the configuration of the virtual rest room providing system shown in FIG. 1, and therefore a description thereof will be omitted.

[0080] (Processing of virtual rest room provision system) The processing contents of the virtual rest room providing system according to the second modified example of the first embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of processing of the virtual rest room providing system according to the second modified example of the first embodiment.

[0081] The processes from step S70 to step S74 are the same as the processes from step S10 to step S14 shown in FIG. 5, respectively, and therefore will not be described here.

[0082] If the determination in step S14 is Yes, the detection device 12 confirms with the user whether or not to connect to the virtual break room (step S76). FIG. 13 is a diagram for explaining a method for confirming whether or not to connect to a virtual break room according to a second modification of the first embodiment. The confirmation unit 84 confirms with the user U whether or not to connect to the virtual break room, for example, by outputting a voice message such as "Do you want to connect to the virtual break room?" from the audio output unit 62. The confirmation unit 84 may output information regarding the number of people connected to the virtual break room from the audio output unit 62, such as "X people are connected to the virtual break room. Do you want to connect to the virtual break room?". The confirmation unit 84 may output information indicating that a specific person, such as a friend, colleague, or superior, is connected to the virtual break room from the audio output unit 62, such as "Mr. A is connecting to the virtual break room. Do you want to connect to the virtual break room?". In a home environment, multiple audio output units 62 may be provided. When multiple audio output units 62 are provided, information may be output only from the audio output unit 62 located closest to the user U. Then, the process proceeds to step S78.

[0083] The detection device 12 determines whether to connect to the virtual rest room (step S78). Specifically, when the input unit 60 detects the user U's voice saying, for example, "Yes, please connect to the virtual rest room," the determination unit 86 determines to connect to the virtual rest room. When the input unit 60 detects the user U's voice saying, for example, "No, please do not connect to the virtual rest room," the determination unit 86 determines not to connect to the virtual rest room. The user can select whether to connect to the virtual rest room based on the various information output in step S78. When it is determined not to connect to the virtual rest room (step S78; No), the process proceeds to step S80. When it is determined to connect to the virtual rest room (step S78; Yes), the process proceeds to step S82.

[0084] The processes from step S80 to step S96 are the same as the processes from step S16 to step S32 shown in FIG. 5, respectively, and therefore will not be described here.

[0085] As described above, the second modification of the first embodiment provides a virtual rest room to a user only when the user desires to connect to the virtual rest room. This allows the second modification of the first embodiment to provide a virtual rest room to the user more appropriately.

[0086] [Second embodiment] Next, a second embodiment will be described. In the first embodiment, when it is determined that the user has moved along a flow line, the system is automatically connected to a virtual rest room. In the second embodiment, when it is determined that the user has moved between areas, a process of connecting to a virtual rest room is executed.

[0087] (Terminal Device) An example of the configuration of a terminal device according to the second embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing an example of the configuration of a terminal device according to the second embodiment.

[0088] As shown in FIG. 14, the terminal device 10A differs from the terminal device 10 shown in FIG. 2 in that the control unit 32A includes a flow line setting unit 40A, and the flow line setting unit 40A includes an area role setting unit 52.

[0089] The area role setting unit 52 sets an area that provides a virtual rest room for the user. The area role setting unit 52 will be described in detail later.

[0090] (Detection device) An example of the configuration of the detection device according to the second embodiment will be described with reference to Fig. 15. Fig. 15 is a block diagram showing an example of the configuration of the detection device according to the second embodiment.

[0091] As shown in FIG. 15, detection device 12A differs from detection device 12 shown in FIG. 3 in that control unit 70A includes flow line movement detection unit 82A, and flow line movement detection unit 82A includes area movement detection unit 88.

[0092] The area movement detection unit 88 detects movement of the user to a predetermined area. The area movement detection unit 88 detects movement of the user to a predetermined area based on the detection result of the user's position by the position detection sensor 64. Details of the area movement detection unit 88 will be described later.

[0093] (Processing of virtual rest room provision system) The processing contents of the virtual rest room providing system according to the second embodiment will be described with reference to Fig. 16. Fig. 16 is a flowchart showing the flow of processing of the virtual rest room providing system according to the second embodiment.

[0094] The process of step S100 is the same as the process of step S10 shown in Fig. 5, and therefore a description thereof will be omitted. Note that step S100 may be omitted in this embodiment.

[0095] The terminal device 10A sets an area (step S102). The area role setting unit 52 sets an area in which a virtual break room is provided to the user. The area role setting unit 52 sets the role of each area in, for example, a home environment. The area role setting unit 52 sets, for example, the living room as an area where work is performed. In this case, the living room is a type of first area in this embodiment. The area role setting unit 52 sets, for example, the kitchen as an area in which a virtual break room is provided. In this case, the kitchen is a type of second area in this embodiment. In this case, in the home environment, for example, when a user moves from the living room to the kitchen, it is determined that the movement is for providing a virtual break room. In the outdoor environment such as an office, for example, when the user moves from their desk in the living room to the kitchen, it is determined that the movement is for providing a virtual break room. This makes it possible to provide a virtual break room to users who move to a predetermined kitchen at the same time. Then, the process proceeds to step S104.

[0096] That is, the area role setting unit 52 sets a first area and a second area different from the first area. The first area is an area where the user performs work, such as a living room or the user's own room in a home environment, or a work area or conference room in a workplace environment. The second area is a rest area where the user takes a break, such as a kitchen or toilet in a home environment, or a kitchenette in a workplace environment. The area role setting unit 52 may automatically set the first area and the second area by predicting the area where the user performs work and the rest area using machine learning, for example.

[0097] The process of step S104 is the same as the process of step S12 shown in FIG. 5, and therefore a description thereof will be omitted.

[0098] The detection device 12 determines whether the user U has moved between areas (step S106). FIG. 17 is a diagram illustrating an example of a method for detecting movement between areas according to the second embodiment. As illustrated in FIG. 17, for example, position detection sensors 64 are disposed at the four corners of the areas AR1, AR2, and AR3. The position detection sensors 64 may also be disposed in the passages leading from the area AR1 to the areas AR2 and AR3. The position detection sensors 64 are cameras that capture images of the user U. In this case, if the area AR1 is the living room and the area AR3 is the kitchen, the area movement detection unit 88 detects the time when the user U leaves the area AR1 and enters the area AR3 based on the image capture results of the cameras. If the position detection sensors 64 are motion sensors or pressure sensors, the position detection sensors 64 may be disposed at the entrances of each area, and the area movement detection unit 88 may detect the user U's movement between areas based on the detection results of the position detection sensors 64 at the entrances of each area. If it is determined that the user U has moved between areas (step S106; Yes), the process proceeds to step S110. If it is not determined that the user U has moved between areas (step S106; No), the process proceeds to step S108.

[0099] That is, the area movement detection unit 88 detects whether the user U has moved from the first area to the second area. More specifically, the area movement detection unit 88 detects whether the user U has left the first area and entered the second area.

[0100] Furthermore, in step S106, the area movement detection unit 88 may detect that the user U has left the second area, determine that the user U has moved between areas (step S106; Yes), and proceed to step S110. This allows the user to communicate with other users when they return to the living room, which is the first area, after taking care of business in the kitchen or toilet, which is the second area.

[0101] The processes from step S108 to step S124 are the same as the processes from step S16 to step S32 shown in FIG. 5, respectively, and therefore will not be described here.

[0102] As described above, in the second embodiment, when it is determined that the user has moved to a pre-set area such as a kitchen, a virtual break room is provided to the user. This allows the user, when working from home, to communicate in the virtual break room with other users who have moved to the kitchen or other areas in the office at the same time, thereby eliminating the lack of communication in a working from home environment.

[0103] [Modification of the second embodiment] Next, a modified example of the second embodiment of the present disclosure will be described. In the modified example of the second embodiment, a rest area for a user to take a rest is set in a home environment or the like. Then, in the modified example of the second embodiment, when it is determined that the user has moved to the rest area, a process is executed to provide the user with a virtual rest room.

[0104] (Processing of virtual rest room provision system) The processing contents of the virtual rest room providing system according to the modified example of the second embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the flow of processing of the virtual rest room providing system according to the modified example of the second embodiment.

[0105] The process of step S130 is the same as the process of step S10 shown in FIG. 5, and therefore a description thereof will be omitted.

[0106] The terminal device 10A sets a rest area (step S132). The area role setting unit 52 sets the rest area for users to take a rest. This makes it possible to provide a virtual rest room for users who move to a predetermined rest area at the same time. Then, the process proceeds to step S134.

[0107] The process of step S134 is the same as the process of step S12 shown in FIG. 5, and therefore a description thereof will be omitted.

[0108] The detection device 12 determines whether the user U has moved to the rest area (step S136). The method by which the detection device 12 determines whether the user U has moved to the rest area is the same as the processing of step S106 shown in FIG. 16, so the description will be omitted. If it is determined that the user U has moved to the rest area (step S136; Yes), the process proceeds to step S140. If it is not determined that the user U has moved to the rest area (step S136; No), the process proceeds to step S138.

[0109] The processes from step S138 to step S154 are the same as the processes from step S16 to step S32 shown in FIG. 5, respectively, and therefore will not be described here.

[0110] As described above, in the modified example of the second embodiment, when it is determined that the user has moved to a preset rest area, a virtual rest room is provided to the user. This allows the user, for example, when working from home, to communicate in the virtual rest room with other users who are taking a break at the same time in an office, thereby resolving the lack of communication in a work-from-home environment.

[0111] [Third embodiment] An example of the configuration of a virtual rest room providing system according to the third embodiment will be described with reference to Fig. 19. Fig. 19 is a diagram showing an example of the configuration of a virtual rest room providing system according to the third embodiment.

[0112] 19, the virtual rest room providing system 1A includes a terminal device 10 and a server device 14. The virtual rest room providing system 1A differs from the virtual rest room providing system 1 shown in FIG. 1 in that it does not include a detection device 12. A position information acquisition unit 48 of the terminal device 10 in the virtual rest room providing system 1A detects the movement of a user along a flow line set in advance between predetermined areas.

[0113] The virtual rest room providing system 1A sets restaurants, cafes, parks, etc. as areas where virtual rest rooms are provided. When the virtual rest room providing system 1A detects that the user has moved from their home or the like to an area where a virtual rest room is provided, the system provides the user with a virtual rest room.

[0114] (Processing of virtual rest room provision system) The processing content of the virtual rest room providing system according to the third embodiment will be described with reference to Fig. 20. Fig. 20 is a flowchart showing the flow of processing of the virtual rest room providing system according to the third embodiment.

[0115] The terminal device 10 (virtual rest room providing device) sets a flow line (step S160). FIG. 21 is a diagram for explaining an example of a method for setting a flow line according to the third embodiment. FIG. 21 shows map information from home P1 to cafe P2. The flow line setting unit 40 sets a flow line L10 indicating a route from home P1 to cafe P2. The flow line setting unit 40 may set multiple flow lines for the route from home P1 to cafe P2. Then, the process proceeds to step S162.

[0116] The position information acquisition unit 48 of the terminal device 10 determines whether the user U has moved along the flow line (step S162). Specifically, if the position information of the user U calculated based on the GNSS signal acquired from the GNSS receiver 28 is on the flow line L10 set in step S100, the position information acquisition unit 48 determines that the user U has moved along the flow line L10. Note that the case where the position information of the user U is on the flow line L10 set in step S160 does not necessarily mean that the position information exactly matches, but may also include a case where the position information deviates within a predetermined range. If it is not determined that the user U has moved along the flow line (step S162; No), the process proceeds to step S164. If it is determined that the user U has moved along the flow line (step S162; Yes), the process proceeds to step S166.

[0117] The method by which the location information acquisition unit 48 acquires the location information of the user U in step S162 is not limited to calculation based on the GNSS signal. For example, the location information of the user U may be acquired based on an image captured by an imaging device such as a surveillance camera (not shown) installed outdoors.

[0118] If the determination in step S162 is No, the terminal device 10 determines whether or not to end position detection of the current position (step S164). Specifically, if the terminal device 10 has received an operation to turn off the power, or an operation to end position detection of the current position, the terminal device 10 determines to end position detection of the current position. If it has been determined to end position detection of the current position (step S164; Yes), the processing in FIG. 20 ends. If it has not been determined to end position detection of the current position (step S164; No), the process proceeds to step S162.

[0119] The processes from step S166 to step S180 are the same as the processes from step S18 to step S32 shown in FIG. 5, respectively, and therefore will not be described here.

[0120] As described above, in the third embodiment, when it is determined that the user has moved to a preset cafe, etc., a virtual break room is provided to the user. This makes it possible to resolve the lack of communication when the user is out in a telecommuting environment, etc.

[0121] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0122] 1,1A Virtual Rest Room Provision System 10,10A terminal equipment 12,12A Detector 14 Server equipment 20,60 Input section 22 Display section 24,62 Audio output section 26,66,90 Storage section 28 GNSS receiver 30,68,92 Communications Department 32,70,94 Control section 40, 40A Flow setting section 42 Virtual break room connection 44 Virtual break room information acquisition unit 46 Output control section 48 Location information acquisition section 50 Communication Execution Department 52 Area Role Setting Department 64 Position detection sensor 80 Sensor control unit 82, 82A Traffic movement detection unit 84 Verification Department 86 Judgment section 88 Area movement detection unit 100 Virtual Break Room Management Department 200 Virtual Break Room AR1, AR2, AR3 Area U User L1,L2,L10 Flow line

Claims

1. a detection device including a flow line movement detection unit that determines whether a user has moved along a flow line set between areas based on a result of detection of the user's position by a position detection sensor; a flow line setting unit that sets a flow line indicating a trajectory when the user moves between areas; When it is determined that the user has moved along the flow line, the user interacts with other users in the virtual space. a virtual break room connection unit that connects to a virtual break room where communication is possible; a virtual rest room information acquisition unit that acquires information about the virtual rest room; a terminal device including an output control unit that outputs information about the virtual rest room; A virtual rest room providing system comprising:

2. The flow line setting unit sets a first area and a second area different from the first area. An area role setting unit is provided, The flow line movement detection unit detects whether the user has moved from the first area to the second area. an area movement detection unit that detects whether the virtual rest room connection unit connects to the virtual rest room when detecting movement from the first area to the second area. The virtual rest room providing system according to claim 1 .

3. The second area is a rest area for the user to take a rest. The virtual rest room providing system according to claim 2 .

4. a flow line setting unit that sets a flow line indicating a trajectory when a user moves between areas; A position information acquisition device that determines whether the user has moved along a flow line set between the areas. Tokube and When it is determined that the user has moved along the flow line, the user interacts with other users in the virtual space. a virtual break room connection unit that connects to a virtual break room where communication is possible; a virtual rest room information acquisition unit that acquires information about the virtual rest room; an output control unit that outputs information about the virtual rest room; A virtual rest room providing device comprising:

5. setting a flow line indicating a path taken by a user when moving between areas; determining whether the user has moved along a flow line set between areas based on a result of detection of the user's position by the position detection sensor; When it is determined that the user has moved along the flow line, the user interacts with other users in the virtual space. connecting to a virtual break room where communication can be carried out; obtaining information about the virtual break room; outputting information about the virtual rest room; A computer-implemented method for providing a virtual break room, comprising:

Citation Information

Patent Citations

  • System and method for supporting break, storage medium, terminal equipment and server device

    JP2001142850A

  • Controller and method for virtual system and storage medium

    JP2001160959A

  • Equipment controller

    JP2010183322A

  • Automatic Control of Wearable Display Devices Based on External Conditions

    JP2020507797A

  • Traffic line analyzer and program

    JP2021002289A