Information processing system, information processing device, information processing method, and program

Abstract

To grasp a communication situation between employees online such as remote work.SOLUTION: An information processing system comprises: a first location information acquisition unit which acquires first location information in a first space of one or each of a plurality of users having a sound collector in a digital twin where a first space in a real space is reproduced in a second space in a virtual space; a second location information acquisition unit which acquires second location information in a second space of one or each of the plurality of users having the sound collector; a presentation unit which presents each avatar representing each user on the second space on the basis of the first location information and the second location information; and a determination unit which determines whether there is communication between the first user corresponding to a first avatar and the second user corresponding to a second avatar on the basis of a state of the sound collector and a distance between the first avatar and the second avatar. Each of the first avatar and the second avatar is included in each avatar.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing device, an information processing method, and a program. [Background technology]

[0002] Traditionally, communication between employees working in an office has been carried out in the office, etc. In such an environment, the visualization and measurement of communication status has been carried out using the location information of employees in the office and the audio recorded in the section of the office between employees. For example, Patent Document 1 discloses a personal relationship extraction system that extracts relationships between people by recognizing whether a conversation has occurred in each of a space divided into a number of sections and identifying the people who have had the conversation.The personal relationship extraction system is characterized by having a voice determination unit that determines whether the sound collected in each section includes voice, a person identification unit that identifies the multiple people when multiple people are present around each section, a recording unit that recognizes that the conversation in that section occurred between the identified people and records it when the voice determination unit determines that the sound collected in a certain section includes voice and the person identification unit determines that multiple people have been identified around that section, and a visualization unit that extracts and visualizes relationships between people by accumulating the records in the recording unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-191878 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, as working styles have become more diverse, the proportion of companies implementing remote work using private homes, satellite offices, etc. has been increasing. In addition to telephone, email, and chat tools, various online communication tools are now widely used for communication between employees in remote work situations. The technology described in Patent Document 1 makes it possible to grasp the communication status between employees in the office, but has the problem that it cannot grasp the communication status between employees online, such as in remote work situations.

[0005] The present invention has been made in consideration of the above points, and has an objective of providing an information processing system, an information processing device, an information processing method, and a program that can grasp the communication status between employees online, such as in remote work. [Means for solving the problem]

[0006] The present invention has been made to solve the above-mentioned problems, and one aspect of the present invention is an information processing system, in which a digital twin in which a first space in real space is reproduced in a second space in a virtual space includes a first position information acquisition unit that acquires first position information in the first space of each of one or more users having a sound collector, a second position information acquisition unit that acquires second position information in the second space of each of one or more users having a sound collector, a presentation unit that presents each avatar representing each user in the second space based on the first position information and the second position information, and a determination unit that determines whether or not there is communication between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar, and each of the first avatar and the second avatar is included in the respective avatar.

[0007] Moreover, one aspect of the present invention is an information processing device comprising: a first position information acquisition unit that acquires first position information in the first space of each of one or more users having a sound collector; a second position information acquisition unit that acquires second position information in the second space of each of one or more users having a sound collector; a presentation unit that presents each avatar representing each user in the second space based on the first position information and the second position information; and a determination unit that determines whether or not there is communication between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar, wherein each of the first avatar and the second avatar is included in the respective avatar.

[0008] Moreover, one aspect of the present invention is an information processing method executed by a computer of an information processing device, comprising: a first position information acquisition step of acquiring first position information in the first space of each of one or more users having a sound collector, in a digital twin in which a first space in real space is reproduced in a second space in a virtual space; a second position information acquisition step of acquiring second position information in the second space of each of one or more users having a sound collector; a presentation step of presenting each avatar representing each user in the second space based on the first position information and the second position information; and a determination step of determining whether or not there is communication between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar, wherein each of the first avatar and the second avatar is included in the respective avatar.

[0009] Moreover, one aspect of the present invention is a program to be executed by a computer of an information processing device, the program comprising: a first position information acquisition step of acquiring first position information in the first space of each of one or more users having a sound collector in a digital twin in which a first space in real space is reproduced in a second space in a virtual space; a second position information acquisition step of acquiring second position information in the second space of each of one or more users having a sound collector; a presentation step of presenting each avatar representing each user in the second space based on the first position information and the second position information; and a determination step of determining whether or not there is communication between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar, wherein each of the first avatar and the second avatar is included in the respective avatar. Effect of the Invention

[0010] According to an embodiment of the present invention, it is possible to grasp the status of communication between employees online, such as during remote work. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an example of a configuration of an information processing device according to a first embodiment. [Diagram 2] 13 is a flowchart illustrating an example of a process for presenting location information in a digital twin according to this embodiment. [Diagram 3] 11 is a diagram illustrating an example of a communication determination process in the information processing device according to the embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <First embodiment> Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0013] [Information processing system configuration] First, an information processing system SYS according to the first embodiment will be described. The information processing system SYS includes at least a plurality of users each having a sound collector, and an information processing device 100. The sound collector is a sound collector that can be switched between a state in which sound can be collected and a state in which sound cannot be collected, such as switching between a power on state and an off state, or switching between a mute state and an unmute state. The sound collector is, for example, a microphone.

[0014] The multiple users are one or more users who stay in an office in real space (also referred to as a real office or a first space), and / or one or more users who join and stay in a virtual office in virtual space (also referred to as a second space) from a location other than the office (for example, a remote work destination such as a home, a satellite office, or another base). A virtual office is, for example, a digital twin office in which a real office is reproduced (constructed) in a virtual space.

[0015] Each user staying in a real office or a virtual office is presented as an avatar representing the user at a corresponding position in the virtual office based on the location information of the user. In the virtual office, the users corresponding to the avatars can communicate with each other by contacting or approaching each other. The communication may be, for example, a conversation.

[0016] Here, the users communicating with each other do not need to be in the same space, for example, a real office, and each user may be in either a real office or a virtual office.

[0017] The information processing system SYS also includes a management device that manages the virtual office and manages logins to the virtual office, but the description will be omitted. The information processing system SYS also includes a user terminal device with a sound collector that is used by the user to connect to the virtual office, but the description will be omitted. In the following description, the user terminal device with a sound collector is referred to as a user with a sound collector.

[0018] The information processing system SYS will now be described more specifically.

[0019] In a digital twin in which a first space in a real space is reproduced in a second space in a virtual space, the information processing system SYS acquires first position information in the first space of each of one or more users having a sound collector, acquires second position information in the second space of each of one or more users having a sound collector, and presents each avatar representing each user in the second space based on the first position information and the second position information. The information processing system SYS determines the presence or absence of communication between the first user corresponding to the first avatar and the second user corresponding to the second avatar based on the state of the sound collector and the distance between the first avatar and the second avatar. Each of the first avatar and the second avatar is included in each avatar.

[0020] In addition, in the information processing system SYS, the state of the hearing collector indicates whether or not the hearing collector is capable of collecting sound, and the presence or absence of communication is determined by determining that the first user and the second user are in communication when the distance between the first avatar and the second avatar is within a predetermined threshold, the hearing collector held by the first user is capable of collecting sound, and the hearing collector held by the second user is capable of collecting sound.

[0021] In addition, in the information processing system SYS, the judgment is made by determining whether or not the second user is a user staying in the first space when the distance between the first avatar and the second avatar is within a predetermined threshold, the sound collector held by the first user is capable of collecting sound, and the sound collector held by the second user is not capable of collecting sound, and by determining whether or not the first user and the second user are communicating with each other based on voices collected in multiple sections within the first space when the second user is a user staying in the first space.

[0022] Furthermore, the information processing system SYS evaluates communication for each user based on the determination result of the presence or absence of communication for each user and multi-stage thresholds.

[0023] In this manner, the information processing system SYS can grasp the communication situation between users in online communication even when the users are in different spaces.

[0024] Next, the information processing device 100 will be described.

[0025] FIG. 1 is a block diagram showing an example of a configuration of an information processing device 100 according to the first embodiment of the present invention. The information processing device 100 includes a communication unit 11, a control unit 12, a storage unit 13, an input unit 14, and an output unit 15. The communication unit 11, the control unit 12, the storage unit 13, the input unit 14, and the output unit 15 are connected to each other via a bus.

[0026] The input unit 14 is an input device such as a mouse, a keyboard, a touch panel, or a microphone. The output unit 15 is an output device such as a display unit, a speaker, or the like.

[0027] The communication unit 11 has a function of communicating with other devices such as a management device and a user terminal device via a network. The communication unit 11 is controlled by the control unit 12, and transmits various information output from the control unit 12 to the other devices. The communication unit 11 receives various information transmitted from the other devices, and outputs the received various information to the control unit 12.

[0028] The control unit 12 controls the processing of each unit of the information processing device 100, and exerts the functions of the information processing device 100. The control unit 12 may be configured with dedicated hardware, or may be configured with a general-purpose computer system. The computer system includes at least an arithmetic processing device and a storage medium. For example, a processor such as a CPU (Central Processing Unit) may be applied as the arithmetic processing device. A storage unit (not shown) and a flash memory (not shown) are used as the storage medium. For example, the arithmetic processing device reads a program stored in advance in the flash memory, and expands the read program in the storage unit. The arithmetic processing device executes the program expanded in the storage unit to realize the functions of the control unit 12.

[0029] The term "CPU" as used herein refers to a processor in general, and includes not only a device known as a CPU in the narrow sense, but also, for example, a GPU or DSP. The CPU as used herein is not limited to being realized by a single processor, and may be realized by combining multiple processors of the same or different types.

[0030] The control unit 12 includes an acquisition unit 121, a presentation unit 122, a determination unit 123, and an evaluation unit . The acquisition unit 121 includes a virtual office login user list acquisition unit 1211, a real office position information acquisition unit 1212 (first position information acquisition unit), and a virtual office position information acquisition unit 1213 (second position information acquisition unit).

[0031] A virtual office login user list acquisition unit 1211 acquires a virtual office login user list, which is a list of users who have logged in to the virtual office, from a management device via a network. A user who has logged in to the virtual office is not a user who stays in a real office, but a user who logs in to the virtual office via a network from a place other than the real office, such as a personal residence, a shared office, or a satellite office. The virtual office login user list is a list in which information such as user names, display names of user avatars, user identification information, and login times are associated with each other.

[0032] The real office position information acquisition unit 1212 acquires the position information of each user in the real office. The position information of each user may be position information estimated by a camera or the like, position information obtained by various sensors, or position information obtained by various known technologies.

[0033] The virtual office location information acquisition unit 1213 acquires location information of each user in the virtual office. The location information of each user may be location information based on various known technologies. Here, each user in the virtual office refers to each user who logs in to the virtual office.

[0034] The presentation unit 122 presents the avatar of each user staying in the real office at a corresponding position in the virtual office based on a user list logged in to the virtual office, real office position information, and virtual office position information, and presents the avatar of each user logged in to the virtual office at a predetermined position in the virtual office, a position in the virtual office corresponding to each user's seat position in the real office, and a position in the virtual office identified based on the avatar's movement history within the virtual office.

[0035] The determination unit 123 is configured to include a sound collector state determination unit 1231 , a partner user determination unit 1232 , a partner user sound collector state determination unit 1233 , a real office visitor determination unit 1234 , and a real office communication determination unit 1235 .

[0036] The sound collector state determination unit 1231 determines the state of the sound collector owned by the user. The state of the sound collector is whether or not it is in a state where sound can be collected. A state where sound can be collected is when the power is on or when the mute is released. A state where sound cannot be collected is when the power is off or when the mute is released. The sound collector state determination unit 1231 determines, for example, whether or not the state of the sound collector owned by the first user is in a state where sound can be collected.

[0037] The other user determination unit 1232 determines whether the distance between the avatars in the virtual office is within a predetermined threshold. It is determined whether or not the distance between the avatar of the first user and the avatar of the second user is within an avatar distance threshold stored in the storage unit 13. Alternatively, the other user determination unit 1232 may determine whether or not the front of the avatar of the second user faces the direction of the avatar of the first user, and use the determination result as reference information. The other user determination unit 1232 determines (specifies) a user whose distance from the avatar of the first user is within the avatar distance threshold, for example, a second user, as the other user. Note that the other user may be one or more.

[0038] The other user's sound collector state determination unit 1233 determines whether or not the sound collector owned by the other user is in a state capable of collecting sound. The other user's sound collector state determination unit 1233 determines, for example, whether or not the sound collector of the second user is in a state capable of collecting sound.

[0039] The real office visitor determination unit 1234 refers to the virtual office login user list and determines whether each user is a user staying in the real office or a user logging in to the virtual office. Specifically, the real office visitor determination unit 1234 determines a user included in the virtual office login user list as a user staying in the virtual office, and determines a user not included in the virtual office login user list as a user staying in the real office.

[0040] The real office communication determination unit 1235 determines the communication state in the real office when the sound collector owned by the user is not in a state capable of collecting sound or when the user is a user staying in a real office. For example, the real office communication determination unit 1235 determines the communication state in the real office when the sound collector owned by one or both of the first user and the second user is not in a state capable of collecting sound or when one or both of the first user and the second user are users staying in a real office. The communication state in the real office is determined by using known technologies such as the technology described in JP 2019-191878 A, the technology described in JP 2021-012530 A, and the technology described in JP 2021-182089 A. Here, the determination of the communication state refers to a state determination of the presence or absence of communication, and identification of each user who communicated when communication is present.

[0041] The evaluation unit 124 evaluates the communication for each user based on the number of communications (frequency) for each user and an evaluation threshold. The evaluation threshold is, for example, a multi-stage threshold with a stepwise threshold range, and is a threshold with excellent, good, poor, etc., defined according to the stage. The number of communications (frequency) for each user may be, for example, the total number of times a first user communicated with other users, or may be the number of times communication was performed for each communication partner, such as between the first user and the second user, or between the first user and the third user.

[0042] The storage unit 13 stores an avatar distance threshold 131, an evaluation threshold 132, a communication record 133, and an evaluation result 134.

[0043] The avatar distance threshold 131 is a threshold for the distance between avatars. Specifically, the avatar distance threshold 131 is a threshold for distance used by the determination unit 123 to determine that a second avatar or the like that exists at a distance within the avatar distance threshold from a first avatar is a communication partner of the first avatar.

[0044] The evaluation threshold 132 is a threshold of the number (frequency) used to evaluate the number (frequency) of communications between users. Specifically, the evaluation threshold 132 is a threshold of the number (frequency) used by the evaluation unit 124 to perform a graded evaluation of the number of communications between the first user and a communication partner.

[0045] The communication record 133 is a communication record including the total number of times communication was performed with other users, the number of times communication was performed with each other user, etc. The communication record 133 is a record for each user.

[0046] The evaluation result 134 is the evaluation result by the evaluation unit 124 for each user.

[0047] Next, the flow of the presentation process will be described. FIG. 2 is a flowchart showing an example of a presentation process in the information processing device 100 according to this embodiment.

[0048] In step S101, the information processing device 100 acquires a virtual office login user list from a management device via a network. After that, the information processing device 100 executes the process of step S102.

[0049] In step S102, the information processing device 100 acquires location information of the user staying in the real office from the management device via the network. After that, the information processing device 100 executes the process of step S103.

[0050] In step S103, the information processing device 100 acquires the location information of the users who log in to the virtual office via the network, and presents an avatar representing each user at a corresponding position on the virtual office based on the virtual office login user list, the location information of users staying in the real office, and the location information of users who log in to the virtual office. After that, the information processing device 100 ends the presentation process shown in FIG. 2.

[0051] The information processing device 100 may repeatedly execute the processes from step S101 to step S103 at predetermined time intervals or in response to a user's login or movement.

[0052] Next, the flow of the communication determination process will be described. Fig. 3 is a flowchart showing an example of the communication determination process in the information processing device 100 according to this embodiment. Here, the communication determination process in Fig. 3 is a process executed after the process of step S103 in Fig. 2, for example. In addition, in the communication determination process in Fig. 3, the processes from step S201 to step S212 are executed for each user in the virtual office. The illustrated example is an example of a case where the communication determination process is executed for the first user, for example.

[0053] In step S201, the information processing device 100 determines whether or not the sound collector owned by the user corresponding to the avatar in the virtual office is in a state capable of collecting sound. If the sound collector owned by the user is in a state capable of collecting sound (step S201 YES), the information processing device 100 executes the process of step S202. On the other hand, if the sound collector owned by the user is not in a state capable of collecting sound (step S201 NO), the information processing device 100 executes the process of step S208.

[0054] In step S202, the information processing device 100 detects a second avatar that is within a predetermined distance, for example, within an avatar distance threshold, from the first avatar representing the first user. When the second avatar is detected, the second user corresponding to the second avatar is identified as a communication partner of the first user. After that, the information processing device 100 executes the process of step S203.

[0055] Note that information processing device 100 may repeatedly execute the process of step S202 until the second avatar is detected, or may end the communication determination process in FIG. 3 if the second avatar is not detected.

[0056] In step S203, the information processing device 100 determines whether or not the sound collector owned by the other user, that is, the second user corresponding to the second avatar, is in a state capable of collecting sound. If the sound collector owned by the second user is in a state capable of collecting sound (step S203 YES), the information processing device 100 executes the process of step S204. On the other hand, if the sound collector owned by the second user is not in a state capable of collecting sound (step S203 NO), the information processing device 100 executes the process of step S210.

[0057] In step S204, the information processing device 100 records the second user as a communication partner of the first user in the communication record 133 of the storage unit 13. After that, the information processing device 100 executes the process of step S205.

[0058] In step S205, the information processing device 100 records information indicating that communication has occurred between the first user and the second user in the communication record 133 of the storage unit 13. After that, the information processing device 100 executes the process of step S206.

[0059] In step S206, the information processing device 100 determines whether or not communication determination has been performed for the number of users corresponding to all avatars staying in the virtual office. If communication determination has been performed for the number of users corresponding to all avatars staying in the virtual office (YES in step S206), the information processing device 100 ends the communication process in Fig. 3. On the other hand, if communication determination has not been performed for the number of users corresponding to all avatars staying in the virtual office (NO in step S206), the information processing device 100 executes the process of step S207.

[0060] In step S207, the information processing device 100 switches the target of communication determination to the next user for whom communication determination is to be performed. After that, the information processing device 100 executes the process of step S201.

[0061] In step S208, the information processing device 100 determines whether the first user is a user staying in a real office based on the virtual office login user list. If the first user is a user staying in a real office (step S208 YES), the information processing device 100 executes the process of step S209. On the other hand, if the first user is not a user staying in a real office (step S208 NO), the information processing device 100 executes the process of step S212.

[0062] In step S209, the information processing device 100 detects a second avatar that is within a predetermined distance, for example, within an avatar distance threshold, from the first avatar representing the first user. When the second avatar is detected, the second user corresponding to the second avatar is identified as a communication partner of the first user. After that, the information processing device 100 executes the process of step S210.

[0063] Note that information processing device 100 may repeatedly execute the process of step S209 until the second avatar is detected, or may end the communication determination process in FIG. 3 if the second avatar is not detected.

[0064] In step S210, the information processing device 100 determines whether the second user is a user staying in a real office based on the virtual office login user list. If the second user is a user staying in a real office (step S210 YES), the information processing device 100 executes the process of step S211. On the other hand, if the second user is not a user staying in a real office (step S210 NO), the information processing device 100 executes the process of step S212.

[0065] In step S211, the information processing device 100 executes a communication estimation process in a real office. The communication estimation process uses a known technology such as the technology described in JP 2019-191878 A, the technology described in JP 2021-012530 A, or the technology described in JP 2021-182089 A. After that, the information processing device 100 executes the process of step S204.

[0066] In step S212, the information processing device 100 records that the first user has not communicated with other users in the communication record 133 of the storage unit 13. After that, the information processing device 100 executes the process of step S206.

[0067] After the communication determination process shown in FIG. 3, the information processing device 100 may execute a process of evaluating the communication for each user based on the number (frequency) of communications for each user and an evaluation threshold.

[0068] Thus, the information processing system SYS of this embodiment is equipped with a first position information acquisition unit (real office position information acquisition unit 1212) that acquires first position information in the first space of each of one or more users who have a hearing collector, a second position information acquisition unit (virtual office position information acquisition unit 1213) that acquires second position information in the second space of each of one or more users who have a hearing collector, a presentation unit 122 that presents each avatar representing each user in the second space based on the first position information and the second position information, and a determination unit 123 that determines whether or not there is communication between the first user corresponding to the first avatar and the second user corresponding to the second avatar based on the state of the hearing collector and the distance between the first avatar and the second avatar, and each of the first avatar and the second avatar is included in the respective avatar.

[0069] In this manner, the information processing system SYS can grasp the communication situation between users in online communication even when the users are in different spaces.

[0070] Furthermore, in the above-mentioned information processing system SYS, the state of the sound collector is a state indicating whether or not the sound collector is capable of collecting sound, and the judgment unit 123 judges that the first user and the second user are in communication when the distance between the first avatar and the second avatar is within a predetermined threshold, the sound collector held by the first user is capable of collecting sound, and the sound collector held by the second user is capable of collecting sound.

[0071] In this way, the information processing system SYS can grasp that communication has taken place between the user and another user in the virtual space.

[0072] Furthermore, in the above-mentioned information processing system SYS, the judgment unit 123 judges whether or not the second user is a user staying in the first space when the distance between the first avatar and the second avatar is within a predetermined threshold, the sound collector held by the first user is capable of collecting sound, and the sound collector held by the second user is not capable of collecting sound, and judges whether or not the first user and the second user are communicating with each other based on the voices collected in multiple sections within the first space when the second user is a user staying in the first space.

[0073] By doing this, the information processing system SYS can obtain an integrated understanding of communication between users in the real space and users in the virtual space, communication between users in the virtual space, and communication between users in the real space.

[0074] The information processing system SYS further includes an evaluation unit that evaluates communication for each user based on a determination result of the presence or absence of communication for each user and a multi-stage threshold value.

[0075] In this way, the information processing system SYS can grasp the communication situation between users regardless of whether the users are in real space or virtual space, and can also visualize the grasped communication situation.

[0076] In addition, in a digital twin in which a first space in real space is reproduced in a second space in virtual space, the information processing device 100 includes a first position information acquisition unit (real office position information acquisition unit 1212) that acquires first position information in the first space of each of one or more users who have a sound collector, a second position information acquisition unit (virtual office position information acquisition unit 1213) that acquires second position information in the second space of each of one or more users who have a sound collector, a presentation unit 122 that presents each avatar representing each user in the second space based on the first position information and the second position information, and a determination unit 123 that determines whether or not there is communication between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on the state of the sound collector and the distance between the first avatar and the second avatar, and each of the first avatar and the second avatar is included in the respective avatar.

[0077] In this manner, the information processing system SYS can grasp the communication situation between users in online communication even when the users are in different spaces.

[0078] It should be noted that the information processing device 100 and part of the management device in the above-mentioned embodiment may be realized by a computer. In that case, a program for realizing this control function may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to realize the control function. Note that the "computer system" here refers to a computer system built into the information processing device 100 and the management device, and includes hardware such as an OS and peripheral devices.

[0079] In addition, the term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into computer systems. Furthermore, the term "computer-readable recording medium" may also include devices that dynamically hold a program for a short period of time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, and devices that hold a program for a certain period of time, such as volatile memory inside a computer system that serves as a server or client in such cases. Furthermore, the above-mentioned program may be one that realizes part of the above-mentioned functions, or may be one that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0080] In addition, the information processing device 100 and the management device in the above-mentioned embodiment may be realized as a part or the whole as an integrated circuit such as LSI (Large Scale Integration). Each functional block of the information processing device 100 and the management device may be individually processed as a processor, or may be integrated as a processor by integrating a part or the whole. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used.

[0081] Although one embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes, etc. are possible within the scope that does not deviate from the gist of the present invention.

[0082] The "Sustainable Development Goals (SDGs)" are 17 international goals that were adopted at the United Nations Summit in September 2015. The information processing system, information processing device, information processing method, and program according to the present embodiment can contribute to the achievement of, for example, goal 8. "Decent work and economic growth" out of the 17 SDGs. [Explanation of symbols]

[0083] SYS Information Processing System 100 Information processing device 11 Communications Department 12 Control section 121 Acquisition Department 1211 Virtual Office Login User List Acquisition Department 1212 Real Office Location Information Acquisition Department 1213 Virtual Office Location Information Acquisition Department 122 Presentation section 123 Judgment section 1231 Sound collector status determination unit 1232 Other User Judgment Unit 1233 Other user's hearing aid status determination unit 1234 Real Office Resident Determination Department 1235 Real Office Communication Judgment Department 124 Evaluation Section 13 Storage section 131 Avatar Distance Threshold 132 Evaluation Threshold 133 Communication Records 134 Evaluation Results 14 Input section 15 Output section

Claims

1. In a digital twin, a first space in the real world is reproduced in a second space in a virtual world. A first position information acquisition unit that acquires first position information in the first space of each of one or a plurality of users having a sound collector; A second position information acquisition unit that acquires second position information in the second space of each of one or more users having a sound collector; a presentation unit that presents avatars representing the respective users in the second space based on the first position information and the second position information; A determination unit that determines whether or not communication is occurring between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar; Equipped with Each of the first avatar and the second avatar is included in the respective avatar; Information processing system.

2. The state of the sound collector is a state indicating whether the sound collector is capable of collecting sound, The determination unit determines that the first user and the second user are in communication when a distance between the first avatar and the second avatar is within a predetermined threshold, the sound collector owned by the first user is capable of collecting sound, and the sound collector owned by the second user is capable of collecting sound. The information processing system according to claim 1 .

3. The determination unit determines whether or not the second user is a user staying in the first space when a distance between the first avatar and the second avatar is within a predetermined threshold, the sound collector owned by the first user is capable of collecting sound, and the sound collector owned by the second user is not capable of collecting sound, When the second user is a user staying in the first space, it is determined whether or not communication between the first user and the second user occurs based on sounds collected in a plurality of sections in the first space. The information processing system according to claim 2 .

4. an evaluation unit that evaluates communication for each user based on a result of the determination of the presence or absence of communication with each user and a multi-stage threshold; Further comprising: The information processing system according to claim 3 .

5. In a digital twin, a first space in the real world is reproduced in a second space in a virtual world. A first position information acquisition unit that acquires first position information in the first space of each of one or a plurality of users having a sound collector; A second position information acquisition unit that acquires second position information in the second space of each of one or more users having a sound collector; a presentation unit that presents avatars representing the respective users in the second space based on the first position information and the second position information; A determination unit that determines whether or not communication is occurring between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar; Equipped with Each of the first avatar and the second avatar is included in the respective avatar; Information processing device.

6. An information processing method executed by a computer of an information processing device, comprising: In a digital twin, a first space in the real world is reproduced in a second space in a virtual world. A first position information acquisition step of acquiring first position information in the first space of each of one or a plurality of users having a sound collector; A second position information acquisition step of acquiring second position information in the second space of each of one or more users having a sound collector; a presentation step of presenting, in the second space, avatars representing the respective users based on the first position information and the second position information; A determination step of determining whether or not communication is occurring between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar; having Each of the first avatar and the second avatar is included in the respective avatar; Information processing methods.

7. A program for causing a computer of an information processing device to execute the program, In a digital twin, a first space in the real world is reproduced in a second space in a virtual world. A first position information acquisition step of acquiring first position information in the first space of each of one or a plurality of users having a sound collector; A second position information acquisition step of acquiring second position information in the second space of each of one or more users having a sound collector; a presentation step of presenting, in the second space, avatars representing the respective users based on the first position information and the second position information; A determination step of determining whether or not communication is occurring between a first user corresponding to the first avatar and a second user corresponding to the second avatar based on a state of the sound collector and a distance between the first avatar and the second avatar; having Each of the first avatar and the second avatar is included in the respective avatar; program.

Images