Information processing system and program

Abstract

To enable a nearby person positioned around a target person to know the status of a notification to be notified to the target person and relating to the speech of the nearby person.SOLUTION: (A) shows a situation in which a display unit 217 has begun displaying speech content 48. In this case, a light-emitting device 500 lights up. When the display unit 217 begins processing for displaying the speech content 48, the light-emitting device 500 lights up. (C) shows a situation in which the display unit 217 of a device 200 has completed the processing for displaying the speech content. In the situation shown in (C), a nearby person 42 has also finished speaking. In this case, CPU generates control information so as to turn off the light-emitting device 500. When the control information to turn off the light-emitting device 500 is generated, the light-emitting device 500 turns off.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] Patent document 1 discloses a process for determining the speech of a first user based on sensing information from a sensor device that senses at least one of a first user and a second user, and controlling information to be output to the first user based on the determination result of the speech of the first user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-106649 Summary of the Invention [Problem to be solved by the invention]

[0004] When a notification is sent to a target person regarding speech made by people nearby the target person, the target person can learn the content of speech made by people nearby the target person. For example, if a notification is sent to a target person through a device that only the target person can access, the surrounding people cannot know the status of the notification. In this case, a situation may arise in which a surrounding person makes a new utterance while the notification to the target person has not yet been completed. In addition, for example, a malfunction of the device that the target person refers to may occur, and in this case, a situation may arise in which people nearby make utterances under the circumstances in which the target person cannot be notified. An object of the present invention is to enable nearby people who are located around a target person to know the status of notifications regarding speech made to the target person by the nearby people. [Means for solving the problem]

[0005] The invention described in claim 1 is an information processing system that includes a processor, which identifies a notification status, which is a status of a notification made to a target person regarding an utterance of a nearby person who is located in the vicinity of the target person, and generates control information that causes the nearby person to be notified of the identified notification status. The invention described in claim 2 is an information processing system described in claim 1, in which the processor identifies, as the notification status, the progress status of the notification made to the target person, and generates, as the control information, control information that causes the progress status to be notified to the surrounding people. The invention described in claim 3 is an information processing system described in claim 2, in which the processor identifies, as the progress status, the progress status of a display process of speech content, which is the content of the speech of the surrounding person, in a subject-reference device, which is a device referenced by the subject, and generates, as the control information, control information that causes the surrounding person to be notified of the progress status of the display process in the subject-reference device. The invention described in claim 4 is an information processing system described in claim 3, in which the processor generates control information that notifies the surrounding persons that the display processing in the subject reference device has been completed. The invention described in claim 5 is an information processing system described in claim 1, in which the processor generates control information that causes the output of a nearby person reference device, which is a device referenced by the nearby person, to change depending on the notification status. The invention described in claim 6 is an information processing system described in claim 5, in which the processor generates control information that causes the output of the nearby person reference device to change upon the end of the notification made to the target person. The invention described in claim 7 is an information processing system described in claim 6, in which the processor generates control information that changes the brightness of at least a part of the surrounding person reference device upon termination of the notification made to the target person. The invention described in claim 8 is an information processing system described in claim 5, in which the target person is notified of the speech content, which is the content of the speech of the surrounding person, a notification process of the speech content to the target person is performed, and the processor further generates control information that causes information indicating that speech is possible to be output from the surrounding person reference device upon completion of the notification process. The invention described in claim 9 is an information processing system described in claim 1, in which the processor generates control information that changes the sound output from the sound source depending on the status of the notification made to the target person. The invention described in claim 10 is an information processing system described in claim 9, wherein the processor generates, as the control information, control information that causes the sound source to stop emitting sound when the notification made to the target person ends, or control information that causes the sound source to emit sound when the notification ends. The invention described in claim 11 is an information processing system described in claim 9, in which the target person is notified of the speech content, which is the content of the speech of the surrounding person, and a notification process of the speech content to the target person is performed, and the processor further generates control information that causes a sound corresponding to information indicating that speech is possible to be output from the sound source upon completion of the notification process. The invention described in claim 12 is an information processing system described in claim 1, in which the processor generates control information that causes each of the surrounding persons to be notified of the notification status through an individual device that each of the surrounding persons has. The invention described in claim 13 is an information processing system described in claim 12, in which the processor generates control information that changes the vibration state of the individual device depending on the status of the notification made to the target person. The invention described in claim 14 is an information processing system described in claim 12, in which the processor generates control information that changes the content of the display on the individual device depending on the status of the notification made to the target person. The invention described in claim 15 is an information processing system described in claim 14, in which the target person is notified of the speech content, which is the content of the speech of the person around them, a notification process of the speech content to the target person is performed, and the processor further generates control information that causes information indicating that speech is possible to be displayed on the individual device upon completion of the notification process. The invention described in claim 16 is an information processing system described in claim 1, in which the target person is notified of the speech content, which is the content of the speech of a speaker who is one of the surrounding people who made the speech, and the processor identifies, as the notification status, a notification status for the speech content of the speaker for each speaker, and further generates control information that causes the notification manner when the notification status identified for each speaker is notified to the surrounding people to differ for each speaker. The invention described in claim 17 is an information processing system described in claim 1, in which a notification regarding the speech of a registered peripheral person who is a peripheral person who has been registered in advance among the peripheral people is made to the target person, and a notification regarding the speech of a non-registered person other than the registered peripheral person is not made to the target person, and the processor identifies as the notification status a notification status that is a notification regarding the speech of the registered peripheral person and is made to the target person, and generates as the control information control information that causes the notification status of the notification regarding the speech of the registered peripheral person to be notified to the peripheral person. The invention described in claim 18 is a program for causing a computer to realize a specification function for specifying a notification status, which is a status of a notification regarding an utterance of a person nearby who is a person in the vicinity of a target person and is made to the target person, and a generation function for generating control information that causes the specified notification status to be notified to the person nearby. [Effects of the Invention]

[0006] According to the invention of claim 1, it is possible to enable surrounding persons located around the target person to know the status of notifications regarding speech made to the target person by the surrounding persons. According to the invention of claim 2, it is possible to notify nearby people of the progress of the notification being made to the target person. According to the invention of claim 3, it is possible to notify nearby people of the progress of the display process in the subject reference device that the subject refers to. According to the invention of claim 4, it is possible to notify nearby people that the display process in the subject reference device has been completed. According to the invention of claim 5, it is possible to change the output of the nearby person reference device, which is the device that the nearby person refers to, depending on the notification situation. According to the invention of claim 6, it is possible to change the output of the nearby person reference device upon completion of the notification given to the subject person. According to the invention of claim 7, it is possible to notify nearby people that the notification to the target person has ended by utilizing a change in brightness of at least a part of the nearby person reference device. According to the invention of claim 8, it is possible to notify people nearby that it is possible to speak. According to the invention of claim 9, it is possible to use sound to notify people around the target person of the status of the notification being made to the target person. According to the invention of claim 10, it is possible to use sound to notify people nearby that the notification given to the target person has ended. According to the invention of claim 11, it is possible to notify people nearby that it is possible to speak. According to the invention of claim 12, it is possible to individually notify each of the people around the target person of the status of the notification being made to the target person. According to the invention of claim 13, it is possible to use vibrations of individual devices to notify nearby people of the status of the notification being made to the target person. According to the invention of claim 14, it is possible to inform nearby people of the status of notifications being made to the target person through displays on individual devices. According to the invention of claim 15, it is possible to inform nearby people that it is possible to speak through a display on the individual device. According to the invention of claim 16, it is possible to notify the surrounding people of the speech of which surrounding people the target person has been notified. According to the invention of claim 17, it is possible to notify nearby people of the status of notifications regarding speech by nearby people who have been registered in advance. According to the invention of claim 18, it is possible to enable the surrounding persons to know the status of notifications regarding the speech of the surrounding persons located around the target person and the status of such notifications being made to the target person. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a diagram showing the overall configuration of a notification system. [Figure 2] FIG. 2 illustrates a configuration of a management server. [Figure 3] FIG. 2 is a diagram showing the hardware configuration of the device. [Figure 4] FIG. 2 is a diagram showing a database stored in an information storage unit of a management server. [Figure 5] 10A to 10C are diagrams illustrating an example of processing executed in the notification system. [Figure 6] 10A to 10H are diagrams showing a series of flow of the display process. [Figure 7] 10(A) to 10(C) are diagrams showing other processing examples. [Figure 8] 10A to 10D are diagrams showing an example of processing when a sound source is used. [Figure 9] 10A to 10C are diagrams showing an example of processing when speech permission information is output. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing the overall configuration of a notification system 1 of this embodiment. The notification system 1 includes a management server 300. The notification system 1 also includes a device 200 that is worn by a target person, as will be described later. Although only one device 200 is shown in FIG. 1, a plurality of devices 200 are provided according to the number of subjects. The device 200 is in the form of glasses. The device 200 is worn on the head of the subject. The subject visually recognizes his or her surroundings through the device 200.

[0009] Also provided is an individual microphone 600 worn by each of the nearby people, which will be described later. The individual microphone 600 picks up the voices of the nearby people and generates voice information. An individual microphone 600 is provided for each nearby person. If there are multiple nearby people, multiple individual microphones 600 are provided.

[0010] Furthermore, a light emitting device 500 is provided as an example of a nearby person reference device. The light-emitting device 500 is provided with a light source such as an LED, and a CPU as an example of a processor that controls the output of the light source. The notification status of the speech-related notification given to the target person is notified to people nearby via the light-emitting device 500. Note that this notification to nearby people may be made via a device other than the light-emitting device 500, such as a sound source, as will be described later. The device 200 is connected to the management server 300 via a communication line 400 such as the Internet. The individual microphone 600 and the light-emitting device 500 are also connected to the management server 300 via the communication line 400.

[0011] [Management Server Configuration] 2 is a diagram showing the configuration of the management server 300. The management server 300 is realized by a computer. The management server 300, which functions as an information processing system, includes a processing unit 111 that executes digital arithmetic processing according to a program. The management server 300 also includes an information storage unit 19 that stores information. The information storage unit 19 is realized by an existing information storage device. Specifically, the information storage unit 19 is realized by, for example, an HDD (Hard Disk Drive). The information storage unit 19 is also realized by, for example, a semiconductor memory.

[0012] The arithmetic processing unit 111 is provided with a CPU 11a as an example of a processor. The arithmetic processing unit 111 is also provided with a RAM 11b that is used as a working memory for the CPU 11a, etc. The arithmetic processing unit 111 is also provided with a ROM 11c that stores programs executed by the CPU 11a, etc. The arithmetic processing unit 111 is also provided with a nonvolatile memory 11d that can retain data even if the power supply is interrupted.

[0013] The nonvolatile memory 11d is configured, for example, with a battery-backed SRAM, a flash memory, etc. The information storage unit 19 stores various types of information such as programs executed by the CPU 11a. The CPU 11a provided in the arithmetic processing unit 111 reads the programs stored in the ROM 11c or the information storage unit 19. As a result, various processes performed by the management server 300 are executed by this management server 300.

[0014] The program executed by the CPU 11a can be stored in a recording medium and provided to the management server 300. This recording medium is a computer-readable recording medium. Examples of recording media include magnetic recording media such as magnetic tapes and magnetic disks, and optical recording media such as optical disks. Other examples of recording media include magneto-optical recording media and semiconductor memories. Alternatively, the program executed by the CPU 11a may be provided to the management server 300 using a communication means, such as a communication means using an internet line.

[0015] [Device configuration] FIG. 3 is a diagram showing the hardware configuration of the device 200. As shown in FIG. The device 200 includes a processing unit 211, an information storage unit 212, a sensor 213, and a device camera 214. The device 200 also includes a device microphone 215, a speaker 216, and a display unit 217. The arithmetic processing unit 211 is provided with a CPU 21a as an example of a processor. The arithmetic processing unit 211 is also provided with a RAM 21c that is used as a working memory for the CPU 21a, etc. The arithmetic processing unit 211 is also provided with a ROM 21b that stores programs executed by the CPU 21a, etc.

[0016] The information storage unit 212 is realized by an existing information storage device such as a semiconductor memory. Examples of the sensor 213 include a GPS sensor and a direction sensor. By referring to the output from the sensor 213, the current position of the device 200 and the orientation of the device 200 can be identified. The device camera 214 is a camera that captures images of the surroundings of the device 200. When the subject wears the device 200, the device camera 214 faces in the forward direction of the subject and captures an image of the forward direction. In other words, the device camera 214 faces in the direction the subject is facing and captures an image of the front of the subject.

[0017] The device microphone 215 captures the voice of the subject and generates voice information. The speaker 216 outputs sounds and voices to notify the person wearing the device 200. The display unit 217 is a so-called display that displays various information, and is placed in front of the subject's eyes when the device 200 is worn by the subject.

[0018] The display unit 217 displays an image obtained by the device camera 214. When the subject wears the device 200, the display unit 217 displays an image showing the state in front of the subject. In this embodiment, the subject person views the image displayed on the display unit 217 to visually confirm what is in front of the subject person. The device 200 can be thought of as a subject-referenced device that is referenced by the subject.

[0019] In addition, there are also transmission-type devices 200. In this case, a transparent display unit 217 that allows the subject to see what is behind the display unit 217 is installed. The subject views the area behind the display unit 217 through the display unit 217. In other words, the subject views the area in front of the subject through the display unit 217. In the see-through device 200, an image is displayed on the display unit 217. The user visually recognizes both the real space located behind the display unit 217 and the image displayed on the display unit 217.

[0020] The program executed by the CPU 21a may be stored in a recording medium and provided to the device 200. This recording medium is a computer-readable recording medium. As mentioned above, examples of the recording medium include magnetic recording media such as magnetic tapes and magnetic disks, and optical recording media such as optical disks. Other examples of the recording medium include magneto-optical recording media and semiconductor memories. Furthermore, the program executed by the CPU 21a may be provided to the device 200 using a communication means. An example of the communication means is a communication means using an internet line.

[0021] The device 200 is not limited to a glasses-type device, but may also be, for example, a smartphone, a tablet terminal, etc. The glasses-type device, smartphone, tablet terminal, etc. are all devices that can be carried by the subject person. Smartphones and tablet devices also have a display and a device camera. In this case, the subject can see what is ahead of them by referring to the image captured by the device camera and displayed on the display.

[0022] In this case, the subject refers to the display unit provided on the smartphone or tablet device placed in front of the subject, which allows the subject to visually recognize the space located in front of the subject and behind the smartphone or tablet device. In this embodiment, a notification process of the spoken content, which will be described later, is performed on the target person via the glasses-type device 200. However, this is not limited to this, and this notification process can also be performed when a smartphone or a tablet terminal is used.

[0023] In this specification, the term "processor" refers to a processor in the broad sense. An example of a processor is a general-purpose processor, such as a CPU (Central Processing Unit). Another example of a processor is a dedicated processor. An example of a dedicated processor is a GPU (Graphics Processing Unit). Another example of a dedicated processor is an ASIC (Application Specific Integrated Circuit). Another example of a dedicated processor is an FPGA (Field Programmable Gate Array) or a programmable logic device. The operations of the processor are not limited to being performed by a single processor. The operations of the processor may be performed by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in this embodiment and may be changed.

[0024] [Database Description] FIG. 4 is a diagram showing a database stored in the information storage unit 19 of the management server 300 (see FIG. 2). As shown in FIG. 4, information about each nearby person 42 (see FIG. 5) is registered in the database. In the database, for each nearby person 42, an identification ID, which is information used to identify each nearby person 42, is stored.

[0025] The database also stores microphone identification information for each nearby person 42. The microphone identification information is identification information for the individual microphone 600 (see FIG. 1) that each nearby person 42 has. Furthermore, facial information of each nearby person 42 is registered in the database. In this embodiment, an image of the face of the nearby person 42 is taken in advance. Then, face information, which is information about the face of the nearby person 42, is registered in a database. The facial information may include, for example, an image of the face of the peripheral person 42. The facial information may also include information about the facial features of the peripheral person 42. The information about the features can be obtained by analyzing the image of the face of the peripheral person 42.

[0026] The video captured by the device camera 214 (see FIG. 3) and the audio information obtained by the individual microphone 600 (see FIG. 1) are transmitted to the management server 300 (see FIG. 1). The CPU 11a (see FIG. 2) of the management server 300 acquires this video and audio information. Then, the CPU 11a acquires this video and audio information as information about the nearby person 42. Based on the video captured by the equipment camera 214, the CPU 11a identifies the nearby person 42 appearing in the video. The CPU 11a acquires an image of the face of each of the nearby people 42 appearing in the video. Then, the CPU 11a identifies the nearby people 42 based on the image of the face and the face information stored in the database. Furthermore, the CPU 11 a acquires the content of the speech of the nearby person 42 based on the voice information obtained by the individual microphone 600 .

[0027] [Description of the process executed by notification system 1] 5(A) to 5(C) are diagrams showing an example of processing executed by the notification system 1. In FIG. 5A shows a target person 41 for whom the notification process of the speech content is performed. Also, FIG. 5A shows a plurality of surrounding people 42 who are people located around the target person 41. 5(A), the device 200 is worn by the target person 41. The target person 41 is notified of the content of the speech of the nearby person 42 through the device 200. It is also assumed that the target person 41 is a person with a hearing impairment. When the speech content 48 is notified, the hearing impaired person can also identify the speech content of the nearby person 42.

[0028] 5(A), a nearby person 42 is displayed on the display unit 217 provided on the device 200. Furthermore, the display unit 217 displays the content 48 of the nearby person 42's speech. Each of the nearby persons 42 is equipped with an individual microphone 600. Voice information of the nearby persons 42 is acquired by the individual microphone 600. In this embodiment, the target person 41 also has an individual microphone 600 attached to it.

[0029] The device 200 worn by the subject 41 is a glasses-type device 200. This device 200 is worn on the head of a subject 41. The subject 41 visually recognizes nearby people 42 located around the subject 41 through this device 200. In other words, the subject 41 visually recognizes nearby people 42 located in front of the subject 41 through this device 200.

[0030] As described above, the device 200 is provided with the device camera 214 (see FIG. 3). The device 200 also has a display unit 217 that displays the image captured by the device camera 214. The target person 41 visually recognizes the nearby person 42 by referring to the nearby person 42 photographed by the device camera 214 and displayed on the display unit 217.

[0031] It is also possible that the device 200 is the above-described transmissive device 200. In this case, the target person 41 can see the surrounding person 42 positioned behind the transparent display unit 217 through the transparent display unit 217. 5(A), a light-emitting device 500 is provided in this embodiment. The light-emitting device 500 is provided in a location that is visible to nearby people 42. The role of the light-emitting device 500 will be described later.

[0032] When the CPU 11a of the management server 300 acquires the voice information acquired by the individual microphone 600, it identifies the nearby person 42 who made the utterance. The individual microphone 600 transmits microphone identification information together with the audio information. The CPU 11a acquires this microphone identification information that is transmitted to the management server 300 together with the audio information. The CPU 11a identifies the nearby person 42 based on the acquired microphone identification information and the microphone identification information stored in the database.

[0033] Each individual microphone 600 stores microphone identification information for identifying the individual microphone 600. This microphone identification information is transmitted from the individual microphone 600 to the management server 300 together with the audio information. The CPU 11a identifies the nearby person 42 based on this microphone identification information and the microphone identification information registered in the database. The CPU 11a identifies the nearby person 42 who made the utterance that is the source of the audio information acquired by the individual microphone 600. In this embodiment, every time an utterance is made, and for each nearby person 42, the nearby person 42 who made the utterance is identified.

[0034] An individual microphone 600 is provided for each nearby person 42 . The individual microphone 600 provided for each nearby person 42 acquires voice information of each nearby person 42. The voice information acquired by the individual microphone 600 is transmitted to the management server 300 together with the microphone identification information, as described above. Based on the microphone identification information, the CPU 11a identifies the nearby person 42. Furthermore, the CPU 11a acquires voice information about the identified nearby person 42. Furthermore, based on the acquired voice information, the CPU 11a acquires the speech content 48 of the identified nearby person 42. Note that the acquisition of the speech content 48 based on the voice information may be performed using a known method.

[0035] When transmitting audio information from the individual microphone 600 to the management server 300, the audio information is selected by the individual microphone 600. The individual microphone 600 selects audio information whose sound pressure exceeds a predetermined threshold from the obtained audio information. Then, the selected audio information is transmitted from the individual microphone 600 to the management server 300 together with the microphone identification information. This prevents the voice information of other nearby persons 42 from being transmitted to the management server 300, the voice information of which is not scheduled to be acquired.

[0036] The "other surrounding person 42" refers to a surrounding person 42 other than the surrounding person 42 wearing the individual microphone 600. In other words, the "other surrounding person 42" refers to a surrounding person 42 not wearing the individual microphone 600. In this embodiment, the voice information of the other nearby people 42 is prevented from being transmitted to the management server 300 via the individual microphone 600.

[0037] The other nearby person 42 is away from the nearby person 42 wearing the individual microphone 600. In this case, the sound pressure of the voice of the other nearby person 42 picked up by the individual microphone 600 becomes low. In this case, the voice information of the other nearby person 42 is not transmitted to the management server 300. In this embodiment, voice information whose sound pressure exceeds a predetermined threshold is selected. Then, this selected voice information is transmitted to the management server 300. In this case, voice information of other nearby persons 42 is not transmitted to the management server 300.

[0038] The management server 300 may select the audio information whose sound pressure exceeds a predetermined threshold. In this case, the management server 300 selects audio information from the audio information transmitted from the individual microphone 600. The management server 300 selects audio information whose sound pressure exceeds a predetermined threshold from the transmitted audio information. In this case, the management server 300 acquires the selected voice information as the voice information of the nearby person 42 wearing the individual microphone 600.

[0039] Alternatively, the CPU 11a may acquire voice information obtained by a terminal device as the voice information of the nearby person 42. Examples of the terminal device include a smartphone or a tablet terminal owned by each of the nearby people 42. Smartphones and tablet devices are equipped with microphones. The CPU 11a may acquire voice information obtained by a microphone of the terminal device as the voice information of the nearby person 42. In this case, the CPU 11a acquires the voice information obtained by the microphone and transmitted to the management server 300 as the voice information of the nearby person 42.

[0040] Alternatively, a common microphone may be provided. In this case, the CPU 11a acquires voice information acquired by the common microphone. Then, the CPU 11a acquires voice information of each of the nearby people 42 based on the voice information acquired by the common microphone. When a common microphone is used, the voice feature information is registered in advance in a database. Specifically, the voice feature information of each of the nearby people 42 is registered in the database for each nearby person 42. In this case, the CPU 11a acquires the voice information of each of the nearby people 42 based on this characteristic information registered in the database.

[0041] Furthermore, the CPU 11a of the management server 300 identifies each of the nearby persons 42 displayed on the display unit 217 (see FIG. 5(A)). In addition to acquiring the voice information of each nearby person 42, the CPU 11a identifies each of the nearby persons 42 displayed on the display unit 217. The CPU 11a identifies each of the nearby people 42 based on the image captured by the equipment camera 214 (see FIG. 3).

[0042] Specifically, the CPU 11a identifies each of the nearby people 42 based on the video and face information of the nearby people 42. The CPU 11a acquires a video image captured by the equipment camera 214, showing the surrounding people 42. Then, the CPU 11a identifies each of the surrounding people 42 based on the video image of the surrounding people 42 and the facial information of the surrounding people 42. The CPU 11a identifies each of the surrounding people 42 based on the video image of the surrounding people 42 and the facial information registered in the database.

[0043] Thereafter, the CPU 11a generates control information for associating the utterance content 48 with the nearby person 42 who made the utterance. The CPU 11a generates control information for associating the utterance content 48 with the nearby person 42 displayed on the display unit 217. As described above, the CPU 11a identifies the nearby person 42 who made the utterance and the speech content 48 of this nearby person 42. The CPU 11a also identifies each of the nearby people 42 displayed on the display unit 217 of the device 200. Then, the CPU 11a generates control information for associating the utterance content 48 with the nearby person 42. The CPU 11a generates control information for associating the utterance content 48 with the nearby person 42 displayed on the display unit 217.

[0044] When generating the control information, the CPU 11a generates the control information including position information that is information about the display position of the utterance content 48. The CPU 11a determines the position of the nearby person 42 displayed on the display unit 217 as the display position of the speech content 48. More specifically, the CPU 11a determines the position around the head of the nearby person 42 as the display position of the speech content 48. Then, the CPU 11a generates control information including position information, which is information about the display position. The CPU 11a also includes the identified utterance content 48 in the control information.

[0045] In this embodiment, the control information including the location information and the speech content 48 is transmitted from the management server 300 to the device 200. Then, based on this control information, the CPU 21a (see FIG. 3) of the device 200 controls the display of the display unit 217. As a result, the utterance content 48 is displayed on the display unit 217 at a position specified by the position information. 5(A), for example, is displayed on the display unit 217 of the device 200. In this display, the utterance content 48 is displayed in a state in which the utterance content 48 is associated with the nearby person 42 who made the utterance.

[0046] In this embodiment, as described above, the speech content 48 of the nearby person 42 is displayed on the display unit 217 of the device 200. In this embodiment, when the nearby person 42 speaks, the speech content 48 of the nearby person 42 is displayed on the display unit 217 of the device 200. In this embodiment, when the speech content 48 is displayed, a display image 45 made up of an image showing a speech bubble is displayed. The speech content 48 is displayed inside this display image 45.

[0047] 6(A) to 6(H) are diagrams showing a series of flow of the display process. 6A shows a situation where there is no speech from the nearby person 42, and in this case, the CPU 11a does not acquire voice information. Also, in this case, the CPU 11a does not generate control information for displaying the speech content 48. In this case, the display unit 217 of the device 200 does not display the utterance content 48 .

[0048] 6(B) to 6(H) show the situation after the nearby person 42 starts speaking. In this case, the CPU 11a acquires voice information, and based on this voice information, the CPU 11a acquires the speech content 48. Then, the CPU 11a generates control information for displaying this speech content 48. As a result, as indicated by the reference symbol 13X, the utterance content 48 is displayed on the display unit 217 of the device 200. More specifically, the utterance content 48 is displayed inside the display image 45 displayed on the display unit 217 of the device 200.

[0049] As described above, this speech content 48 is displayed in association with the nearby person 42 who made the speech. As a result, the target person 41 is notified of the utterance content 48 of the nearby person 42. In this embodiment, the process of notifying the target person 41 of the utterance content 48 is performed in this manner.

[0050] There is a time lag between the timing when the voice information is acquired and the timing when the speech content 48 is displayed. The timing at which the audio information is acquired refers to the timing at which the audio information is acquired by the CPU 11a. The timing at which the utterance content 48 is displayed refers to the timing at which the display of the utterance content 48 on the display unit 217 starts. In this embodiment, as indicated by the arrow 14Y, the display of the spoken content 48 starts after the CPU 11a acquires the voice information.

[0051] FIG. 6(F) shows the timing when the speech of the nearby person 42 ends. In this case, as indicated by reference symbol 14P, the display process of the utterance content 48 ends with a delay from this timing in Fig. 6(F). Also, in this case, as indicated by reference symbol 14Z, the utterance content 48 disappears with a delay from this timing in Fig. 6(F). The display process continues even after the speech of the nearby person 42 has ended. The display process continues even after the speech of the nearby person 42 has ended until the last part of the speech content 48 is displayed. When the last part of the utterance content 48 is displayed on the display unit 217, the display process on the display unit 217 ends. This brings about the state indicated by reference numeral 14P. Thereafter, the utterance content 48 disappears as shown in Fig. 14Z.

[0052] [Notification process to nearby people] The CPU 11a identifies a notification status, which is the status of the above notification made to the target person 41. As described above, the target person 41 is notified of the speech content 48 of the nearby person 42. The CPU 11a identifies a notification status, which is the status of this notification made to the target person 41. The CPU 11a identifies a notification status, which is the status of the notification process indicated by reference numeral 6X in FIG. 6, at predetermined time intervals.

[0053] The CPU 11a identifies the notification status at predetermined time intervals based on information transmitted from the device 200 at predetermined time intervals. Information about the status of the notification given to the target person 41 is transmitted from the device 200 to the management server 300. This information is transmitted from the device 200 to the management server 300 at predetermined time intervals. The CPU 11a identifies the notification status based on this information transmitted to the management server 300. The CPU 11a identifies the notification status, which is the status of the notification to be given to the target person 41, based on this information.

[0054] As described above, the target person 41 is notified of the speech of the peripheral person 42. Specifically, the target person 41 is notified of the speech content 48 of the peripheral person 42. The CPU 11a identifies the status of notification of the utterance content 48. The CPU 11a identifies the progress status of notification of the utterance content 48 made to the target person 41 as the notification status. More specifically, the CPU 11a identifies the progress of the display process in the device 200 as this progress.

[0055] The CPU 11a identifies the progress of the display process of the device 200, which is the display process of the speech content 48 of the nearby person 42. Thereafter, the CPU 11a generates control information for notifying the nearby person 42 of the identified progress status. This control information is output to the light-emitting device 500, which is an example of a nearby person reference device. In response to this, a CPU (not shown) provided in the light-emitting device 500 controls the light-emitting device 500 based on this control information.

[0056] The CPU 11a of the management server 300 generates, as the control information, for example, control information for changing the output of the peripheral person reference device. The peripheral person reference device is a device referenced by the peripheral person 42, such as the light-emitting device 500. The CPU 11a generates control information for changing the output of the nearby person reference device in accordance with the notification status of the device 200.

[0057] The CPU 11a generates control information for changing the output of the nearby person reference device when the notification in the device 200 ends. More specifically, the CPU 11a generates control information for changing the brightness of at least a part of the surrounding person reference device. The CPU 11a generates this control information when the notification to the target person 41 ends.

[0058] The CPU 11a generates control information for notifying the nearby person 42 that the display process in the device 200 has ended. In this embodiment, the generated control information is transmitted to, for example, the light-emitting device 500 (see FIG. 5(A)). Based on this control information, lighting of the light-emitting device 500, which is an example of a nearby person reference device, is controlled. As a result, the nearby person 42 can recognize the notification status of the device 200 by referring to the light-emitting device 500.

[0059] 5(A) to 5(C) show a processing example in which the output of a light-emitting device 500, which is an example of a nearby person reference device, is changed. 5(A) shows a situation in which a nearby person 42 designated by reference symbol 5A among the multiple nearby people 42 has started speaking. Also, FIG. 5(A) shows a situation in which a display process of the spoken content 48 has started on the display unit 217.

[0060] In this case, the light-emitting device 500 lights up. When the display unit 217 starts displaying the utterance content 48, the light-emitting device 500 lights up. In this embodiment, most of the light-emitting device 500 is configured to light up, but the light-emitting device 500 may be configured to only partially emit light. 5(A), the CPU 11a generates control information to light up the light-emitting device 500. When the display process is being performed by the device 200, the CPU 11a generates control information to light up the light-emitting device 500. As a result, the light emitting device 500 lights up as shown in FIG. 5(A).

[0061] 5(B) shows a state immediately before the speech of the nearby person 42 indicated by the reference symbol 5A ends. At the timing of FIG. 5(B), the display process is still being performed on the display unit 217 of the device 200. In this case, similarly to the above, the CPU 11a generates control information for causing the light-emitting device 500 to light up. As a result, the light emitting device 500 continues to light up, as shown in FIG. 5(B).

[0062] Fig. 5(C) shows a situation where the display process has been completed on the display unit 217 of the device 200. In the situation shown in Fig. 5(C), the nearby person 42 has also finished speaking. In this case, the CPU 11a generates control information to turn off the light-emitting device 500. When the CPU 11a determines that the display process in the device 200 has ended, it generates this control information. It should be noted that "display processing is completed" refers to a state in which the display of the last part of the acquired utterance content 48 is completed. When control information for turning off the light-emitting device 500 is generated, the light-emitting device 500 turns off. In this case, each of the surrounding people 42 recognizes that the display process of the speech content 48 in the device 200 has ended. In this case, each of the surrounding people 42 recognizes that they may start speaking.

[0063] 7(A) to 7(C) are diagrams showing other processing examples. In this processing example, the output of the individual device 91 is changed depending on the status of the notification given to the target person 41. The "individual device 91" refers to a device that each of the nearby people 42 has. The CPU 11a generates control information for changing the output of the individual device 91 in accordance with the status of the notification given to the target person 41. In this processing example, the CPU 11a generates control information for changing the vibration state of the individual device 91. The individual device 91 is provided with a vibration source (not shown).

[0064] The vibration of the individual device 91 can also notify the nearby people 42 that the display process of the speech content 48 has started or ended. In FIG. 7, the voices of the nearby people 42 are acquired by a microphone (not shown) provided in the individual device 91. Examples of the individual device 91 include a smartphone and a tablet terminal. The smartphone and the tablet terminal are often provided with a vibration source. The individual device 91 may also be a dedicated device for transmitting vibrations to the nearby person 42. In FIG. 7, the individual device 91 is a smartphone.

[0065] FIG. 7(A) shows a situation in which one of the multiple surrounding people 42, designated by reference numeral 7A, has started speaking. In this processing example, in this case, the individual device 91 possessed by each of the nearby people 42 vibrates. In this embodiment, when the display process in the device 200 starts, the individual device 91 starts vibrating. In this processing example, the CPU 11a first identifies that the display process has started in the device 200. Then, in response to this identification, the CPU 11a generates control information for vibrating the individual device 91. As a result, the individual device 91 starts vibrating.

[0066] FIG. 7(B) shows the state immediately before the speech of the nearby person 42 indicated by the reference symbol 7A ends. In this case, similarly to the above, the CPU 11a generates control information for vibrating the individual device 91. As a result, the individual device 91 continues to vibrate. FIG. 7C shows the state where the display process in the device 200 has ended.

[0067] In this case, the CPU 11a generates control information to stop the vibration of the individual device 91. As a result, the vibration of the individual device 91 stops. In this case, each of the nearby people 42 recognizes that the display process in the device 200 has ended. First, each of the nearby people 42 recognizes that the individual device 91 has stopped vibrating. In response to this, each of the nearby people 42 recognizes that the display process has ended.

[0068] Alternatively, the CPU 11a may generate control information that changes the sound output from the sound source. In this case, the CPU 11a generates control information that changes the sound depending on the status of the notification to the target person 41. More specifically, the CPU 11a generates control information that causes the sound source to stop emitting sound when the notification ends, for example. Furthermore, the CPU 11a generates control information for causing a sound to be emitted from a sound source when the notification ends, for example.

[0069] 8(A) to 8(D) are diagrams showing an example of processing when a sound source 93 is used. 8(A) shows a situation in which a nearby person 42 designated by reference symbol 8A among the multiple nearby people 42 has started speaking. Also, FIG. 8(A) shows a situation in which the display of the spoken content 48 on the display unit 217 has started. In this case, the CPU 11a generates control information for starting the output of sound from the sound source 93. As a result, the output of sound from the sound source 93 starts. In this example, a sound such as a typing sound or a clicking sound is output to indicate that information is being input. In this processing example, when the display processing is started in the device 200, a sound is output from the sound source 93.

[0070] The CPU 11a generates control information for causing a predetermined specific sound to be output from the sound source 93. As a result, the predetermined specific sound, such as the above-mentioned typing sound or clicking sound, is output from the sound source 93. In this embodiment, when the display process in the device 200 is started, the sound source 93 starts to output sound.

[0071] FIG. 8(B) shows the state immediately before the speech of the nearby person 42 indicated by the reference symbol 8A ends. In this case as well, the CPU 11a generates control information that causes a predetermined specific sound to be output from the sound source 93. As a result, the sound source 93 continues to output the sound.

[0072] FIG. 8C shows the state where the display process in the device 200 has ended. In this case, the CPU 11a generates control information to mute sound from the sound source 93. As a result, typing sounds and clicking sounds are not output. Furthermore, in this processing example, the CPU 11a generates control information for causing a new sound to be output from the sound source 93. This "new sound" refers to a sound that is different from the sound that was output from the sound source 93 when the display processing in the device 200 was being performed.

[0073] As a result, a new sound indicating that the display process has ended is output, as indicated by reference numeral 8C. After that, as shown in FIG. 8(D), the sound source 93 goes into a silent state. 8(C), each of the nearby persons 42 recognizes that the display process in the device 200 has ended. Also, in the state shown in FIG. 8(D), each of the nearby persons 42 recognizes that the display process in the device 200 has ended.

[0074] Although the above description has been given of a case where two sounds are output, it is also possible to output only one of the two sounds. In the above example, one of two sounds is output during the display process in the device 200. Specifically, the above-mentioned typing sound or clicking sound is output. Furthermore, when the display process in the device 200 ends, the other of the two sounds is output. Specifically, the new sound is output. It is not essential that two sounds are output, and it is also possible to configure the device so that only one of the two sounds is output.

[0075] Additionally, the CPU 11a may generate control information that causes information indicating that speech is permitted to be output. Hereinafter, in this specification, this information indicating that speech is permitted will be referred to as "speech permission information." In this case, the CPU 11a generates control information for causing the speech permission information to be output from the nearby person reference device upon completion of the notification process. The peripheral person reference device refers to a device that is referenced by the peripheral person 42. Examples of peripheral person reference devices include the above-mentioned light-emitting device 500, a smartphone, a tablet terminal, and a PC (Personal Computer). Another example of a peripheral person reference device is the above-mentioned device 200 worn by the subject person 41.

[0076] The device 200 may be worn not only by the subject person 41 but also by a peripheral person 42. Therefore, the device 200 also corresponds to a peripheral person reference device, which is a device that is referenced by the peripheral person 42. In the following description, a case where speech permission information is displayed on device 200 worn by nearby person 42 will be described as an example. The speech permission information may be displayed not only on the device 200 but also on a smartphone, a tablet terminal, a PC, or the like.

[0077] Here, the device 200, the smartphone, the tablet terminal, the PC, etc. can also be regarded as an individual device. An individual device refers to a device that each of the nearby people 42 has. The above-mentioned notification to nearby person 42 using vibration can be said to be an example of notification using an individual device. Other examples of individual devices include wristwatch-type devices, ring-type devices, etc. Even wristwatch-type devices and ring-type devices can provide notifications using light, vibration, and sound as described above.

[0078] 9(A) to 9(C) are diagrams showing an example of processing when speech permission information is output. FIG. 9(A) shows a situation in which one of the multiple surrounding people 42, designated by reference numeral 9A, has started speaking. In this processing example, at this time, "Speaking" is displayed on the device 200 worn by the nearby person 42. Information indicating that display processing of the speech content 48 is being performed is displayed on the device 200.

[0079] 9(B) shows the state immediately before the speech of the nearby person 42 indicated by the reference symbol 9A ends. In this case, as in the above, "Speaking" is displayed on the device 200 worn by the nearby person 42. In this case as well, the device 200 displays information indicating that the display processing of the utterance content 48 is being performed.

[0080] FIG. 9(C) shows a state in which the display process in the device 200 worn by the subject person 41 has been completed. When the display process on the device 200 worn by the target person 41 is completed, the display of "talking" disappears. The display of "talking" displayed on the device 200 worn by the nearby person 42 disappears. As a result, in this case too, the nearby person 42 is notified that the notification process for the utterance content 48 has been completed. Furthermore, in this processing example, text information saying "Speech permitted" is displayed as shown in Fig. 9(C) In other words, in this processing example, speech permission information is displayed.

[0081] In this example, control information is generated to change the content of the display on device 200 worn by nearby person 42. In this processing example, the control information changes the display on display unit 217 of device 200 worn by nearby person 42. In this embodiment, the state changes from one in which the phrase "talking" is displayed to one in which this phrase is erased. Also, the state where the speech permission information "Speech allowed" is not displayed changes to a state where this speech permission information is displayed. In this processing example, when the state shown in FIG. 9(C) is reached, the nearby person 42 recognizes that it is time for him or her to speak.

[0082] Here, the case where speech permission information is notified to nearby person 42 through text information has been described. However, the manner of notifying speech permission information is not limited to this. A sound corresponding to the speech permission information may be output from sound source 93 (see FIG. 8). An example of the "sound corresponding to the utterance enablement information" is the sound obtained by reading out text information. Specifically, an example is the sound obtained by reading out the text information "utterance enablement." Furthermore, the "sound corresponding to the utterable information" may be a sound other than the sound obtained by reading out text information, such as a chime sound.

[0083] [Notification process for each speaker] The CPU 11a may further generate control information for varying the notification mode when the notification status is notified to the nearby people 42. More specifically, the CPU 11a may generate control information for varying the notification mode for each speaker. In this embodiment, the target person 41 is notified of the utterance content 48 of the speaker who made the utterance among the surrounding people 42. In this embodiment, the target person 41 is notified of the utterance content 48 for each speaker.

[0084] In this embodiment, the CPU 11a identifies the notification status for each speaker. The CPU 11a identifies the notification status for each speaker regarding the utterance content 48 of the speaker. The CPU 11a makes the notification mode different for each speaker when this notification status specified for each speaker is notified to the nearby people 42. The CPU 11a generates control information that makes this notification mode different for each speaker. Specifically, the CPU 11a generates control information for causing the light-emitting device 500 to emit a different light color for each speaker. The light-emitting device 500 is a device used for notifying the notification status.

[0085] The CPU 11a generates control information for changing the light-emitting color of the light-emitting device 500 used for this notification of the notification status. Specifically, the CPU 11a generates control information for changing the light-emitting color for each speaker. In this case, the color of the light emitted from the light-emitting device 500 is changed every time a different speaker is heard. In this case, the surrounding person 42 can identify the person's utterance content 48 that is being notified to the target person 41. In addition, in this case, the surrounding person 42 can identify the speaker about whom the notification being sent to him or her is made.

[0086] The notification mode may be changed in a manner other than by changing the luminescent color. For example, the light emitting pattern of the light emitting device 500 may be different for each speaker. Alternatively, the sound output from the sound source 93 may be different for each speaker. Alternatively, for example, the vibration mode of the vibration source may be varied for each speaker. Furthermore, each time a different speaker is present, new information about the speaker may be displayed on the subject-reference device or individual device.

[0087] [Notification regarding speech by registered nearby persons] In this embodiment, notification regarding speech of a registered peripheral person 42 who is a peripheral person 42 registered in advance is made to the target person 41. In this embodiment, notification regarding speech of a non-registered person who is other than the registered peripheral person 42 is not made to the target person 41. In this embodiment, non-registered persons are not registered in the database, and furthermore, non-registered persons do not have individual microphones 600 .

[0088] It is also possible that the voice information of an unregistered person is acquired by the individual microphone 600 of the registered nearby person 42. In this case, the sound pressure of the voice information of the unregistered person will be low, and this voice information will not be transmitted to the management server 300. It is also possible that voice information of an unregistered person is acquired by the individual microphone 600 of the registered nearby person 42. However, in this case, this voice information is not transmitted to the management server 300.

[0089] In this case, the CPU 11a identifies the notification status regarding the utterance of the registered nearby person 42 as the notification status. The CPU 11a identifies the status of the notification regarding the speech of the registered nearby person 42 and given to the target person 41 as the notification status. The notification of the utterance of the unregistered person is not made to the target person 41. In this case, the CPU 11a does not specify the notification status of the utterance of the unregistered person as the notification status.

[0090] In this case, the CPU 11a generates control information for notifying the notification status regarding the speech of the registered peripheral person 42. The CPU 11a generates control information for notifying the peripheral person 42 of the notification status regarding the registered peripheral person 42. The CPU 11a does not generate control information for notifying the notification status of the notification regarding the speech of the unregistered person. The CPU 11a does not generate control information for notifying the nearby person 42 of the notification status of the unregistered person.

[0091] 〔others〕 The above notifications may be combined. The above describes a case where each of the light-emitting device 500 emits light, the vibration source vibrates, the sound source 93 outputs sound, and the speech permission information is displayed individually. The above describes a case where multiple types of notifications are performed individually. The mode of notification is not limited to this, and two or more types of notifications out of the multiple types of notifications may be sent to nearby person 42. Alternatively, the notification to the nearby person 42 may be made via the device 200 worn by the subject person 41. For example, the notification to the nearby person 42 may be made by varying the output of a light source (not shown) provided on the outer surface of the device 200.

[0092] In the above description, the case where the start and end of notification of the speech content 48 are notified to the nearby person 42 has been described. In addition, the surrounding person 42 may be notified of a situation where notification itself cannot be performed or the quality of notification is degraded. In other words, the surrounding person 42 may be notified of a situation where a problem occurs in notification to the target person 41. Due to a malfunction of the device 200 worn by the subject person 41, a situation may arise in which notification itself cannot be performed or the quality of notification may be reduced. A situation in which notification itself cannot be performed or a situation in which the quality of notification is degraded may be notified to the surrounding person 42. In other words, a situation in which a problem occurs in notification to the target person 41 may be notified to the surrounding person 42.

[0093] It is assumed that a situation occurs in which a problem occurs in the notification to a target person 41, and a nearby person 42 is notified of this situation. In this case, in a situation where a problem occurs in the notification to the target person 41, the nearby person 42 is less likely to make a speech. When notifying the target person 41 of a situation where a problem has occurred in notification, the light-emitting device 500 is illuminated in the same manner as described above. Alternatively, the vibration source is vibrated, sound is output from the sound source 93, or information is displayed.

[0094] Specifically, for example, the light-emitting device 500 is caused to blink, or the light-emitting device 500 is caused to emit light in a predetermined specific color, such as red. Also, for example, the vibration of the vibration source is increased compared to when the above-mentioned problem does not occur. Also, for example, a sound source 93 outputs a sound indicating that a problem will occur. Also, for example, information indicating that a malfunction will occur is displayed on the display unit 217 of the device 200. Additionally, two or more types of notifications may be sent to nearby people 42 in the same manner as above.

[0095] In the above description, the management server 300, which is an example of an information processing system, identifies the notification status and generates the control information. The processes of identifying the notification status and generating the control information may be realized by one device such as one management server 300. Furthermore, the processes of identifying the notification status and generating the control information may be realized by multiple devices. The information processing system may be configured by a single device or may be configured by multiple devices.

[0096] (Addendum) (((1))) a processor; The processor: Identifying a notification situation, which is a situation of a notification regarding an utterance of a person nearby the target person and is made to the target person; generating control information for notifying the nearby person of the identified notification status; Information processing system. (((2))) The processor: As the notification status, a progress status of the notification to the target person is identified; generating, as the control information, control information for notifying the nearby person of the progress status; The information processing system according to (((1))). (((3))) The processor: As the progress status, a display process of the speech content, which is the content of the speech of the surrounding person, is identified, and the progress status of the display process is identified in a subject reference device, which is a device referenced by the subject; generating, as the control information, control information for notifying the nearby person of a progress status of the display process in the subject reference device; The information processing system according to (((2))). (((4))) The processor: generating, as the control information, control information for notifying the nearby person that the display process in the subject reference device has been completed; The information processing system according to (((3))). (((5))) The processor: As the control information, control information is generated that changes an output of a peripheral person reference device that is a device referenced by the peripheral person according to the notification status. An information processing system according to any one of ((1))) to ((4))). (((6))) The processor: As the control information, control information is generated that changes the output of the nearby person reference device upon completion of the notification given to the target person. The information processing system according to (((5))). (((7))) The processor: As the control information, control information is generated that changes brightness of at least a part of the nearby person reference device upon completion of the notification to the target person. The information processing system according to (((6))). (((8))) The target person is notified of the content of the speech of the surrounding person, and a notification process of the content of the speech to the target person is performed; The processor: and further generating control information for causing the nearby person reference device to output information indicating that speech is possible upon completion of the notification process. The information processing system according to (((5))) or (((6))). (((9))) The processor: generating, as the control information, control information that changes the sound output from a sound source depending on the status of the notification given to the target person; An information processing system according to any one of ((1))) to (((8))). (((10))) The processor: As the control information, generate control information that stops sound from being emitted from the sound source upon completion of the notification given to the target person, or generate control information that causes sound to be emitted from the sound source upon completion of the notification. The information processing system according to (((9))). (((11))) The target person is notified of the content of the speech of the surrounding person, and a notification process of the content of the speech to the target person is performed; The processor: and further generating control information for causing the sound source to output a sound corresponding to information indicating that speech is possible upon completion of the notification process. The information processing system according to (((9))). (((12))) The processor: As the control information, control information is generated that allows each of the peripheral people to be notified of the notification status through an individual device that is a device owned by each of the peripheral people. An information processing system according to any one of ((1))) to (((11))). (((13))) The processor: generating, as the control information, control information that changes a vibration state of the individual device depending on a status of the notification to be given to the target person; The information processing system according to (((12))). (((14))) The processor: generating, as the control information, control information that changes the content of the display on the individual device depending on the status of the notification given to the target person; The information processing system according to (((12))) or (((13))). (((15))) The target person is notified of the content of the speech of the surrounding person, and a notification process of the content of the speech to the target person is performed; The processor: and further generating control information for causing information indicating that speech is possible to be displayed on the individual device upon completion of the notification process. The information processing system according to (((14))). (((16))) The target person is notified of the content of the utterance made by the speaker who is one of the surrounding people who made the utterance, The processor: As the notification status, a notification status of the speech content of each speaker is identified; Further, control information is generated so that a notification mode when the notification status specified for each speaker is notified to the nearby people varies for each speaker. An information processing system according to any one of (((1))) to (((15))). (((17))) A notification regarding speech by a registered peripheral person who is a peripheral person registered in advance among the peripheral people is given to the target person, and a notification regarding speech by a non-registered person who is a person other than the registered peripheral person is not given to the target person, The processor: As the notification status, a notification status is identified which is a status of the notification regarding the speech of the registered nearby person and is made to the target person; As the control information, control information is generated that allows the notification status of the notification regarding the utterance of the registered nearby person to be notified to the nearby person. An information processing system according to any one of ((1))) to (((16))). (((18))) A specifying function for specifying a notification status, which is a status of a notification regarding an utterance of a person nearby who is a person nearby the target person and is made to the target person; a generation function for generating control information for notifying the nearby person of the identified notification status; A program to make the above happen on a computer.

[0097] According to the information processing system relating to (((1))), it is possible to enable the surrounding people to know the status of notifications regarding the speech of the surrounding people who are located around the target person and are sent to the target person. According to the information processing system of (((2))), it is possible to notify people around the target person of the progress of the notification being made to the target person. According to the information processing system of (((3))), it is possible to notify nearby people of the progress of the display process in the subject-reference device referenced by the subject. According to the information processing system of (((4))), it is possible to notify nearby people that the display process in the subject reference device has been completed. According to the information processing system of (((5))), it is possible to change the output of the nearby person reference device, which is a device that is referenced by the nearby person, depending on the notification situation. According to the information processing system of (((6))), it is possible to change the output of the nearby person reference device upon completion of the notification given to the target person. According to the information processing system of (((7))), it is possible to notify surrounding people that a notification to the target person has ended by utilizing a change in the brightness of at least a part of the surrounding person reference device. According to the information processing system of (((8))), it is possible to notify people nearby that it is possible to speak. According to the information processing system of (((9))), it is possible to use sound to notify people around the target person of the status of the notification being made to the target person. According to the information processing system of (((10))), it is possible to use sound to notify people nearby that a notification to a target person has been completed. According to the information processing device of (((11))), it is possible to notify people nearby that it is possible to speak. According to the information processing device of (((12))), it is possible to individually notify each of the nearby people of the status of the notification being made to the target person. According to the information processing device of (((13))), it is possible to notify nearby people of the status of a notification being made to a target person by using vibrations of individual devices. According to the information processing system of (((14))), it is possible to inform nearby people of the status of notifications being sent to the target person through displays on individual devices. According to the information processing system of (((15))), it is possible to inform nearby people that it is possible to speak through a display on an individual device. According to the information processing system of (((16))), it is possible to notify the surrounding people of the speech of which surrounding people the target person has been notified. According to the information processing system of (((17))), it is possible to notify nearby people of the status of notifications regarding speech by nearby people who have been registered in advance. According to the program (((18))), it is possible to enable the surrounding people to know the status of notifications regarding the speech of the surrounding people who are located around the target person and are sent to the target person. [Explanation of symbols]

[0098] 1...notification system, 11a...CPU, 41...target person, 42...surrounding person, 91...individual device, 93...sound source, 200...device, 300...management server, 500...light-emitting device

Claims

1. a processor; The processor: Identifying a notification situation, which is a situation of a notification regarding an utterance of a person nearby the target person and is made to the target person; generating control information for notifying the nearby person of the identified notification status; Information processing system.

2. The processor: As the notification status, a progress status of the notification to the target person is identified; generating, as the control information, control information for notifying the nearby person of the progress status; The information processing system according to claim 1 .

3. The processor: As the progress status, a display process of the speech content, which is the content of the speech of the surrounding person, is identified, and the progress status of the display process is identified in a subject reference device, which is a device referenced by the subject; generating, as the control information, control information for notifying the nearby person of a progress status of the display process in the subject reference device; The information processing system according to claim 2 .

4. The processor: generating, as the control information, control information for notifying the nearby person that the display process in the subject reference device has been completed; The information processing system according to claim 3 .

5. The processor: As the control information, control information is generated that changes an output of a peripheral person reference device that is a device referenced by the peripheral person according to the notification status. The information processing system according to claim 1 .

6. The processor: As the control information, control information is generated that changes the output of the nearby person reference device upon completion of the notification given to the target person. The information processing system according to claim 5 .

7. The processor: As the control information, control information is generated that changes brightness of at least a part of the nearby person reference device upon completion of the notification to the target person. The information processing system according to claim 6.

8. The target person is notified of the content of the speech of the surrounding person, and a notification process of the content of the speech to the target person is performed; The processor: and further generating control information for causing the nearby person reference device to output information indicating that speech is possible upon completion of the notification process. The information processing system according to claim 5 .

9. The processor: generating, as the control information, control information that changes the sound output from a sound source depending on the status of the notification given to the target person; The information processing system according to claim 1 .

10. The processor: As the control information, generate control information that stops sound from being emitted from the sound source upon completion of the notification given to the target person, or generate control information that causes sound to be emitted from the sound source upon completion of the notification. The information processing system according to claim 9 .

11. The target person is notified of the content of the speech of the surrounding person, and a notification process of the content of the speech to the target person is performed; The processor: and further generating control information for causing the sound source to output a sound corresponding to information indicating that speech is possible upon completion of the notification process. The information processing system according to claim 9 .

12. The processor: As the control information, control information is generated that allows each of the peripheral people to be notified of the notification status through an individual device that is a device owned by each of the peripheral people. The information processing system according to claim 1 .

13. The processor: generating, as the control information, control information that changes a vibration state of the individual device depending on a status of the notification to be given to the target person; The information processing system according to claim 12.

14. The processor: generating, as the control information, control information that changes the content of the display on the individual device depending on the status of the notification given to the target person; The information processing system according to claim 12.

15. The target person is notified of the content of the speech of the surrounding person, and a notification process of the content of the speech to the target person is performed; The processor: and further generating control information for causing information indicating that speech is possible to be displayed on the individual device upon completion of the notification process. The information processing system according to claim 14.

16. The target person is notified of the content of the utterance made by the speaker who is one of the surrounding people who made the utterance, The processor: As the notification status, a notification status of the speech content of each speaker is identified; Further, control information is generated so that a notification mode when the notification status specified for each speaker is notified to the nearby people varies for each speaker. The information processing system according to claim 1 .

17. A notification regarding speech by a registered peripheral person who is a peripheral person registered in advance among the peripheral people is given to the target person, and a notification regarding speech by a non-registered person who is a person other than the registered peripheral person is not given to the target person, The processor: As the notification status, a notification status is identified which is a status of the notification regarding the speech of the registered nearby person and is made to the target person; As the control information, control information is generated that allows the notification status of the notification regarding the utterance of the registered nearby person to be notified to the nearby person. The information processing system according to claim 1 .

18. A specifying function for specifying a notification status, which is a status of a notification regarding an utterance of a person nearby who is a person nearby the target person and is made to the target person; a generation function for generating control information for notifying the nearby person of the identified notification status; A program to make the above happen on a computer.

Images