Management system, management method and management program

The management system addresses the inability of conventional communication systems to gather environmental information during events by using beacons, mobile terminals, and AI evaluation, resulting in efficient and automated harassment evaluation reports.

JP7663283B1Active Publication Date: 2025-04-16MOYAI CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024214998
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-12-09
Publication Date
2025-04-16
Estimated Expiration
2044-12-09

AI Technical Summary

Technical Problem

Conventional communication systems are unable to obtain information about the surrounding environment of a person at the time of an event.

Method used

A management system that includes a beacon emitting radio waves, a mobile terminal capable of receiving these radio waves and transmitting event information, a remote communication unit, and a remote server with an evaluation unit. The system detects environmental information using images or voices and outputs an evaluation report through artificial intelligence based on event and environmental information.

Benefits of technology

Enables the automatic output of an evaluation report with an appropriate evaluation, allowing for the acquisition of information about the user's surrounding environment when an event occurs, thereby reducing the burden on employees and managers in reporting and evaluating harassment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007663283000001_ABST
    Figure 0007663283000001_ABST
Patent Text Reader

Abstract

A management system, a management method, and a management program are provided that are capable of obtaining information about the user's surrounding environment when an event occurs. [Solution] The management system 100 includes a monitoring device 10 having a beacon 11 that emits radio waves including a beacon identifier bi, installed in a monitored space S, and detecting environmental information In, a mobile terminal 20 capable of transmitting event information Iv including a mobile terminal identifier mi and a beacon identifier bi, and a remote server 30 capable of receiving the event information Iv via a communication network N and outputting an evaluation report R. The event information Iv includes an event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. The remote server 30 receives environmental information Iv before and after the event occurrence time T from the monitoring device 10, and outputs an evaluation report R through artificial intelligence AI based on the event information Iv and the environmental information In.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a management system, a management method, and a management program. [Background technology]

[0002] Conventionally, there has been a communication system that detects the position of a person carrying a wireless terminal (for example, Patent Document 1).

[0003] In the conventional communication system, a wireless terminal is connected to a base station via a network, and an information processing device is connected to the base station via a short-range wireless communication to track a person's behavior based on the position information of the wireless terminal. Therefore, the conventional communication system is not capable of obtaining information about the surrounding environment of a person when an event occurs. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2007-150435 A Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a management system, a management method, and a management program that are capable of obtaining information about the user's surrounding environment when an event occurs. [Means for solving the problem]

[0006] (1) A management system according to one embodiment of the present invention includes a monitoring device having a beacon that emits radio waves including a beacon identifier, installed in a monitored space, and detecting environmental information through images or audio; a mobile terminal that can receive the radio waves and transmit event information including a mobile terminal identifier and the beacon identifier; a remote server having a remote communication unit that can receive the event information via a communication network, and an evaluation unit that outputs an evaluation report, wherein the event information includes a time of event occurrence detected by the monitoring device or the mobile terminal, and the evaluation unit receives the environmental information before and after the time of event occurrence from the monitoring device, and outputs the evaluation report through artificial intelligence based on the event information and the environmental information. (2) In (1) above, the event information is that the mobile device has detected a user command, and the environmental information is voice before and after the time the event occurred, and the remote server may input a predefined prompt and text converted based on the voice to a large-scale language processing model connected to the communications network to generate a harassment evaluation. (3) In the above (2), the remote server may input a summary sentence that summarizes the text to the large-scale language processing model. (4) A management method according to one aspect of the present invention includes a detection step of detecting environmental information in a monitored space based on images or sounds by a monitoring device installed in the monitored space and having a beacon that emits radio waves including a beacon identifier, a transmission step of transmitting event information including a mobile terminal identifier and the beacon identifier by a mobile terminal capable of receiving the radio waves, a reception step of receiving the event information by a remote server via a communication network, and an evaluation output step of outputting an evaluation report by the remote server, wherein the event information includes a time of event occurrence detected by the monitoring device or the mobile terminal, and in the evaluation output step, the remote server receives the environmental information before and after the time of event occurrence from the monitoring device, and outputs the evaluation report through artificial intelligence based on the event information and the environmental information. (5) A management program according to one embodiment of the present invention is a management program that causes a computer to execute a detection function for detecting environmental information in the form of images or sounds in a monitored space using a monitoring device that is installed in the monitored space and has a beacon that emits radio waves including a beacon identifier, a transmission function for transmitting event information including a mobile terminal identifier and the beacon identifier using a mobile terminal that can receive the radio waves, a reception function for receiving the event information via a remote server via a communication network, and an evaluation output function for outputting an evaluation report by the remote server, wherein the event information includes a time of event occurrence detected by the monitoring device or the mobile terminal, and the evaluation output function causes the remote server to receive the environmental information before and after the time of event occurrence from the monitoring device, and outputs the evaluation report through artificial intelligence based on the event information and the environmental information. Effect of the Invention

[0007] According to the present invention, it is possible to provide a management system, a management method, and a management program capable of obtaining information about the user's surrounding environment when an event occurs. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an overview of a management system applied to a business establishment. [Diagram 2] FIG. 2 is a functional diagram of the management system. [Diagram 3] FIG. 13 illustrates an example of a prompt. [Figure 4] FIG. 13 is a diagram showing an example of text. [Diagram 5] 13A to 13C are diagrams showing examples of summary sentences, harassment words, and types of harassment in an evaluation report. [Figure 6] FIG. 13 is a diagram showing an example of a harassment evaluation in an evaluation report. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] (Embodiment) Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Fig. 1 is a schematic diagram of the management system 100. Fig. 2 is a functional diagram of the management system 100. Note that, hereinafter, parts having common functions may be given the same reference numerals or symbols.

[0010] The management system 100 according to the embodiment can be used for the purpose of grasping and automatically evaluating suspected acts of harassment when they are experienced, seen, or heard in a room space in a business establishment (office, store, workshop, etc.) where multiple employees work. Conventionally, when an employee is subjected to power harassment by a manager in a business establishment, for example, the employee needs to create a document explaining the situation and submit it to the human resources department, and the human resources department needs to interview the employee based on the document and evaluate the presence or absence of harassment or the severity of the harassment. Therefore, the burden on the employee associated with the harassment report and the burden on the manager associated with the evaluation or certification of harassment were large. For this reason, the conventional business establishment was an environment where people hesitated to report harassment. Therefore, according to the management system 100 described below, a harassment evaluation report can be automatically output by simply pressing a button on an app on a mobile device owned by the user, so that both the burden on the employee associated with the harassment report and the burden on the manager associated with the certification of the harassment can be reduced.

[0011] As shown in Figures 1 and 2, a management system 100 according to an embodiment includes a monitoring device 10 having a beacon 11 that emits radio waves including a beacon identifier bi, which is installed in a monitored space S and detects environmental information Iv in the form of images or audio, a mobile terminal 20 that can receive radio waves and transmit event information Iv including a mobile terminal identifier mi and a beacon identifier bi, and a remote server 30 that can receive the event information Iv via a communication network N and output an evaluation report R.

[0012] The communication network N may be, for example, a public line such as the Internet, a VPN, or a dedicated line provided by a carrier. Information from the mobile terminal 20 is transmitted to the remote server 30 through the communication network N. Information from the remote server 30 is transmitted to the mobile terminal 20 through the communication network N. Information from the monitoring device 10 is transmitted to the remote server 30 through the communication network N. Information from the remote server 30 is transmitted to the monitoring device 10 through the communication network N.

[0013] The management system 100 according to the embodiment includes a monitoring device 10 installed in a monitored space S, and has a beacon 11 that emits radio waves including a beacon identifier bi.

[0014] The monitoring device 10 may include a monitoring communication device 14 that is connected to a communication network N and has a function of transmitting and receiving information between the monitoring device 10 and the outside. The monitoring device 10 may include a GPS receiver 15 that appropriately acquires location information of the monitoring device 10 from a satellite.

[0015] The monitoring device 10 detects environmental information In by an image (still image or video) or sound using a device corresponding to the physical phenomenon to be detected. The environmental information In is information representing the surrounding environment of a person (user) and may be information representing a person's senses such as vision and hearing in the monitored space S, and may be information representing a thermal environment such as temperature and humidity, or acceleration such as shock or vibration. The monitoring device 10 may detect an image of the monitored space S captured by a camera 12 attached to the monitoring device 10 as the environmental information In. The monitoring device 10 may detect sound in the monitored space S as the environmental information In by a microphone 16 attached to the monitoring device 10. The environmental information In may be acceleration acting on the monitoring device 10 measured by an acceleration sensor. The positions at which the devices such as the camera 12 and the microphone 16 are arranged may be separated from the positions at which the beacon 11 is arranged.

[0016] The management system 100 includes a mobile terminal 20 having a transceiver 22 capable of receiving radio waves from a beacon 11 and transmitting event information Iv including a mobile terminal identifier mi and a beacon identifier bi to a remote server 30.

[0017] The mobile terminal 20 is a communication device carried by a user (employee). The mobile terminal 20 is configured to receive signals transmitted from the beacon 11 at a transceiver 22. The mobile terminal 20 has wireless communication functions such as Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile phone network, and Internet connection. The mobile terminal 20 may be a smartphone or tablet capable of using various applications. The mobile terminal 20 may have a mobile camera.

[0018] The mobile terminal 20 may include a mobile display 21. The mobile display 21 may be capable of displaying a screen controlled by the notification application 23. The mobile display 21 may be a so-called graphic interface (GUI) that serves both as a display output and an input interface.

[0019] The mobile terminal 20 may be capable of acquiring location information of the mobile terminal 20. The mobile terminal 20 may acquire the location information by a location information detection function such as a GPS function provided in the mobile terminal 20. The mobile terminal 20 may acquire the location information not only by the GPS function but also by comprehensively grasping information of Wi-Fi (registered trademark), BLE, and antenna base station.

[0020] It is preferable that the mobile terminal 20 has installed therein a notification application 23. As shown in Fig. 1, the notification application 23 displays a virtual button 23b, text, or the like on the mobile display 21 of the mobile terminal 20. The virtual button 23b is displayed on the mobile display 21 by the notification application 23 to receive a notification command from the user.

[0021] The notification application 23 displays a virtual button 23b on the mobile display 21 of the mobile terminal 20 based on a user's operation of the mobile terminal 20. When the virtual button 23b is pressed (clicked), the notification application 23 accepts the operation as a notification command and causes the transmission / reception unit 22 mounted on the mobile terminal 20 to transmit the event information Iv to the remote server 30 via the communication network N.

[0022] The event information Iv is that the mobile terminal 20 has detected a user command. The event information Iv includes information on the event occurrence time T, that is, the time when the user presses the virtual button 23b. In this case, if the mobile terminal 20 receives the beacon identifier bi of the beacon 11, the notification application 23 causes the mobile terminal 20 to transmit the event information Iv to the remote server 30 together with the beacon identifier bi. If the mobile terminal 20 receives the beacon identifiers bi of multiple beacons 11, the notification application 23 may cause the mobile terminal 20 to transmit the beacon identifiers bi associated with the radio wave intensities of the respective beacons 11 together with the event information Iv to the remote server 30. The event information Iv may include location information of the mobile terminal 20 acquired by a location information detection function such as a GPS function provided in the mobile terminal 20. This allows the remote server 30 to check the location of the mobile terminal 20 within the business establishment, so that the event occurrence time T and the location, etc. can be identified when a user (employee) is subjected to harassment, etc.

[0023] The management system 100 includes a remote communication unit 32 capable of receiving event information Iv from the mobile terminal 20 via a communication network N, and a remote server 30 having an evaluation unit 35 that inputs the event information Iv and outputs an evaluation report R.

[0024] The event information Iv includes the event occurrence time T detected by the monitoring device 10 or the mobile terminal 20.

[0025] The event information Iv may include a value X indicating that a button has been pressed on the mobile terminal 20 (for example, an action on a virtual button 23b on a notification application 23 (GUI) preinstalled on the mobile terminal 20 by a user who owns the mobile terminal 20), and a value corresponding to the acceleration α of the monitoring device 10 or a value Y indicating that the acceleration α has exceeded a threshold. The event information Iv may be, for example, a combination of the value X and the event occurrence time T, or a combination of the value Y and the event occurrence time T.

[0026] The remote server 30 is a computer system that performs data processing. The remote server 30 includes a CPU, memories such as a RAM, a ROM, and an auxiliary storage device, an external connection interface with an input / output device, a network interface, and a bus connecting them. The remote server 30 may be provided as a so-called cloud service.

[0027] The remote server 30 has a memory unit 31 that stores relative position information RI that links a beacon identifier bi with a monitored space S. The monitored space S is a specific position in a specific space. The relative position information RI is specific position information in a specific space. The relative position information RI may be expressed in coordinates. The monitored space S is, for example, a part of a business establishment, such as the northwest office of a Tokyo office of a company with multiple business establishments, as shown in FIG. 1. In other words, the relative position information RI indicates which monitored space S a specific beacon 11 (specific beacon identifier bi) is installed for, at which position in which business establishment.

[0028] The remote server 30 is a computer system that performs data processing. The remote server 30 includes a CPU, memories such as a RAM, a ROM, and an auxiliary storage device, an external connection interface with an input / output device, a network interface, and a bus connecting them.

[0029] The remote server 30 includes a storage unit 31 that stores data transmitted from the mobile terminal 20 in association with the beacon identifier bi, a remote communication unit 32 that enables communication with the mobile terminal 20 and the monitoring device 10 installed near the monitored space S, and a control unit 33 that controls the remote server 30. The function of the control unit 33 may be provided in the monitoring device 10, or may be shared between the remote server 30 or the monitoring device 10. The remote server 30 may include a remote display 34 that can display the contents of communication with the user (text chat, audio, video, etc.), images captured by the camera 12, or images displayed by the monitoring display 13.

[0030] The storage unit 31 stores a program for causing the remote server 30 to execute the management method according to this embodiment.

[0031] The storage unit 31 has relative location information RI, which is a list of information indicating the relationship between the identifier bi of the beacon 11 and the location where the beacon 11 is installed. For example, when a first beacon 111 having a first identifier bi1, a second beacon 112 having a second identifier bi2, and a third beacon 113 having a third identifier bi3 are installed in the northwestern part of an office in the Tokyo office, the southeastern part of the Tokyo office, and the southwestern part of the Tokyo office, the relative location information RI indicates a pair of the beacon identifier bi of the beacon 11 and the location where the beacon 11 is installed, such as the northeastern part of the Tokyo office and the first identifier bi1, the southeastern part of the Tokyo office and the second identifier bi2, and the southwestern part of the Tokyo office and the third identifier bi3.

[0032] The remote communication unit 32 has a communication function through a communication network N such as a mobile phone network, an Internet connection, or the like.

[0033] The control unit 33 specifies the location of the mobile terminal 20 (the location of the user who carries the mobile terminal 20) based on the beacon identifier bi received from the mobile terminal 20 and the relative position information RI stored in the storage unit 31. The control unit 33 may specify the location of the mobile terminal 20 by appropriately referring to position information transmitted from the mobile terminal 20 using a GPS function or the like.

[0034] The remote server 30 may output an image (or video) captured by the camera 12 at the designated beacon reception time t1. That is, the control unit 33 of the remote server 30 appropriately displays an image captured by the camera 12 at the designated beacon reception time t1 of the specified monitored space S on the remote display 34. This allows the monitored space S at the location and time where the mobile terminal 20 was located to be confirmed. Furthermore, the administrator of the remote server 30 can confirm the location of the user who reported the occurrence of the event (where the harassment occurred) based on the information displayed on the remote display 34. Therefore, according to the management system 100, the location of the mobile terminal 20 and its surrounding environment when the event occurred can be grasped. Furthermore, according to the management system 100, the event can be detected substantially in real time, and the location where the event occurred can be identified.

[0035] Here, the remote server 30 receives the environmental information In before and after the event occurrence time T from the monitoring device 10, and outputs the evaluation report R through the artificial intelligence AI based on the event information Iv and the environmental information In. The remote server 30 may receive the environmental information In directly from the monitoring device 10, or may receive it indirectly from the monitoring device 10 through the mobile terminal 20. The management system 100 can acquire the event information Iv from the mobile terminal 20 and the environmental information In from the monitoring device, and output the evaluation report R after taking into account not only the user information at the event occurrence time T, but also the user's surrounding environment (information related to the monitored space S) at the event occurrence time T. Therefore, the management system 100 can automatically output the evaluation report R in which an appropriate evaluation has been made by the artificial intelligence AI. Therefore, the management system 100 can obtain information about the user's surrounding environment at the time of the event occurrence.

[0036] Specifically, the event information Iv may be the detection of a user command by the mobile terminal 20, in other words, the user pressing the virtual button 23b on the notification application 23 (or GUI) preinstalled in the mobile terminal 20. The environmental information In may be a voice before and after the event occurrence time T. The evaluation unit 35 may input a text TX (conversational text) converted based on a predefined prompt P and voice to a large-scale language processing model LLM (sub-concept of artificial intelligence AI; sub-concept of generation AI) connected to the communication network N to generate a harassment evaluation (evaluation report R). In this way, the management system 100 can automatically output an evaluation report R in which an appropriate evaluation has been made by the artificial intelligence AI based on the voice in the monitored space S before and after the event occurrence time T.

[0037] The artificial intelligence AI may be a machine learning model or a large-scale language model.

[0038] In detail, the evaluation unit 35 inputs a summary sentence TXa that summarizes the text TX to the large-scale language processing model LLM. This makes it possible to contribute to an appropriate evaluation without being influenced by noise, as compared with the case where the speech before summary is directly input to the large-scale language processing model LLM, and also makes it possible to reduce the amount of calculation and shorten the time until output. Therefore, the evaluation by the output evaluation report R can be made more appropriate.

[0039] (Management method) Hereinafter, an example of the management method according to the present embodiment will be described, assuming a case where a user A (possessor of a mobile terminal 20) is subjected to harassment by a user B (whether or not the user is a possessor of a mobile terminal 20) in a monitored space S of a business establishment where the user A is present. The management method may be implemented on the premise that the management system 100 is implemented. In the following description of the management method, when the subject is omitted, the subject of the operation is the management system 100. Hereinafter, it is assumed that a monitoring device 10 having a beacon 11 having a beacon identifier bi is provided in the vicinity of the monitored space S. A single monitored space S may be associated with a plurality of mutually identifiable monitoring devices 10 (having different beacon identifiers bi) installed in different locations. In the monitored space S, there is a mobile terminal 20 on which a notification application 23 is installed. A remote server 30 connected to a communication network N is provided at a location away from the monitored space S. The monitoring device 10 has a microphone 16 and a camera 12.

[0040] Fig. 3 is a diagram showing an example of a prompt P. Fig. 4 is a diagram showing an example of a text TX. Fig. 5 is a diagram showing examples of a summary sentence TXa, harassment words W, and types of harassment C in an evaluation report R. Fig. 6 is a diagram showing an example of an evaluation of harassment in an evaluation report R.

[0041] (1) When a user carrying a mobile terminal 20 is present in the monitored space S, if the mobile terminal 20 is within a short distance range where radio waves from a beacon 11 of a monitoring device 10 installed in the monitored space S can reach, the mobile terminal 20 receives radio waves including a beacon identifier bi from a beacon 11 having an identifier bi installed in the monitored space S. This allows the mobile terminal 20 to identify the monitoring device 10 located closest to the location of the mobile terminal 20. Furthermore, if the mobile terminal 20 receives radio waves including multiple different beacon identifiers bi, it is understood that the mobile terminal 20 is located between the positions of the beacons 11 (monitoring devices 10) having those multiple beacon identifiers bi. Furthermore, if the mobile terminal 20 receives radio waves including multiple different beacon identifiers bi and the strengths of those radio waves are known, it is understood that the mobile terminal 20 is located between the positions of the beacons 11 (monitoring devices 10) having those multiple beacon identifiers bi and on the side with stronger radio wave strength.

[0042] (2) The event information Iv including the mobile terminal identifier mi and the beacon identifier bi is transmitted to the remote server 30 by the mobile terminal 20 capable of receiving radio waves from the beacon 11 (transmission step). Specifically, the mobile terminal 20 transmits information including the beacon reception time t1 when the mobile terminal 20 receives the radio waves from the beacon 11, the beacon identifier bi, and the mobile terminal identifier mi to the remote server 30 via the communication network N at appropriate times or periodically. This allows the user to know the position of the mobile terminal 20 (which monitored space S the mobile terminal 20 is in) and the time within the business establishment through the management system 100 (remote server 30). Here, by previously associating the relationship between the mobile terminal identifier mi and the user name representing the holder of the mobile terminal 20, and the positional relationship between the beacon identifier bi and the monitored space S, the user's position and time within the business establishment can be known.

[0043] (3) Specifically, when user A is subjected to harassment by user B, he / she presses the virtual button 23b displayed on the notification application 23 of the mobile terminal 20 as shown in Fig. 1. Then, the mobile terminal 20 transmits event information Iv including the event occurrence time T to the remote server 30. Here, the event information Iv includes the event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. This allows the administrator to grasp the environmental information In of the monitored space S at the event occurrence time T as well as the event occurrence time T in the business premises through the management system 100 (remote server 30).

[0044] (4) The event information Iv is received by the remote server 30 via the communication network N (receiving step). Then, upon receiving the event information Iv from the mobile terminal 20, the remote server 30 requests, from the monitoring device 10, environmental information In of the monitored space S before and after the event occurrence time T, including the event occurrence time T. In this example, upon receiving the event information Iv from the mobile terminal 20, the remote server 30 transmits, to the monitoring device 10, a request signal d requesting audio in the monitored space S acquired by the microphone 16 of the monitoring device 10.

[0045] (5) Environmental information In based on an image or sound in the monitored space S is detected by the monitoring device 10 that is installed in the monitored space S and has a beacon 11 that emits radio waves including a beacon identifier bi (detection step). Specifically, when the monitoring device 10 receives a request signal d from the remote server 30, it transmits the environmental information In to the remote server 30. In more detail, the monitoring device 10 detects sound in the monitored space S acquired by the microphone 16 of the monitoring device 10. Then, based on a request (request signal d) from the remote server 30, the monitoring device 10 transmits the detected sound to the remote server 30 as environmental information In. Note that the monitoring device 10 may transmit an image of the monitored space S captured by the camera 12 of the monitoring device 10 instead of or together with the sound in response to a request from the remote server 30.

[0046] (6) The evaluation report R is output by the remote server 30 (evaluation output step). In this evaluation output step, the remote server 30 receives environmental information In before and after the event occurrence time T from the monitoring device 10, and outputs the evaluation report R through the artificial intelligence AI based on the event information Iv and the environmental information In. This management method can acquire the event information Iv from the mobile terminal 20 and the environmental information In from the monitoring device, and output the evaluation report R after taking into account not only the user information at the event occurrence time T, but also the user's surrounding environment (information related to the monitored space S) at the event occurrence time T. Therefore, this management method can automatically output the evaluation report R with an appropriate evaluation made by the artificial intelligence AI. Therefore, this management method can obtain information about the user's surrounding environment at the time of the event occurrence.

[0047] Specifically, when the evaluation unit 35 of the remote server 30 receives environmental information In (audio) around the event occurrence time T from the monitoring device 10, the evaluation unit 35 inputs the environmental information In to the artificial intelligence AI. Here, the artificial intelligence AI may be a large-scale language model LLM connected to the Internet. The large-scale language model LLM may be connected to the communication network N (on the cloud) or may be in the remote server 30.

[0048] (6-1) In detail, as shown in FIG. 4, the evaluation unit 35 may appropriately use known software to transcribe (convert into text, verbalize) the acquired environmental information In, which is the voice, and convert it into text TX.

[0049] (6-2) As appropriate, the evaluation unit 35 may create a summary sentence TXa that summarizes the text TX using known software, as shown in FIG.

[0050] (6-3) Then, the evaluation unit 35 outputs an evaluation report R through the artificial intelligence AI based on the event information Iv and the environmental information In.

[0051] (6-4) In detail, the evaluation unit 35 inputs the text TX or summary sentence TXa converted based on the voice, which is the environmental information In, and a prompt P (command sentence) for outputting an evaluation report R based on the text TX or summary sentence TXa to the artificial intelligence AI (large-scale language model LLM). As shown in FIG. 3, the prompt P is a content that commands the artificial intelligence AI to perform a harassment evaluation indicating the presence or absence of harassment against the user or the degree of harassment based on the reference text TX or summary sentence TXa, and to create an evaluation report R, for example, "Summarize the sentence from the following conversation sentence, extract harassment words, and determine the type of harassment. Also, calculate the probability that this conversation can be said to be harassment." Then, the artificial intelligence AI (large-scale language model LLM) returns the evaluation report R to the evaluation unit 35.

[0052] (6-5) The evaluation unit 35 appropriately extracts, through the artificial intelligence AI (large scale language model LLM), harassment words W that are effective for creating the evaluation report R from the text TX or the summary sentence TXa (see FIG. 5).

[0053] (6-6) The evaluation unit 35 appropriately presents possible types of harassment C that may be applicable based on the extracted harassment words W (see FIG. 5).

[0054] (6-7) The evaluation unit 35 evaluates the harassment with reference to the type C of harassment. For example, as shown in FIG. 6, along with a graded, rough evaluation such as "highly severe," comments such as "Person A's words and actions contain many elements of harassment, such as denial of personality and criticism of appearance, threats, and intimidating attitudes toward Person B. It is highly likely that Person B experienced mental distress." are presented.

[0055] (6-8) The evaluation unit 35 appropriately supplements the logic (grounds) behind the evaluation described above. The supplementary information may be an explanation of each factor for calculating the evaluation of harassment (probability of harassment), such as, for example, "This judgment was made based on the information provided and may differ depending on the actual situation. Several factors must be taken into consideration to calculate the probability of harassment," "Maliciousness of the remarks: The more malicious the remarks are, such as insults, threats, and denial of a person's character, the higher the probability of harassment," "Frequency of remarks: Repeated remarks are more likely to be harassment than remarks made just once," "Victim's emotions: The probability of harassment is higher if the victim feels fear, anxiety, discomfort, etc.," "Surrounding circumstances: The probability of harassment is higher if there are witnesses or evidence," and "Relationship between the perpetrator and victim: The relationship between the two parties, such as whether there is a power relationship, must also be taken into consideration."

[0056] The supplementary information also includes the following: "Taking these factors into consideration, we propose a formula for calculating the probability of harassment.", "Harassment probability (%) = (maliciousness of the remarks + frequency of the remarks + victim's feelings + surrounding circumstances + relationship between the perpetrator and victim) / 5 * 10," "Each element is rated on a scale from 0 to 10, with 0 being not applicable and 10 being highly applicable.", "Let's use this formula to calculate the probability of harassment in this case.", "Maliciousness of the remarks: Since it included malicious remarks such as insults, threats, and denial of one's character, we will rate it as 10.", "Frequency of the remarks: Since there were multiple remarks, we will rate it as 8.", "Victim's feelings: Based on Suzuki's remarks, we have determined that there is a high possibility that she felt fear or anxiety, so we will rate it as 9.", "Surrounding circumstances: Since the supervisor, Sato, is a witness, we will rate it as 8.", "Relationship between the perpetrator and victim: "Since Tanaka is a customer and Suzuki is an employee, and a power relationship exists, we rate it 9.", "When these figures are applied to the formula, we get the following: Harassment Probability (%) = (10 + 8 + 9 + 8 + 9) / 5 * 10 = 88%", "Therefore, the probability that this conversation is harassment is calculated to be 88%." These may be evaluation criteria for harassment or calculation grounds for the probability of harassment.

[0057] (6-9) Next, the evaluation unit 35 of the remote server 30 appropriately displays the evaluation report R output from the artificial intelligence AI (large scale language model LLM) on the remote display 34. This allows the administrator of the remote server 30 to check the contents of the evaluation report R. The evaluation unit 35 may also appropriately display the evaluation report R on the mobile display 21 of the mobile terminal 20. This allows the user of the mobile terminal 20 to check the contents of the evaluation report R.

[0058] Thus, the management method according to the present embodiment includes a detection step of detecting the environmental information In by the image or sound in the monitored space S by the monitoring device 10 having the beacon 11 installed in the monitored space S and emitting the radio wave including the beacon identifier bi, a transmission step of transmitting the event information Iv including the mobile terminal identifier mi and the previous beacon identifier bi by the mobile terminal 20 capable of receiving the radio wave, a reception step of receiving the event information Iv by the remote server 30 via the communication network N, and an evaluation output step of outputting the evaluation report R by the remote server 30. Here, the event information Iv includes the event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. Then, in the evaluation output step, the remote server 30 receives the environmental information In before and after the event occurrence time T from the monitoring device 10, and outputs the evaluation report R through the artificial intelligence AI based on the event information Iv and the environmental information In. According to the management method of this embodiment, user A can quickly confirm the harassment assessment, which indicates whether or not user A has experienced harassment and the degree of the harassment, without the need for the administrator to create or submit an application regarding the harassment he or she has experienced, and without the need for the administrator to directly interview user A or analyze the content of the interview.

[0059] In this manner, the management method using the management system 100 can be implemented.

[0060] (Management Program) A management program according to this embodiment for implementing the above-mentioned management method by a computer will be described below. The management program may be installed in the mobile terminal 20 as a notification application 23. The management program may be installed in the remote server 30, in the monitoring device 10, or in a server on a cloud other than the mobile terminal 20 or the remote server 30.

[0061] The management program causes the computer to execute a detection function of detecting environmental information Iv in the monitored space S by an image or sound using a monitoring device 10 that is installed in the monitored space S and has a beacon 11 that emits radio waves including a beacon identifier bi. The management program causes the computer to execute a transmission function of transmitting event information Iv including a mobile terminal identifier mi and a beacon identifier bi using a mobile terminal 20 that can receive radio waves. The management program causes the computer to execute a reception function of receiving the event information Iv via a communication network N using a remote server 30. The management program causes the computer to execute an evaluation output function of outputting an evaluation report R using the remote server 30. Here, the event information Iv includes the event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. Then, in the evaluation output function, the remote server 30 receives environmental information In before and after the event occurrence time T from the monitoring device 10, and outputs an evaluation report R through the artificial intelligence AI based on the event information Iv and the environmental information In. In this way, according to the management program of this embodiment, user A can quickly confirm the harassment assessment, which indicates whether or not user A has experienced harassment and the degree of the harassment, without the need for the administrator to create or submit an application form regarding the harassment he or she has experienced, and without the administrator having to directly interview user A or analyze the content of that interview.

[0062] The technical scope of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention.

[0063] In addition, the components in the above-described embodiment may be replaced with known components as appropriate without departing from the spirit of the present invention. Furthermore, the above-described modified examples may be combined as appropriate without departing from the spirit of the present invention.

[0064] As described above, the management system 100 according to the embodiment includes a monitoring device 10 having a beacon 11 that emits radio waves including a beacon identifier bi, which is installed in a monitored space S, and which detects environmental information In by image or sound, a mobile terminal 20 that can receive radio waves and transmit event information Iv including a mobile terminal identifier mi and a beacon identifier bi, a remote communication unit 32 that can receive the event information Iv via a communication network N, and a remote server 30 having an evaluation unit 35 that outputs an evaluation report R. Here, the event information Iv includes an event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. The evaluation unit 35 receives environmental information Iv before and after the event occurrence time T from the monitoring device 10, and outputs an evaluation report R through artificial intelligence AI based on the event information Iv and the environmental information In. According to the present management system 100, the event information Iv from the mobile terminal 20 and the environmental information In from the monitoring device are acquired, and an evaluation report R can be output after taking into account not only the user's information at the event occurrence time T, but also the user's surrounding environment (information related to the monitored space S) at the event occurrence time T. Then, the user A can quickly confirm the harassment evaluation that indicates the presence or absence of harassment against the user A that the user A faced, or the degree of harassment, without having to create or submit an application for harassment for the user A, and the administrator can quickly confirm the harassment evaluation that indicates the presence or absence of harassment against the user A that the user A faced, or the degree of harassment, without having to directly interview the user A or analyze the interviewed content. Therefore, the management system 100 can automatically output an evaluation report R in which an appropriate evaluation has been made by the artificial intelligence AI. Thus, according to the management system 100, information about the surrounding environment of the user at the time of the event occurrence can be obtained.

[0065] The management method according to the embodiment includes a detection step of detecting environmental information In by an image or sound in a monitored space S by a monitoring device 10 having a beacon 11 that is installed in the monitored space S and emits radio waves including a beacon identifier bi, a transmission step of transmitting event information Iv including a mobile terminal identifier mi and a beacon identifier bi by a mobile terminal 20 that can receive radio waves, a reception step of receiving the event information Iv by a remote server 30 via a communication network N, and an evaluation output step of outputting an evaluation report R by the remote server 30. Here, the event information Iv includes an event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. In the evaluation output step, the remote server 30 receives environmental information Iv before and after the event occurrence time T from the monitoring device 10, and outputs an evaluation report R through artificial intelligence AI based on the event information Iv and the environmental information In. According to this management method, the event information Iv from the mobile terminal 20 and the environmental information In from the monitoring device 10 are acquired, and the evaluation report R can be output after taking into account not only the user's information at the event occurrence time T, but also the user's surrounding environment (information related to the monitored space S) at the event occurrence time T. Then, the user A can quickly confirm the harassment evaluation that indicates the presence or absence of harassment against the user A that the user A faced, or the degree of harassment, without having to create or submit an application for harassment for the user A, and the administrator can quickly confirm the harassment evaluation that indicates the presence or absence of harassment against the user A that the user A faced, or the degree of harassment, without having to directly interview the user A or analyze the interviewed content. Therefore, the management method can automatically output the evaluation report R in which an appropriate evaluation is made by the artificial intelligence AI. Therefore, according to this management method, information about the surrounding environment of the user at the time of the event occurrence can be obtained.

[0066] The management program according to the embodiment causes a computer to execute a detection function of detecting environmental information Iv in the monitored space S by an image or sound using a monitoring device 10 that is installed in the monitored space S and has a beacon 11 that emits radio waves including a beacon identifier bi. The management program causes a computer to execute a transmission function of transmitting event information Iv including a mobile terminal identifier mi and a beacon identifier bi using a mobile terminal 20 that can receive radio waves. The management program causes a computer to execute a reception function of receiving the event information Iv by a remote server 30 via a communication network N. The management program causes a computer to execute an evaluation output function of outputting an evaluation report R by the remote server 30. Here, the event information Iv includes the event occurrence time T detected by the monitoring device 10 or the mobile terminal 20. In the evaluation output function, the management program causes the remote server 30 to receive environmental information In before and after the event occurrence time T from the monitoring device 10, and outputs an evaluation report R through the artificial intelligence AI based on the event information Iv and the environmental information In. According to this management program, the event information Iv from the mobile terminal 20 and the environmental information In from the monitoring device 10 are acquired, and an evaluation report R can be output after taking into account not only the user's information at the event occurrence time T, but also the user's surrounding environment (information related to the monitored space S) at the event occurrence time T. Then, the user A can quickly confirm the harassment evaluation that indicates the presence or absence of harassment against the user A that the user A faced, or the degree of harassment, without having to create or submit an application for harassment, and the administrator can quickly confirm the harassment evaluation that indicates the presence or absence of harassment against the user A that the user A faced, or the degree of harassment, without having to directly interview the user A or analyze the interviewed content. Therefore, the management program can automatically output an evaluation report R in which an appropriate evaluation has been made by the artificial intelligence AI. Therefore, according to this management program, information about the surrounding environment of the user at the time of the event occurrence can be obtained. [Explanation of symbols]

[0067] 100 Management Systems 10 Monitoring equipment 11. Beacon 12 Camera 13 Monitoring Display 14 Surveillance and communication devices 15 GPS receiver 16. Mike 20 Mobile Devices 21 Mobile Display 22 Transmitter / receiver 23 Notification App 23b Virtual Buttons 30 Remote Server 31 Storage section 32 Remote Communication Department 33 Control Unit 34 Remote Display 35 Evaluation Department AI artificial intelligence C. Types of Harassment Event Information N Communication Network P prompt R Evaluation Report S monitoring space T Event occurrence time TX Text TXa Abstract W Harassment Words X,Y Values bi beacon identifier d request signal mi mobile device identifier t1 Beacon reception time

Claims

1. A monitoring device that has a beacon that emits radio waves including a beacon identifier, is installed in a monitored space, and detects environmental information by images or sounds; a mobile terminal capable of receiving the radio waves and transmitting event information including a mobile terminal identifier and the beacon identifier; a remote server including a remote communication unit capable of receiving the event information via a communication network, and an evaluation unit that outputs a harassment evaluation that indicates the presence or absence of harassment against the user that the user has faced, or the degree of the harassment, the event information includes an event occurrence time detected by the monitoring device or the mobile terminal and a notification command from the user received by a notification application installed on the mobile terminal; The evaluation unit receives the environmental information before and after the event occurrence time from the monitoring device, and outputs the harassment evaluation through artificial intelligence based on the event information and the environmental information. Management system.

2. The environmental information is audio before and after the event occurrence time, The remote server inputs predefined prompts and the converted text based on the speech to a large-scale language processing model connected to the communication network to generate the harassment assessment. The management system according to claim 1 .

3. The remote server inputs a summary that summarizes the text to the large-scale language processing model. The management system according to claim 2.

4. a detection step of detecting environmental information in a monitored space by an image or sound using a monitoring device that is installed in the monitored space and has a beacon that emits radio waves including a beacon identifier; a transmitting step of transmitting event information including a mobile terminal identifier and the beacon identifier by a mobile terminal capable of receiving the radio waves; receiving the event information by a remote server via a communication network; and an evaluation output step of outputting, by a remote server, a harassment evaluation indicating the presence or absence of harassment against the user or the degree of harassment faced by the user, the event information includes an event occurrence time detected by the monitoring device or the mobile terminal and a notification command from the user received by a notification application installed on the mobile terminal; In the evaluation output step, the remote server receives the environmental information before and after the event occurrence time from the monitoring device, and outputs the harassment evaluation through artificial intelligence based on the event information and the environmental information. Management method.

5. On the computer, A detection function for detecting environmental information in a monitored space by an image or sound using a monitoring device that is installed in the monitored space and has a beacon that emits radio waves including a beacon identifier; A transmission function for transmitting event information including a mobile terminal identifier and the beacon identifier by a mobile terminal capable of receiving the radio waves; a receiving function for receiving the event information by a remote server via a communication network; an evaluation output function for outputting, by a remote server, a harassment evaluation indicating the presence or absence of harassment against the user or the degree of harassment that the user has faced; the event information includes an event occurrence time detected by the monitoring device or the mobile terminal and a notification command from the user received by a notification application installed on the mobile terminal; In the evaluation output function, the remote server receives the environmental information before and after the event occurrence time from the monitoring device, and outputs the harassment evaluation through artificial intelligence based on the event information and the environmental information. Management program.

Citation Information

Patent Citations

  • Device for estimating terminal location on basis of presence probability density in consideration for radio wave attenuation, program therefor and method therefor

    JP2019082363A

  • Artificial intelligence-based generation of event evaluation report

    WO2020214316A1

  • Communication system

    JP2007150435A