Message misdelivery prevention support program, message misdelivery prevention support device, message misdelivery prevention support method, and recording medium
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- NEC SOLUTION INNOVATORS LTD
- Filing Date
- 2025-01-22
- Publication Date
- 2026-08-03
AI Technical Summary
【0010】 本開示によれば、精度よくメッセージの誤送信を抑制できる。
Smart Images
Figure 2026125526000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a program for supporting suppression of mistransmission of messages, a device for supporting suppression of mistransmission of messages, a method for supporting suppression of mistransmission of messages, and a recording medium.
Background Art
[0002] As a mechanism for preventing mistransmission of e-mails or the like, a mechanism is known in which phrases corresponding to destination e-mail addresses are permitted or prohibited in advance, and a warning is given when the set phrases are included in the transmitted e-mail. For example, in Patent Document 1, when transmission of a transmission target e-mail is instructed, a step (S1) of decomposing the transmission target e-mail into target phrases, a step (S2) of searching a phrase DB in which phrases extracted from e-mails already communicated with the communication partner of the transmission target e-mail are registered, a step (S4) of calculating the appearance frequency FAi of each target phrase based on the detected phrase DB, a step (S < / S5) of calculating the non-use period index NIi of each target phrase, a step (S6) of calculating the safety index ISi (= FAi × NIi) of each target phrase, and a step of adding the calculated safety index ISi of each target phrase and subtracting the result from 1 to calculate the mistransmission index IF (= 1 - ΣISi) of the transmission target e-mail as a step (S7) are executed by a computer. An e-mail mistransmission prevention program is described.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, methods for detecting misdelivery that utilize a vocabulary database registered for each recipient, such as Patent Document 1, have the problem of failing to detect cases where an email is sent that happens to use the same vocabulary as an permitted vocabulary in the vocabulary database, but the actual content is incorrect. Therefore, further methods for suppressing misdelivery of messages are needed.
[0005] Therefore, this disclosure aims to provide a message misdelivery suppression support program, a message misdelivery suppression support device, a message misdelivery suppression support method, and a recording medium that can accurately suppress the misdelivery of messages. [Means for solving the problem]
[0006] To achieve the aforementioned objectives, the message misdelivery prevention support program of this disclosure is: This includes procedures for obtaining reply message information, detecting erroneous transmissions, and issuing warnings. The procedure for obtaining the reply message information described above obtains the reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery detection procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message, The aforementioned warning procedure warns if the reply message may have been sent in error. This is a message transmission erroneous transmission prevention support program that causes a computer to execute each of the above steps.
[0007] The message misdelivery prevention support device disclosed herein is It includes a reply message information acquisition unit, a misdelivery detection unit, and a warning unit, The aforementioned reply message information acquisition unit acquires reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The misdelivery detection unit determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The warning unit issues a warning if there is a possibility that the reply message was sent in error.
[0008] The method for supporting the prevention of accidental message transmission in this disclosure is: This includes a process for obtaining reply message information, a process for determining erroneous transmission, and a warning process. The aforementioned step of obtaining reply message information obtains reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery determination step determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message, The warning step provides a warning if the reply message may have been sent in error. This is a method for supporting the suppression of erroneous message transmission, in which a computer performs each of the aforementioned steps.
[0009] The recording medium disclosed herein is This includes procedures for obtaining reply message information, detecting erroneous transmissions, and issuing warnings. The procedure for obtaining the reply message information described above obtains the reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery detection procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message, The aforementioned warning procedure warns if the reply message may have been sent in error. This is a computer-readable recording medium that stores a message transmission erroneous transmission suppression support program that causes the computer to execute each of the above procedures. [Effects of the Invention]
[0010] According to the present disclosure, mistransmission of messages can be accurately suppressed.
Brief Description of the Drawings
[0011] [Figure 1] FIG. 1 is a block diagram showing a configuration example of a message mistransmission suppression support device of the present disclosure. [Figure 2] FIG. 2 is a block diagram showing an example of a hardware configuration of the message mistransmission suppression support device of the present disclosure. [Figure 3] FIG. 3 is a flowchart showing an example of processing in the message mistransmission suppression support device of the present disclosure.
Embodiments for Carrying Out the Invention
[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments. In the following figures, the same parts are denoted by the same reference numerals. Also, unless otherwise specified, the descriptions of the respective embodiments can be mutually referred to, and the configurations of the respective embodiments can be combined unless otherwise specified.
[0013] In the present disclosure, the "message" is not particularly limited as long as it is a means for transmitting information from one person to another person. Examples of the message include, for example, email, chat, messenger app, SNS (social networking service), etc.
[0014] [Embodiment 1] The message mistransmission suppression support program of the present disclosure is a program for causing a computer to execute a reply message information acquisition procedure, a mistransmission determination procedure, and a warning procedure. The message mistransmission suppression support program of the present disclosure can also be said to be a program that causes a computer to function as a reply message information acquisition procedure, a mistransmission determination procedure, and a warning procedure. Further, the message mistransmission suppression support program of the present disclosure can also be said to be a program for causing a computer to execute each step of the message mistransmission suppression support method described later, for example.
[0015] The reply message information acquisition procedure acquires reply message information for a reply target message, The reply message information includes the content of the reply target message and the content of the reply message, The mistransmission determination procedure determines the possibility that the reply message is a mistransmission based on the content of the reply target message and the content of the reply message, The warning procedure gives a warning when there is a possibility that the reply message is a mistransmission.
[0016] Each of the aforementioned steps can be reinterpreted, for example, by substituting "step" with "process." The message misdelivery prevention support program of this disclosure may also be recorded on, for example, a computer-readable storage medium. The storage medium is, for example, a non-transitory computer-readable storage medium. The storage medium is not particularly limited and includes, for example, random access memory (RAM), read-only memory (ROM), hard disk (HD), flash memory (e.g., SSD (Solid State Drive), USB flash memory, SD / SDHC card, etc.), optical disc (e.g., CD-R / CD-RW, DVD-R / DVD-RW, BD-R / BD-RE, etc.), magneto-optical disk (MO), floppy disk (FD), etc. The message misdelivery prevention support program of this disclosure (for example, also called a programming product or program product) may also be delivered, for example, from an external computer. The "delivery" may be, for example, delivered via a communication network or delivered via a wired device. The message misdelivery prevention support program of this disclosure may be installed and executed on the delivered device, or it may be executed without being installed. An information processing device capable of executing the message misdelivery prevention support program of this disclosure may be, for example, the message misdelivery prevention support device of this disclosure.
[0017] The message misdelivery prevention support program described herein may be implemented, for example, as a function of another program capable of sending and receiving messages (e.g., an email management client, an SNS application, a web browser, etc.).
[0018] Next, the configuration of an example of the message misdelivery suppression support device of this disclosure will be described with reference to Figure 1. Figure 1 is a block diagram showing the configuration of an example of the message misdelivery suppression support device 10 (hereinafter also referred to as "this device") of this embodiment. As shown in Figure 1, this device 10 includes a reply message information acquisition unit 11, a misdelivery determination unit 12, and a warning unit 13. In addition, although not shown, this device 10 may also include, for example, an input unit, an output unit, a display unit, and / or a storage unit. The reply message information acquisition unit 11, the misdelivery determination unit 12, and the warning unit 13 can each execute, for example, the reply message information acquisition procedure, the misdelivery determination procedure, and the warning procedure in the message misdelivery suppression support program of this disclosure.
[0019] The device 10 may be, for example, a single device including the aforementioned parts, or it may be a device in which each of the aforementioned parts can be connected via a communication network. Furthermore, the device 10 can be connected to an external device described later via the communication network. The communication network is not particularly limited and can use a known network, for example, it may be wired or wireless. Examples of the communication network include the Internet, WWW (World Wide Web), telephone lines, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Tolerant Networking), LPWA (Low Power Wide Area), L5G (Local 5G), etc. Examples of wireless communication include Wi-Fi (registered trademark), Bluetooth (registered trademark), Local 5G, LPWA, etc. The wireless communication may be in the form of direct communication between devices (Ad Hoc communication), infrastructure communication, indirect communication via an access point, etc. The device 10 may be, for example, incorporated into a server as a system. Furthermore, the device 10 may be, for example, a personal computer (PC, e.g., desktop or notebook), smartphone, tablet terminal, etc., on which the program of this disclosure is installed. The device 10 may also be in the form of cloud computing or edge computing, for example, in which at least one of the aforementioned parts is on a server and the other aforementioned parts are on a terminal.
[0020] Figure 2 illustrates a block diagram of the hardware configuration of the device 10. The device 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, memory 102, bus 103, storage device 104, input device 105, output device 106, communication device 107, etc. Each part of the device 10 is interconnected via the bus 103 through its respective interface (I / F).
[0021] The central processing unit 101 operates in cooperation with other components via controllers (system controller, I / O controller, etc.) and is responsible for the overall control of the device 10. In the device 10, the central processing unit 101 executes, for example, the program disclosed herein and other programs, and also reads and writes various types of information. Specifically, for example, the central processing unit 101 functions as a reply message information acquisition unit 11, a mistransmission detection unit 12, and a warning unit 13. The device 10 may also include other computing devices such as a CPU, GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), or a combination thereof as its computing device.
[0022] Bus 103 can also be connected to external devices, for example. Examples of such external devices include a user terminal, an external storage device (such as an external database), a printer, an external input device, an external display device, and an external imaging device. The device 10 can be connected to an external network (the aforementioned communication network) via a communication device 107 connected to bus 103, for example, and can also be connected to other devices via the external network.
[0023] Memory 102 may be, for example, main memory. When the central processing unit 101 performs processing, memory 102 reads various operational programs, such as the program of this disclosure, stored in the storage device 104 (described later), and the central processing unit 101 receives data from memory 102 and executes the program. The main memory may be, for example, RAM (random access memory). Alternatively, memory 102 may be, for example, ROM (read-only memory).
[0024] The storage device 104 is also called a so-called auxiliary storage device, for example, in relation to the main memory (primary memory). As described above, the storage device 104 stores an operating program including the program of this disclosure. The storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium. The recording medium is not particularly limited and may be internal or external, for example, an HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, memory card, etc. The storage device 104 may be, for example, a hard disk drive (HDD) in which the recording medium and the drive are integrated, or a solid state drive (SSD).
[0025] In this device 10, the memory 102 and storage device 104 can also store various types of information, such as log information, information obtained from an external database (not shown) or external devices, information generated by this device 10, and information used by this device 10 when executing processing. In this case, the memory 102 and storage device 104 may store, for example, the user information of this device as described above. At least some of the information may be stored on an external server other than the memory 102 and storage device 104, or it may be stored in a distributed manner across multiple terminals using blockchain technology or the like. Furthermore, if this device 10 includes the storage unit, for example, the memory 102 and storage device 104 function as the storage unit.
[0026] The device 10 further includes, for example, an input device 105 and an output device 106. The input device 105 may include, for example, a pointing device such as a touch panel, trackpad, or mouse; a keyboard; imaging means such as a camera or scanner; a card reader such as an IC card reader or magnetic card reader; an audio input means such as a microphone; and so on. The output device 106 may include, for example, a display device such as an LED display or liquid crystal display; an audio output device such as a speaker; a printer; and so on. In this embodiment 1, the input device 105 and the output device 106 are configured separately, but the input device 105 and the output device 106 may be configured as an integrated unit, such as a touch panel display.
[0027] An example of processing by the message misdelivery prevention support program of this disclosure will be explained in more detail with reference to Figure 3. Figure 3 is a flowchart showing an example of each step of the message misdelivery prevention support program of this disclosure. The message misdelivery prevention support program of this disclosure is implemented, for example, using the device 10 shown in Figure 1 or Figure 2 on which the message misdelivery prevention support program of this disclosure is installed, as follows. Note that the implementation of the message misdelivery prevention support program of this embodiment is not limited to the use of the device 10 shown in Figure 1 or Figure 2.
[0028] The reply message information acquisition unit 11 acquires reply message information for a message to be replied to (S1, reply message information acquisition procedure). The message to be replied to is, for example, information about a message directed to a user. The reply message is, for example, a reply message from the user to the message to be replied to. The reply message information includes the content of the message to be replied to and the content of the reply message. The reply message information acquisition unit 11 can acquire the reply message information from, for example, another program or device that manages the message. As a specific example, if the message is an email, for example, the reply message information acquisition unit 11 can acquire the reply message information from the user's email management client. The reply message information may be recorded in, for example, the storage unit of this device 10, or on a recording medium outside of this device 10. In this case, the reply message information acquisition unit 11 can acquire the reply message information recorded in, for example, the storage unit or the external recording medium.
[0029] The reply message information may include, for example, a history of replies to the message to be replied to. The reply history is, for example, a history of past exchanges including the message to be replied to. The reply history may include, for example, an email tree, an SNS tree, etc. The reply message information may include, for example, at least one of the recipient identification information of the reply message and the sender identification information of the message to be replied to. The recipient identification information is, for example, information that identifies the recipient of the reply message (the sender of the message to be replied to). The sender identification information is, for example, information that identifies the sender of the reply message. The recipient identification information and the sender identification information are not particularly limited as long as they are information that can identify the recipient or sender. The recipient identification information and the sender identification information may include, for example, a name, nickname, ID, password, email address, telephone number, address, identification number (for example, My Number (personal information), etc.), IP address, MAC address, device-specific information of the terminal, etc.
[0030] The misdelivery detection unit 12 determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message (S2, misdelivery detection procedure). The misdelivery detection unit 12 may, for example, provide the reply message information to a Large Language Model (LLM) and have it determine the possibility that the reply message is a misdelivery. The Large Language Model may, for example, operate in a terminal local environment or in a cloud environment. Since the reply message information may contain personal information or confidential information, if the Large Language Model operates in a terminal local environment, security can be improved from the standpoint of privacy protection and security maintenance. The misdelivery detection unit 12 can determine the possibility of a misdelivery by, for example, providing the Large Language Model with misdelivery detection instruction information (prompt) to determine the possibility that the reply message is a misdelivery to the message to be replied to, in addition to the content of the message to be replied to and the content of the reply message. The content of the misdelivery detection instruction information is not particularly limited as long as it is an instruction in natural language that enables the LLM to determine the possibility that the reply message is a misdelivery to the message to be replied to.
[0031] The following are specific examples of error transmission detection instruction information, but this disclosure is not limited to these examples. Specific examples of error transmission detection instruction information: "Below are the contents of the message to be replied to (Message A) and the contents of the reply message to it (Message B). Your task is to determine whether Message B may have been sent to Message A in error." Criteria for determining the possibility of sending a message to the wrong recipient: • Presence of contradictions: If [Document B] contains information that is clearly different from or contradicts the content of [Document A]. • Appropriateness: If [Text B] does not appropriately respond to the question, request, or intent of [Text A]. • Contextual relevance: When the content of [Text B] is not in line with the context of [Text A] and includes a completely different topic or context. Please provide your results in the following format: If there is a possibility of accidental sending: Please explain the specific reason and indicate which parts of [Text A] and [Text B] are contradictory or unrelated. If there is no possibility of accidental transmission, please briefly explain why. [Text A]: ' 』 [Text B]: ' ''
[0032] The following is another specific example of misdelivery detection instruction information. In the following example, we will explain the case in which a large-scale language model is first used to summarize the content of the email, and then the summarized email content is compared, but this disclosure is not limited to the following example. Specific examples of error transmission detection instruction information: First, summarize the email content using the following prompt. =========== Please determine the type of email. When doing so, please specify one of the following categories: "Inquiry / Response," "Notification," "Request," or "Other." --- Email type: <type> --- If the email type is "Inquiry / Support," please explain what the following email is about in the format below. Sender: <name> mail recipient: <name> Requirements: <requirement> Requirements: <request> Items to be answered: <response> summary: <context> --- If there is no answer, please write "none". Please clearly state your affiliation and name in both the recipient and sender fields. Please describe the requirements and responses in detail. In particular, please specify what the response addresses. When summarizing, please be sure to include all specific information, such as the user (owner) and the products used. =========== After that, the following prompt will perform a content comparison. =========== Your task is to look at email A, determine if email B is a correct reply to email A, and then respond. --- Email A: (Content of Email A) --- Email B: (Contents of Email B) --- Email B will respond with "true" if it is correct as a reply to Email A, and "false" if it is incorrect. Please pay close attention to any specific information contained in the email before making a decision. Please make five decisions and respond five times in the following format. --- First time: Second time: Third time: 4th time: 5th time: --- Please also consider the following criteria when making the following decisions. From the perspective of preventing information leaks, if the response to email B contains any unique information other than the items requested in email A, the answer will be "false" without exception. If the items requested in email A are not clearly answered in email B, the result should be "false". ===========
[0033] The misdelivery detection unit 12 may, for example, further refer to the reply history to determine the possibility that the reply message is a misdelivery. In this case, the misdelivery detection unit 12 can determine the possibility of a misdelivery by, for example, providing the large-scale language model with the content of the message to be replied to, the content of the reply message, the reply history, and misdelivery detection instruction information for determining the possibility that the reply message is a misdelivery to the message to be replied to. The misdelivery detection instruction information in this case may be the same as described above, except that it includes, for example, a constraint condition that instructs the determination to be made while taking the reply history into consideration.
[0034] The following are specific examples of error transmission detection instruction information, but this disclosure is not limited to these examples. Furthermore, the following examples are explained using the case where the message is an email and the reply history is a mail tree, but these examples are not limited to this disclosure. Specific examples of error transmission detection instruction information: "Below are the contents of the message to be replied to (Message A), the contents of the reply message to it (Message B), and the reply history (email tree). Your task is to determine, based on the entire email tree, whether Message B may have been sent to Message A in error." Criteria for determining the possibility of sending a message to the wrong recipient: • Presence of contradictions: If [Text B] contains information that is clearly different from or contradicts the content of [Text A] or the entire email tree. • Appropriateness: If, considering the entire email tree, [Message B] does not appropriately respond to the question, request, or intent of [Message A]. • Contextual relevance: When the content of [Text B] is not relevant to the context of [Text A] and includes a completely different topic or context. Or, when is [Text B] relevant to the context and topic of the entire email tree? • Consistency of intent: Does the content of [Text B] match the request, question, or progression of discussion shown in the email tree? Please provide your results in the following format: If there is a possibility of accidental sending: Please explain the specific reasons and indicate which parts of [Message A], [Message B], and [Email Tree] are contradictory or irrelevant. If there is no possibility of accidental transmission, please briefly explain why. [Mail tree]: ' 』 [Text A]: ' 』 [Text B]: ' ''
[0035] The following is another specific example of mistransmission detection instruction information. This disclosure is not limited to the following examples. Specific examples of error transmission detection instruction information: =========== Your task is to look at email A, determine if email B is a correct reply to email A, and then respond. --- Email A: (Content of Email A) --- Email B: (Contents of Email B) --- Email B will respond with "true" if it is correct as a reply to Email A, and "false" if it is incorrect. Prior to emails A and B, there had already been several email exchanges, and the contents of those exchanges are summarized in the following past emails. Please refer to past emails and pay close attention to the specific information contained within them when making your decision. --- Past emails: (Content of past emails) --- Please make five decisions and respond five times in the following format. Also, please briefly explain your reasoning. --- First time: Second time: Third time: 4th time: 5th time: --- Please also consider the following criteria when making the following decisions. From the perspective of preventing information leaks, if the response to email B contains any unique information other than the items requested in email A, the answer will be "false" without exception. If the items requested in email A are not clearly answered in email B, the result should be "false". ===========
[0036] The mistransmission detection unit 12 may, for example, further refer to related topic information to determine whether the reply message is a mistransmission. In this case, the mistransmission detection unit 12 may, for example, sequentially perform a determination based on the reply message information and a determination referring to the related topic information, or it may make a determination by simultaneously referring to the reply message information and the related topic information. The related topic information includes at least one of the relationships between topic contents and combinations of topic contents and person identification information. The related topic information may be text data or numerical data. The related topic information can be generated, for example, by organizing the relationships between topic contents and between topic contents and person identification information and converting each relationship into a vector. Specifically, for example, numerical related topic information can be generated by inputting organized related topics described in natural language into an Embeddings Model. When the mistransmission detection unit 12 refers to related topic information, it prepares the related topic information and records it in the storage unit of the device 10 prior to processing the device 10. The misdelivery detection unit 12, for example, converts the content of the message to be replied to, which is included in the reply message information, into a vector, and by referring to the converted vector and the related topic information, identifies related topics that are related to the content of the message to be replied to. Then, by determining whether the identified related topics are related to the message to be replied to, the unit can determine whether the reply message is likely to have been sent in error.
[0037] The misdelivery detection unit 12 may, for example, determine the possibility of misdelivery by providing the large-scale language model with, in addition to the content of the message to be replied to and the content of the reply message, related topic information and misdelivery detection instruction information for determining the possibility that the reply message is a misdelivery of the message to be replied to. In this case, the instruction information for determining whether a transmission has been mistransmitted may be the same as described above, except that it includes, for example, a constraint that instructs the determination to be made after considering related topic information.
[0038] The following are specific examples of misdelivery detection instruction information, but this disclosure is not limited to these examples. Furthermore, the following examples illustrate cases where the message is an email and the related topic information is a combination of a person and corresponding business knowledge (business knowledge), but these examples are not limited to this disclosure. Specific examples of error transmission detection instruction information: "Below are the contents of the message to be replied to (Message A), the contents of the reply message to it (Message B), business knowledge, and the reply history (email tree). Your task is to determine, based on the entire email tree and business knowledge, whether Message B may have been sent to Message A in error." Criteria for determining the possibility of sending a message to the wrong recipient: • Presence of contradictions: If [Text B] contains information that is clearly different from or contradicts the content of [Text A] or the entire email tree. • Appropriateness: If, considering the entire email tree, [Message B] does not appropriately respond to the question, request, or intent of [Message A]. • Contextual relevance: When the content of [Text B] is not relevant to the context of [Text A] and includes a completely different topic or context. Or, when is [Text B] relevant to the context and topic of the entire email tree? • Consistency of intent: Does the content of [Text B] match the request, question, or progression of discussion shown in the email tree? • Topic Matching: Does the topic described in document B correspond to the topic associated with the recipient of document B (the sender of document A)? Please provide your results in the following format: If there is a possibility of sending the email to the wrong recipient: Please explain the specific reason and indicate which parts of [Message A], [Message B], [Email Tree], and your business knowledge are inconsistent or irrelevant. If there is no possibility of accidental transmission, please briefly explain why. [Mail tree]: ' 』 [Text A]: ' 』 [Text B]: ' ''
[0039] The following is another specific example of mistransmission detection instruction information. This disclosure is not limited to the following examples. Specific examples of error transmission detection instruction information: Your task is to determine if the content of the following email is consistent with the data content of the reference information provided to you in advance. """ Email: (Content of the email) """ Please also refer to the following information regarding the data content included in the email. """ Reference information: (Content of the data) """ Based on the data content of the reference information, determine whether the content of the email is correct. If it is correct, reply "true," and if it is incorrect, reply "false." Please ignore the capitalization of the serial number and server name, as well as the [doc1] keyword in the reference information. ===========
[0040] The mistransmission detection unit 12 may, for example, update the related topic information by referring to the transmitted message information based on the detection result of the transmitted message.
[0041] Furthermore, the misdelivery detection unit 12 is not limited to a process that determines the possibility of misdelivery using, for example, LLM. The misdelivery detection unit 12 may, for example, use other machine learning methods to determine the possibility of the reply message being misdelivered, or it may determine the possibility of the reply message being misdelivered without using machine learning.
[0042] When the misdelivery detection unit 12 uses machine learning to determine the possibility that the reply message is a misdelivery, for example, it constructs a machine learning model that has learned the content of past misdelivered reply messages and the content of the reply message. Then, by inputting the content of the reply message and the content of the reply message into the constructed machine learning model, it can determine the possibility that the reply message is a misdelivery.
[0043] If the misdelivery detection unit 12 determines the possibility that the reply message is a misdelivery without using machine learning, the misdelivery detection unit 12 can determine the possibility that the reply message is a misdelivery by using, for example, analysis using natural language processing, rule-based text analysis, etc. The analysis using natural language processing can, for example, calculate a similarity score between the content of the message to be replied to and the content of the reply message, and if the similarity score is below a threshold, it can be determined that there is a possibility of misdelivery. The rule-based text analysis can, for example, set up a correspondence list in advance of keywords used in the message to be replied to and keywords used in the reply message that have contradictory or inappropriate relationships, and if a pair of keywords set in the list is detected between the message to be replied to and the reply message, it can be determined that there is a possibility that the reply message was misdelivered.
[0044] The warning unit 13 issues a warning if there is a possibility that the reply message was sent in error. The warning unit 13 can warn the creator (user) of the reply message by outputting a message indicating that the reply message they attempted to send was sent in error. The warning unit 13 may, for example, issue a warning in text, voice, image, or a combination of these. The warning unit 13 may also output the reason why it was determined that the reply message was sent in error. The reason may, for example, be information obtained from the LLM used in S2. The warning unit 13 may also, for example, cooperate with other programs or devices that manage the message to stop the transmission of the reply message that may have been sent in error.
[0045] The message misdelivery prevention support method described herein is a method implemented by, for example, replacing each "procedure" in the message misdelivery prevention support program described herein with a "process." The message misdelivery prevention support method described herein can be implemented, for example, using the message misdelivery prevention support device 10 shown in Figure 1 or Figure 2. However, the message misdelivery prevention support method described herein is not limited to, for example, a method using the message misdelivery prevention support device 10. The message misdelivery prevention support method described herein can be implemented by referring to, for example, the descriptions in the message misdelivery prevention support program and the message misdelivery prevention support device described herein.
[0046] The message misdelivery prevention support program of this disclosure includes a reply message information acquisition procedure, a misdelivery determination procedure, and a warning procedure. The reply message information acquisition procedure acquires reply message information for a message to be replied to, and the reply message information includes the content of the message to be replied to and the content of the reply message. The misdelivery determination procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The warning procedure can issue a warning if there is a possibility that the reply message is a misdelivery. Therefore, the message misdelivery prevention support program of this disclosure can, for example, determine the possibility of misdelivery based on the actual content of the email. Consequently, the message misdelivery prevention support program of this disclosure can suppress message misdelivery with greater accuracy.
[0047] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure are possible, as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0048] <Note> Some or all of the above embodiments may be described as follows, but are not limited to the following: (Note 1) This includes procedures for obtaining reply message information, detecting erroneous transmissions, and issuing warnings. The procedure for obtaining the reply message information described above obtains the reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery detection procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The aforementioned warning procedure warns if the reply message may have been sent in error. A program that assists in preventing the accidental sending of messages to a computer, enabling it to execute each step of the process. (Note 2) The aforementioned reply message information includes the reply history for the message to be replied to, The aforementioned misdelivery detection procedure further includes the message misdelivery suppression support program described in Appendix 1, which refers to the reply history to determine the possibility that the reply message was misdelivered. (Note 3) The reply message information includes at least one of the recipient identification information of the reply message and the sender identification information of the reply message, The aforementioned misdelivery detection procedure further determines the possibility that the reply message was sent in error by referring to related topic information. The message misdelivery prevention support program described in Appendix 1 or 2 includes, as described above, the related topic information, which includes at least one of the relationships between topic contents and combinations of topic contents and person identification information. (Note 4) The message misdelivery detection procedure is a message misdelivery suppression support program as described in Appendix 3, which updates the related topic information by referring to the transmitted message information based on the detection result of the transmitted message. (Note 5) The aforementioned misdelivery detection procedure involves providing the reply message information to a large-scale language model and having it determine the possibility that the reply message is a misdelivery. A message misdelivery prevention support program described in any of the appendices 1 to 4. (Note 6) It includes a reply message information acquisition unit, a misdelivery detection unit, and a warning unit, The aforementioned reply message information acquisition unit acquires reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The misdelivery detection unit determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The warning unit issues a warning if there is a possibility that the reply message was sent in error. A device to help prevent accidental transmission of messages. (Note 7) The aforementioned reply message information includes the reply history for the message to be replied to, The message misdelivery suppression support device described in Appendix 6 further determines the possibility that the reply message is a misdelivery by referring to the reply history. (Note 8) The reply message information includes at least one of the recipient identification information of the reply message and the sender identification information of the reply message, The aforementioned misdelivery detection unit further determines the possibility that the reply message is a misdelivery by referring to related topic information. The message misdelivery suppression support device according to Appendix 6 or 7, wherein the related topic information includes at least one of the relationships between topic contents and combinations of topic contents and person identification information. (Note 9) The message mistransmission suppression support device described in Appendix 8, wherein the mistransmission determination unit updates the related topic information by referring to the transmitted message information based on the determination result of the transmitted message. (Note 10) The misdelivery detection unit provides the large-scale language model with the reply message information and causes it to determine the possibility that the reply message is a misdelivery. A message misdelivery suppression support device as described in any of appendices 6 to 9. (Note 11) This includes a process for obtaining reply message information, a process for determining erroneous transmission, and a warning process. The aforementioned step of obtaining reply message information obtains reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery determination step determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message, The warning step provides a warning if the reply message may have been sent in error. A method for supporting the suppression of erroneous message transmission, in which each step is performed by a computer. (Note 12) The aforementioned reply message information includes the reply history for the message to be replied to, The message misdelivery suppression support method described in Appendix 11 further includes a misdelivery determination step which involves referring to the reply history to determine the possibility that the reply message is a misdelivery. (Note 13) The reply message information includes at least one of the recipient identification information of the reply message and the sender identification information of the reply message, The aforementioned misdelivery detection step further determines the possibility that the reply message is a misdelivery by referring to related topic information. The message misdelivery suppression support method according to Appendix 11 or 12, wherein the related topic information includes at least one of the relationships between topic contents and combinations of topic contents and person identification information. (Note 14) The message misdelivery suppression support method described in Appendix 13, wherein the misdelivery determination step updates the related topic information by referring to the transmitted message information based on the determination result of the transmitted message. (Note 15) The aforementioned misdelivery detection step involves providing the reply message information to a large-scale language model and having it determine the possibility that the reply message is a misdelivery. A method for supporting the suppression of misdelivered messages, as described in any of Appendix 11 to 14. (Note 16) This includes procedures for obtaining reply message information, detecting erroneous transmissions, and issuing warnings. The procedure for obtaining the reply message information described above obtains the reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery detection procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The aforementioned warning procedure warns if the reply message may have been sent in error. A computer-readable recording medium containing a program that assists in preventing the misdelivery of messages, which is used to instruct a computer to execute each step. (Note 17) The aforementioned reply message information includes the reply history for the message to be replied to, The recording medium described in Appendix 16 further determines the possibility that the reply message is a misdelivery by referring to the reply history. (Note 18) The reply message information includes at least one of the recipient identification information of the reply message and the sender identification information of the reply message, The aforementioned misdelivery detection procedure further determines the possibility that the reply message was sent in error by referring to related topic information. The recording medium described in Appendix 16 or 17 includes, but is not limited to, the relationship between topic contents and at least one of the combination of topic contents and person identification information. (Note 19) The recording medium described in Appendix 18 updates the related topic information by referring to the transmitted message information based on the result of the transmission error determination procedure for the transmitted message. (Note 20) The aforementioned misdelivery detection procedure involves providing the reply message information to a large-scale language model and having it determine the possibility that the reply message is a misdelivery. A recording medium as described in any of the appendices 16 to 19. [Industrial applicability]
[0049] According to this disclosure, it is possible to suppress the misdelivery of messages with high accuracy. For this reason, this disclosure can be suitably used in various fields, for example. [Explanation of Symbols]
[0050] 10. Message Misdelivery Prevention Support Device 11 Reply message information acquisition unit 12 Mistransmission Detection Unit 13 Warning part 101 Central Processing Unit 102 memory 103 Bus 104 Storage device 105 Input device 106 Output device 107 Communication devices< / context> < / response> < / request> < / requirement> < / name> < / name> < / type>
Claims
1. This includes procedures for obtaining reply message information, detecting erroneous transmissions, and issuing warnings. The procedure for obtaining the reply message information described above obtains the reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery detection procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The aforementioned warning procedure warns if the reply message may have been sent in error. A program that assists in preventing the accidental sending of messages to a computer, enabling it to execute each step of the process.
2. The aforementioned reply message information includes the reply history for the message to be replied to, The message misdelivery suppression support program according to claim 1, further comprising the misdelivery determination procedure, which determines the possibility that the reply message is a misdelivery by referring to the reply history.
3. The reply message information includes at least one of the recipient identification information of the reply message and the sender identification information of the reply message, The aforementioned misdelivery detection procedure further determines the possibility that the reply message was sent in error by referring to related topic information. The message misdelivery suppression support program according to claim 1 or 2, wherein the related topic information includes at least one of the relationships between topic contents and combinations of topic contents and person identification information.
4. The message misdelivery suppression support program according to claim 3, wherein the misdelivery determination procedure updates the related topic information by referring to the transmitted message information based on the determination result of the transmitted message.
5. The aforementioned misdelivery detection procedure involves providing the reply message information to a large-scale language model and having it determine the possibility that the reply message is a misdelivery. A message misdelivery suppression support program according to claim 1 or 2.
6. It includes a reply message information acquisition unit, a misdelivery detection unit, and a warning unit, The aforementioned reply message information acquisition unit acquires reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The misdelivery detection unit determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The warning unit issues a warning if there is a possibility that the reply message was sent in error. A device to help prevent accidental transmission of messages.
7. The aforementioned reply message information includes the reply history for the message to be replied to, The message misdelivery suppression support device according to claim 6, wherein the misdelivery determination unit further determines the possibility that the reply message is a misdelivery by referring to the reply history.
8. The reply message information includes at least one of the recipient identification information of the reply message and the sender identification information of the reply message, The aforementioned misdelivery detection unit further determines the possibility that the reply message is a misdelivery by referring to related topic information. The message misdelivery suppression support device according to claim 6 or 7, wherein the related topic information includes at least one of the relationships between topic contents and combinations of topic contents and person identification information.
9. This includes a process for obtaining reply message information, a process for determining erroneous transmission, and a warning process. The aforementioned step of obtaining reply message information obtains reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery determination step determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message, The warning step provides a warning if the reply message may have been sent in error. A method for supporting the suppression of erroneous message transmission, in which each step is performed by a computer.
10. This includes procedures for obtaining reply message information, detecting erroneous transmissions, and issuing warnings. The procedure for obtaining the reply message information described above obtains the reply message information for the message to be replied to, The aforementioned reply message information includes the content of the message to be replied to and the content of the reply message, The aforementioned misdelivery detection procedure determines the possibility that the reply message is a misdelivery based on the content of the message to be replied to and the content of the reply message. The aforementioned warning procedure warns if the reply message may have been sent in error. A computer-readable recording medium containing a program that assists in preventing the misdelivery of messages, which is used to instruct a computer to execute each step.