Request processing system, information terminal control method, request processing method, request processing program, and information terminal control program

Abstract

To provide a message processing system capable of properly acquiring information with an information terminal.SOLUTION: A message processing system 100 includes: a first terminal (common entrance equipment 11) placed at an entrance of a facility; and a second terminal (master unit 22a) that is placed inside the facility and is capable of performing two-way call with the first terminal. The message processing system 100 also includes: a storage unit that stores purpose information on the purpose of a visitor acquired by the first terminal before starting the two-way call between the first terminal and the second terminal; and an output unit that outputs the purpose information stored in the storage unit to a third terminal different from the second terminal via a public line.SELECTED DRAWING: Figure 1

Description

【Technical Field】 【0001】 The present disclosure relates to a case processing system using an intercom for communication between a common entrance and a residential unit, a control method for an information terminal, a case processing method, a case processing program, and a control program for an information terminal. 【Background Art】 【0002】 Conventionally, intercom systems are installed in many collective facilities such as condominiums and apartments. This intercom system generally includes an entrance intercom provided at the common entrance, and an intercom main unit and a door phone provided in each residential unit. A visitor uses the entrance intercom to call the intercom main unit of the visited residential unit and make a call. 【0003】 In Patent Document 1, it is shown that convenience is improved by acquiring the voice of a visitor in the intercom main unit while the intercom main unit is being called by the visitor. 【Prior Art Documents】 【Patent Documents】 【0004】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2019-193234 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0005】 Here, in the intercom system, there is a demand to use an information terminal such as a smartphone in the same way as the intercom main unit. In this case, it is necessary to consider the case of using the information terminal outside the home, and in that case, there is a demand to perform operations so as not to have an adverse effect on the surroundings. 【Means for Solving the Problems】 【0006】 The request processing system relating to this disclosure comprises: a first terminal installed at the entrance of a facility; a second terminal installed inside the facility and capable of two-way communication with the first terminal; a storage unit that stores request information regarding the visitor's request acquired by the first terminal before the start of the two-way communication between the first terminal and the second terminal; and an output unit that outputs the request information stored in the storage unit to a third terminal different from the second terminal via a public telephone line. The aforementioned requirements information can be broadcast from the third terminal based on operations performed on the third terminal during a call to the third terminal resulting from a call from the first terminal to the second terminal. . 【0007】 Furthermore, the information terminal control method relating to this disclosure is a control method for an information terminal that can communicate via a public line with an intercom system including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility, and comprises the steps of: acquiring request information regarding the visitor's request obtained by the first terminal before the start of a two-way call with the second terminal; and notifying the acquired request information. When the first terminal makes a call to initiate the two-way call with the second terminal, it also makes a call to the information terminal, and during the call, the information terminal is made capable of executing the notification step based on user operations on the information terminal. . 【0008】 Furthermore, the request processing system relating to this disclosure is a request processing system that processes requests in a call between a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, comprising: the first terminal; an acquisition unit that acquires request information relating to the visitor's request acquired at the first terminal before the start of the two-way call with the second terminal; a storage unit that stores the request information acquired by the acquisition unit; and an output unit that outputs the request information stored in the storage unit to a third terminal different from the second terminal via a public line. The aforementioned request information can be broadcast from the third terminal based on operations performed on the third terminal during a call to the second terminal from the first terminal. . 【0009】 Furthermore, this disclosure relates to a program for the aforementioned request processing system and information terminal control method. [Effects of the Invention] 【0010】 According to this disclosure, appropriate information regarding the visitor's purpose and other details can be obtained at an early stage. [Brief explanation of the drawing] 【0011】 [Figure 1] This diagram schematically shows the overall configuration of the requirements processing system according to the embodiment. [Figure 2] This is a functional block diagram of a shared entrance system according to an embodiment. [Figure 3] This is a block diagram showing the configuration of the master unit 22a of a dwelling unit according to the embodiment. [Figure 4] This is a block diagram showing the configuration of an information terminal according to the embodiment. [Figure 5] This flowchart shows the processing of the shared entrance device upon arrival of a visitor according to the embodiment. [Figure 6] This flowchart shows the processing performed when a visitor arrives at the master unit according to the embodiment. [Figure 7] This flowchart shows the processing of an information terminal upon arrival according to the embodiment. [Figure 8] This flowchart shows the process of adding response candidates to the requirements of the information terminal according to the embodiment. [Modes for carrying out the invention] 【0012】 The embodiments of this disclosure will be described below with reference to the drawings. The embodiments described below are not limiting to this disclosure, and configurations formed by selectively combining multiple examples are also included in this disclosure. 【0013】 The main body of the system and device of the present disclosure includes a computer. By executing a program on this computer, the functions of the main body of the system and device of the present disclosure and the method using the same are realized. The computer mainly includes a processor that operates according to the program as a hardware configuration. The type of the processor is not limited as long as it can realize the above functions by executing the program. The processor is composed of one or more electronic circuits including an integrated circuit (IC) or a large-scale integrated circuit (LSI). The plurality of electronic circuits may be integrated on one chip or provided on a plurality of chips. The plurality of chips may be integrated into one device or provided in a plurality of devices. Also, the program is stored in a non-temporary storage medium such as a ROM readable by a computer, an optical disk, or a hard disk drive. The program may be stored in the storage medium in advance or may be supplied to the storage medium via a wide-area communication network including the Internet or the like. 【0014】 "Overall Configuration" FIG. 1 is a diagram schematically showing the overall configuration of a case processing system 100 which is an example of an embodiment. 【0015】 The case processing system includes an intercom system 1 installed in a collective facility such as an apartment, a management system 3 and an information terminal 4 connected to the intercom system 1 via a communication line 2. In the present disclosure, the information terminal 4 is also referred to as a third terminal. 【0016】 The intercom system 1 is a system for processing the matters of visitors in a collective facility. The intercom system 1 is connected to an external management system 3 by a communication line 2 such as the Internet using a public line such as a telephone line. Also, an information terminal 4 such as a smartphone, a mobile phone, or a notebook computer is connected to the communication line 2, and the information terminal 4 functions as a terminal similar to the master unit 22a of the intercom described later. 【0017】 The intercom system 1 is a system installed in a collective facility such as an apartment building, and includes a common entrance device 11 provided at the common entrance, an intercom master unit 22a provided in each dwelling unit which is the exclusive part of each occupant, and a control device 30 that performs various controls. 【0018】 At the common entrance of the collective facility, there are provided a common entrance device 11 for a visitor to have a conversation with an occupant, a key detection device 12 for detecting a card key of a visitor or an occupant, an entrance door 13 which is the entrance of the collective facility, an electric lock 14 for locking and unlocking the entrance door 13, etc. Note that the common entrance device 11 is also called a lobby intercom etc., and is also referred to as the first terminal in the present disclosure. 【0019】 In each dwelling unit of the collective facility, there are provided an intercom master unit (hereinafter referred to as the master unit) 22a, a entrance sub-unit 22b, a router 22c etc. for connecting the master unit 22a and an information terminal 4 via a communication line 2. In the present disclosure, the master unit 22a is also referred to as the second terminal. 【0020】 The entrance sub-unit 22b can perform two-way communication with the master unit 22a, similar to the common entrance device 11. Also, the router 22c is for connecting to an external communication line 2, and can be shared with that for connecting various information devices such as a PC (personal computer) provided in each dwelling unit to the communication line 2. Further, various sensors provided in the living room and various devices may be connected to the master unit 22a so that information thereof can be exchanged with the outside. 【0021】 The control device 30 is composed of a computer and performs various data processing. The common entrance device 11 and the master unit 22a of the dwelling unit are connected to the control device 30, and a management room master unit 15 which is planned to be used by a manager etc. is also connected. Also, a communication line 2 is connected to the control device 30 via a gateway 61 and a router 62, and the control device 30 can communicate with the outside. Note that various data can be stored here in the control device 30. Note that it may be stored in other devices within the intercom system 1 or in a database etc. connected to the intercom system 1. 【0022】 The management system 3, connected to the communication line 2, has a management server 3a and performs various management tasks for multiple collective facilities. The management system 3 may also include a control device 30, or it may be configured as a cloud-based system. Furthermore, at least part or all of the management system 3 may be included in the intercom system 1. The management system 3 typically performs various management tasks for the request processing systems in multiple collective facilities. 【0023】 Furthermore, the information terminal 4 is preferably portable by residents, and can be operated from outside the collective facility via the master unit 22a, allowing the same operations as those performed on the master unit 22a on devices connected to the master unit 22a. The information terminal 4 can also be connected to the communication line 2 via the master unit 22a and the control device 30. 【0024】 The shared entrance device 11, master unit 22a, management room master unit 15, management server 3a, and information terminal 4 are all terminals that handle information processing, and they are connected to form the request processing system 100. The request processing system 100 also functions as an audio information output system. 【0025】 "facility" Intercom System 1 can be applied to various types of multi-unit buildings, such as apartments, dormitories, and company housing. However, it is not limited to multi-unit buildings; any facility with a shared entrance is acceptable. Intercom System 1 can also be applied to non-residential multi-unit buildings, such as offices, factories, research facilities, medical facilities, and accommodation facilities, which consist of multiple facilities (multiple companies, departments, divisions, etc.). Furthermore, the facilities may be single-family homes or other non-residential buildings. 【0026】 "Shared entrance system" The common entrance is equipped with a shared entrance device 11, which is a shared entrance device for calling each dwelling unit. The shared entrance device 11 is used by people visiting a dwelling unit (referred to as visitors). Visitors can call their destination dwelling unit (for example, dwelling unit number) by entering it into the shared entrance device 11. The common entrance is also equipped with an entrance door 13 and an electric lock 14 for locking the entrance door 13. The electric lock 14 is, for example, an auto-locking device that automatically locks the entrance door 13 when it is closed, and the electric lock 14 is locked and unlocked under the control of the control device 30. The entrance door 13 is, for example, an automatic door and is normally locked. The shared entrance device 11 is connected to the control device 30 and also to the master unit 22a of each dwelling unit, etc., so that they can communicate with each other. 【0027】 The shared entrance device 11 is installed outside the entrance door 13 of the common entrance. Visitors use the shared entrance device 11 to call the dwelling unit they are visiting and announce their arrival. Residents can confirm the visitor using the master unit 22a, operate the master unit 22a to unlock the electric lock 14, and open the entrance door 13. 【0028】 In the example shown in Figure 1, a key detection device 12 is installed at the shared entrance. The key detection device 12 is composed of, for example, an IC card reader, and when it detects a pre-registered card key, the electric lock 14 is unlocked and the entrance door 13 opens. 【0029】 Figure 2 is a functional block diagram of the shared entrance device 11. The shared entrance device 11 has a communication unit 120, which is connected to a control device 30, and necessary information is exchanged via communication. This connection may be wired or wireless. The communication unit 120 is connected to a processing unit 121. The processing unit 121 is a computer composed of a processor, memory, etc., which performs various information processing by executing various programs and controls connected devices with various signals according to the results. It also includes a storage unit 121a that stores video and audio about the request obtained by the camera 112 and microphone 114, an output unit 121b that outputs the request stored in the storage unit 121a to the outside via the communication unit 120, and a setting unit 121c that stores settings such as whether to inquire about the request or record / video the request. The information related to the request, including the video and audio about the request, is called request information. 【0030】 The processing unit 121 is connected to a camera 112, a motion sensor 113, a microphone 114, a monitor 115, and a speaker 116. The motion sensor 113 detects when a visitor approaches, acquires the visitor's image and voice, and outputs necessary displays and sounds from the microphone 114, monitor 115, and speaker 116. 【0031】 Furthermore, the input unit 110 is connected to the processing unit 121. The input unit 110 includes a numeric keypad 110a, a call button 110b, and function keys 110c. For example, the room number can be entered using the numeric keypad 110a, and the intercom in the corresponding room can be called using the call button 110b. Various functions can be set to the function keys 110c. 【0032】 "Main unit" Figure 3 is a block diagram showing the configuration of the master unit 22a. Each home's master unit 22a is connected to the line 122 from the control device 30. 【0033】 The line 122 may be a wired or wireless line. The processing unit 204 is connected to the line 122 via the communication unit 202 in the master unit 22a. The processing unit 204 is a computer and is responsible for various data processing. The communication unit 202 performs the processing necessary for the data exchange that the processing unit 204 performs with other external devices on the line 122. The door station 22b and router 22c mentioned above are also connected to the communication unit 202, and the communication unit 202 performs the processing necessary for data exchange. The master unit 22a can perform two-way communication, such as voice calls, with the door station 22b, similar to the shared entrance device 11. 【0034】 The processing unit 204 is connected to an input unit 206 and a microphone 208 as input means. The input unit 206 is for inputting character data, etc., and may include input keys or a touch panel. The microphone 208 can input voice. Furthermore, a camera may be provided to allow video input as well. 【0035】 Furthermore, the processing unit 204 is connected to a monitor 210 and a speaker 212 as output means, and can output video and audio from these. The monitor 210 can be used as a display unit when using the touch panel. 【0036】 Furthermore, in this example, the storage unit 144 is connected to the processing unit 134, and can store message information, including video and audio. 【0037】 Furthermore, the processing unit 134 has an analysis unit 134a, which can, for example, perform speech recognition on audio data and generate text data. 【0038】 "Information terminal" Figure 4 is a block diagram showing the configuration of the information terminal 4. The information terminal 4 communicates with the master unit 22a via the communication line 2 and can make calls to the shared entrance device 11 on behalf of the master unit 22a. It may also be configured to make calls to the entrance sub-unit 22b. 【0039】 The information terminal 4 is preferably composed of a portable device capable of wireless communication, such as a smartphone. Here, the information terminal 4 can perform various functions in the same way as a general-purpose computer by registering applications, etc., but Figure 4 shows the configuration when it functions as an intercom terminal. That is, the information terminal 4 according to this embodiment has a predetermined application program installed, and by executing that application program, it can connect to the master unit 22a and communicate with the shared entrance device 11 on behalf of the master unit 22a. 【0040】 The information terminal 4, which serves as the terminal for the intercom, has a configuration almost identical to that of the master unit 22a. However, smartphones and the like are portable terminals, and the communication unit 402 is capable of wireless communication. The communication unit 402 is connected to the processing unit 404. The processing unit 404 is connected to an input unit 406 and a microphone 408 as input means, and a monitor 410 and a speaker 412 as output means, as well as a storage unit 414 for storing various information. The information terminal 4 has this configuration and has the same functions as the master unit 22a. The processing unit 404 also has an analysis unit 404a and a setting unit 404b. The analysis unit 404a performs speech recognition and the like, recognizes text from speech data, analyzes the recognized text, and determines the type of request, which is the content of the request. The setting unit 404b stores information such as whether to allow output from speaker 412 (whether or not to output sound) and a table of response candidates corresponding to the type of request. If there are multiple response candidates for a single request, a priority is assigned, and this priority can be updated through learning. Furthermore, it is desirable that the response candidates be edited by the user as needed, allowing for changes, additions, and deletions. The silent mode setting on smartphones, etc., can also be used for the above-mentioned setting of whether or not to output sound. 【0041】 "Processing via the shared entrance device" Figure 5 is a flowchart showing the processing performed by the processing unit 121 of the shared entrance device 11 upon arrival of a visitor. This processing assumes that the setting unit 112c of the processing unit 121 is configured to inquire about the visitor's purpose and to record / video the visitor's information. Depending on the user's settings, it is also possible to disable the inquiry about the visitor's purpose and the recording / video recording. 【0042】 The shared entrance device 11 determines whether a visitor is approaching based on the detection result of the motion sensor 113 (see Figure 2) (S11). If the determination in S11 is YES, an instruction is output (S12). This instruction tells the visitor to enter the room number of their destination and press the call button 110b. 【0043】 The system determines whether the visitor has entered the room number and pressed the call button 110b within a predetermined time (S13). If the determination is YES, a call signal is output to the master unit 22a of the dwelling unit identified by the room number, thereby making a call (S14). If the determination in S11 and S13 is NO, the system returns to the determination in S11. 【0044】 Here, a call is made to the master unit 22a, and while waiting for a response from the master unit 22a, the visitor is inquired about their purpose (S15). This inquiry is made by voice from the speaker 116, but images and text related to the inquiry may also be output to the monitor 115. 【0045】 Furthermore, the monitor 115 can display a list of possible visitor types. These options may include "Scheduled Visit," "Package Delivery," "Door-to-Door Sales," "Survey," and "Visiting an Acquaintance," and it would be ideal if users could select these options via a touch panel. 【0046】 Then, in response to the inquiry about the request, the microphone 114 and camera 112 acquire the audio and video of the request and store them in the storage unit 121a (S16). In addition, when selecting the candidate as described above, it is not necessary to acquire request information in audio and video, or it is possible to acquire it together with at least one of audio and video. 【0047】 Then, once the request has been acquired and stored, the request is transmitted from the output unit 121b to the master unit 22a of the calling dwelling (S17). It is preferable that the transmission in S17 be performed in parallel with the storage in S16. 【0048】 Next, it is determined whether a response was received from the master unit 22a within a predetermined time (S18). This response is from the master unit 22a, but it may also be a response from the information terminal 4. 【0049】 If the determination in S18 is YES, two-way communication is performed with the responding terminal (master unit 22a or information terminal 4) (S19). That is, a normal intercom conversation is performed, with video and audio transmitted from the shared entrance device 11 side and audio transmitted from the master unit 22a side (S19). 【0050】 If a response is received between the inquiry of the request, acquisition of request information, and transmission of the request in steps S15-S17, the processing currently underway may be interrupted and the system may proceed to S19. Alternatively, the system may complete the transmission of the request in S17 before proceeding to the communication in S19. In this case as well, it is advisable to store the audio and video of the request for a predetermined period of time. Furthermore, the request inquiry in S15 may be disabled; in this case, the system will respond to the call in S14 and proceed to the response determination in S18. 【0051】 Furthermore, if no request was entered in S16, or if the request was selected, it is best to proceed directly to the judgment in S18. 【0052】 Furthermore, when prompting for input of a request, the S14 call is performed only if a request is entered; if no request is entered, the call on the master unit 22a does not need to be performed. In this case, the video and audio may be stored and played back as appropriate on the master unit 22a. 【0053】 If the S18 determination is NO, the system will notify that the call cannot be forwarded. In other words, it will notify via audio or video that communication via the intercom is not possible. In addition, for example, if the call destination is set to answering machine mode, the system may prompt the caller to enter an answering machine message, and if a message is entered, it may be retrieved and stored. 【0054】 This message may also be sent to the master unit 22a in the dwelling unit and stored in the master unit 22a. In the common entrance device 11, stored requests and messages are usually stored in the master unit 22a, so saving them is not necessary, but they may be stored for a predetermined period and made available for transmission upon request. 【0055】 "Processing at the main unit in the dwelling unit" Figure 6 is a flowchart showing the processing in the processing unit 204 of the master unit 22a when a visitor arrives. 【0056】 The master unit 22a determines whether it has received a call from the shared entrance device 11 (S31). This determines whether it has received a call signal from the shared entrance device 11. If the determination in S31 is NO, this determination is repeated, and if it is YES, the master unit 22a starts up its system and receives the video and audio of the message sent from the shared entrance device 11 (S32). In other words, the master unit 22a receives the message sent from the shared entrance device 11 before a response is input and two-way communication begins. 【0057】 Furthermore, following or in parallel with the reception of the message in S32, a ringtone is output from speaker 212, and the received message video and audio are output from monitor 210 and speaker 212 (S33). The received message video and audio are also stored in storage unit 214. 【0058】 Then, the stored video and audio messages are transmitted to the registered information terminal 4 (S34). In other words, residents of a dwelling unit can pre-register an information terminal 4 to respond on behalf of the master unit 22a. 【0059】 Next, it is determined whether a response has been received from the master unit 22a or the registration information terminal 4 within a predetermined time (S35). If the determination in S35 is YES, two-way communication (video and audio communication) is performed between the master unit 22a and the shared entrance device 11 (S36). 【0060】 The process terminates when the communication in S36 is completed or when the determination in S35 is NO. However, if the information terminal 4 responds during the determination in the predetermined time in S35, the process may be terminated even if it is within the predetermined time. 【0061】 "Processing on information terminals" Figure 7 is a flowchart showing the processing in the processing unit 404 of the information terminal 4 when a visitor arrives. 【0062】 It is determined whether a call has been received from the shared entrance device 11 (S41). This is a determination of whether the information terminal 4 has received a call signal from the shared entrance device 11 via the master unit 22a to which it is registered. If the determination in S41 is NO, this determination is repeated. 【0063】 If the determination in S41 is YES, then it is determined whether message reception is enabled on the information terminal 4 (S42). That is, the application program registered on the information terminal 4 can set whether message reception is enabled or disabled, and this setting is checked. Users who do not need to receive messages can disable this setting, and no message information will be received, and the process will proceed to the determination in S47 as to whether or not another terminal has responded. 【0064】 If the determination in S42 is YES, the video and audio of the message sent via the master unit 22a are received, and a message playback button is displayed (S43). In other words, the message sent following the transmission of the call signal is received, and at that time, a message playback button is displayed on the monitor 410. For example, the text "Do you want to play the message?" is displayed in an operable state. In this embodiment, it is assumed that the information terminal 4 employs a touch panel as the input unit 406, and the operation is detected by touching the displayed button, but other physical button operations may also be used. 【0065】 If the user operates the message playback button and the answer is YES in S44, it is determined whether playback with sound (playback with sound output) is enabled, that is, whether sound output from the speaker is permitted (S45). This determination can be made by displaying a button to set whether or not to enable sound output, similar to the playback button, and determining the status based on the operation of this button. Alternatively, the determination may be made based on pre-set sound output conditions. For example, if the information terminal 4 is set to a mode that prohibits or suppresses sound output, such as silent mode, it can be determined that there is no sound playback. This allows for the use of different settings in the normal use of the information terminal 4, such as enabling sound output when at home and prohibiting sound output in situations where sound output is undesirable, without any special operation. Furthermore, the presence or absence of sound output may be set depending on whether or not an earphone device is connected to the information terminal 4. In this case, for example, if an earphone device is connected, sound output may be enabled. Moreover, even if the information terminal 4 is in silent mode, if an earphone device is connected, sound output may be enabled. 【0066】 Here, the determination of whether or not to output audio in S45 may be made while confirming the necessity of receiving the message in S42, and it may also be possible to disable audio output while the message is being played back (notified) in S46 (while the notification is being performed). 【0067】 If the determination in S45 is YES, the video and audio related to the message received in S42 are played back and output from the monitor 410 and speaker 412 (S46). This notifies the user of the message. 【0068】 If playback in S46 is completed, or if the determination in S42 and S44 is NO, it is determined whether another terminal has responded (S47). Here, the other terminals are assumed to be the master unit 22a and other information terminals 4 registered with the master unit 22a. The predetermined time is the predetermined time from the completion of message playback. 【0069】 If the determination in S47 is NO, meaning that other terminals have not responded, it is determined in S48 whether the information terminal 4 has received an input within a predetermined time to respond, i.e., to communicate (two-way communication) with the shared entrance device 11. Here, within the predetermined time in S48, it is preferable to control the system so that the terminal that receives the response input earlier from the other terminals will initiate two-way communication with the shared entrance device. 【0070】 If the determination in S48 is YES, two-way communication, i.e., video and audio communication, is performed between the shared entrance device 11 and the information terminal 4 (S49). Normally, the video and audio from the shared entrance device 11 are played back on the information terminal 4, and only audio is supplied from the information terminal 4 to the shared entrance device 11. 【0071】 The process terminates when the two-way call in S49 ends, when the answer in S47 is YES or in S48 is NO, i.e., when another terminal responds, or when there is no response from the information terminal 4. 【0072】 If the answer in S45 is NO, i.e., if audio playback is not performed, the analysis unit 404a performs speech recognition processing to generate text about the request (request text) and displays the request text on the monitor 410 (S50). In addition, the recognized request is identified as belonging to one of the pre-stored request types. 【0073】 Then, candidate response messages (hereinafter referred to as "response candidates") that are pre-configured to correspond to the type of specified request are read from the tables registered in the setting unit 404b. Here, it is first determined whether there are multiple response candidates to read (S51). If the determination in S51 is YES, the priority order is read for the multiple response candidates and a priority order for display is set (S52). That is, the display order for the multiple response candidates is determined, and if the number of candidates is greater than the predetermined number to be displayed, the response candidates to be displayed are selected based on the priority order. 【0074】 If the display content is determined in S52, or if there are not multiple candidates in S51, the response candidates for the determined request are displayed (S53). 【0075】 For example, in the case of package delivery, the system uses speech recognition to process a voice message such as, "This is XX Transportation. We've come to deliver your package." It then reads out the following pre-stored response options corresponding to this message and displays them in order of their set priority. 1. I'll open it now. Please leave it in front of your front door. 2. Please place it in the delivery box next to the shared entrance. 3. I cannot receive it right now. Please redeliver it. 【0076】 Here, as mentioned above, if there are many response candidates and the number of available options exceeds the number that can be displayed, it would be good to display only the top-ranking available options according to the set priority, or to display a "Show All" button or similar, and if requested, display and allow selection of the response candidates that are not currently shown. Alternatively, a "Enter Text" button could be provided to allow the response to be entered as text. 【0077】 In this example, in S56, the system continuously learns and updates the priority order. For example, in dwelling unit A, option 1 is frequently selected, so its priority is 1. However, in dwelling unit B, option 2 is frequently selected, so its priority becomes 1. In this case, the display order will differ between the two units. 【0078】 Next, it is determined whether a response candidate has been selected (S54). Response selection is usually done via input from the touch panel. If the determination in S52 is YES, the response corresponding to the selected response candidate is sent (S55). This response is, for example, text data and is sent to the shared entrance device 11 via the master unit 22a, where it is displayed on the monitor 115. Note that while the response candidates are displayed as text on the information terminal 4, voice data may also be stored in the storage unit 414 and sent to the shared entrance device 11. In this case, the selected response is output as voice on the shared entrance device 11. 【0079】 Once the transmission of the response in S55 is complete, the selection results of the response candidates are learned, the priority is updated (S56), and the process is terminated. 【0080】 Here, the shared entrance device 11 can also convert the incoming response text into speech and output the speech. In addition, the information terminal 4 may be muted and in a two-way communication state, and the information terminal 4 may perform text input multiple times. 【0081】 Furthermore, if the answer in S52 is NO, the process moves to determining whether there is a response in S48 when voice is available. If there is a response in S48, it becomes a two-way call with voice in S49. On the other hand, if there is no response in S48, the answer will be NO in S48 and the call will end there. Therefore, if voice is not available, it is best to end the call without responding. 【0082】 If another terminal responds between S50 and S53, it is considered more appropriate for the other terminal to respond normally, and therefore, processing on the information terminal 4 should be terminated. 【0083】 Furthermore, in Figure 7, the message text and response candidates were displayed only when the determination of whether to play with audio in S45 was NO. However, even when playing a message with audio (S46) because the determination in S45 is YES, the process of displaying the message text (S50) and updating the priority (S56) may also be performed. In other words, by overlaying the text on the screen where audio playback is taking place, or by displaying the text on a separate screen, the same response candidate display, selection, and transmission can be performed even when there is no audio. 【0084】 Furthermore, users may be allowed to add suggested responses to a request. Figure 8 is a flowchart showing the process of adding suggested responses to a request. 【0085】 First, it is determined whether maintenance has been requested (S61), and if YES, the maintenance menu is displayed (S62). This maintenance menu includes additional response options for the request. 【0086】 The system determines whether "Add response candidate" is selected (S63), and if it is YES, it determines whether the request to which a response candidate should be added has been selected (S64). That is, when "Add response candidate" is selected, the type of request is displayed, and the user selects the request to which a response candidate should be added. 【0087】 In S64, if a request is selected, the user is asked to choose whether to input a response via text or voice, and the result is determined (S65). 【0088】 In S65, if text input is selected, the system accepts text input from the user (S67). Then, it determines whether to perform speech conversion (S67), and if not, it registers the entered text as a candidate response for the relevant request (S68). 【0089】 If the determination in S65 is voice input, voice input (voice recording) regarding response candidates is accepted (S69). Then, the system asks whether sound quality conversion is necessary, and if YES, sound quality conversion is performed (S70); if NO, sound quality conversion is not performed and the response candidate of the input voice is registered (S72). 【0090】 In the voice conversion step S69, the recorded voice data is converted into another predetermined voice. The predetermined voices can include male and female voices obtained through computer speech synthesis, gender-neutral voices, or voices created by combining pre-recorded voices. 【0091】 If the result of S63 and S64 is NO, no response candidates are added, and the process ends. If the result of S67 is YES, the process proceeds to S72, and the voice-changed response candidates are registered. 【0092】 In this way, the added response candidates are added and stored in the setting unit 404b in association with the selected request. The added response candidates may be automatically set to priority 1, or they may be set to any priority. 【0093】 Furthermore, at the end of the process shown in Figure 7, an "Add Candidate" button may be displayed, allowing users to input additional response candidates. 【0094】 "Effects of the Embodiment" Thus, in this embodiment, when a request is entered into the shared entrance device 11, a request playback button is displayed on the information terminal 4, and the request can be heard by responding to this button. 【0095】 Furthermore, the system can interpret the visitor's voice message, convert it to text, and display it. This allows visitors to confirm the visitor's message in text format along with their video feed. Therefore, it is possible to confirm the visitor's message even in situations where voice output is undesirable. 【0096】 Since the audio output can be switched on or off according to the settings of the information terminal 4, such as the normal state of silent mode, there is no need to specifically set the audio on or off. 【0097】 Furthermore, response options are displayed, allowing users to input responses without using their voice. Additionally, a key input option has been added for selecting response options; if selected, the response can also be entered as text. Therefore, it is possible to respond to the shared entrance device 11 without producing or emitting any voice. 【0098】 In this way, the shared entrance device 11 can prompt visitors to input the type of their request, or the shared entrance device 11 or the information terminal 4 can interpret the voice of the request and determine the type of request. 【0099】 When the type of request is known, narrowing down the response message options to only the appropriate ones makes it easier to select a response and improves usability. 【0100】 Furthermore, selecting a response message can be cumbersome and time-consuming. Therefore, the display order (priority) of response messages can be changed using the following method. 【0101】 "Other configurations" Figures 7 and 8 illustrate the processing performed when a message is received on the information terminal 4 (including message playback, display of message text, display of response candidates, and registration of response candidates). However, the processing shown in Figures 7 and 8 can also be performed on the master unit 22a. That is, the master unit 22a can also display text or display and select response candidates instead of the usual audio and video output. Furthermore, response candidates can be added as needed. 【0102】 The system uses image analysis to authenticate visitors based on the video footage captured by the camera, recognizes the type of visitor's purpose, and outputs a response message appropriate to the visitor's request. For example, it might recognize a visitor as a delivery person based on their uniform, and in this case, prioritize the display of a response message such as "Please put the package in." Furthermore, for family members, facial recognition data can be registered in advance, and this registered data can be used to identify visitors and set the priority of response messages. 【0103】 Furthermore, the shared entrance device 11 can analyze the video and audio of the message received and create candidate response messages. For example, if "I'm home" is recognized, it can generate "Welcome back." 【0104】 Furthermore, it is possible to allow users to record response messages. While registration is possible via voice input from the microphone of information terminal 4, for privacy reasons, it may be converted to machine voice, or text input may be converted to recorded voice or machine voice. 【0105】 In addition, by registering a specific application on the information terminal 4, it is possible to view recorded video footage and play back video and audio recordings of messages made by the shared entrance device 11. Furthermore, once playback of the video and audio recordings of messages is complete, the information terminal 4 can automatically delete them, and they can be saved on the master unit 22a or stored for a predetermined period on the shared entrance device 11. 【0106】 Furthermore, the system can learn from the user's selection of response messages and change the display order of recommended response messages based on their frequency of use. 【0107】 In this embodiment, the visitor's message was automatically acquired by the shared entrance device 11 when a visitor arrived, but this function can also be turned off. In that case, the system should prompt the visitor for a response. Two-way communication should then be initiated in response to the response. For example, if a family member is expected to return home, the acquisition of the visitor's message should be turned off. 【0108】 In this case, the display order of the list of response messages displayed on the information terminal 4 can be changed. 【0109】 Although the explanation of the message information included both audio and video, the message information may be audio only. 【0110】 Furthermore, the audio and video information provided may be from different time periods. For example, the shared entrance device 11 may acquire video without audio before the inquiry and transmit it to the master unit 22a, or it may acquire only video while the shared entrance device 11 is outputting audio such as the audio for the inquiry. In other words, it may acquire and transmit images at a time different from when the inquiry is acquired. The shared entrance device 11 may also continuously acquire audio and video when it detects a person using the motion sensor 113. 【0111】 Furthermore, the term "video" is not limited to regular video footage; it may also refer to still images or a series of still images at predetermined intervals. 【0112】 In this embodiment, the description was based on the premise of a shared entrance device 11 for a multi-unit building. However, when applying the system of this disclosure to facilities such as detached houses, the request information may be acquired by a device equivalent to the entrance sub-unit 22b instead of the shared entrance device 11. Furthermore, even in a multi-unit building, the request information may be acquired by the entrance sub-unit 22b. That is, the entrance sub-unit 22b may acquire the request information, transmit it to the master unit 22a, and the information terminal 4 may respond to the entrance sub-unit 22b. 【0113】 This disclosure is further illustrated by the following embodiments. Configuration 1: A message processing system comprising: a first terminal installed at the entrance of a facility; a second terminal installed inside the facility and capable of two-way communication with the first terminal; a storage unit that stores message information regarding the visitor's request acquired by the first terminal before the start of the two-way communication between the first terminal and the second terminal; and an output unit that outputs the message information stored in the storage unit to a third terminal different from the second terminal via a public telephone line. Configuration 2: The request processing system according to Configuration 1, wherein the storage unit and the output unit are provided in the first terminal, and the request information is output from the first terminal and then sent to the third terminal via the second terminal and the public network. Configuration 3: The request information includes the voice of a visitor to the facility acquired by the first terminal, as described in Configuration 1 or 2, for the request processing system. Configuration 4: A request processing system according to any one of Configurations 1 to 3, wherein the request information can be broadcast from the third terminal during a call to the third terminal in connection with a call from the first terminal to the second terminal. Configuration 5: The request processing system according to Configuration 4, wherein the request information can be notified from the third terminal based on an operation performed on the third terminal. Configuration 6: A message processing system for processing messages in a call between a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, comprising: the first terminal; an acquisition unit that acquires message information regarding the visitor's message acquired by the first terminal before the start of the two-way call with the second terminal; a storage unit that stores the message information acquired by the acquisition unit; and an output unit that outputs the message information stored in the storage unit to a third terminal different from the second terminal via a public line. Configuration 6 includes a request processing system that includes any of the configurations from Configurations 2 to 5. Configuration 7: A method for controlling an information terminal that can communicate via a public line with an intercom system including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility, the method comprising: a step of acquiring request information regarding the visitor's request, which the first terminal acquired before the start of a two-way call with the second terminal; and a notification step of notifying the acquired request information. Configuration 8: The information terminal control method described in Configuration 7, wherein the requirements information includes the voice of a visitor to the facility, which is acquired by the first terminal. Configuration 9: The information terminal control method according to Configuration 7 or 8, wherein when the first terminal makes a call to initiate the two-way call with the second terminal, it also makes a call to the information terminal, and the notification step can be executed during the call. Configuration 10: A control method for an information terminal according to any one of Configurations 7 to 9, which enables the notification step to be executed based on user operations on the information terminal. Configuration 11: A control method for an information terminal according to any one of Configurations 7 to 10, comprising the step of displaying a message to enable or disable the audio output from the speaker of the information terminal while confirming or performing the notification step. Configuration 12: A control method for an information terminal according to any one of claims 7 to 11, wherein the enabled or disabled state of the voice output is set based on the enabled or disabled state of a silent mode that sets the enabled or disabled state of the voice output in the information terminal. Configuration 13: A method for controlling an information terminal according to any one of Configurations 7 to 12, comprising the step of displaying candidate responses to the aforementioned request information. Configuration 14: An intercom message processing method including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, A method for processing inquiries, comprising the steps of: acquiring inquiry information regarding the visitor's purpose at the first terminal before the start of the two-way call between the first terminal and the second terminal; storing the acquired inquiry information; and outputting the stored inquiry information to a third terminal different from the second terminal via a public telephone line. A requirements processing method in configuration 14 that further includes one of the items in configurations 2 to 5. Configuration 15: An intercom message processing program including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, wherein the intercom is instructed to acquire message information regarding the visitor's request at the first terminal before the start of the two-way communication between the first terminal and the second terminal, to store the acquired message information, and to output the stored message information to a third terminal different from the second terminal via a public telephone line. Configuration 15 further includes the items of Configurations 2 to 5 in the request processing program. Configuration 16: A message processing program used in a message processing system that processes messages in a call between a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, the message processing system comprising: causing the first terminal to acquire message information regarding the visitor's request before the start of the two-way call between the first terminal and the second terminal; storing the acquired message information; and outputting the stored message information to a third terminal different from the second terminal via a public telephone line. Configuration 16 further includes the items of Configurations 2 to 5 in the requirements processing system. Configuration 17: A control program for an information terminal that can communicate via a public line with an intercom system including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility, the information terminal causing the information terminal to acquire visitor information obtained by the first terminal before the start of a two-way call with the second terminal, and to broadcast the acquired visitor information. Configuration 17 further includes the items of Configurations 8 to 13, as well as a control program for an information terminal. [Explanation of Symbols] 【0114】 1: Intercom system 2: Communication lines 4: Information terminal (third terminal) 11: Shared entrance device (Terminal 1) 22a: Master unit (second terminal) 100: Request Processing System

Claims

[Claim 1] The first terminal is located at the entrance of the facility, A second terminal is provided inside the aforementioned facility and is capable of two-way communication with the first terminal, A storage unit that stores information about the visitor's purpose acquired at the first terminal before the start of the two-way call between the first terminal and the second terminal, An output unit that outputs the requirements information stored in the memory unit to a third terminal different from the second terminal via a public network, Equipped with, The aforementioned request information can be broadcast from the third terminal based on an operation performed on the third terminal during a call to the second terminal from the first terminal. A system for processing inquiries. [Claim 2] The request processing system according to claim 1, wherein the storage unit and the output unit are provided in the first terminal, and the request information is sent to the third terminal via the second terminal and the public network after being output from the first terminal. [Claim 3] The request information includes the voice of a visitor to the facility acquired by the first terminal, as described in claim 1 or 2. [Claim 4] A message processing system for processing messages during a call between a first terminal located at the entrance of a facility and a second terminal located inside the facility, which is capable of two-way communication with the first terminal, An acquisition unit that acquires information regarding the visitor's purpose, which is acquired by the first terminal, before the start of the two-way call between the first terminal and the second terminal, A storage unit that stores the requirements information acquired by the acquisition unit, An output unit that outputs the requirements information stored in the memory unit to a third terminal different from the second terminal via a public network, Equipped with, The aforementioned request information can be broadcast from the third terminal based on an operation performed on the third terminal during a call to the second terminal from the first terminal. A system for processing inquiries. [Claim 5] A control method for an information terminal that can communicate via a public network to an intercom system including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility, The first terminal obtains information regarding the visitor's purpose, which it acquired before the start of a two-way call with the second terminal. A notification step in which the acquired requirements information is notified, It has, When the first terminal initiates a call with the second terminal to start the two-way call, it also initiates a call with the information terminal, and during the call, the information terminal is made capable of executing the notification step based on user operations on the information terminal. A method for controlling information terminals. [Claim 6] The aforementioned request information includes the voice of a visitor to the facility, acquired by the first terminal. A method for controlling an information terminal according to claim 5. [Claim 7] The system includes a step of displaying a message to enable or disable audio output from the speaker of the information terminal while confirming or during the execution of the notification step, The method for controlling an information terminal according to claim 6. [Claim 8] Based on whether the silent mode for which voice output is enabled or disabled is enabled or disabled in the aforementioned information terminal, the voice output is enabled or disabled. The method for controlling an information terminal according to claim 6. [Claim 9] The process includes a step of displaying candidate responses to the aforementioned requirement information. A method for controlling an information terminal according to claim 5. [Claim 10] A method for processing messages in an intercom system, comprising a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, Before the start of the two-way call between the first terminal and the second terminal, the first terminal obtains information regarding the visitor's purpose. A step of storing the acquired requirements information, The steps include outputting the stored request information to a third terminal different from the second terminal via a public network, Yes, The aforementioned request information can be broadcast from the third terminal based on an operation performed on the third terminal during a call to the second terminal from the first terminal. Method for handling inquiries. [Claim 11] An intercom system message processing program comprising a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, The aforementioned intercom system, Before the start of the two-way call between the first terminal and the second terminal, the first terminal is made to acquire information regarding the visitor's purpose. The acquired requirements information is stored, The stored request information is output via a public network to a third terminal different from the second terminal. The aforementioned request information is made available from the third terminal based on operations performed on the third terminal during a call to the second terminal from the first terminal. A request processing program. [Claim 12] A message processing program used in a message processing system that processes messages in a call between a first terminal located at the entrance of a facility and a second terminal located inside the facility and capable of two-way communication with the first terminal, In the aforementioned request processing system, Before the start of the two-way call between the first terminal and the second terminal, the first terminal is instructed to acquire information regarding the visitor's purpose. The acquired requirements information is stored, The stored request information is output via a public network to a third terminal different from the second terminal. The aforementioned request information is made available from the third terminal based on operations performed on the third terminal during a call to the second terminal from the first terminal. A request processing program. [Claim 13] A control program for an information terminal that can communicate via a public network to an intercom system including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility, On the aforementioned information terminal, The first terminal obtains information regarding the visitor's purpose that it acquired before the start of a two-way call with the second terminal. The acquired requirements information is to be broadcast, When the first terminal initiates a call with the second terminal to start the two-way call, it also initiates a call with the information terminal, and during the call, the information terminal is made capable of executing the notification step based on user operations on the information terminal. Control program for information terminals.

Images