Intercom response method and intercom system
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-02-07
- Publication Date
- 2026-08-13
Smart Images
Figure JP2025004229_13082026_PF_FP_ABST
Abstract
Description
Intercom response method and intercom system ,
[0004] ,
[0008] ,
[0007] , ,
[0006] , ,
[0005] ,
[0001] The present invention relates to an intercom response method and an intercom system.
[0002] In Patent Document 1, an intercom system is disclosed in which when a mobile communication terminal is taken outside a building, a microphone and a speaker of an intercom installed outside the entrance of the building are connected to this mobile communication terminal. By using this intercom system, even when a call operation is performed on the intercom when a resident of the building is outside, the presence of a visitor can be notified to this resident through the mobile communication terminal.
[0003] Japanese Patent Application Laid-Open No. 2000-232525
[0004] However, even when using this intercom system, when a resident of the building goes out by vehicle, there is a problem that since this resident is driving, the mobile communication terminal cannot be operated and the call operation performed on the intercom may not be confirmed.
[0005] An object of the present invention is to provide an intercom response method and an intercom system capable of notifying a resident when a call operation is performed on the intercom of a building even when the resident of the building is going out by vehicle.
[0006] An intercom response method according to an aspect of the present invention is an intercom response method executed by an intercom system including an intercom for a resident of a building to respond to a call operation performed by a visitor to the building and an information processing device mounted on a vehicle. When a call operation is performed, when it is determined that a resident inside the building does not respond to the call operation, the intercom transmits a notification indicating that the call operation has been performed to the information processing device, and the information processing device outputs the notification to the occupants of the vehicle.
[0007] According to an aspect of the present invention, even when a resident of a building is going out by vehicle, when a call operation is performed on the intercom of the building, this can be notified to the resident.
[0008] Figure 1 is a block diagram showing the configuration of the intercom system according to this embodiment. Figure 2 is a sequence diagram showing the processes performed by the intercom system from the time a call operation is made on the intercom until the response process is executed. Figure 3A is a flowchart showing the operation of the vehicle control device from the time it starts the response process until it sets up the devices to be used as information output means and information input means. Figure 3B is a flowchart showing the response processing content that the vehicle control device performs for each instruction given by the vehicle occupant. Figure 4 is a sequence diagram showing the change location identification process performed by the vehicle control device and the vehicle management server. Figure 5 is a flowchart showing the behavior change process performed by the vehicle control device. Figure 6 is a sequence diagram showing the operation of the intercom system when it finishes processing.
[0009] Embodiments of the present invention will be described below with reference to the drawings.
[0010] Referring to Figure 1, the configuration of the intercom system 1 according to this embodiment will be described. The intercom system 1 according to this embodiment is a system that enables the occupants of a vehicle 20 to respond to a call operation made by an intercom 11 installed in a building 10 such as a residence, office, or store.
[0011] The intercom system 1 mainly consists of an intercom 11, a vehicle 20, a vehicle management server 30, and a delivery company server 40. The intercom 11, the vehicle 20, the vehicle management server 30, and the delivery company server 40 are configured to communicate with each other via a communication network 50. The communication network 50 may be, for example, the internet. The communication network 50 may also utilize mobile communication functions such as 4G / LTE or 5G.
[0012] The intercom 11 is a device that allows residents of building 10 to respond to calls made by visitors to building 10. The intercom 11 includes a call button 111, an outdoor camera device 112, an outdoor microphone device 113, an outdoor input / output device 114, an outdoor speaker device 115, an indoor device 116, an intercom communication device 117, and an intercom control device 118.
[0013] The call button 111 is a button used by visitors to building 10 to make a call. The outdoor camera device 112 is installed outside building 10 and photographs visitors who operate the call button 111. The outdoor microphone device 113 is installed outside building 10 and captures the voice of visitors who operate the call button 111.
[0014] The outdoor input / output device 114 is, for example, a touch panel display and is installed outside the building 10. It displays necessary information under the control of the intercom control device 118 and inputs the operations performed by visitors according to the displayed information. The outdoor speaker device 115 is installed outside the building 10 and outputs predetermined audio, such as audio input from the indoor device 116, audio transmitted from the vehicle 20 via the vehicle management server 30, or audio previously held as response information, under the control of the intercom control device 118.
[0015] The indoor device 116 is a device used by residents of the building 10. The indoor device 116 is configured, for example, with a touch panel display, a microphone device, and a speaker device. The indoor device 116 displays and outputs necessary information under the control of the intercom control device 118, and also inputs the operations performed and spoken by residents of the building 10 according to the displayed information.
[0016] Furthermore, the indoor device 116, under the control of the intercom control device 118, outputs a call tone when the call button 111 of the intercom 11 is operated by a visitor. When a resident inside the building 10 responds to the outputted call tone, communication is established with the devices installed outside the building 10. Specifically, the devices installed outside the building 10 are the outdoor camera device 112, the outdoor microphone device 113, the outdoor input / output device 114, and the outdoor speaker device 115.
[0017] The intercom communication device 117 communicates with the vehicle management server 30. The intercom communication device 117 receives predetermined data from the vehicle management server 30 or transmits predetermined data to the vehicle management server 30 under the control of the intercom control device 118. For example, the intercom communication device 117 may be a device equipped with mobile communication functions such as 4G / LTE or 5G, or a device equipped with short-range wireless communication functions such as Wi-Fi® or Bluetooth®.
[0018] The intercom control device 118 is a microcomputer (controller) mainly composed of a CPU, memory, and input / output interface. The memory contains a computer program (application) that enables the information terminal to function as an intercom 11 in the intercom system 1. By executing the computer program, the intercom control device 118 realizes one or more functions of the intercom 11.
[0019] When a call operation is performed using the call button 111, the intercom control device 118 determines that a resident inside the building 10 has responded to the call operation if the resident responds using the indoor device 116. If the intercom control device 118 determines that a resident has responded to the call operation, it establishes communication between the indoor device 116 and the devices installed outside the building 10.
[0020] Furthermore, if a call operation is performed using the call button 111 and no response operation is performed using the indoor device 116, the intercom control device 118 determines that no resident in the building 10 is responding to the call operation. If the intercom control device 118 determines that no resident is responding to the call operation, it sends a notification to the vehicle 20 indicating that a call operation has been performed. As a result, the intercom control device 118 establishes communication between each device installed outside the building 10 and the vehicle 20 via the vehicle management server 30, and transmits and receives information.
[0021] Vehicle 20 is a vehicle used by residents of building 10 when they go out. In this embodiment, vehicle 20 is an electric vehicle that drives its wheels with only an electric motor, but it may also be an engine-powered vehicle that drives its wheels with only an engine, or a hybrid vehicle that drives its wheels with both an engine and an electric motor.
[0022] Vehicle 20 is equipped with a vehicle control device 201, a vehicle storage device 202, a vehicle camera device 203, a center display 204, a meter display 205, a vehicle speaker device 206, a steering switch 207, a vehicle microphone device 208, a location information acquisition device 209, a vehicle communication device 210, and an information processing device 211. When the ignition is turned on, these devices are activated.
[0023] The vehicle control device 201 is a device that controls the driving state of the vehicle 20. The vehicle storage device 202 stores message template information and the like that is used when automatically responding to visitors to the building 10. The vehicle camera device 203 takes pictures of the interior of the vehicle 20.
[0024] The center display 204 is, for example, a touch panel display and is mounted in the IVI (In-vehicle Infotainment) and positioned near the center of the front of the vehicle interior. The center display 204 has functions such as outputting navigation information to the destination based on the occupant's operation, and inputting settings for various devices in the vehicle 20, such as the air conditioner.
[0025] The meter display 205 is positioned, for example, in front of the steering wheel and displays information related to the vehicle's status, such as vehicle speed and fuel or battery level.
[0026] The vehicle speaker device 206 outputs sound into the vehicle cabin. The steering switch 207 is installed on the steering wheel of the vehicle 20 and inputs the driver's operations. The vehicle microphone device 208 picks up sound from inside the vehicle cabin.
[0027] The position information acquisition device 209 acquires the current position information of the vehicle 20 by receiving GNSS signals from multiple satellites for the Global Navigation Satellite System (GNSS) and calculating position information. One example of GNSS is GPS (Global Positioning System).
[0028] The vehicle communication device 210 communicates with the vehicle management server 30. The vehicle communication device 210 receives predetermined data from the vehicle management server 30 and transmits predetermined data to the vehicle management server 30. For example, the vehicle communication device 210 may be a device equipped with mobile communication functions such as 4G / LTE or 5G, or a device equipped with short-range wireless communication functions such as Wi-Fi or Bluetooth.
[0029] The information processing device 211 controls the various devices mounted on the vehicle 20, including the vehicle control device 201, vehicle storage device 202, vehicle camera device 203, center display 204, meter display 205, vehicle speaker device 206, steering switch 207, vehicle microphone device 208, location information acquisition device 209, and vehicle communication device 210.
[0030] The vehicle management server 30 is an information processing device that intercepts the intercom 11 and the vehicle 20 and issues various instructions to the intercom 11 and the vehicle 20. The vehicle management server 30 comprises a server control device 31, a server communication device 32, and a server storage device 33.
[0031] The server control device 31 is a microcomputer (controller) mainly composed of a CPU, memory, and input / output interface. The CPU reads various computer programs stored in memory and executes various instructions contained in the programs. By executing programs, the CPU realizes one or more functions of the server control device 31. For example, the server control device 31 has a function to search for candidate locations for changes to the delivery location of items delivered by a delivery company in response to inquiries from the vehicle 20.
[0032] The server communication device 32 communicates with the intercom 11 or the vehicle 20. The server communication device 32 is controlled by the server control device 31 and receives predetermined data from the intercom 11 and the vehicle 20, and transmits predetermined data to the intercom 11 and the vehicle 20. For example, the server communication device 32 may be a device equipped with mobile communication functions such as 4G / LTE or 5G, or a device equipped with Wi-Fi communication functions.
[0033] The server storage device 33 stores location information for potential delivery locations for packages, such as pre-registered stores and delivery boxes, as determined by the delivery company.
[0034] The delivery company server 40 manages information about the delivery routes of each delivery vehicle.
[0035] Next, the intercom response method according to this embodiment will be described. Figure 2 is a sequence diagram showing the process executed by the intercom system 1 when a call operation is performed on the intercom 11.
[0036] First, when a visitor to building 10 presses the call button 111 on the intercom 11 to initiate a call, the intercom control device 118 detects the call operation (S1: YES). Upon detecting the call operation, the intercom control device 118 starts taking pictures with the outdoor camera device 112 and recording sound with the outdoor microphone device 113, and also outputs a call sound from the indoor device 116 (S2).
[0037] If a resident inside the building 10 responds to the call using the indoor device 116 within a predetermined time after the indoor device 116 outputs a call tone, the intercom control device 118 determines that a resident inside the building 10 has responded to the call (S3: YES). Once the intercom control device 118 determines that a resident inside the building 10 has responded to the call, it establishes communication between the indoor device 116 and the devices installed outside the building 10 (S4). Once communication is established between the indoor device 116 and the devices installed outside the building 10, the resident inside the building 10 can view the image information of the visitor outside, and the visitor and the resident can communicate.
[0038] After the call between the visitor and the resident inside building 10 has ended, if the resident performs a termination operation on the indoor device 116 (S5: YES), communication between the device installed outside building 10 and the indoor device 116 is disconnected, and the process ends.
[0039] In step S3, the intercom control device 118 determines that the resident in building 10 did not respond to the call if the resident in building 10 did not respond to the call within a predetermined time after a call tone was output from the indoor unit 116 (S3: NO). Alternatively, the intercom control device 118 may determine that the resident in building 10 did not respond to the call if the intercom 11 was pre-set to absent mode, indicating that no resident was present in building 10 (S3: NO). Similarly, the intercom control device 118 may determine that the resident in building 10 did not respond to the call if it recognized that the intended resident of the visitor was absent from building 10 (S3: NO).
[0040] This section explains the case where "the visitor recognizes that the intended resident is not inside building 10." When a visitor makes a call, if they perform an operation to identify the intended resident, the intercom control device 118 recognizes this. For example, when a call is made, the intercom control device 118 may automatically announce "Who is this visit for?" from the outdoor speaker device 115, and then identify the intended resident by analyzing the voice "This is a package for Mr. / Ms. XX" spoken by the visitor in response. Based on the recognized information, the intercom control device 118 outputs information to the indoor device 116 notifying that there is a visitor intended for the identified resident. If the indoor device 116 does not respond to the outputted information within a predetermined time, or if an operation or voice indicating that the identified resident is absent is input, the intercom control device 118 recognizes that the visitor's intended resident is not inside building 10.
[0041] When the intercom control device 118 determines that the resident in the building 10 does not respond to the call operation, it transmits a communication connection request to the vehicle 20 via the intercom communication device 117 and the communication network 50 to the vehicle management server 30 (S6).
[0042] When the vehicle management server 30 does not respond to the transmitted communication connection request, the intercom control device 118 transmits the communication connection request again. If the intercom control device 118 does not receive a response from the vehicle management server 30 even after transmitting the communication connection request a predetermined number of times, it ends the process.
[0043] When the vehicle management server 30 normally receives the communication connection request (S7), the server communication device 32 transmits a communication connection response to the intercom 11 to establish a communication connection between the intercom 11 and the vehicle management server 30 (S8). When the communication connection between the intercom 11 and the vehicle management server 30 is established, the intercom control device 118 requests the vehicle management server 30 to transmit a notification indicating that a call operation has been performed on the intercom 11 to the vehicle 20 (S9). This notification includes information for confirming with the passengers of the vehicle 20 whether to respond to the call operation.
[0044] At this time, the intercom control device 118 may analyze the video captured by the outdoor camera device 112 to identify the type of visitor, for example, a delivery person, a resident of the building 10 or their family, etc., and include the identified information in the notification transmitted to the vehicle management server 30. For example, when the intercom control device 118 detects that the visitor is carrying luggage, it identifies the visitor as a delivery person. Also, when the intercom control device 118 detects that the visitor is a person corresponding to the face information of a resident of the building 10 or their family stored in advance, it identifies the visitor as a resident of the building 10 or their family.
[0045] Also, the intercom control device 118 may output an announcement "Who is it?" from the outdoor speaker device 115 in an automatic response when a call operation is performed, and identify the type of visitor by analyzing the voice emitted by the visitor in response to this.
[0046] When the intercom control device 118 identifies that the visitor is a delivery person, the notification to the vehicle 20 may include information for confirming with the vehicle occupants whether they wish to redeliver the delivered item and information for confirming with the vehicle occupants whether they wish to change the delivery destination of the delivered item.
[0047] In the vehicle management server 30, when a request to transmit a notification to the vehicle 20 is received, the server control device 31 transmits a communication connection request to the vehicle 20 via the communication network 50 (S11). Here, if the vehicle 20 is in the ignition-on state, the information processing device 211 responds to this communication connection request, and if it is in the ignition-off state, no response is made. If the vehicle 20 does not respond to the transmitted communication connection request, the server control device 31 transmits the communication connection request again. If the server control device 31 does not receive a response from the vehicle 20 even after transmitting the communication connection request a predetermined number of times, the process ends.
[0048] When the vehicle 20 normally receives a communication connection request while in the ignition-on state (S12), the vehicle communication device 210 transmits a communication connection response to the vehicle management server 30 to establish a communication connection (S13). When the communication connection between the vehicle management server 30 and the vehicle 20 is established, the server control device 31 transmits the notification requested from the intercom 11 to the vehicle 20 (S14). After transmitting the notification to the vehicle 20, the server control device 31 shifts to a standby state (S15).
[0049] When the vehicle 20 receives a notification from the vehicle management server 30 (S16), it executes response processing for a call operation in cooperation with the vehicle management server 30 and the intercom 11 (S17).
[0050] After a call operation is performed, the intercom 11 may not execute the transmission of a notification to the vehicle 20 regarding a call operation that is executed again within a predetermined time or until the response processing from the vehicle 20 to the intercom 11 for this call operation ends. As will be described later, when the intercom 11 is notified of the end of the response processing from the vehicle 20, it determines that the response processing from the vehicle 20 to the intercom 11 for the call operation has ended.
[0051] Alternatively, the intercom 11 sends a notification to the vehicle 20 each time a call operation is performed, but the vehicle 20 may choose not to output information for notifications received consecutively after it has received a notification regarding a call operation. Specifically, the vehicle 20 will choose not to output information for notifications received again within a predetermined time or until it is notified that the response process has ended for that call operation, as described later. This prevents the vehicle 20 from outputting multiple notifications for a single visit, even if the same visitor makes multiple consecutive calls.
[0052] Details of the processing performed by the information processing device 211 in response to a call operation will be explained with reference to the flowcharts in Figures 3A and 3B.
[0053] The information processing device 211 determines whether or not there is an occupant in the passenger seat of the vehicle 20 (S21). The information processing device 211 may determine whether or not there is an occupant in the passenger seat of the vehicle 20 by analyzing the video captured by the vehicle camera device 203, or it may determine based on the detection result of a seat sensor (not shown) installed in the passenger seat. If the information processing device 211 determines that there is no occupant in the passenger seat (S21: NO), it further determines whether or not the vehicle 20 is currently stopped (S22). The information processing device 211 determines that the vehicle 20 is stopped when the vehicle speed of the vehicle 20 is 0 km / h, or when the shift lever of the vehicle 20 is switched to parking.
[0054] Here, if it is determined in step S21 that there is an occupant in the passenger seat (S21: YES), or if it is determined in step S22 that the vehicle 20 is stopped (S22: YES), the information processing device 211 starts response processing in the stopped behavior (S23).
[0055] When response processing is initiated during the stopped behavior, the information processing device 211 acquires video footage captured by the outdoor camera device 112 and audio captured by the outdoor microphone device 113 from the intercom 11 (S24). The information processing device 211 displays predetermined text information or icons and the acquired video footage on the center display 204, and outputs the acquired audio from the vehicle speaker device (S25). This text information or icons include information notifying that a call operation has been performed on the intercom 11, and information allowing the user to select a method of responding to this call operation. This "information allowing the user to select a response method" may include, for example, options such as "automatic response" and "response by phone."
[0056] Furthermore, the information processing device 211 is configured to accept touch panel operations, including the center display 204, voice input using the vehicle microphone device 208, and operations using the steering wheel switches 207 (S26).
[0057] Thereafter, during the stopped state, the information processing device 211 appropriately sends and receives information including video and audio to and from the intercom 11 and performs response processing. In the stopped state, the information processing device 211 uses the center display 204 and the vehicle speaker device 206 as information output means, and uses the center display 204, the vehicle microphone device 208, and the steering switch 207 as information input means.
[0058] Furthermore, if it is determined in step S22 that the vehicle is in operation (S22: NO), the information processing device 211 starts response processing in the operation behavior (S27). When response processing starts in the operation behavior, the information processing device 211 acquires the sound picked up by the outdoor microphone device 113 from the intercom 11 (S28). The information processing device 211 displays predetermined text information or icons on the meter display 205 and outputs the acquired sound from the vehicle speaker device (S29). This text information or icons include, as in the case of stopped behavior, information notifying that a call operation has been made on the intercom 11, and information allowing the user to select a method of responding to this call operation.
[0059] Furthermore, during driving, the information processing device 211 locks the acceptance of touch panel operations, including the meter display 205, and enables the acceptance of voice input using the vehicle microphone device 208 and operations using the steering wheel switches 207 (S30).
[0060] Thereafter, during driving, the information processing device 211 sends and receives information, including voice, to and from the intercom 11 as appropriate and performs response processing. During driving, the information processing device 211 uses the meter display 205 and the vehicle speaker device 206 as information output means, and the vehicle microphone device 208 and the steering switch 207 as information input means.
[0061] As described above, the settings for information input / output during stationary or driving behavior have been configured, making it possible for visitors to the building 10 and the occupants of the vehicle 20 to communicate using the intercom 11 and equipment inside the vehicle 20.
[0062] Next, we will explain the process that the information processing device 211 of the vehicle 20 executes based on the operations performed by the occupant when the visitor is a delivery person, referring to the flowchart in Figure 3B.
[0063] If the information processing device 211 determines that the occupant in the vehicle 20 has not selected either "automatic response" or "response by phone" from the displayed information for selecting a response method, and a predetermined time has elapsed (S31: NO → S32: NO), then the information processing device 211 determines that the occupant has not responded to the call operation. When the information processing device 211 determines that the occupant has not responded to the call operation, it generates a termination notice and outputs it using the information output means, notifying the intercom 11 of the end of the response process (S33).
[0064] Furthermore, when the information processing device 211 determines that the occupant in the vehicle 20 has instructed "respond by phone" using the information input means from the displayed information for selecting a response method (S31: NO → S32: YES), it sets the system so that the visitor and the occupant in the vehicle 20 can communicate (S34). Specifically, it establishes communication between the outdoor microphone device 113 and outdoor speaker device 115 in the intercom 11 and the vehicle microphone device 208 and vehicle speaker device 206 in the vehicle 20. Subsequently, when the occupant performs an operation to indicate the end of the response process, the information processing device 211 confirms this operation (S35: YES), generates a termination notification, and outputs it using the information output means. The information processing device 211 also notifies the intercom 11 of the end of the response process (S33).
[0065] Furthermore, if the information processing device 211 determines that the occupant in the vehicle 20 has instructed "automatic response" from the displayed information for selecting a response method (S31: YES), it starts processing with an automatic response. Once processing with an automatic response has started, the intercom 11 remains in a standby state while the occupant is performing operations related to the content of the automatic response. At this time, in order to prevent visitors from realizing that no processing is being performed on the intercom 11, the information processing device 211 may send information to the intercom 11 notifying it that the occupant in the vehicle 20 is about to respond, for example, output information "The user is about to respond. Please wait a moment," and output it via voice or text display.
[0066] When the information processing device 211 starts processing by automatic response, it outputs information such as "Response from template," "Request for redelivery," and "Request for change of delivery address" as options for items that can be processed by automatic response, based on the information contained in the notification received from the intercom 11. "Response from template" is a process that automatically outputs output information for each item set in advance as a template from the intercom 11. "Request for redelivery" is a process that automatically requests redelivery to building 10 by automatic response. "Request for change of delivery address" is a process that automatically requests a change of delivery address to a location other than building 10 by automatic response.
[0067] Here, if the crew selects "Response from template" from the options of items that can be executed by automated response (S36: YES), the information processing device 211 outputs pre-set output information items using the information output means (S37). If the crew selects any item from the output information items (S38: YES), the information processing device 211 sends an instruction to execute the automated response for the selected item to the intercom 11 via the vehicle management server 30 (S39). These items include, for example, "Leave at door" and "Deliver to vehicle," which are types of delivery processes that can be executed in the area where the delivery person is currently located.
[0068] The intercom 11 automatically responds by outputting information related to the instructions transmitted from the vehicle 20 from at least one of the outdoor input / output device 114 and the outdoor speaker device 115. By recognizing the outputted information, the delivery person can perform actions in accordance with the wishes of the occupant of the vehicle 20, such as "leave at door" (placing the delivery item next to the entrance) or "deliver to vehicle" (placing the delivery item in a vehicle parked near the building 10).
[0069] After the information processing device 211 sends an instruction to the intercom 11 to execute an automatic response, when the occupant performs an operation to indicate the end of the response processing, the information processing device 211 confirms this operation (S35: YES), generates a termination notification, and outputs it using the information output means. The information processing device 211 also notifies the intercom 11 of the end of the response processing (S33).
[0070] Furthermore, if a predetermined time has elapsed without any items being selected in step S38 (S38: NO), the information processing device 211 outputs a notification prompting an action. If no selection operation is performed even after outputting this notification a predetermined number of times, the information processing device 211 outputs information from the information output means to confirm with the occupant whether or not to terminate the response process. When the occupant performs an operation to indicate termination in response to the outputted information, the information processing device 211 confirms this operation (S35: YES), generates a termination notification, and outputs it from the information output means. The information processing device 211 also notifies the intercom 11 of the termination of the response process (S33).
[0071] Furthermore, when the occupant selects "Request for redelivery" from the options of items that can be executed by automatic response, the information processing device 211 calculates the estimated time of the occupant's return to building 10 (S41). Specifically, the information processing device 211 calculates the estimated time of the occupant's return to building 10 based on the current location information of the vehicle 20 acquired by the location information acquisition device 209 and the location information of building 10 that has been registered in advance. If a destination is set for the vehicle 20, the information processing device 211 also takes into account the location information of this destination when calculating the estimated time of return.
[0072] If the location information for building 10 is not registered in the information processing device 211, the information processing device 211 outputs information requesting the occupant to enter the address. Also, if a destination is set for vehicle 20 but its location information is not registered, the information processing device 211 outputs information requesting the occupant to enter the address of this destination. When the occupant enters the address information for building 10 or the destination in response to the outputted information, the information processing device 211 uses this entered information to calculate the estimated time of the occupant's return to building 10.
[0073] The method for calculating the estimated time of return to building 10 by the information processing device 211 will now be explained. First, the information processing device 211 identifies the shortest route from the current position of the vehicle 20 to building 10, and calculates the time required to return to building 10 by adding or subtracting a value that takes into account the degree of congestion on the route to the travel time, which is the value obtained by dividing the distance of this route by the planned speed of the vehicle 20. If a destination is set, the information processing device 211 calculates the travel time and the time required to return home based on the shortest route from the current position of the vehicle 20 to building 10 via this destination. At this time, the time required to return home may be calculated by adding a buffer of time during travel, such as the time spent at the destination, to the travel time.
[0074] The information processing device 211 calculates the estimated time of return home by adding the calculated time required to return home to the current time (S41). Here, the information processing device 211 may output the calculated estimated time of return home information to prompt the crew member for confirmation, and when the crew member performs the confirmation operation, the calculated estimated time of return home may be finalized. Alternatively, the information processing device 211 may finalize the time corrected by the crew member during this confirmation operation as the estimated time of return home. The information processing device 211 determines the desired redelivery time from the time after the finalized estimated time of return home, and generates redelivery request information with the determined desired redelivery time added as response information to the call operation. Based on the generated response information, the information processing device 211 sends an instruction to execute an automated response to request redelivery to the intercom 11 via the vehicle management server 30 (S42).
[0075] Based on instructions transmitted from the vehicle 20, the intercom control device 118 automatically responds by displaying the message "Please redeliver between XX:XX and YY" as text on the outdoor input / output device 114, or by outputting it as voice information from the outdoor speaker device 115. The delivery person can then confirm the outputted information and understand that they will redeliver between XX:XX and YY.
[0076] Furthermore, when the crew selects "Request to change delivery address" from the list of items that can be processed by the automated response, the information processing device 211 executes the change location identification process (S44). Details of the change location identification process executed by the information processing device 211 will be explained with reference to Figure 4.
[0077] When the information processing device 211 starts the process of identifying the change location, it outputs a request for instructions on a base to search for candidate change locations (S51). In response to the outputted information, when the crew member specifies a base to search for candidate change locations (S52: YES), the information processing device 211 transmits the location information of the specified base to the vehicle management server 30 (S53).
[0078] If the crew member specifies a location whose location information has already been acquired by the information processing device 211, such as building 10, the current location of vehicle 20, or the destination of vehicle 20, as a base for searching for candidate locations for the change, the information processing device 211 transmits the location information of the specified location to the vehicle management server 30. If the crew member specifies a location whose location information has not been acquired by the information processing device 211, the information processing device 211 outputs information prompting the crew member to enter the address of the specified location. When the crew member enters the address information in response to the outputted information, the information processing device 211 transmits the entered address information to the vehicle management server 30 as location information for a base for searching for candidate locations for the change.
[0079] When the vehicle management server 30 obtains location information of a predetermined base from the vehicle 20, it checks the delivery route of the delivery vehicle with the delivery company server 40 and selects candidate locations for delivery changes within a predetermined distance from the base. For each selected candidate location, the vehicle management server 30 identifies the time when the delivery item can be received based on the delivery route of the delivery vehicle (S54). The vehicle management server 30 transmits information on the selected candidate locations and the time when the delivery item can be received at each candidate location to the vehicle 20 (S55).
[0080] In vehicle 20, the information processing device 211 acquires information transmitted from the vehicle management server 30 and outputs it using a predetermined information output means (S56). When the occupant recognizes the outputted information and selects one of the outputted candidate locations (S57: YES), the information processing device 211 identifies the selected candidate location as the delivery change location (S58). Once the delivery change location is identified, the information processing device 211 generates delivery destination change request information with the information of the identified location added as response information to the call operation.
[0081] Based on the generated response information, the information processing device 211 sends an instruction to execute an automated response to the intercom 11 via the vehicle management server 30 to request a change of delivery destination to a specified location (S45). If a predetermined time has elapsed in step S52 without the occupant specifying a base (S52: NO), or if a predetermined time has elapsed in step S57 without the occupant selecting a candidate location (S57: NO), the process proceeds to step S35.
[0082] In the intercom 11, based on instructions transmitted from the vehicle 20, the intercom control device 118 automatically responds by outputting information requesting a change of delivery destination to a specified location from at least one of the outdoor input / output device 114 and the outdoor speaker device 115. The delivery person can recognize the outputted information and decide to change the delivery destination of the package to the designated location in accordance with the driver's wishes.
[0083] The information processing device 211 may store information about the vehicle's 20 travel route, and when it generates information requesting a change of delivery destination, it may output suggestion information to change the stored travel route to a route that passes through the location identified as the new delivery destination within the time frame in which the delivered item can be received.
[0084] Furthermore, while the processes described in steps S36 to S45 are being executed, the information processing device 211 may display a "Back" button on the center display 204 or meter display 205 to return to the previous screen, and a "Connect" button to switch to answering a call. When the "Back" button is pressed by the occupant, the information processing device 211 interrupts the currently executing process and returns the display content of the center display 204 or meter display 205 to the previous screen. When the "Connect" button is pressed by the occupant, the information processing device 211 proceeds to step S34 and sets the system so that the visitor and the occupant in the vehicle 20 can communicate.
[0085] While the above-described automatic response process is being executed, the behavior change process executed by the information processing device 211 in response to a change in the operating status (driving / stopped) of the vehicle 20 will be explained with reference to Figure 5. During the execution of the automatic response process, the information processing device 211 monitors whether or not the operating status of the vehicle 20 has changed. When the information processing device 211 detects that the operating status has changed from stopped to driving (S61: YES), it locks the display of the video captured by the outdoor camera device 112 and the acceptance of touch panel operations (S62). The information processing device 211 also outputs an announcement from the vehicle speaker device 206 indicating that the behavior of the automatic response process will be changed to the driving behavior (S63).
[0086] The information processing device 211 also stops acquiring video footage captured by the outdoor camera device 112 from the intercom 11 (S64) and outputs an announcement as appropriate based on the process of the automated response processing that is currently running (S65).
[0087] For example, if the information processing device 211 is displaying information on multiple options for the crew to choose from, it will announce these options sequentially or announce the option with the highest priority. Subsequently, the information processing device 211 will proceed to response processing based on the driving behavior (S66) and return to step S61.
[0088] Furthermore, if the information processing device 211 detects that the driving status has switched from driving to stopped during the execution of the automatic response process (S61: NO → S67: YES), it unlocks the display of the video captured by the outdoor camera device 112 and the acceptance of touch panel operations (S68). The information processing device 211 also outputs an announcement from the vehicle speaker device 206 that the behavior of the automatic response process has been changed to the stopped behavior (S69).
[0089] The information processing device 211 also starts acquiring video footage captured by the outdoor camera device 112 from the intercom 11 (S70), outputs the video footage (S71), transitions from the ongoing automatic response processing to response processing based on operating behavior (S72), and returns to step S61.
[0090] When the information processing device 211 notifies the intercom 11 of the completion of the response processing in step S33, it terminates the response processing for the call operation.
[0091] Subsequently, the process moves to the flowchart in Figure 6. When the information processing device 211 detects that the response processing for the call operation has been completed (S81: YES), it disconnects communication between the vehicle communication device 210 and the server communication device 32 of the vehicle management server 30 (S82). When the server control device 31 detects that communication between the server communication device 32 and the intercom communication device 117 has been disconnected, it disconnects communication between the server communication device 32 and the intercom communication device 117 of the intercom 11 (S83). When the intercom control device 118 detects that communication between the intercom communication device 117 and the server communication device 32 has been disconnected (S84), it determines that the response processing from the vehicle 20 to the intercom 11 has been completed and terminates processing for the call operation.
[0092] If the intercom 11 is configured to communicate with the mobile terminals of residents in the building 10 in addition to the vehicle 20, the intercom control device 118 may be configured to prioritize connecting to the vehicle 20 over the resident's mobile terminal when a visitor makes a call. This ensures that when a resident is out in the vehicle, information about the visitor is output to the output device in the vehicle 20 instead of the mobile terminal, making it easier for the resident to respond even while driving.
[0093] Furthermore, if multiple vehicles capable of communicating with the intercom 11 are registered for each resident, the intercom control device 118 may establish a communication connection with the vehicle corresponding to the resident addressed to the delivery item when a delivery person arrives at the building 10 and performs a call operation, and notify the delivery person of the call operation. At this time, the intercom control device 118 obtains information about the address of the delivery item from the delivery person through an automated response using voice recognition processing or the like.
[0094] Furthermore, if multiple vehicles capable of communicating with the intercom 11 are registered, the intercom control device 118 may prioritize communication connections with vehicles moving towards the building 10 rather than vehicles moving away from the building 10, in response to a call operation made by a visitor. Alternatively, the intercom control device 118 may prioritize communication connections with the vehicle closest to the building 10 among the multiple registered vehicles. This allows for priority notification to residents who are likely to be able to respond quickly to the call operation.
[0095] Furthermore, the intercom 11 may store in a database the facial information of visitors who have been instructed not to answer calls made in the past, and may choose not to answer when a call is made by a visitor whose facial information corresponds to that stored in the database. In this case, the intercom 11 will not output any response information and will not establish a communication connection with the vehicle 20.
[0096] Furthermore, when the information processing device 211 starts response processing in step S17, it may automatically send information to the intercom 11 instructing the delivery to "leave at door," "deliver to a designated delivery box," or "deliver into a designated vehicle," based on pre-set information, without performing information input / output processing by each device in the vehicle 20. When the intercom 11 receives information on any of these instructions, it outputs the received information from at least one of the outdoor input / output device 114 and the outdoor speaker device 115. By recognizing the outputted information, the delivery person can perform delivery work in accordance with the resident's wishes.
[0097] According to the above embodiment, the intercom response method performed by an intercom system, which consists of an intercom for residents of a building to respond to calls made by visitors to the building and an information processing device mounted on a vehicle, is as follows: When a call is made, if the intercom determines that a resident inside the building has not responded to the call, it sends a notification to the information processing device indicating that a call has been made, and the information processing device outputs the notification to the occupants of the vehicle.
[0098] This allows residents to be notified when a call is made via the building's intercom, even when they are out in their vehicle.
[0099] Furthermore, the notification includes information to confirm with the vehicle occupant whether or not to respond to the call operation. If the information processing device determines that a predetermined time has elapsed without a response instruction from the occupant in response to the notification, it may determine that the vehicle occupant has not responded to the call operation. This allows the information processing device to recognize when it has determined that the vehicle occupant has not responded to the call operation.
[0100] Furthermore, the notification includes information to confirm with the vehicle occupant whether to respond to the call operation, and the intercom may refrain from sending a notification to the information processing device for subsequent call operations performed within a predetermined time after the initial call operation or before the information processing device has finished processing the response to the call operation to the intercom. This prevents the vehicle from outputting multiple notifications for a single visit, which would complicate processing, even if the same visitor makes multiple consecutive call operations.
[0101] Furthermore, if the visitor is a delivery person, the notification may include information to confirm with the vehicle occupant whether they wish for the delivery to be redelivered by the delivery person. If the information processing device determines that the vehicle occupant has entered information requesting redelivery in response to the notification, it may calculate the time required for the occupant to return home to the building based on the vehicle's travel time from its current location to the building, determine the desired redelivery time to request the delivery person to redelivery based on the return time, generate redelivery request information with the desired redelivery time added as response information to the call operation, and transmit the response information to the intercom. This allows the occupant to request redelivery from the vehicle to the delivery person based on the occupant's return time.
[0102] Furthermore, when information requesting redelivery is input, the information processing device may calculate the travel time from the vehicle's current location to the building via the destination set by the occupant, and then add the time spent at the destination to the calculated travel time to determine the time required to return home. This allows for a more accurate calculation of the occupant's time required to return home.
[0103] Furthermore, the intercom may be equipped with a camera, and the information processing device may be configured to display the video captured by the camera on a display device inside the vehicle when it determines that there is a person in the passenger seat inside the vehicle, or when it determines that the vehicle is stopped. This allows information to be provided in a way that enables the driver to operate the vehicle safely.
[0104] Furthermore, if the visitor is a delivery person, the notification may include information to confirm with the vehicle occupant whether they wish to change the delivery address of the delivery by the delivery person. If the information processing device determines that the vehicle occupant has entered information requesting a change of delivery address to a designated location in response to the notification, it may generate information requesting a change of delivery address, with the designated location added, as response information to the call operation and transmit the response information to the intercom. This allows the occupant to request the delivery person to change the delivery address to a desired location from within the vehicle.
[0105] Furthermore, if a designated location has a set time limit for receiving deliveries, and the information processing device maintains information about the vehicle's route, and generates information requesting a change of delivery destination, it may generate suggestion information to change the route to one that passes through the designated location within the time limit for receiving deliveries, and output this information to the vehicle's occupants. This allows the occupants to confirm a route that allows them to pick up the deliveries at the designated delivery location within the time limit while driving the vehicle.
[0106] As described above, embodiments of the present invention have been presented, but the statements and drawings that constitute part of this disclosure should not be understood as limiting the invention. Various alternative embodiments, examples, and operational techniques will become apparent to those skilled in the art from this disclosure.
[0107] 1: Intercom system, 10: Building, 11: Intercom, 20: Vehicle, 30: Vehicle management server, 31: Server control device, 32: Server communication device, 33: Server storage device, 40: Delivery company server, 50: Communication network, 111: Call button, 112: Outdoor camera device, 113: Outdoor microphone device, 114: Outdoor input / output device, 115: Outdoor speaker device, 116: Indoor device, 117: Intercom communication device, 118: Intercom control device, 201: Vehicle control device, 202: Vehicle storage device, 203: Vehicle camera device, 204: Center display, 205: Meter display, 206: Vehicle speaker device, 207: Steering switch, 208: Vehicle microphone device, 209: Location information acquisition device, 210: Vehicle communication device, 211: Information processing device
Claims
1. An intercom response method performed by an intercom system comprising an intercom for residents of a building to respond to calls made by visitors to the building, and an information processing device mounted on a vehicle, wherein the intercom, when it determines that a resident in the building has not responded to the call, transmits a notification to the information processing device indicating that a call has been made, and the information processing device outputs the notification to the occupant of the vehicle.
2. The intercom response method according to claim 1, wherein the notification includes information to confirm with the occupant of the vehicle whether or not to respond to the call operation, and the information processing device determines that the occupant of the vehicle has not responded to the call operation if a predetermined time has elapsed without a response instruction being input from the occupant in response to the notification.
3. The intercom response method according to claim 1, wherein the notification includes information to confirm with the occupant of the vehicle whether or not to respond to the call operation, and the intercom does not transmit the notification to the information processing device for any subsequent call operations performed within a predetermined time after the call operation has been performed or until the response processing from the information processing device to the intercom for the call operation has been completed.
4. If the visitor is a delivery person, the notification includes information to confirm with the occupant of the vehicle whether they wish for the delivery person to redeliver the item; if the information processing device determines that the occupant of the vehicle has entered information requesting redelivery in response to the notification, it calculates the time required for the occupant to return home to the building based on the vehicle's travel time from its current location to the building, determines a redelivery request time to which the occupant should request the delivery person to redeliver the item based on the time required to return home, generates redelivery request information with the redelivery request time added as response information to the call operation, and transmits the response information to the intercom; the intercom response method according to claim 1.
5. The intercom response method according to claim 4, wherein when information requesting redelivery is input, the information processing device calculates the travel time from the vehicle's current location to the building via the destination set by the occupant, and adds the time spent at the destination to the calculated travel time to determine the time required to return home.
6. The intercom response method according to claim 1, wherein the intercom is equipped with a camera device, and the information processing device can display the image captured by the camera device on a display device inside the vehicle when it determines that there is a person in the passenger seat inside the vehicle or when it determines that the vehicle is stopped.
7. If the visitor is a delivery person, the notification includes information to confirm with the occupant of the vehicle whether they wish to change the delivery address of the delivery by the delivery person, and if the information processing device determines that the occupant of the vehicle has entered information in response to the notification indicating a wish to change the delivery address to a predetermined location, it generates information indicating a wish to change the delivery address with the information of the predetermined location added as response information to the call operation, and transmits the response information to the intercom, the intercom response method according to claim 1.
8. With respect to the predetermined location, a time for receiving the delivered item is set, and the information processing device holds information on the vehicle's driving route, and when it generates the delivery destination change request information, it generates suggestion information to change the driving route to a route that passes through the predetermined location within the time for receiving the delivered item, and outputs this to the occupant of the vehicle, the intercom response method according to claim 7.
9. An intercom system comprising an intercom for residents of a building to respond to calls made by visitors to the building, and an information processing device mounted on a vehicle, wherein the intercom, when it determines that a resident in the building has not responded to the call, transmits a notification to the information processing device indicating that a call has been made, and the information processing device outputs the notification to the occupants of the vehicle.