Information processing apparatus, information processing method, and non-transitory storage medium
By suppressing the monitoring function when the autonomous vehicle is stationary, the problem of excessive burden on remote monitors is solved, and the monitoring efficiency is improved.
Patent Information
- Application Number
- CN202210967165.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-08-13
- Filing Date
- 2022-08-12
- Publication Date
- 2026-02-10
- Estimated Expiration
- 2042-08-12
AI Technical Summary
The burden on remote monitors is too heavy, especially when the monitoring function continues to operate even when the autonomous vehicle is stationary and there is no delivery person, resulting in unnecessary monitoring information processing.
When the autonomous vehicle is stationary, if the control unit of the monitoring device determines that there is no delivery person, it suppresses the monitoring function, including stopping or reducing the use of cameras, narrowing the camera range, and stopping the transmission of monitoring images.
It reduces the surveillance burden on remote monitors, decreases unnecessary surveillance information processing, and improves surveillance efficiency.
Smart Images

Figure CN115705776B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to information processing apparatus, information processing methods, and non-transitory storage media. Background Technology
[0002] In the past, there have been examples of determining the monitoring priority of a vehicle based on vehicle information obtained from the vehicle being monitored by the monitor, and determining the prompt information to be used to monitor the vehicle based on the monitoring priority (e.g., Japanese Patent Application Publication No. 2020-61120). Summary of the Invention
[0003] The purpose of this disclosure is to provide an information processing apparatus, information processing method, and program that can reduce the burden on remote monitors.
[0004] One aspect of this disclosure is an information processing device mounted on an autonomous delivery vehicle equipped with a monitoring device for remote surveillance. The information processing device includes a control unit that, when determining that there is no delivery person inside the autonomous vehicle while it is stationary, suppresses the monitoring function of the monitoring device.
[0005] As alternatives, this disclosure may include information processing methods, computer programs, non-transitory recording media containing computer programs, and information processing systems having the same features as the information processing apparatus described above.
[0006] According to this disclosure, the burden on remote monitors can be reduced by suppressing the monitoring function. Attached Figure Description
[0007] Figure 1 This is a diagram illustrating an example of the structure of an information processing system according to an embodiment.
[0008] Figure 2 It is shown Figure 1 The diagram shows an example of the structure of an in-vehicle information processing system.
[0009] Figure 3 This is a diagram showing an example of the structure of a monitoring device.
[0010] Figure 4 This is a flowchart illustrating action example 1.
[0011] Figure 5 This is a flowchart illustrating action example 2.
[0012] Figure 6 This is a flowchart illustrating action example 3. Detailed Implementation
[0013] The information processing device according to the embodiment is mounted on an autonomous delivery vehicle equipped with a monitoring device for remote monitoring. Furthermore, the information processing device includes a control unit that suppresses the monitoring function of the monitoring device when it is determined that there is no delivery person inside the autonomous vehicle while the vehicle is stationary.
[0014] By suppressing the monitoring function, the information used by the monitor to conduct surveillance is interrupted, or the amount of information provided for surveillance is reduced. This reduces the monitoring burden on the monitor.
[0015] Hereinafter, with reference to the accompanying drawings, the information processing apparatus, information processing method, and program involved in the embodiments will be described. The structure of the embodiments is illustrative. The structures of the embodiments can be suitably combined.
[0016] <Structure of Information Processing Systems>
[0017] Figure 1 This is a diagram illustrating an example of the structure of an information processing system according to an embodiment. Figure 1 In this system, the information processing system includes vehicle 2 and a computer in control center 4 (hereinafter referred to as "control center 4"). Vehicle 2 is equipped with an onboard information processing system 20, which is connected to control center 4 via network N and can communicate with each other. The onboard information processing system 20 is an example of an "information processing device".
[0018] Network N includes wired networks and wireless networks. Wired networks, also known as core networks or backbone networks, are broadband networks exemplified by fiber optic networks. Wireless networks include mobile telephone networks exemplified by Long Term Evolution (LTE), 5G, and 6G.
[0019] Vehicle 2 is an autonomous vehicle used for door-to-door delivery. In this embodiment, vehicle 2 is a fully automated driving vehicle (Level 5 of autonomous driving). However, vehicle 2 is not necessarily a fully autonomous vehicle; it may also involve a driver. Vehicle 2 can be either engine-driven or motor-driven.
[0020] Control center 4 can be constructed using dedicated or general-purpose computers such as server units, personal computers, or workstations. Control center 4 manages vehicle 2, including the operation and maintenance of each monitored vehicle. For example, control center 4 creates operation schedules for regularly running vehicles 2, including start times, operation times, end times, and maintenance periods. Control center 4 updates the operation schedules in a timely manner, distributes them to vehicles 2, and manages their operation. Vehicle 2 can perform automated driving according to the operation schedule, circling one or more delivery destinations.
[0021] Inside vehicle 2, there is a cargo compartment 3 for storing goods intended for door-to-door delivery. The cargo compartment 3 contains the goods 4a destined for the recipient. A delivery person 5, who will deliver goods 4a to the recipient, sits in cargo compartment 3. When vehicle 2 stops at the designated location, the delivery person 5 disembarks with goods 4a, moves to the handover area, and hands goods 4a to the recipient.
[0022] Delivery person 5 holds smart key 6. Vehicle information processing system 20 includes smart key system 40. When smart key 6 receives radio waves transmitted from smart key system 40, it transmits radio waves towards smart key system 40. If the electric field strength or received power of the radio waves from smart key 6 is lower than a predetermined level, smart key system 40 determines that smart key 6 has moved to the outside of vehicle 2 and locks the doors of vehicle 2. Additionally, smart key system 40 turns off the drive source (engine or motor, etc.) of vehicle 2. On the other hand, if the electric field strength or received power of the radio waves from smart key 6 is higher than a predetermined level, it is configured to unlock the doors and turn the drive source ON. Therefore, when delivery person 5 gets out of vehicle 2 and delivers goods 4a, it is not necessary to unlock or lock the doors or turn off the drive source. Furthermore, smart key 6 can be a dedicated smart key device or a smart device (smartphone or tablet, etc.) with smart key functionality installed.
[0023] The vehicle information processing system 20 notifies the control center 4 of information related to autonomous driving at appropriate time intervals. This information includes information collected and processed by the vehicle information processing system 20 for autonomous driving (such as the location of vehicle 2), judgments based on this information, and control actions taken by the driving mechanism based on these judgments. The monitor 11 of vehicle 2, referring to the arrival information at the control center 4, monitors for any abnormalities during the autonomous driving process of vehicle 2. The generation and notification of the aforementioned information related to autonomous driving can be accomplished by the monitoring device 50 included in the vehicle information processing system 20. Figure 2 It can be carried out either outside the monitoring device 50.
[0024] The monitoring device 50 controls the operation (ON, OFF, and camera range, etc.) of one or more cameras 55 (camera devices) that capture images of the cargo room 3, etc. The monitoring device 50 processes the captured images (referred to as "monitoring images") into a format for transmission to the control center 4. The processed monitoring images are then transmitted to the control center 4 via network N. The control center 4 can display the monitoring images on one or more display devices (one or more screens) in accordance with the number of monitoring images (still images or video streams). The monitor 11 at the control center 4 can refer to the monitoring images to monitor for any abnormalities. The camera images include still images and animations. The monitor 11 is a remote observer.
[0025] In this embodiment, the monitoring device 50 determines whether the delivery person 5 is not inside the vehicle 2 (moved outside the vehicle) based on the reception status of radio waves from the smart key 6, and suppresses the monitoring function of the monitoring device 50 if it determines that the delivery person 5 is not inside the vehicle 2.
[0026] Figure 2 It is shown Figure 1 The diagram shows an example of the structure of the in-vehicle information processing system 20. Figure 2 In this vehicle 2, a Data Communication Module (DCM) 21 and a Central Electrical Control Unit (Central ECU) 22 are included. The Central ECU 22 is connected to the safety device 24 and the Automatic Driving System (ADS) 25 via an in-vehicle network 23 (such as an in-vehicle LAN). Additionally, the Central ECU 22 is connected to the audio-visual NAVI device 26 and the monitoring device 50 via the in-vehicle network 23.
[0027] DCM21 is a communication device capable of communicating with the control center 4 via network N. DCM21 is also capable of wireless communication via a portable communication network. Central ECU22 manages the various devices within vehicle 2.
[0028] The Central ECU22, for example, has a processor and a memory. The processor executes a computer program (hereinafter referred to as the "program") on the memory, performing processing as a Central ECU22.
[0029] The preventive safety device 24 has a built-in ECU that executes collision avoidance support actions through program processing. Based on signals from sensors such as radar and cameras, the preventive safety device 24 performs actions such as collision avoidance support, lane departure warning, automatic high beams, and radar cruise control.
[0030] The ADS25 has a built-in ECU that collects information for autonomous driving, performs cognitive analysis, makes cognitive-based judgments, and controls the vehicle's (2's) actions based on these judgments through program execution. The ADS25 is connected to Spatial Information Service (SIS) 27 and Advanced Drive Extension (ADX) 28. SIS 27 and ADX 28 each have built-in ECUs that perform sophisticated and advanced driver support processing through program handling. For example, the ADS25 uses detection signals from Light Detection and Ranging (LiDAR) to detect surrounding vehicles or three-dimensional objects, infers the vehicle's (2's) position, and performs motion control.
[0031] SIS27 provides the ADS25 with information such as the vehicle's own attitude and its position on the map. SIS27 acquires position information from a global navigation satellite system (GNSS) or global positioning system (GPS), 6-axis acceleration signals from a gyroscope sensor, or path information or map information from a navigation system. Based on the acquired information, SIS27 calculates the vehicle's own attitude and its position on the map. ADX28 uses an Artificial Intelligence (AI) system to identify and process information from the aforementioned sensors and notifies ADS25 of the processing results.
[0032] The audio-visual NAVI device 26 has a built-in ECU that, through program processing, provides various functions such as using sound, images, and map information for the user of vehicle 2.
[0033] <Structure of the monitoring device>
[0034] Figure 3 This is a diagram illustrating a structural example of a monitoring device 50. The monitoring device 50 includes a processor 51 (an example of a "control unit"), a storage device 52, a communication device 53, a smart key detection mechanism 54, a camera 55, and a sensor 56, all connected via a bus 57. The monitoring device 50 is an example of a computer, configured in the vehicle 2 in a removable or fixed manner.
[0035] Storage device 52 is an example of a non-transitory storage medium, including a main storage device and an auxiliary storage device. The main storage device is used as a storage area for programs and data, a program expansion area, a program execution area, or a buffer area for communication data, etc. The main storage device is composed of RAM (Random Access Memory), or a combination of RAM and ROM (Read Only Memory). The auxiliary storage device is used as a storage area for data and programs. As an auxiliary storage device, a non-volatile storage medium can be used. Examples of non-volatile storage media include hard disks, Solid State Drives (SSDs), flash memory, or EEPROM (Electrically Erasable Programmable Read-Only Memory).
[0036] The communication device 53 is a circuit that performs communication processing. The communication device 53 is, for example, a network interface card (NIC) connected to the in-vehicle network 23 (in-vehicle LAN).
[0037] The smart key detection mechanism 54 includes a transmitter that sends radio waves toward the smart key 6 and a receiver that receives radio waves from the smart key 6. The processor 51 can use the output from the receiver to calculate the electric field strength or received power of the received radio waves. Alternatively, the monitoring device 50 can also be configured to receive the calculated results of the electric field strength or received power from the smart key system 40 via the communication device 53 and the in-vehicle network 23. In this case, the smart key detection mechanism 54 can be omitted. Furthermore, in this embodiment, it is envisioned that the monitoring device 50 is attached to the vehicle 2 (capable of estimating the location of the smart key independently of the smart key system 40), and the smart key detection mechanism 54 is provided in this configuration.
[0038] In this embodiment, two or more cameras 55 are prepared. The cameras 55 are configured to capture images of multiple predetermined locations inside and outside the vehicle 2, such as the cargo compartment 3, the delivery person's seat 5, and the vicinity of the vehicle door 2. Furthermore, the cameras 55 may also have a structure that allows their viewing angle and camera direction to be changed via a processor 51 or similar means. The sensor 56 is, for example, a human sensor, which detects the presence of people (such as the delivery person 5) inside the vehicle. The detection method using the human sensor is not limited; the human sensor can be a light sensor or a CDS sensor, etc. However, the type of sensor 56, i.e., the physical quantity detected by the sensor 56 (the output of the sensor 56), can be appropriately changed depending on the object being monitored.
[0039] The processor 51 is, for example, a CPU (Central Processing Unit). The processor 51 performs various processes by executing various programs stored in the storage device 52, etc. For example, the processor 51 can calculate the electric field strength or received power of the received radio waves from the smart key 6 based on the output of the smart key detection mechanism 54, and determine whether the delivery person 5 is inside the vehicle based on the calculation result. Additionally, the processor 51 can analyze the video images captured by the camera 55 to determine whether the delivery person 5 is inside the vehicle 2. Furthermore, the processor 51 can also determine whether the delivery person 5 is inside the vehicle based on the output of the sensor 56. Alternatively, the processor 51 can also receive unlock and lock signals from the vehicle 2 doors based on the smart key system 40 via the in-vehicle network 23, determining that the delivery person 5 has gone outside the vehicle upon receiving the lock signal, and that the delivery person 5 is inside the vehicle upon receiving the unlock signal.
[0040] When the processor 51 determines that the delivery person 5 is not in the vehicle, i.e., has gone outside the vehicle, it suppresses the monitoring function. Suppressing the monitoring function can be, for example, stopping the operation of the monitoring device 50 (OFF). Suppressing the monitoring function can involve OFFing all or some of the cameras 55. For example, by OFFing some of the cameras 55, one or more cameras may be used to monitor the area near the doors of the vehicle 2. This is to quickly locate the delivery person 5 who has finished their delivery and returned to the vehicle 2. Because some of the cameras 55 are OFF, the monitoring range of the surveillance image is smaller than when it is not suppressed. Alternatively, suppressing the monitoring function can also involve OFFing the processing (conversion) of the camera images from the cameras 55 to a format for transmission, or stopping transmission based on the OFF of the communication device 53, or stopping the transmission of surveillance images from the DCM 21.
[0041] Additionally, if the processor 51 determines, based on the output of at least one of the smart key detection mechanism 54, camera 55, and sensor 56, that the delivery person 5 is inside the vehicle (returns to the vehicle), it will release the suppression of the monitoring function.
[0042] <Action Example>
[0043] Figure 4 This is a flowchart illustrating a processing example (Action Example 1) of the processor 51 of the monitoring device 50. At the beginning of the flowchart, the monitoring function of the monitoring device 50 is in a non-suppressed state.
[0044] In step S001, processor 51 obtains the status information of vehicle 2. That is, processor 51 queries the Central ECU 22 for the status of vehicle 2. The Central ECU 22 obtains information indicating the vehicle's status from the ADS 25 and sends it to processor 51. In this way, processor 51 obtains information indicating the status of vehicle 2.
[0045] In step S002, processor 51 determines whether the information indicating the state of vehicle 2 indicates that vehicle 2 is in a stopped state. For example, if the information indicating the state of vehicle 2 indicates that vehicle 2 has applied the parking brake, processor 51 determines that vehicle 2 is in a stopped state. If vehicle 2 is determined to be in a stopped state, the process proceeds to step S003; otherwise, the process returns to step S001. The stopped state can also be a state other than the state of applying the parking brake.
[0046] In step S003, the processor 51 determines whether the smart key 6 is outside the vehicle. Specifically, the processor 51 calculates the electric field strength or received power of the radio waves emitted from the smart key 6 based on the output from the smart key detection mechanism 54, and determines whether the calculation result is below a predetermined threshold (stored in the storage device 52, etc.). If the calculation result is determined to be below the threshold, it is treated as if the smart key 6 is outside the vehicle (the delivery person 5 holding the smart key 6 has gone outside the vehicle). At this point, the process proceeds to step S004.
[0047] Furthermore, the processing in step S003 can also be as follows: The processor 51 stores the temporal changes (history) of the electric field strength or received power in the storage device 52. If, during the time period of the determination object in the history, the processor 51 determines that the smart key 6 is located (exists) outside the vehicle, the electric field strength or received power changes from a state exceeding a threshold to a state below the threshold.
[0048] In step S003, if the calculation result exceeds the threshold, it is treated as if the smart key 6 is inside the vehicle (the delivery person 5 is inside the vehicle), and the process returns to step S001. Alternatively, in step S003, the electric field strength or received power can be converted into distance, and the location of the smart key 6 inside or outside the vehicle can be determined based on the distance.
[0049] In step S004, the processor 51 performs a suppression process for the monitoring function. That is, the processor 51 reduces the number of cameras 55 used when not suppressed to a predetermined number (e.g., one). At this time, all cameras 55 can be turned off, as can the processing of generating monitoring images for transmission and the processing of sending monitoring images for transmission to the Central ECU 22.
[0050] In step S005, the processor 51 determines whether the smart key 6 is outside the vehicle. This process is the same as in step S003. If it is determined that the smart key 6 is outside the vehicle, the process proceeds to step S006; otherwise, in order to facilitate the delivery person 5 returning to the vehicle, the process proceeds to step S007.
[0051] Furthermore, the processing in step S005 can also be as follows: The processor 51 stores the temporal changes (history) of the electric field strength or received power in the storage device 52. If, during the time period of the determination object in the history, the processor 51 determines that the smart key 6 is located (present) inside the vehicle, the electric field strength or received power changes from a state below a threshold to a state exceeding the threshold.
[0052] In step S006, processor 51 determines whether there is anyone inside the vehicle. That is, processor 51 determines whether there is anyone inside the vehicle by analyzing the image captured by camera 55 or the output of sensor 56. This is to detect suspicious persons or other intruders into the vehicle when delivery person 5 is not present. If someone is detected, the process proceeds to step S007; otherwise, the process returns to step S005.
[0053] In step S007, the processor 51 releases the suppression process of the monitoring function and returns to the unsuppressed state. Afterwards, the process returns to step S001. Furthermore, the processing in step S006 is optional.
[0054] Figure 5 This is a flowchart illustrating a processing example (Action Example 2) of the processor 51 of the monitoring device 50. At the beginning of the flowchart, the monitoring function of the monitoring device 50 is in a non-suppressed state. This is in contrast to the processing of Action Example 1. Figure 4 In the comparison, Figure 5 The processing differs from the previous one in that (1) step S003a is provided instead of step S003, and (2) step S005 is omitted. Figure 4 The processing differs. Therefore, step S003a will be explained, while explanations of other steps will be omitted.
[0055] In step S003a, the processor 51 analyzes at least one of the outputs of the camera 55 (camera image) and the sensor 56 to determine whether the person (deliveryman 5) is not in the vehicle. At this time, if the camera image shows a person, it is also possible to determine whether the person is deliveryman 5 through image analysis (identification of clothing color, pattern, etc.). Alternatively, the outputs of multiple sensors 56 can be combined to determine whether the person is deliveryman 5. Then, if it is determined that no one (deliveryman 5) is in the vehicle (not present), the process proceeds to step S004; otherwise, the process returns to step S001. As described in Operation Example 2, the determination can be performed using the outputs of at least one of the camera 55 and the sensor 56 instead of using the radio waves from the smart key 6.
[0056] Figure 6 This is a flowchart illustrating a processing example (Action Example 3) of the processor 51 of the monitoring device 50. At the beginning of the flowchart, the monitoring function of the monitoring device 50 is in a non-suppressed state. This is in contrast to the processing of Action Example 1. Figure 4 In the comparison of ), Figure 6 In the processing, step S003a is inserted between step S003 and step S004. The details of each step are the same as in Action Examples 1 and 2, so the explanation is omitted. As described in Action Example 3, both the determination using the radio waves from the smart key 6 and the determination using the output of at least one of the camera 55 and the sensor 56 can be performed to improve the accuracy of the determination of whether it is not present.
[0057] Furthermore, while examples 1-3 illustrate the operation of processor 51, the processing performed by processor 51 can also be performed by Central ECU 22. In this case, processor 51 sends outputs from smart key detection mechanism 54, camera 55, and sensor 56 to Central ECU 22. Additionally, processor 51, upon receiving instructions from Central ECU 22, suppresses and releases the monitoring function. Alternatively, Central ECU 22 can stop sending monitoring images to DCM 21 to suppress the monitoring function. Monitoring using monitoring device 50 is performed by capturing and sending monitoring images to control center 4. However, the outputs of one or more sensors 56, or multiple sensors 56, can be sent to control center 4, and the monitor 11 uses the information obtained from the sensor outputs to perform monitoring. In this case, the monitoring function is suppressed, for example, by stopping the transmission of sensor outputs. Furthermore, monitoring can also be performed using both monitoring images and sensor outputs; suppression of this situation can be achieved by stopping the transmission of at least one of the monitoring images or sensor outputs.
[0058] <Effects of the Implementation Method>
[0059] In this embodiment, vehicle 2 is an autonomous delivery vehicle equipped with a monitoring device 50 for remote monitoring. Vehicle 2 is equipped with an on-board information processing system 20 as an information processing unit. The processor 51 (or Central ECU 22) included in the on-board information processing system 20 determines that there is no delivery person 5 inside the vehicle 2 when the vehicle 2 is stationary, and suppresses the monitoring function of the monitoring device 50. By suppressing the monitoring, the monitoring images are not sent to the control center 4, or the monitoring images are sent to the control center 4 with a reduced camera range (reduced number of cameras 55). Therefore, the monitor 11 can perform monitoring without using the monitoring images, or with a reduced monitoring range, when the delivery person 5 is not inside the vehicle 2. This reduces the burden on the monitor 11.
[0060] In this implementation, if the processor 51, acting as the control unit, determines that the smart key 6 of the vehicle 2 is not inside the vehicle 2 when the vehicle 2 is stopped, it can determine that there is no delivery person 5 inside the vehicle 2 when the vehicle 2 is stopped. Figure 4 (S003). That is, it can use the radio waves from the smart key 6 to determine whether the deliveryman 5 is in the car.
[0061] The processor 51 can also determine that the smart key 6 is outside the vehicle if, based on historical data of the electric field strength or received power of the radio waves of the smart key 6 while the vehicle 2 is stationary, the smart key 6 has moved from inside the vehicle 2 to outside (S003). Then, the monitoring function can be suppressed based on this determination (S004). By determining whether the smart key 6 is inside or outside the vehicle based on historical data rather than a single calculation, the accuracy of the determination can be improved.
[0062] Additionally, the processor 51 can, for example, determine whether the smart key 6 has moved from outside the vehicle to inside the vehicle based on the history of the electric field strength or received power of the radio waves emitted by the smart key 6. Figure 4 (S005). Then, based on this determination, the suppression of the monitoring function can be lifted (S007).
[0063] Furthermore, when the vehicle 2 is stationary, the processor 51 determines, based on at least one of the camera image obtained from filming inside the vehicle 2 and the output of the sensor 56, that there is no delivery person inside the vehicle 2. Figure 5 S003a) can suppress the monitoring function (S004).
[0064] In this embodiment, in the unsuppressed state of the monitoring function, the monitoring device 50 captures images (monitoring images) of the vehicle 2. In the suppressed state of the monitoring function, the processor 51 reduces the capture range of the monitoring image to be smaller than that in the unsuppressed state. For example, the number of cameras 55 performing the capture is reduced. This enables the suppression of the monitoring function (S004). By reducing the capture range used for monitoring, the workload of the monitor 11 is reduced because the range of monitoring by referring to the monitoring image is smaller. The reduction in the capture range can also be achieved by reducing the viewing angle of the monitoring image, thus reducing the number of objects reflected in the monitoring image. The suppression of the monitoring function (S004) can be either stopping the capture of the monitoring image or stopping the processing of the captured monitoring image (converting the size or format of the monitoring image for transmission). By stopping processing, the monitoring image is not transmitted normally, so the control center 4 cannot display the monitoring image normally. When the monitor 11 recognizes this state as not requiring monitoring, monitoring is not performed, thereby reducing the workload of the monitor 11. Alternatively, suppressing the monitoring function can also mean stopping the transmission of monitoring images.
[0065] Furthermore, when the processor 51 is in the state of suppressing the monitoring function, and determines that someone is inside the vehicle 2 while the smart key 6 is outside the vehicle, it can release the suppression of the monitoring function. Therefore, monitoring can resume if someone other than the delivery person 5 enters the vehicle.
[0066] <Other>
[0067] The above-described embodiments are merely examples, and this disclosure can be appropriately modified and implemented without departing from its spirit. Furthermore, processes described as being performed by one device can also be performed by multiple devices. Alternatively, processes described as being performed by different devices can also be performed by one device. In a computer system, the hardware architecture (server architecture) used to implement each function can be flexibly changed.
[0068] This disclosure can also be implemented by supplying a computer program containing the functions described in the above embodiments to a computer, which has one or more processors that read and execute the program. Such a computer program can be provided to the computer either through a non-transitory computer-readable storage medium that can be connected to the computer's system bus, or via a network. Non-transitory computer-readable storage media include, for example, any type of disk such as a hard disk (floppy disk, hard disk drive (HDD), etc.) or an optical disk (CD-ROM, DVD, Blu-ray disc, etc.). Furthermore, non-transitory computer-readable storage media include read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards, flash memory, optical cards, and any type of medium suitable for storing electronic commands.
Claims
1. An information processing device mounted on an autonomous delivery vehicle equipped with a monitoring device for remote monitoring, the monitoring device controlling the operation of a plurality of camera devices for remote monitoring, the plurality of camera devices being configured to capture images of multiple locations inside and outside the autonomous delivery vehicle, wherein... The information processing device includes a control unit. When the control unit determines that there is no delivery person inside the autonomous vehicle while it is stationary, it controls the monitoring device to shut down some of the multiple camera devices and turn on the remaining camera devices to suppress the monitoring function of the monitoring device. When the control unit determines that there is a delivery person inside the autonomous vehicle while it is stationary, it turns on all of the multiple camera devices to cancel the suppression of the monitoring function of the monitoring device. If the control unit determines that the smart key for the autonomous vehicle is not inside the autonomous vehicle, it determines that there is no delivery person inside the autonomous vehicle. When the monitoring function is suppressed, if the control unit determines that there is someone inside the autonomous vehicle while the smart key is outside the autonomous vehicle, it will release the suppression of the monitoring function and turn on the portion of the camera devices that were previously turned off.
2. The information processing apparatus according to claim 1, wherein, If the control unit determines that the smart key is not inside the autonomous vehicle if the history of the electric field strength or received power of the radio waves from the smart key indicates that the smart key has moved from inside the vehicle to outside the vehicle, the control unit will determine that the smart key is not inside the autonomous vehicle.
3. The information processing apparatus according to claim 1 or 2, wherein, When the control unit determines that the smart key has been moved from outside the autonomous vehicle to inside the vehicle, it releases the suppression of the monitoring function of the monitoring device.
4. The information processing apparatus according to claim 1, wherein, The control unit determines that there is no delivery person in the autonomous vehicle based on the video images obtained by using the multiple camera devices to film the interior of the autonomous vehicle in the stopped state or the output of the sensors.
5. The information processing apparatus according to claim 1 or 2, wherein, In the unsuppressed state of the monitoring function, when the monitoring device uses multiple camera devices to capture images for monitoring the autonomous vehicle, the control unit, in the suppressed state of the monitoring function, makes the image capture range of the monitoring image smaller than the image capture range of the monitoring image in the unsuppressed state.
6. An information processing method, executed by an information processing device mounted on an autonomous delivery vehicle equipped with a monitoring device for remote monitoring, wherein the monitoring device controls the operation of a plurality of camera devices for remote monitoring, the plurality of camera devices being configured to capture images of multiple locations inside and outside the autonomous delivery vehicle, wherein... The information processing device performs: When it is determined that there is no delivery person in the autonomous vehicle while it is stopped, the monitoring device is controlled to turn off some of the multiple camera devices and turn on the remaining multiple camera devices to suppress the monitoring function of the monitoring device. as well as When it is determined that there is a delivery person inside the autonomous vehicle while it is stationary, all cameras of the multiple camera devices are activated to cancel the suppression of the monitoring function of the surveillance device. If it is determined that the smart key for the autonomous vehicle is not inside the autonomous vehicle, it is determined that there is no delivery person inside the autonomous vehicle. When the monitoring function is suppressed, and it is determined that there is someone inside the autonomous vehicle while the smart key is outside the autonomous vehicle, the suppression of the monitoring function is released, causing the portion of the camera devices that were turned off to turn on.
7. The information processing method according to claim 6, wherein, If the information processing device determines that the smart key is not inside the autonomous vehicle if the historical data of the electric field strength or received power of the radio waves from the smart key indicates that the smart key has moved from inside the vehicle to outside the vehicle, the information processing device will determine that the smart key is not inside the autonomous vehicle.
8. The information processing method according to claim 7, wherein, When the information processing device determines that the smart key has been moved from outside the autonomous vehicle to inside the vehicle, it releases the suppression of the monitoring function of the monitoring device.
9. The information processing method according to claim 6, wherein, The information processing device determines that there is no delivery person in the autonomous vehicle based on the video images obtained by using the multiple camera devices to film the interior of the autonomous vehicle in the stopped state or the output of the sensors.
10. The information processing method according to claim 6 or 7, wherein, When the monitoring device uses multiple camera devices to capture images of the autonomous vehicle for monitoring in the unsuppressed state of the monitoring function, the information processing device makes the image capture range of the monitoring image smaller than the image capture range of the monitoring image in the unsuppressed state.
11. A non-transitory storage medium storing a program that causes a computer mounted on an autonomous delivery vehicle equipped with a monitoring device for remote monitoring to perform the following actions: the monitoring device controls the operation of a plurality of camera devices for remote monitoring, the plurality of camera devices being configured to capture images of multiple locations inside and outside the autonomous vehicle. When it is determined that there is no delivery person inside the autonomous vehicle while it is stationary, the monitoring device is controlled to shut down some of the multiple camera devices and activate the remaining ones, thereby suppressing the monitoring function of the monitoring device. When it is determined that there is a delivery person inside the autonomous vehicle while it is stationary, all the multiple camera devices are activated, thereby canceling the suppression of the monitoring function of the monitoring device. If it is determined that the smart key for the autonomous vehicle is not inside the autonomous vehicle, it is determined that there is no delivery person inside the autonomous vehicle. When the monitoring function is suppressed, and it is determined that there is someone inside the autonomous vehicle while the smart key is outside the autonomous vehicle, the suppression of the monitoring function is released, causing the portion of the camera devices that were turned off to turn on.
12. The non-transitory storage medium according to claim 11, wherein, If the history of the electric field strength or received power of the radio waves from the smart key indicates that the smart key has moved from inside the autonomous vehicle to outside the vehicle, the program causes the computer to determine that the smart key is not inside the autonomous vehicle.
13. The non-transitory storage medium according to claim 12, wherein, If it is determined that the smart key has been moved from outside the autonomous vehicle to inside the vehicle, the program causes the computer to release the suppression of the monitoring function of the monitoring device.
14. The non-transitory storage medium according to claim 12, wherein, The program causes the computer to determine, based on the video images obtained by using the multiple camera devices to film the interior of the autonomous vehicle in the stopped state, or the output of the sensors, that there is no delivery person in the autonomous vehicle.
Citation Information
Patent Citations
Information processing method, and information processing system
JP2020061120A
Position detection for activation of device and methods thereof
US20110224870A1
Luggage management system and luggage management method
US20190182457A1