Information processing device and vehicle

Abstract

The invention relates to an information processing apparatus and a vehicle. A control unit of an information processing device acquires a parameter value relating to the incidence of light from outside a vehicle into a predetermined region that is set further toward the inside than a door of the vehicle and that is a target of a detection process based on moving image analysis, which is an object that is an obstacle to open / close the door. A control unit of the information processing apparatus performs a determination process for determining whether or not the parameter value satisfies a predetermined condition in which an increase in erroneous detection in the detection process due to the incidence of light into the predetermined region is expected. The control unit then executes a detection process when it is determined that the parameter value does not satisfy the predetermined condition. Furthermore, when it is determined that the parameter value satisfies the predetermined condition, the control unit prohibits execution of the detection process and outputs notification information regarding prohibition of execution of the detection process to the driver of the vehicle.

Description

Technical Field

[0001] The present disclosure relates to an information processing device and a vehicle. Background Art

[0002] Patent Document 1 discloses a monitoring system. The monitoring system acquires images captured by a camera that captures the passenger cabins of multiple mobile objects. Based on the acquired images, the monitoring system determines the movement of passengers in the passenger cabins of the multiple mobile objects. Based on the acquired movement, the monitoring system calculates a priority level indicating the degree of necessity for passenger monitoring. The monitoring system then determines the display target on a display device based on the priority level, with the display device sequentially switching to display the passenger cabins of the multiple mobile objects during a display switching period.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2022-94724 Summary of the Invention

[0006] An object of the present disclosure is to improve the detection accuracy of an object that obstructs the opening / closing of a vehicle door by using dynamic image analysis, and to reduce the burden on the vehicle driver to monitor the object.

[0007] The information processing device disclosed herein includes a control unit,

[0008] The control unit is configured to perform the following actions:

[0009] acquiring a parameter value associated with incident light from outside the vehicle into a predetermined area, wherein the predetermined area is an area set inside a door of the vehicle and is a target area for detection processing based on dynamic image analysis of an object that obstructs opening / closing of the door;

[0010] executing a process of determining whether the parameter value satisfies a prescribed condition, wherein the prescribed condition is a condition under which an increase in false detections in the detection process due to incidence of light into the prescribed area is expected; and

[0011] If it is determined that the parameter value does not satisfy the specified conditions, the detection processing is executed; if it is determined that the parameter value satisfies the specified conditions, the execution of the detection processing is prohibited and a notification message regarding the prohibition of the execution of the detection processing is output to the driver of the vehicle.

[0012] Effects of the Invention

[0013] According to the present disclosure, the detection accuracy of an object that obstructs the opening / closing of a vehicle door can be improved by using dynamic image analysis, and the burden of monitoring the object on the driver of the vehicle can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a diagram showing the schematic configuration of a monitoring system.

[0015] Figure 2 This is an example of the arrangement of side windows of a vehicle.

[0016] Figure 3 This is a block diagram schematically showing an example of the functional configuration of an in-vehicle device.

[0017] Figure 4 This is a diagram showing an example of the table structure of solar information stored in the solar information database.

[0018] Figure 5 This is a diagram showing an example of the table structure of condition information stored in the condition information database.

[0019] Figure 6 This is a flowchart of the processing executed by the control unit.

[0020] Description of reference numerals:

[0021] 1: Monitoring system; 10: Vehicle; 100: Onboard device; 101: Control unit; 102: Communication unit; 103: Input / output unit; 104: Solar information DB; 105: Condition information DB; 200: Illumination sensor; 300: Camera; 400: GPS sensor; 500: Vehicle door. DETAILED DESCRIPTION

[0022] When an object (person, object) is near a vehicle door, it can sometimes hinder the door's opening / closing. Therefore, the presence of an object near the door is determined by analyzing the dynamic image captured by a camera inside the vehicle. On the other hand, light can sometimes enter the vicinity of the door. In this case, the dynamic image analysis can sometimes mistakenly identify the incident light as an object. This can lead to the determination that an object, hindering the door's opening / closing, is present near the door, even though it doesn't actually exist.

[0023] Therefore, the control unit of the information processing device disclosed herein acquires parameter values associated with the incidence of light from outside the vehicle into a predetermined area. Here, the predetermined area is an area located further inboard than the vehicle door and is the target of dynamic image analysis-based detection processing for objects that obstruct the opening and closing of the door. The control unit of the information processing device then determines whether the parameter values meet predetermined conditions, where the conditions are expected to increase false detections in the detection process due to the incidence of light into the predetermined area.

[0024] If the control unit determines that the parameter value does not satisfy the prescribed condition, the control unit executes the detection process. Alternatively, if the control unit determines that the parameter value satisfies the prescribed condition, the control unit prohibits the detection process. In this case, the control unit outputs notification information regarding the prohibition of the detection process to the driver of the vehicle.

[0025] As described above, the information processing device determines whether to execute the detection process based on the parameter value. If the information processing device does not predict an increase in false detections during the detection process due to the incidence of light into the predetermined area (the likelihood of false detection is low), the information processing device executes the detection process. Alternatively, if the information processing device predicts an increase in false detections during the detection process due to the incidence of light into the predetermined area (the likelihood of false detection is high), the information processing device prohibits the execution of the detection process.

[0026] Furthermore, if the detection process is prohibited, the information processing device notifies the vehicle driver of the prohibition. This allows the vehicle driver to understand that the detection process has not been executed, and the vehicle driver is prompted to confirm the presence of an object within the specified area. That is, if the likelihood of false detection during the detection process is low, the presence of an object within the specified area is confirmed through the detection process. If the likelihood of false detection during the detection process is high, the vehicle driver is prompted to confirm the presence of an object within the specified area. This improves the accuracy of dynamic image analysis-based detection of objects that obstruct the opening / closing of vehicle doors, and reduces the burden on the vehicle driver of monitoring such objects.

[0027] The following describes specific embodiments of the present disclosure based on the accompanying drawings. Unless otherwise specified, the dimensions, materials, shapes, and relative configurations of the components described in these embodiments are not intended to limit the technical scope of the present disclosure to these specifications. Furthermore, unless otherwise specified, the hardware configuration, module configuration, and functional configuration described in these embodiments are not intended to limit the technical scope of the present disclosure to these specifications.

[0028] <Implementation Method>

[0029] (System Overview)

[0030] based on Figure 1 and Figure 2 , the monitoring system 1 in this embodiment is described. Figure 1 1 is a diagram showing a schematic configuration of a monitoring system 1. The monitoring system 1 is configured to include an onboard device 100, an illuminance sensor 200, a camera 300, a GPS sensor 400, and a door 500. Here, the onboard device 100, the illuminance sensor 200, the camera 300, the GPS sensor 400, and the door 500 are mounted on a vehicle 10. In the monitoring system 1, the onboard device 100, the illuminance sensor 200, the camera 300, the GPS sensor 400, and the door 500 are connected via an in-vehicle network. It should be noted that in this embodiment, the vehicle 10 is a bus. However, the vehicle 10 may also be a vehicle other than a bus. As an example of a vehicle 10 other than a bus, a train vehicle can be shown.

[0031] Figure 2 This is an example of the arrangement of the windows on the side of the vehicle 10. Figure 2 As shown, a window ( Figure 2 (See the hatched portion in the figure). For reasons such as improving lighting and ensuring visibility outside the vehicle 10, three windows are provided on the sides of the vehicle 10, one at the top and one at the bottom. It should be noted that windows are also provided on the top and bottom of the doors 500. Alternatively, windows may be provided on the top and bottom of the vehicle on the front or back of the vehicle 10.

[0032] (illuminance sensor)

[0033] The illuminance sensor 200 is a sensor provided in the vehicle 10. The illuminance sensor 200 senses the illuminance outside the vehicle 10. The illuminance sensor 200 transmits the sensed illuminance outside the vehicle 10 to the vehicle-mounted device 100 in real time via the in-vehicle network.

[0034] (GPS sensor)

[0035] The GPS sensor 400 is provided on the vehicle 10. The GPS sensor 400 senses the current position and orientation of the vehicle 10 (hereinafter sometimes referred to as the "vehicle orientation"). The GPS sensor 400 transmits the sensed current position and orientation of the vehicle 10 to the in-vehicle device 100 in real time via the in-vehicle network.

[0036] (Camera)

[0037] The camera 300 is a camera installed in the vehicle 10. The camera 300 captures a moving image of the surrounding area including the door 500 in the vehicle 10. The camera 300 transmits the captured moving image to the vehicle-mounted device 100 in real time via the in-vehicle network.

[0038] (Car door)

[0039] The door 500 is provided for getting on and off the vehicle 10. The door 500 receives opening / closing information instructing the door 500 to open or close from the vehicle-mounted device 100 via the in-vehicle network. The door 500 opens / closes according to the received opening / closing information.

[0040] (In-vehicle device)

[0041] The vehicle-mounted device 100 is a device mounted on the vehicle 10. The vehicle-mounted device 100 has a function of managing the opening / closing of the vehicle door 500. Here, there is sometimes an object in a predetermined area. The predetermined area is an area set on the inner side of the vehicle door 500, and is an area that sometimes becomes an obstacle to the opening / closing of the vehicle door 500 when there is an object. The predetermined area is, for example, a step portion in the vehicle 10. In addition, the predetermined area can be, for example, an area within a predetermined distance from the vehicle door 500, or a pre-specified range. In addition, the objects detected by the vehicle-mounted device 100 through dynamic image analysis include objects such as people, objects, and animals.

[0042] At this time, objects present in the specified area may sometimes become an obstacle to the opening / closing of the vehicle door 500. Specifically, when the vehicle door 500 is open, an object present in the specified area may be caught in the door pocket, thereby hindering the opening / closing of the vehicle door 500. In addition, when the vehicle door 500 is closed, an object present in the specified area may be caught by the vehicle door 500, thereby hindering the opening / closing of the vehicle door 500. Therefore, the vehicle-mounted device 100 performs a process (hereinafter sometimes referred to as "detection process") to determine whether there is an object in the specified area within the vehicle 10 by performing dynamic image analysis on the dynamic image captured by the camera 300.

[0043] If the vehicle-mounted device 100 determines that there is no object in the predetermined area during the detection process, it allows the door 500 to be opened / closed. If the vehicle-mounted device 100 determines that there is an object in the predetermined area during the detection process, it prohibits the door 500 from being opened / closed.

[0044] On the other hand, depending on the current position and orientation of the vehicle 10, light may enter the vehicle 10. This can cause the vehicle-mounted device 100 to mistakenly interpret the incoming light as an object during dynamic image analysis. Consequently, when light enters a predetermined area, the vehicle-mounted device 100 may mistakenly detect an object in the predetermined area during detection, even though no object exists in the predetermined area.

[0045] Furthermore, as mentioned above, to facilitate lighting and ensure a clear view outside the vehicle 10, the vehicle 10 is provided with a window located below the center portion. Therefore, light easily enters the designated area through the window located below the vehicle 10. In particular, the vehicle 10 also has a window located below the door 500, allowing light to easily enter the designated area through this window. In other words, the window located below the vehicle 10 for lighting and improving visibility can easily impair the accuracy of the detection process.

[0046] Therefore, the vehicle-mounted device 100 obtains parameter values associated with the incidence of light into a predetermined area (hereinafter, sometimes simply referred to as "parameter values"). In this embodiment, the parameter values include the current position and vehicle orientation of the vehicle 10 obtained by the GPS sensor 400. Furthermore, the parameter values include the position of the sun. Furthermore, the parameter values include the illuminance outside the vehicle 10 obtained by the illuminance sensor 200. The vehicle-mounted device 100 determines whether to execute the detection process based on these parameter values. The method by which the vehicle-mounted device 100 determines whether to execute the detection process based on the parameter values will be described in detail later.

[0047] Furthermore, when prohibiting the execution of the detection process, the vehicle-mounted device 100 outputs (by voice or on a display) notification information. The notification information is information for notifying the driver of the vehicle 10 of the prohibition of the execution of the detection process.

[0048] The in-vehicle device 100 is configured as a computer including a processor 110, a main storage unit 120, an auxiliary storage unit 130, and a communication interface (communication I / F) 140. The processor 110 is, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The main storage unit 120 is, for example, a RAM (Random Access Memory). The auxiliary storage unit 130 is, for example, a ROM (Read Only Memory). Furthermore, the auxiliary storage unit 130 is, for example, an HDD (Hard Disk Drive) or a disk recording medium such as a CD-ROM, DVD, or Blu-ray Disc. Furthermore, the auxiliary storage unit 130 may also be a removable medium (portable storage medium). Examples of removable media include a USB memory or an SD card. The communication I / F 140 is, for example, a LAN (Local Area Network) interface board or a wireless communication circuit for wireless communication.

[0049] In the vehicle-mounted device 100, an operating system (OS), various programs, various information tables, etc. are stored in the auxiliary storage unit 130. In addition, in the vehicle-mounted device 100, the program stored in the auxiliary storage unit 130 can be loaded into the main storage unit 120 and executed by the processor 110 to implement various functions as described later. However, some or all of the functions in the vehicle-mounted device 100 can also be implemented by hardware circuits such as ASIC or FPGA. It should be noted that the vehicle-mounted device 100 does not necessarily have to be implemented by a single physical structure, but can also be composed of multiple computers that cooperate with each other. In addition, the illuminance sensor 200, the camera 300, the GPS sensor 400 and the vehicle door 500 are also configured to include a computer in the same way as the vehicle-mounted device 100.

[0050] (Functional composition)

[0051] Then, based on Figures 3 to 5 , the functional structure of the vehicle-mounted device 100 constituting the monitoring system 1 is described. Figure 3 This is a block diagram schematically showing an example of the functional configuration of the vehicle-mounted device 100. The vehicle-mounted device 100 includes a control unit 101, a communication unit 102, an input / output unit 103, a solar information database 104 (solar information DB104), and a condition information database 1404 (condition information DB105).

[0052] The control unit 101 performs computational processing for controlling the in-vehicle device 100. The control unit 101 can be implemented by the processor 110 in the in-vehicle device 100. The communication unit 102 connects the in-vehicle device 100 to the in-vehicle network. The communication unit 102 can be implemented by the communication I / F 140 in the in-vehicle device 100.

[0053] The input / output unit 103 has a function for allowing the driver of the vehicle 10 to input various information into the in-vehicle device 100. Furthermore, the input / output unit 103 has a function for outputting various information to the driver of the vehicle 10 (displaying it on a display or outputting it as audio). The input / output unit 103 can be implemented using a touch panel and a speaker in the in-vehicle device 100.

[0054] The solar information DB 104 has a function of storing solar information. The solar information DB 104 can be realized by the auxiliary storage unit 130 in the vehicle-mounted device 100. The solar information is information for specifying the position of the sun. Figure 4 1 is a diagram showing an example of the table structure of solar information stored in the solar information DB 104 .

[0055] like Figure 4 As shown, the solar information includes a position field, a time field, a solar altitude field, and a solar azimuth field. The position field stores the location of each location. For example, the position field stores the latitude and longitude of each location. The time field stores the time of day. The time field stores information indicating each time from sunrise to sunset.

[0056] The solar altitude field stores the solar altitude at the location in the corresponding position field at the time in the corresponding time field. The solar altitude is an angle where the horizon is set at 0 degrees and the zenith is set at 90 degrees. Furthermore, the solar azimuth field stores the sun's position (solar azimuth) at the time in the corresponding time field when viewed from the location in the corresponding position field. The control unit 101 can obtain solar information stored in the solar information DB 104 to grasp the solar position at each location at each time.

[0057] The condition information DB 105 has a function of storing condition information. The condition information DB 105 can be realized by the auxiliary storage unit 130 in the vehicle-mounted device 100. The condition information is information indicating the relative position of the sun with respect to the vehicle 10, where light is estimated to enter a predetermined area. Figure 5 1 is a diagram showing an example of the table structure of the condition information stored in the condition information DB 105 .

[0058] like Figure 5As shown, the condition information includes a condition ID field, a relative altitude field, and a relative azimuth field. The condition ID field stores an identifier (condition ID) for determining the condition relative to the sun's position relative to the vehicle 10 when the light is estimated to enter the specified area. The relative altitude field stores the sun's altitude relative to the vehicle 10 when the light enters the specified area (hereinafter sometimes referred to as the "relative altitude"). The relative azimuth field stores the sun's azimuth relative to the vehicle 10 when the light enters the specified area (hereinafter sometimes referred to as the "relative azimuth").

[0059] The relative altitude field stores the relative altitude of the sun when light enters a specified area when vehicle 10 is located on a flat surface. Furthermore, the relative azimuth field stores the azimuth of light entering the specified area relative to the front direction of vehicle 10. Specifically, the relative azimuth field stores azimuths set so that the front direction of vehicle 10 is set to 0 degrees and the left (or right) turn angle increases. The relative altitude and relative azimuth are determined, for example, by simulating whether light enters vehicle 10 at various relative altitudes and relative azimuths.

[0060] In this manner, the condition information stores the position of the sun, which is estimated to be the position where light will enter the predetermined area, as a relative position (relative altitude and relative azimuth) relative to the vehicle 10. The control unit 101 can obtain the condition information stored in the condition information DB 105 to understand the conditions (relative position of the sun) under which light may enter the vehicle 10.

[0061] The control unit 101 receives the current position of the vehicle 10 from the GPS sensor 400 via the communication unit 102. The control unit 101 calculates the relative position of the sun using the solar information stored in the solar information DB 104 and the current position and vehicle orientation of the vehicle 10.

[0062] Specifically, the control unit 101 refers to the solar information and identifies the position field storing the position that matches the current position of the vehicle 10. The control unit 101 also identifies the time field corresponding to the identified position field and obtains the current solar altitude and solar azimuth.

[0063] The control unit 101 refers to the altitude of the sun at the current position of the vehicle 10 and calculates the relative altitude with respect to the vehicle 10. At this time, the road on which the vehicle 10 is traveling may sometimes be inclined. As a result, the vehicle 10 may sometimes tilt as the road tilts. Therefore, the control unit 101 may also calculate the relative altitude by taking into account the tilt (roll angle and pitch angle) of the vehicle 10. In addition, the control unit 101 refers to the direction of the sun at the current position of the vehicle 10 and calculates the direction of the sun with respect to the front direction of the vehicle 10 as the relative altitude. In this way, the control unit 101 calculates the relative position of the sun with respect to the vehicle 10.

[0064] The control unit 101 refers to the condition information stored in the condition information DB 105 to determine whether a relative altitude field and a relative orientation field are consistent with the calculated relative altitude and relative orientation. If a relative altitude field and a relative orientation field are consistent with the current relative altitude and relative orientation, the control unit 101 determines that light may enter the specified area. If a relative altitude field and a relative orientation field are not consistent with the current relative altitude and relative orientation, the control unit 101 determines that light may not enter the specified area. In this way, the control unit 101 determines whether the current position and orientation of the vehicle 10 are current positions and orientations where light may enter the specified area.

[0065] On the other hand, even if the current position and orientation of vehicle 10 are such that light may enter the specified area, light may not actually enter vehicle 10. An example of why light may not actually enter vehicle 10 is that vehicle 10 is hidden in the shadows, preventing sufficient light from reaching the area. Another example of why light may not actually enter vehicle 10 is that light may not fully reach the area due to the influence of clouds. Therefore, control unit 101 obtains the illuminance outside vehicle 10 from illuminance sensor 200. Control unit 101 then determines whether the illuminance outside vehicle 10 obtained from illuminance sensor 200 is above a threshold value. Here, a value that can be used to determine that light has not fully reached the area is pre-set as the threshold value.

[0066] Thus, if the current position and orientation of the vehicle 10 are such that light may enter the predetermined area, and if the condition that the illumination outside the vehicle 10 is above a threshold value (hereinafter sometimes referred to as the "predetermined condition") is satisfied, it can be estimated that light will enter the predetermined area. Therefore, if the predetermined condition is satisfied, the control unit 101 determines that light will enter the predetermined area. If these conditions are not satisfied, the control unit 101 determines that light will not enter the predetermined area.

[0067] In this manner, the control unit 101 uses the current position of the vehicle 10, the vehicle's orientation, the position of the sun, and the illuminance outside the vehicle 10 as parameter values to determine whether light is incident on the predetermined area. In other words, the control unit 101 determines, based on the parameter values, whether an increase in false detections in the detection process is expected due to light incident on the predetermined area.

[0068] Furthermore, the control unit 101 determines to execute the detection process when a predetermined condition is not satisfied. Furthermore, the control unit 101 prohibits the execution of the detection process when a predetermined condition is satisfied.

[0069] If the detection process is determined to be executed and no object is detected within the specified area during the detection process, the control unit 101 permits the opening / closing process of the vehicle door 500. In this case, when the input / output unit 103 receives an input instructing the opening / closing of the vehicle door 500, the control unit 101 transmits opening / closing information to the vehicle door 500 via the communication unit 102.

[0070] Furthermore, if the control unit 101 detects an object within a predetermined area during the detection process, it prohibits the execution of the opening / closing process for the vehicle door 500. In this case, even if the input / output unit 103 receives an input from the driver of the vehicle 10 instructing the opening / closing of the vehicle door 500, the control unit 101 does not transmit the opening / closing information to the vehicle door 500 via the communication unit 102. The control unit 101 may also output, via the input / output unit 103, notifying the driver of the vehicle 10 of the presence of an object in front of the vehicle door 500.

[0071] In addition, when it is decided to prohibit the execution of the detection process, the control unit 101 notifies the driver of the vehicle 10 of the prohibition of the execution of the detection process. Specifically, the control unit 101 sends the notification information of prohibiting the execution of the detection process to the input-output unit 103 via the communication unit 102. The input-output unit 103 displays or voice guides the driver of the vehicle 10 indicating the prohibition of the execution of the detection process based on the notification information. As a result, the driver of the vehicle 10 can understand the prohibition of the execution of the detection process. Therefore, the driver of the vehicle 10 is prompted to confirm the surroundings of the vehicle door 500 by visual inspection, etc. Therefore, when the notification process is executed, the control unit 101 presumes that the driver of the vehicle 10 has confirmed the surroundings of the vehicle door 500 by visual inspection, and allows the execution of the opening / closing process of the vehicle door 500.

[0072] In this case, for example, an object may be present in the specified area due to reasons such as an object being in a blind spot of the driver of vehicle 10 or insufficient confirmation by the driver of vehicle 10. Therefore, when the detection process is prohibited, the likelihood of an object being present in the specified area increases compared to when the detection process is executed. Therefore, when the detection process is prohibited, the control unit 101 sets the opening / closing speed of vehicle door 500 to be slower than when the detection process is executed. Specifically, when the detection process is prohibited, the control unit 101 sets the opening / closing speed of vehicle door 500 to be slower than when the detection process is executed.

[0073] This slows the opening speed of door 500, preventing objects in the designated area from being caught in the door pocket compared to when the door 500 opens quickly. Furthermore, because door 500 closes slowly, even if an object in the designated area is caught by door 500, damage to the object is minimized. This allows for safer opening and closing of door 500 in situations where there is a high probability of an object being present in the designated area, compared to when detection processing is performed.

[0074] (flow chart)

[0075] Then, based on Figure 6 , the processing executed by the control unit 101 in the vehicle-mounted device 100 in the monitoring system 1 will be described. Figure 6 2 is a flowchart of a process executed by the control unit 101. This process is a process for determining whether or not the detection process can be executed and whether or not the door can be opened or closed. Figure 6 The shown processing is repeatedly executed at predetermined intervals.

[0076] exist Figure 6 In the illustrated process, first, in S101, the current position and vehicle orientation of the vehicle 10 are acquired from the GPS sensor 400 via the communication unit 102. Next, in S102, solar information and condition information are acquired from the solar information DB 104 and the condition information DB 105, respectively. Next, in S103, the current position, vehicle orientation, solar information, and condition information of the vehicle 10 are referenced to determine whether a predetermined condition is satisfied.

[0077] In the case of a negative determination in S103, it is estimated that the light has not entered the specified area. Therefore, the possibility of false detection of an object in the specified area due to the incidence of light in the detection process is low, and therefore, the detection process is performed in S104. Next, in S105, it is determined whether an object is detected in the detection process. In the case of a negative determination in S105, there is no object in the specified area. Therefore, in S106, the execution of the opening / closing process of the door 500 is allowed. Thereafter, the driver of the vehicle 10 inputs an opening / closing instruction of the door to the input / output unit 103 to execute the opening / closing process of the door 500 at the normal opening / closing speed. Then, the process is temporarily ended. Figure 6 The processing shown.

[0078] In addition, if a positive determination is made in S105, an object exists in the prescribed area. Therefore, the execution of the opening / closing process is prohibited in S107. Then, the process is temporarily terminated. Figure 6 It should be noted that in this case, the process is executed again. Figure 6 The process shown. Figure 6In the illustrated process, in S105 , when the object existing in the predetermined area is no longer detected due to movement of the object, execution of the open / close process is permitted.

[0079] When a positive determination is made in S103, it is estimated that light enters the specified area. Therefore, in S108, the execution of the detection process is prohibited. In addition, in S109, notification information is output via the input / output unit 103. In addition, in S110, the opening / closing speed is set to be slower than usual. Then, in S106, the opening / closing process of the door 500 is allowed at the set opening / closing speed. Thereafter, the opening / closing process of the door 500 at the set opening / closing speed is executed by the driver of the vehicle 10 inputting an opening / closing instruction of the door to the input / output unit 103. Then, the process is temporarily ended. Figure 6 The processing shown.

[0080] As described above, monitoring system 1 determines whether detection processing can be executed based on the current position of vehicle 10, the vehicle's orientation, the illuminance outside vehicle 10, and solar information. Furthermore, when detection processing is executed in monitoring system 1, whether door 500 can be opened or closed is determined based on whether the detection processing detects an object within a predetermined area.

[0081] Furthermore, if the monitoring system 1 prohibits the detection process, a notification message is output instead of performing the detection process. This prompts the driver of the vehicle 10 to confirm whether an object is present around the vehicle door 500, rather than performing the detection process. The driver of the vehicle 10 can then open or close the vehicle door 500 while being prompted to confirm whether an object is present around the vehicle door 500.

[0082] In this manner, when the probability of false detection during the detection process is low, the presence of an object within the predetermined area is confirmed through the detection process. When the probability of false detection during the detection process is high, the driver of vehicle 10 is prompted to confirm the presence of an object within the predetermined area. This improves the detection accuracy of the detection process and reduces the monitoring burden on the driver of vehicle 10.

[0083] (Variation 1)

[0084] In this embodiment, the predetermined conditions are that the current position and orientation of the vehicle 10 are such that light may enter the predetermined area, and the illuminance outside the vehicle 10 is greater than a threshold value. However, the predetermined conditions do not necessarily need to be the above conditions.

[0085] When the sun's altitude is below a predetermined altitude, light easily enters vehicle 10 through the windows. Therefore, it is assumed that light easily enters the predetermined area. Therefore, the predetermined condition may be that the sun's altitude at the current moment is below a predetermined altitude. In other words, the parameter value in this case is the sun's altitude.

[0086] Furthermore, there are time periods when the sun's altitude is below a predetermined altitude. Therefore, the prescribed condition may also be a prescribed time period when the sun's altitude is below a predetermined altitude. In other words, the parameter value in this case is the current time. Even within the same time period, the sun's altitude varies with the season, so the prescribed time period is pre-set based on the season, etc.

[0087] Furthermore, the prescribed conditions do not necessarily require that the illumination outside vehicle 10 be above a threshold. In other words, the prescribed conditions may require that the current position and orientation of vehicle 10 be such that light may enter the prescribed area. This improves the accuracy of the detection process and reduces the monitoring burden on the driver of vehicle 10.

[0088] (Variation 2)

[0089] The monitoring system 1 can be used in various scenarios and can also be used to provide MaaS (Mobility as a Service), which is a service that effectively utilizes mobility.

[0090] <Other implementation methods>

[0091] The above-described embodiment is merely an example, and the present disclosure can be implemented with appropriate modifications without departing from the spirit thereof. In addition, the processes and methods described in the present disclosure can be implemented in combination as long as no technical contradiction arises.

[0092] Furthermore, a process described as being performed by a single device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be performed by a single device. In a computer system, the hardware configuration (server configuration) used to implement each function can be flexibly changed.

[0093] The present disclosure can also be implemented by supplying a computer with a computer program having the functions described in the above embodiments installed therein, and reading and executing the program by one or more processors of the computer. Such a computer program can also be provided to the computer via a non-transitory computer-readable storage medium that can be connected to the system bus of the computer, or can be provided to the computer via a network. Non-transitory computer-readable storage media include, for example, any type of disk such as a magnetic disk (floppy disk (registered trademark) or hard disk drive (HDD)), optical disk (CD-ROM, DVD disk or Blu-ray disk, etc.), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic card, flash memory or optical card, and any type of medium suitable for storing electronic commands.

Claims

1. An information processing device comprising a control unit, The control unit is configured to perform the following actions: Obtaining parameter values associated with incident light from outside the vehicle into a predetermined area, wherein The predetermined area is set on the inner side of a door of the vehicle and is a target area for detection processing based on dynamic image analysis of an object that becomes an obstacle to opening / closing of the door; executing a process of determining whether the parameter value satisfies a predetermined condition, wherein the predetermined condition is a condition under which an increase in false detections in the detection process due to incidence of light into the predetermined area is expected; as well as If it is determined that the parameter value does not satisfy the specified conditions, the detection processing is executed; if it is determined that the parameter value satisfies the specified conditions, the execution of the detection processing is prohibited and a notification message regarding the prohibition of the execution of the detection processing is output to the driver of the vehicle.

2. The information processing device according to claim 1, wherein The parameter values include the position of the vehicle, the orientation of the vehicle, and the position of the sun. Executing the determination process includes determining whether each value of the position of the vehicle, the orientation of the vehicle, and the position of the sun satisfies the prescribed condition.

3. The information processing device according to claim 2, wherein: The parameter value also includes the illumination outside the vehicle, Executing the determination process includes determining whether each value of the illuminance, the position of the vehicle, the orientation of the vehicle, and the position of the sun satisfies the prescribed condition.

4. The information processing device according to any one of claims 1 to 3, wherein: The control unit is further configured to perform the following actions: When it is determined that the parameter value satisfies the prescribed condition, setting the opening / closing speed of the door to be slower than when it is determined that the parameter value does not satisfy the prescribed condition; as well as The door opening / closing process is performed at the set opening / closing speed.

5. A vehicle using the information processing device according to claim 1, In the vehicle, a window is provided below the central portion.

Images