Information processing apparatus, vehicle, and maas providing method

Abstract

To reduce the monitoring burden on a driver of a vehicle regarding an object while improving the detection accuracy of an object that obstructs opening and closing of a door of the vehicle through moving image analysis.SOLUTION: A control unit of an information processing apparatus acquires a parameter value related to penetration of light from outside a vehicle into a predetermined area set inside a door of the vehicle, and being a target for detection processing by moving image analysis of an object that obstructs opening and closing of the door. The control unit of the information processing apparatus executes determination processing to determine whether or not the parameter value satisfies a predetermined condition under which an increase in false detection in the detection processing due to light penetration into the predetermined area is expected. If it is determined that the parameter value does not satisfy the predetermined condition, the control unit executes the detection processing. If it is determined that the parameter value satisfies the predetermined condition, the control unit prohibits execution of the detection processing and outputs notification information to a driver of the vehicle regarding the prohibition of detection processing.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a vehicle, and a MaaS providing method. [Background technology]

[0002] Patent Document 1 discloses a surveillance system. In the surveillance system, captured images are acquired by an imaging unit that captures images of each of the passenger compartments of multiple moving bodies. In the surveillance system, the amount of movement of passengers in each of the passenger compartments of the multiple moving bodies is acquired based on the acquired captured images. In the surveillance system, a priority indicating the degree of need to monitor passengers is calculated based on the acquired amount of movement. Then, in the surveillance system, a display target on a display device that sequentially switches and displays the passenger compartments of each of the multiple moving bodies at a display switching period is determined based on the priority. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-94724 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to improve the accuracy of detecting an object that obstructs the opening and closing of a vehicle door through video image analysis, while reducing the burden on the vehicle driver to monitor the object. [Means for solving the problem]

[0005] The information processing device according to the present disclosure includes: acquiring a parameter value related to light entering from outside the vehicle into a predetermined area set inside a vehicle door, the predetermined area being a target of a detection process for an object that obstructs opening and closing of the door by video image analysis; executing a process of determining whether the parameter value satisfies a predetermined condition that is expected to increase the number of false detections in the detection process due to the shining of light into the predetermined area; If it is determined that the parameter value does not satisfy the predetermined condition, the detection process is executed; If it is determined that the parameter value satisfies the predetermined condition, prohibiting execution of the detection process; outputting notification information to a driver of the vehicle regarding the prohibition of execution of the detection process; The controller is configured to: [Effects of the Invention]

[0006] The present disclosure makes it possible to improve the accuracy of detecting an object that obstructs the opening and closing of a vehicle door through video image analysis, while reducing the burden on the vehicle driver to monitor the object. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a monitoring system. [Figure 2] FIG. 2 shows an example of the arrangement of windows on the side of a vehicle. [Figure 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of the in-vehicle device. [Figure 4] FIG. 4 is a diagram showing an example of a table configuration of solar information held in the solar information database. [Figure 5] FIG. 5 is a diagram showing an example of a table configuration of condition information held in the condition information database. [Figure 6] FIG. 6 is a flowchart of the process executed by the control unit. DETAILED DESCRIPTION OF THE INVENTION

[0008] When an object (person or object) is present near a door inside a vehicle, the object may obstruct the opening and closing of the door. Therefore, a determination is made as to whether or not an object is present near the door by analyzing video images captured by a camera installed inside the vehicle. Meanwhile, light may shine near the door. In this case, the video image analysis may mistakenly identify the shining light as an object. As a result, an object obstructing the opening and closing of the door may be determined to be present near the door, even though it is not actually present.

[0009] Therefore, a control unit of an information processing device according to the present disclosure acquires a parameter value related to the penetration of light from outside the vehicle into a predetermined area. Here, the predetermined area is an area set inside the vehicle door and is an area that is a target of a detection process using video image analysis to detect objects that obstruct the opening and closing of the door. The control unit of the information processing device then executes a determination process to determine whether the parameter value satisfies a predetermined condition that is expected to increase false positives in the detection process due to the penetration of light into the predetermined area.

[0010] The control unit executes the detection process when it determines that the parameter value does not satisfy the predetermined condition, and prohibits the execution of the detection process when it determines that the parameter value satisfies the predetermined condition. In this case, the control unit outputs notification information to the driver of the vehicle about the prohibition of the execution of the detection process.

[0011] As described above, the information processing device determines whether to execute the detection process according to the parameter value. The information processing device executes the detection process when an increase in false detections due to light shining into the predetermined area is not expected (the possibility of false detections is low). Furthermore, the information processing device prohibits the execution of the detection process when an increase in false detections due to light shining into the predetermined area is expected (the possibility of false detections is high).

[0012] Furthermore, when the execution of the detection process is prohibited, the information processing device notifies the vehicle driver that the execution of the detection process is prohibited. This allows the vehicle driver to understand that the detection process is not being executed and prompts the vehicle driver to check for the presence or absence of an object in the specified area. In other words, if the possibility of erroneous detection in the detection process is low, the presence or absence of an object in the specified area is confirmed by the detection process, and if the possibility of erroneous detection in the detection process is high, the vehicle driver is prompted to check for the presence or absence of an object in the specified area. In this way, it is possible to improve the detection accuracy of objects that obstruct the opening and closing of the vehicle door by video image analysis while reducing the burden on the vehicle driver to monitor the object.

[0013] Specific embodiments of the present disclosure will be described below with reference to the drawings. The dimensions, materials, shapes, and relative positions of components described in the present embodiments are not intended to limit the technical scope of the present disclosure unless otherwise specified. Furthermore, the hardware configuration, module configuration, functional configuration, and the like described in the present embodiments are not intended to limit the technical scope of the disclosure unless otherwise specified.

[0014] <Embodiment> (System Overview) A monitoring system 1 according to this embodiment will be described with reference to Figs. 1 and 2. Fig. 1 is a diagram showing a schematic configuration of the monitoring system 1. The monitoring system 1 includes an in-vehicle device 100, an illuminance sensor 200, a camera 300, a GPS sensor 400, and a door 500. Here, the in-vehicle device 100, the illuminance sensor 200, the camera 300, the GPS sensor 400, and the door 500 are mounted on the vehicle 10. In the monitoring system 1, the on-board device 100, the illuminance sensor 200, the camera 300, the GPS sensor 400, and the door 500 are connected via an in-vehicle network. In this embodiment, the vehicle 10 is a bus. However, the vehicle 10 may be a vehicle other than a bus. An example of the vehicle 10 other than a bus is a train.

[0015] FIG. 2 shows an example of the arrangement of windows on the side of vehicle 10. As shown in FIG. 2, windows (hatched areas in FIG. 2) are provided on the side of vehicle 10. Three windows are provided at three locations on the upper part of vehicle 10 and three windows are provided at three locations on the lower part of vehicle 10 on the side of vehicle 10 for reasons such as facilitating lighting and ensuring a good view outside the vehicle 10. Windows are also provided at the upper and lower parts of door 500. Windows may also be provided at the upper and lower parts of the front or rear of vehicle 10.

[0016] (illuminance sensor) The illuminance sensor 200 is a sensor provided in the vehicle 10. The illuminance sensor 200 senses the illuminance outside the vehicle 10. The illuminance sensor 200 transmits the sensed illuminance outside the vehicle 10 to the in-vehicle device 100 in real time via the in-vehicle network.

[0017] (GPS sensor) The GPS sensor 400 is a GPS sensor provided in the vehicle 10. The GPS sensor 400 senses the current position and orientation of the vehicle 10 (hereinafter, may be referred to as "vehicle orientation"). The GPS sensor 400 transmits the sensed current position and vehicle orientation of the vehicle 10 to the in-vehicle device 100 in real time via an in-vehicle network.

[0018] (camera) The camera 300 is a camera installed inside the vehicle 10. The camera 300 captures moving images including the area around the door 500 inside the vehicle 10. The camera 300 transmits the captured moving images to the in-vehicle device 100 in real time via the in-vehicle network.

[0019] (door) The door 500 is a door provided for getting on and off the vehicle 10. The door 500 receives opening / closing information instructing the opening or closing of the door 500 from the in-vehicle device 100 via the in-vehicle network. The door 500 opens or closes the door 500 in accordance with the received opening / closing information.

[0020] (In-vehicle device) The in-vehicle device 100 is a device mounted on the vehicle 10. The in-vehicle device 100 has a function of managing the opening and closing of the door 500. Here, an object may be present in a predetermined area. The predetermined area is an area set inside the door 500, and the presence of an object may obstruct the opening and closing of the door 500. The predetermined area may be, for example, a step portion of the vehicle 10. The predetermined area may also be, for example, an area within a predetermined distance from the door 500, or a range designated in advance. The objects detected by the in-vehicle device 100 through video analysis include people, objects, animals, etc.

[0021] At this time, an object present in the predetermined area may obstruct the opening and closing of the door 500. Specifically, when the door 500 is opened, an object present in the predetermined area may get caught in the door pocket, obstructing the opening and closing of the door 500. Furthermore, when the door 500 is closed, an object present in the predetermined area may get caught in the door 500, obstructing the opening and closing of the door 500. Therefore, the in-vehicle device 100 performs a process (hereinafter, may be referred to as a "detection process") to determine whether or not an object is present in a predetermined area within the vehicle 10 by analyzing the video captured by the camera 300.

[0022] If the in-vehicle device 100 determines in the detection process that no object exists in the predetermined area, it permits the door 500 to be opened or closed. If the in-vehicle device 100 determines in the detection process that an object exists in the predetermined area, it prohibits the door 500 from being opened or closed.

[0023] On the other hand, depending on the current position and vehicle orientation of the vehicle 10, light may shine into the vehicle 10. In this case, the in-vehicle device 100 may mistakenly recognize the shining light as an object in the video image analysis. Therefore, when light shines into a predetermined area, the in-vehicle device 100 may mistakenly detect the presence of an object in the predetermined area in the detection process, even though no object actually exists in the predetermined area.

[0024] Furthermore, as described above, vehicle 10 is provided with windows below the center to allow for easier lighting and to ensure a clear view outside the vehicle 10. This allows light to easily pass through the windows provided at the bottom of vehicle 10 and enter a predetermined area. In particular, vehicle 10 is also provided with windows below door 500, allowing light that passes through these windows to easily enter a predetermined area. In other words, windows provided at the bottom of vehicle 10 to allow for lighting and to improve the view tend to impede the accuracy of the detection process.

[0025] Therefore, the in-vehicle device 100 acquires parameter values ​​(hereinafter, may be simply referred to as "parameter values") related to the penetration of light into a predetermined area. In this embodiment, the parameter values ​​include the current position and vehicle orientation of the vehicle 10 acquired by the GPS sensor 400. The parameter values ​​also include the position of the sun. The parameter values ​​also include the illuminance outside the vehicle 10 acquired by the illuminance sensor 200. The in-vehicle device 100 determines whether or not to execute the detection process depending on these parameter values. A method by which the in-vehicle device 100 determines whether or not to execute the detection process depending on the parameter values ​​will be described in detail later.

[0026] Furthermore, when the execution of the detection process is prohibited, the in-vehicle device 100 outputs notification information (audio output or output to a display). The notification information is information for notifying the driver of the vehicle 10 that the execution of the detection process is prohibited.

[0027] The in-vehicle device 100 includes a computer having a processor 110, a main memory 120, an auxiliary memory 130, and a communication interface (communication I / F) 140. The processor 110 is, for example, a central processing unit (CPU) or a digital signal processor (DSP). The main memory 120 is, for example, a random access memory (RAM). The auxiliary memory 130 is, for example, a read-only memory (ROM). The auxiliary memory 130 is, for example, a hard disk drive (HDD) or a disc recording medium such as a CD-ROM, a DVD disc, or a Blu-ray disc. The auxiliary memory 130 may also be a removable medium (portable storage medium). Examples of removable media include a USB memory or an SD card. The communication I / F 140 is, for example, a local area network (LAN) interface board or a wireless communication circuit for wireless communication.

[0028] In the in-vehicle device 100, the auxiliary storage unit 130 stores an operating system (OS), various programs, various information tables, etc. Furthermore, in the in-vehicle device 100, the processor 110 loads the programs stored in the auxiliary storage unit 130 into the main storage unit 120 and executes them, thereby realizing various functions as described below. However, some or all of the functions of the in-vehicle device 100 may be implemented by a device such as an ASIC or FPGA. The in-vehicle device 100 may be realized by a hardware circuit. The in-vehicle device 100 does not necessarily have to be realized by a single physical configuration, but may be realized by a plurality of computers that cooperate with each other. Similarly to the in-vehicle device 100, the illuminance sensor 200, the camera 300, the GPS sensor 400, and the door 500 are also configured to include a computer.

[0029] (Functional configuration) Next, the functional configuration of the in-vehicle device 100 that constitutes the monitoring system 1 will be described with reference to Fig. 3 to Fig. 5. Fig. 3 is a block diagram that schematically shows an example of the functional configuration of the in-vehicle device 100. The in-vehicle device 100 includes a control unit 101, a communication unit 102, an input / output unit 103, a solar information database 104 (sun information DB104), and a condition information database 1404 (condition information DB105).

[0030] The control unit 101 has a function of performing arithmetic processing for controlling the in-vehicle device 100. The control unit 101 can be realized by the processor 110 in the in-vehicle device 100. The communication unit 102 has a function of connecting the in-vehicle device 100 to an in-vehicle network. The communication unit 102 can be realized by the communication I / F 140 in the in-vehicle device 100.

[0031] The input / output unit 103 has a function for the driver of the vehicle 10 to input various information to the in-vehicle device 100. The input / output unit 103 also has a function for outputting various information to the driver of the vehicle 10 (displaying on a display and outputting by voice). The input / output unit 103 can be realized by a touch panel and a speaker in the in-vehicle device 100.

[0032] The solar information DB 104 has a function of storing solar information. The solar information DB 104 can be realized by the auxiliary storage unit 130 in the in-vehicle device 100. The solar information is information for identifying the position of the sun. Fig. 4 is a diagram showing an example of a table configuration of solar information held in the solar information DB 104.

[0033] As shown in Fig. 4, the solar information has a position field, a time field, a solar altitude field, and a solar azimuth field. Here, the position field stores the position of each point. The position field stores, for example, the latitude and longitude of each point. The time field stores each time. The time field stores information indicating each time from sunrise to sunset.

[0034] The solar altitude field stores the solar altitude at the position in the corresponding position field at the time in the corresponding time field. The solar altitude is an angle set with the horizon direction being 0 degrees and the zenith being 90 degrees. The solar orientation field stores the orientation (solar orientation) in which the sun is located at the time in the corresponding time field as seen from the position in the corresponding position field. The control unit 101 can grasp the position of the sun at each point at each time by acquiring the solar information held in the solar information DB 104.

[0035] The condition information DB 105 has a function of storing condition information. The condition information DB 105 can be realized by the auxiliary storage unit 130 in the in-vehicle device 100. The condition information is information indicating the relative position of the sun with respect to the vehicle 10, at which it is estimated that light will shine into a predetermined area. FIG. 5 is a diagram showing an example of a table configuration of the condition information held in the condition information DB 105.

[0036] As shown in FIG. 5, the condition information has a condition ID field, a relative altitude field, and a relative direction field. The condition ID field stores an identifier (condition ID) for specifying the condition of the relative position of the sun under which light is estimated to shine into a specified area. The relative altitude field stores the solar altitude ( The relative orientation field stores the solar orientation (hereinafter, sometimes referred to as the "relative orientation") relative to the vehicle 10 when light shines into a specified area.

[0037] Here, the relative altitude field stores the solar altitude when light shines into a specified area when the vehicle 10 is on a plane. The relative orientation field stores the orientation based on the front direction of the vehicle 10 when light shines into the specified area. Specifically, the relative orientation field stores orientations that are set so that the angle increases counterclockwise (or clockwise) with the front direction of the vehicle 10 set as 0 degrees. The relative altitude and relative orientation are identified, for example, by simulating whether or not light shines into the vehicle 10 at each relative altitude and each relative orientation.

[0038] In this way, the condition information stores the position of the sun when light is estimated to shine into a predetermined area as a relative position (relative altitude and relative direction) relative to the vehicle 10. By acquiring the condition information stored in the condition information DB 105, the control unit 101 can grasp the conditions under which light can shine into the vehicle 10 (relative position of the sun).

[0039] The control unit 101 receives the current position of the vehicle 10 from the GPS sensor 400 via the communication unit 102. The control unit 101 calculates the relative position of the sun using the sun information stored in the sun information DB 104 and the current position and vehicle direction of the vehicle 10.

[0040] Specifically, the control unit 101 refers to the solar information and identifies a position field that stores a position that matches the current position of the vehicle 10. The control unit 101 also identifies a time field that corresponds to the identified position field, and acquires the solar altitude and solar azimuth at the current time.

[0041] The control unit 101 refers to the solar altitude at the current position of the vehicle 10 and calculates the relative altitude with the vehicle 10 as the reference. At this time, the road on which the vehicle 10 is traveling may be inclined. In this case, the vehicle 10 may tilt according to the inclination of the road. Therefore, the control unit 101 may calculate the relative altitude by taking into account the inclination (roll angle and pitch angle) of the vehicle 10. Furthermore, the control unit 101 refers to the solar azimuth at the current position of the vehicle 10 and calculates the direction of the sun with the front direction of the vehicle 10 as the relative azimuth. In this way, the control unit 101 calculates the relative position of the sun with the vehicle 10 as the reference.

[0042] The control unit 101 refers to the condition information stored in the condition information DB 105 and determines whether a relative altitude field and a relative orientation field that match the calculated relative altitude and relative orientation exist. If a relative altitude field and a relative orientation field that match the current relative altitude and relative orientation exist, the control unit 101 determines that light penetration into the predetermined area may occur. Furthermore, if a relative altitude field and a relative orientation field that match the current relative altitude and relative orientation do not exist, the control unit 101 determines that light penetration into the predetermined area will not occur. In this way, the control unit 101 determines whether the current position and vehicle orientation of the vehicle 10 are such that light penetration into the predetermined area may occur.

[0043] On the other hand, even if the current position and vehicle direction of the vehicle 10 are such that light can penetrate into a predetermined area, there are cases where light does not actually penetrate into the vehicle 10. An example of the reason why light does not actually penetrate into the vehicle 10 is that the vehicle 10 is hidden in shadow, preventing sufficient light from reaching it. Another example of the reason why light does not actually penetrate into the vehicle 10 is that the influence of clouds prevents sufficient light from reaching it. Therefore, the control unit 101 acquires the illuminance outside the vehicle 10 from the illuminance sensor 200. Then, the control unit 101 acquires the illuminance outside the vehicle 10 from the illuminance sensor 200. It is determined whether the illuminance outside the vehicle 10 acquired from the sensor 200 is equal to or greater than a threshold value. Here, as the threshold value, a value at which it can be determined that the light is not reaching the vehicle 10 sufficiently is set in advance.

[0044] In this way, when the current position and vehicle direction of the vehicle 10 are such that light penetration into the predetermined area may occur, and when the conditions (hereinafter sometimes referred to as "predetermined conditions") that the illuminance outside the vehicle 10 is equal to or greater than a threshold are met, it can be estimated that light penetration into the predetermined area will occur. Therefore, when the predetermined conditions are met, the control unit 101 determines that light penetration into the predetermined area will occur. Furthermore, when these conditions are not met, the control unit 101 determines that light penetration into the predetermined area will not occur.

[0045] In this way, the control unit 101 determines whether or not light will penetrate into a predetermined area, using as parameter values ​​the current position of the vehicle 10, the vehicle direction, the position of the sun, and the illuminance outside the vehicle 10. In other words, the control unit 101 determines, according to the parameter values, whether or not an increase in false detections in the detection process due to light penetrating into a predetermined area is expected.

[0046] Furthermore, the control unit 101 determines to execute the detection process when a predetermined condition is not satisfied, and prohibits the execution of the detection process when a predetermined condition is satisfied.

[0047] When it is determined that the detection process is to be performed and no object is detected in the predetermined area in the detection process, the control unit 101 permits the opening and closing process of the door 500. At this time, when the input / output unit 103 receives an input instructing the opening and closing of the door 500, the control unit 101 transmits opening and closing information to the door 500 via the communication unit 102.

[0048] Furthermore, when the control unit 101 detects an object within a predetermined area during the detection process, it prohibits the execution of the opening / closing process of the door 500. At this time, even if the input / output unit 103 receives an input from the driver of the vehicle 10 instructing to open or close the door 500, the control unit 101 does not transmit opening / closing information to the door 500 via the communication unit 102. The control unit 101 may output, via the input / output unit 103, a notification to the driver of the vehicle 10 that an object is present in front of the door 500.

[0049] Furthermore, when it is determined that the execution of the detection process is to be prohibited, the control unit 101 notifies the driver of the vehicle 10 that the execution of the detection process is prohibited. Specifically, the control unit 101 transmits notification information that the execution of the detection process is prohibited to the input / output unit 103 via the communication unit 102. In response to the notification information, the input / output unit 103 displays or provides audio guidance to the driver of the vehicle 10 indicating that the execution of the detection process is prohibited. This allows the driver of the vehicle 10 to understand that the execution of the detection process is prohibited. Therefore, the driver of the vehicle 10 is prompted to check the surroundings of the door 500 by visually checking, for example. Therefore, when the notification process is executed, the control unit 101 presumes that the driver of the vehicle 10 is visually checking the surroundings of the door 500, and permits the execution of the opening and closing process of the door 500.

[0050] At this time, for example, an object may be present in the predetermined area due to the presence of an object in the blind spot of the driver of the vehicle 10 or due to insufficient confirmation by the driver of the vehicle 10. Therefore, when the execution of the detection process is prohibited, the possibility of an object being present in the predetermined area is higher than when the detection process is executed. Therefore, when the execution of the detection process is prohibited, the control unit 101 sets the opening / closing speed of the door 500 to be slower than when the detection process is executed. Specifically, when the execution of the detection process is prohibited, the control unit 101 sets the opening / closing speed of the door 500 to be slower than the normal opening / closing speed of the door 500.

[0051] This slows down the opening speed of the door 500, and makes it possible to prevent objects present in a predetermined area from getting caught in the door pocket, compared to when the opening speed of the door 500 is fast. Furthermore, because the closing speed of the door 500 is slow, damage to an object in a predetermined area can be suppressed even if the object is caught in the door 500. In this way, the door 500 can be opened and closed more safely in a situation where there is a higher possibility that an object is present in the predetermined area than when the detection process is executed.

[0052] (flowchart) Next, the processing executed by the control unit 101 in the in-vehicle device 100 in the monitoring system 1 will be described with reference to Fig. 6. Fig. 6 is a flowchart of the processing executed by the control unit 101. This processing is for determining whether or not to execute the detection processing and whether or not to open or close the door. The processing shown in Fig. 6 is repeatedly executed at predetermined intervals.

[0053] 6, first, in S101, the current position and vehicle orientation of the vehicle 10 are acquired from the GPS sensor 400 via the communication unit 102. Next, in S102, sun information and condition information are acquired from the sun information DB 104 and the condition information DB 105, respectively. Next, in S103, the current position of the vehicle 10, the vehicle orientation, sun information, and condition information are referenced, and it is determined whether or not predetermined conditions are satisfied.

[0054] If a negative determination is made in S103, it is estimated that no light is shining into the predetermined area. Therefore, since there is a low possibility that an object in the predetermined area will be erroneously detected in the detection process due to the shining of light, the detection process is executed in S104. Next, in S105, it is determined whether an object is detected in the detection process. If a negative determination is made in S105, no object is present in the predetermined area. Therefore, in S106, execution of the opening and closing process of the door 500 is permitted. Thereafter, the driver of the vehicle 10 inputs a door opening or closing command to the input / output unit 103, and the opening and closing process of the door 500 is executed at a normal opening and closing speed. Then, the process shown in FIG. 6 is temporarily terminated.

[0055] Furthermore, if a positive determination is made in S105, an object is present within the predetermined area. Therefore, execution of the opening / closing process is prohibited in S107. Then, the process shown in FIG. 6 is temporarily terminated. In this case, the process shown in FIG. 6 is executed again. When the process shown in FIG. 6 is executed again, if the object has moved and is no longer detected as being present within the predetermined area in S105, execution of the opening / closing process is permitted.

[0056] If a positive determination is made in S103, it is estimated that light is shining into a predetermined area. Therefore, in S108, execution of the detection process is prohibited. Furthermore, in S109, notification information is output via the input / output unit 103. Furthermore, in S110, the opening / closing speed is set to be slower than normal. Then, in S106, opening / closing process of the door 500 at the set opening / closing speed is permitted. Thereafter, the driver of the vehicle 10 inputs an instruction to open or close the door to the input / output unit 103, whereby opening / closing process of the door 500 at the set opening / closing speed is executed. Then, the process shown in FIG. 6 is temporarily terminated.

[0057] As described above, in the monitoring system 1, whether or not to execute the detection process is determined based on the current position of the vehicle 10, the vehicle direction, the illuminance outside the vehicle 10, and sun information. When the detection process is executed in the monitoring system 1, whether or not to execute the process of opening or closing the door 500 is determined based on whether or not an object is detected within a predetermined area by the detection process.

[0058] Furthermore, when the execution of the detection process is prohibited in the monitoring system 1, the detection process is not executed and notification information is output. This prompts the driver of the vehicle 10 to check whether or not an object exists around the door 500, rather than executing the detection process. The driver of the vehicle 10 is then prompted to check whether or not an object exists around the door 500. In this state, the door 500 can be opened and closed.

[0059] In this way, when the possibility of erroneous detection in the detection process is low, the presence or absence of an object in a predetermined area is confirmed by the detection process, and when the possibility of erroneous detection in the detection process is high, the driver of vehicle 10 is prompted to confirm the presence or absence of an object in the predetermined area. In this way, it is possible to reduce the monitoring burden on the driver of vehicle 10 while improving the detection accuracy of the detection process.

[0060] (Variation 1) In this embodiment, the predetermined condition is that the current position and vehicle direction of the vehicle 10 are such that light may penetrate into a predetermined area, and that the illuminance outside the vehicle 10 is equal to or greater than a threshold. However, the predetermined condition does not necessarily have to be the above condition.

[0061] When the solar altitude is equal to or lower than a predetermined altitude, it is assumed that light is more likely to penetrate through the windows and enter the vehicle 10, and therefore light is more likely to enter a predetermined area. Therefore, the predetermined condition may be that the solar altitude at the current time is equal to or lower than a predetermined altitude. In other words, the parameter value in this case is the solar altitude.

[0062] Furthermore, there are time periods when the solar altitude is equal to or lower than a predetermined altitude. Therefore, the predetermined condition may be a time period when the solar altitude is equal to or lower than the predetermined altitude. In other words, the parameter value in this case is the current time. Since the solar altitude changes depending on the season even within the same time period, the predetermined time period is set in advance depending on the season, etc.

[0063] Furthermore, the predetermined condition does not have to include a condition that the illuminance outside the vehicle 10 is equal to or greater than a threshold. In other words, the predetermined condition may be that the current position and vehicle orientation of the vehicle 10 are such that light may be incident on a predetermined area. Even in this case, it is possible to reduce the monitoring burden on the driver of the vehicle 10 while improving the detection accuracy of the detection process.

[0064] (Variation 2) The monitoring system 1 can be used in various situations. The monitoring system 1 may be used to provide MaaS (Mobility as a Service), which is a service that utilizes mobility.

[0065] <Other embodiments> The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate within the scope of the present disclosure. Furthermore, the processes and means described in the present disclosure may be freely combined and implemented as long as no technical contradiction occurs.

[0066] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.

[0067] The present disclosure can also be realized by supplying a computer program that implements the functions described in the above embodiments to a computer, and having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer by a non-transitory computer-readable storage medium that can be connected to the system bus of the computer, or may be provided to the computer via a network. The non-transitory computer-readable storage medium may be, for example, a magnetic disk (floppy disk (registered trademark) "(Trademark)" includes any type of medium suitable for storing electronic instructions, such as any type of disk, such as a hard disk drive (HDD), optical disk (CD-ROM, DVD disk, or Blu-ray disk), read-only memory (ROM), random-access memory (RAM), EPROM, EEPROM, magnetic card, flash memory, or optical card. [Explanation of symbols]

[0068] 1. Surveillance system 10. Vehicle 100...In-vehicle equipment 101 Control unit 102··Communications Department 103...Input / output section 104...Solar information DB 105··Condition Information DB 200··Illuminance sensor 300··Camera 400 GPS sensor 500 doors

Claims

1. acquiring a parameter value related to light entering from outside the vehicle into a predetermined area set inside a vehicle door, the predetermined area being a target of a detection process for an object that obstructs opening and closing of the door by video image analysis; executing a process of determining whether the parameter value satisfies a predetermined condition that is expected to increase the number of false detections in the detection process due to light shining into the predetermined area; If it is determined that the parameter value does not satisfy the predetermined condition, the detection process is executed; If it is determined that the parameter value satisfies the predetermined condition, prohibiting execution of the detection process; outputting notification information to a driver of the vehicle regarding the prohibition of execution of the detection process; a control unit configured to perform Information processing device.

2. the parameter values ​​include values ​​of the vehicle's position, the vehicle's orientation, and the sun's position; executing the determination process includes determining whether or not each value of the vehicle position, the vehicle orientation, and the sun position satisfies the predetermined condition; The information processing device according to claim 1 .

3. The parameter values ​​further include an illumination level outside the vehicle; Executing the determination process includes determining whether or not each of the values ​​of the illuminance, the position of the vehicle, the orientation of the vehicle, and the position of the sun satisfies the predetermined condition. The information processing device according to claim 2 .

4. The control unit When it is determined that the parameter value satisfies the predetermined condition, the opening / closing speed of the door is set to be slower than when it is determined that the parameter value does not satisfy the predetermined condition; Executing the door opening and closing process at the set opening and closing speed; and further configured to perform The information processing device according to claim 1 .

5. In the vehicle, the window is provided below the center portion. Using the information processing device according to claim 1, vehicle.

6. Using the information processing device according to claim 1, MaaS (Mobility as a Service) provision method.

Images