Determination device, determination method, and determination program

The determination device uses internal vehicle sensors to detect and adjust for blind spots, enhancing moving object detection accuracy by identifying and notifying users of internal obstructions.

WO2025143239A1PCT designated stage expired Publication Date: 2025-07-03PIONEER IP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/046441
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-28
Filing Date
2024-12-27
Publication Date
2025-07-03

AI Technical Summary

Technical Problem

Conventional distance sensors installed outside vehicles cannot detect blind spots caused by objects within the vehicle, such as seats, leading to unrecognized detection areas.

Method used

A determination device and method that utilizes a motion sensor inside the vehicle to acquire sensor data, detect the position of blind spots, and adjust detection range and sensitivity based on the sensor data to accurately identify and notify users of blind spots.

Benefits of technology

Enhances the accuracy of moving object detection by identifying and adjusting for blind spots within the vehicle, preventing false detections, and improving overall detection precision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024046441_03072025_PF_FP_ABST
    Figure JP2024046441_03072025_PF_FP_ABST
Patent Text Reader

Abstract

This determination device 100 includes: an acquisition unit 132 for acquiring sensor data generated by a moving body sensor provided in a vehicle; and a detection unit 135 for detecting a position of a blind spot of the moving body sensor on the basis of the sensor data acquired by the acquisition unit 132 when the user is walking around the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Determination device, determination method, and determination program

[0001] The present invention relates to a determination device, a determination method, and a determination program.

[0002] Conventionally, there is a technology that recognizes a blind spot as an unspecified area when a distance sensor cannot clearly confirm whether an object is present or not (for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2021-008224

[0004] However, in the prior art, distance sensors are installed outside the vehicle and cannot detect blind spots caused by objects present inside the vehicle. For example, if a blind spot for a motion sensor installed inside the vehicle is created by a seat inside the vehicle, the motion sensor's blind spot cannot be recognized. Thus, the above-mentioned problem is one example of the problem that the present invention aims to solve.

[0005] In order to solve the above-mentioned problems and achieve the object, the invention described in claim 1 is characterized by having an acquisition unit that acquires sensor data generated by a motion sensor installed in a vehicle, and a detection unit that detects the position of the blind spot of the motion sensor based on the sensor data acquired by the acquisition unit when a user is walking around the vehicle.

[0006] The invention described in claim 11 is a determination method executed by a determination device, characterized in that it includes an acquisition step of acquiring sensor data generated by a motion sensor provided in a vehicle, and a detection step of detecting the position of the blind spot of the motion sensor based on the sensor data acquired by the acquisition step when a user is walking around the vehicle.

[0007] The invention described in claim 12 is characterized in that a computer is made to execute an acquisition step of acquiring sensor data generated by a motion sensor installed in a vehicle, and a detection step of detecting the position of the blind spot of the motion sensor based on the sensor data acquired by the acquisition step when a user is walking around the vehicle.

[0008] FIG. 1 is a diagram illustrating an example of the configuration of a determination device according to a first embodiment. FIG. 2 is a diagram illustrating an example of display control processing by the determination device according to the first embodiment. FIG. 3 is a diagram illustrating an example of display control processing by the determination device according to the first embodiment. FIG. 4 is a diagram illustrating an example of detection processing by the determination device according to the first embodiment. FIG. 5 is a flowchart illustrating an example of processing by the determination device according to the first embodiment. FIG. 6 is a diagram illustrating an example of the configuration of a determination device according to a second embodiment. FIG. 7 is a diagram illustrating an example of generation processing by the determination device according to the second embodiment. FIG. 8 is a diagram illustrating an example of vehicle outside detection processing by the determination device according to the second embodiment. FIG. 9 is a diagram illustrating an example of vehicle outside detection processing by the determination device according to the second embodiment. FIG. 10 is a flowchart illustrating an example of processing by the determination device according to the second embodiment. FIG. 11 is a diagram illustrating an example of the configuration of a determination device system according to a modified embodiment. FIG. 12 is a diagram illustrating an example of the configuration of a determination device according to a modified embodiment. FIG. 13 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the determination device.

[0009] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0010] (First embodiment) [1. Configuration of determination device] First, a determination device 100 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the determination device 100 according to an embodiment. As shown in Fig. 1, the determination device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Each unit of the determination device 100 will be described below.

[0011] The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the in-vehicle device 10, for example.

[0012] The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 stores the location where the motion sensor is installed, the strength of the signal to be transmitted, the sensitivity for receiving the signal, the strength of the received signal, the angle calculated from the received signal, the distance, the coordinates of the moving object, the direction of travel, the risk related to the direction of travel of the moving object, the risk related to the position of the moving object, a threshold, an interval, a period, information related to the blind spot of the motion sensor, information related to the size of the vehicle (body type, model, etc.), the installation location of the motion sensor, information related to notifications (notification settings, user terminal information, address information, etc.), images (including moving images and still images), and other information necessary for determining the position of the blind spot of the motion sensor and for determining information related to the vehicle position.

[0013] The control unit 130 is realized using a CPU (Central Processing Unit), an NP (Network Processor), an FPGA (Field Programmable Gate Array), or the like, and executes processing programs stored in memory. As shown in Fig. 1, the control unit 130 has a sensor unit 131, an acquisition unit 132, a notification unit 133, a display control unit 134, a detection unit 135, and an adjustment unit 136. Each unit of the control unit 130 will be described below.

[0014] The sensor unit 131 detects (acquires) information using various sensors. For example, the sensor unit 131 detects a moving object using a motion sensor such as a distance sensor, a microwave sensor, or a LiDAR (light detection and ranging) sensor. The sensor unit 131 also detects the position of the vehicle using a positioning sensor such as a GNSS (Global Navigation Satellite System) sensor or a GPS (Global Positioning System) sensor. The sensor unit 131 also detects the acceleration of the vehicle using an acceleration sensor. For example, the sensor unit 131 also detects the angular velocity of the vehicle using a gyro sensor. For example, the sensor unit 131 also acquires images (moving images and still images) of the surroundings of the vehicle using an imaging device.

[0015] The acquisition unit 132 acquires sensor data generated by a motion sensor provided in the vehicle. For example, the acquisition unit 132 analyzes a signal received by a motion sensor provided in a rearview mirror and acquires the coordinates of a specified moving object from distance and angle information. Here, the rearview mirror is given as an example of a location where the motion sensor may be installed, but the motion sensor may also be installed near the rearview mirror or on a side mirror. That is, the motion sensor may be installed in a location in the vehicle according to the purpose, such as a front pillar, a center pillar, a rear pillar, a rearview mirror, a side mirror, a ceiling, a seat, or a rear window.

[0016] Furthermore, the acquisition unit 132 detects a walking user as a moving object using a motion sensor based on, for example, information encouraging walking from the notification unit 133 or the display control unit 134, analyzes the signal received by the motion sensor, and acquires the coordinates of the moving object identified from the distance and angle information. Here, the sensor data includes data such as the strength of the signal received from the motion sensor and the current time.

[0017] Furthermore, the acquisition unit 132 acquires information about the size of the vehicle in addition to the sensor data. For example, the acquisition unit 132 acquires the model number "****" as information about the size of the vehicle. Note that, although the model number has been exemplified above as information about the size of the vehicle, the information is not limited to this as long as it can identify the size of the vehicle, and may also be information about the vehicle position generated by a motion sensor.

[0018] The notification unit 133 notifies the user of information encouraging the user to walk around the vehicle. For example, the notification unit 133 can prompt the user to walk around the vehicle by voice or the like. For example, the notification unit 133 instructs the user through a speaker or the like of the vehicle, saying, "Please walk alongside the vehicle within 80 cm of the vehicle." The distance of 80 cm may be arbitrarily determined within a range calculated from the average physique (shoulder width, etc.) of a person standing sideways to the vehicle.

[0019] Furthermore, if the user is not walking in the correct walking position, the notification unit 133 notifies the user of information encouraging the user to walk around the vehicle again. For example, the notification unit 133 may instruct the user by voice, such as through a speaker on the vehicle, to "Please walk alongside the vehicle again within 80 cm of the vehicle." Here, a predetermined tolerance may be established for the position to which the user should orient. For example, by setting a tolerance of 10 cm or less for the position to which the user should orient (within 80 cm of the vehicle), it is possible to deal with cases where the user walks in a position slightly different from the correct walking position or errors due to sensor accuracy.

[0020] Furthermore, for example, the notification unit 133 notifies the user of information encouraging the user to walk around the vehicle again in a situation where the position of the moving object indicated by the sensor data acquired by the acquisition unit 132 has stayed outside the range of the location where the user should walk for a time period equal to or greater than a threshold. Additionally, for example, the notification unit 133 can be controlled to notify the user to start walking around the vehicle again when the position of the moving object indicated by the sensor data acquired by the acquisition unit 132 is perpendicular to the direction of travel of the user notified by the notification unit 133 and moves in a direction away from the moving object sensor.

[0021] When the sensor data acquired by the acquisition unit 132 is clearly incorrect, the notification unit 133 can notify the user to try walking around the vehicle again. For example, the notification unit 133 instructs the user by voice from a speaker or the like of the vehicle, saying, "Please walk alongside the vehicle again within 80 cm from the vehicle." Note that the notification unit 133 can instruct the user by voice or the like to limit the position where the user should walk again to the part where sensor data could not be acquired.

[0022] Furthermore, in a situation where the detection unit 135, which will be described later, identifies the position of a blind spot of a motion sensor and then detects that the blind spot is not the blind spot of the motion sensor, the notification unit 133 can notify the user by voice or the like that the blind spot may not be the blind spot of the motion sensor. For example, the notification unit 133 can notify the user by voice from a speaker or the like of the vehicle, saying, "The blind spot of the motion sensor has been changed." In addition, the notification unit 133 can instruct the user to retry detecting the blind spot of the motion sensor.

[0023] The display control unit 134 performs control so that positions around the vehicle where the user should walk are displayed as lines on the user's terminal. For example, the display control unit 134 performs control so that positions around the vehicle where the user should walk are displayed as guide lines or the like on an application or the like of the user's terminal (for example, a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, or the like).

[0024] More specifically, the display control unit 134 receives input of the type of vehicle from the user, and controls the display of an overhead view of the vehicle on the user's terminal, and the display of the location where the user should walk along the vehicle within a range of 80 cm from the vehicle using guide lines, etc. The display control unit 134 also controls the display of text saying "Please walk along the vehicle within a range of 80 cm from the vehicle" on the user's terminal.

[0025] Furthermore, the display control unit 134 controls the display of the position where the moving object is detected as the position where the user has walked on the terminal based on the sensor data acquired by the acquisition unit 132. For example, the display control unit 134 controls the display of the position where the moving object is detected as the position where the user has walked on the terminal. More specifically, the display control unit 134 controls the display of the guide lines around the vehicle indicating the position where the user has walked on the user's terminal so that, for example, the lines are displayed in red instead of black.

[0026] Furthermore, the display control unit 134 controls the display of lines around the vehicle to be changed depending on whether a blind spot has been detected and displayed on the terminal. For example, the display control unit 134 controls the display of guide lines indicating positions around the vehicle where the user has walked depending on whether a blind spot has been detected. More specifically, the display control unit 134 controls the display of guide lines indicating positions where the user has walked that are in a blind spot of the motion sensor to be black, and the display of guide lines indicating positions where the user has walked that are not in a blind spot to be red, on the user's terminal.

[0027] If the user is not walking in the correct walking position, the display control unit 134 controls the display to display information encouraging the user to walk around the vehicle again. For example, the display control unit 134 controls the display to display on the user's device the message "Please walk alongside the vehicle again within 80 cm of the vehicle." Here, a predetermined tolerance value may be set for the position to which the user should orient. For example, by setting a tolerance of 10 cm or less for the position to which the user should orient (within 80 cm of the vehicle), it is possible to deal with cases where the user walks in a position slightly different from the correct walking position or errors due to sensor accuracy.

[0028] Furthermore, for example, the display control unit 134 can perform control to display a message to prompt the user to start walking around the vehicle again when the position of the moving object indicated by the sensor data acquired by the acquisition unit 132 has stayed outside the range of the location where the user should walk for a period of time equal to or greater than a threshold. Additionally, for example, the display control unit 134 can perform control to display a message to prompt the user to start walking around the vehicle again when the position of the moving object indicated by the sensor data acquired by the acquisition unit 132 is perpendicular to the direction of travel of the user displayed by the display control unit 134 and moves in a direction away from the moving object sensor.

[0029] When the sensor data acquired by the acquisition unit 132 is clearly incorrect, the display control unit 134 can control the display to prompt the user to try walking around the vehicle again. For example, the display control unit 134 can display on the user's device the message "Please walk alongside the vehicle again within 80 cm of the vehicle." The display control unit 134 can also control the display to prompt the user to limit the location where the user should try walking again to an area where sensor data could not be acquired. For example, the display control unit 134 can control the display to display the color of the guide line indicating the location where the user should try walking again in blue. By acquiring sensor data for the location where the user should try walking again, the sensor data for the location where the user should try walking again can be combined with sensor data for locations where sensor data was correctly acquired, thereby enabling accurate detection of blind spots.

[0030] Furthermore, after the detection unit 135, which will be described later, identifies the position of a blind spot of a motion sensor, in a situation where the detection unit 135 detects that the position is not a blind spot of the motion sensor, the display control unit 134 can perform control so that a message indicating that the position is not a blind spot is displayed to the user on the user's terminal. For example, the display control unit 134 can perform control so that a message "The blind spot of the motion sensor has been changed" is displayed to the user on the user's terminal. In addition, the display control unit 134 can perform control so that a message is displayed to prompt the user to retry detecting the blind spot of the motion sensor.

[0031] The display control unit 134 controls the display of information on the terminal to present the user with the walking speed, depending on the frequency output by the motion sensor. For example, if the interval between data acquisition from the motion sensor is long depending on the user's walking speed, the display control unit 134 may be unable to acquire data from the motion sensor, making it impossible to display the user's walking location on the user's terminal. Therefore, for example, the display control unit 134 controls the display of an instruction to slow down the user's walking speed on the user's terminal. For example, the display control unit 134 controls the display of text on the user's terminal saying, "Please slow down your walking speed."

[0032] When the user is walking around the vehicle, the detection unit 135 detects the position of the blind spot of the motion sensor based on the sensor data acquired by the acquisition unit 132. For example, when the strength of the signal included in the sensor data is less than a threshold, the detection unit 135 detects the position where the signal strength is less than the threshold as the position of the blind spot of the motion sensor.

[0033] For example, the detection unit 135 detects a position where the signal strength included in the sensor data acquired by the acquisition unit 132 while the user is walking around the vehicle is less than a threshold as a position in the blind spot of the motion sensor. Note that the detection unit 135 determines that a position where the signal strength is not less than the threshold is a position that is not in the blind spot of the motion sensor. Here, the user walking around the vehicle is not limited to the user walking around the entire vehicle, but may also be the user walking only along a part of the vehicle, such as the side of the vehicle.

[0034] Furthermore, the detection unit 135 can detect the blind spot by using the trajectory of the user walking multiple times around the vehicle. In this case, the detection unit 135 can detect the position of the blind spot of the motion sensor with higher accuracy by calculating the average value of the coordinates of the positions of the detected blind spots. Note that in a situation where sensor data for each portion of the vehicle is acquired, the detection unit 135 can detect the position of the blind spot of the motion sensor with higher accuracy by combining the sensor data for each portion of the multiple vehicles.

[0035] In addition, as an example of the detection unit 135 detecting a blind spot of a motion sensor, an example has been given in which the detection unit 135 detects a position where the signal strength is less than a threshold as the position of the motion sensor's blind spot. However, for example, the detection unit 135 can also detect the position of the motion sensor's blind spot when the motion sensor receives noise or when applying an intensity filter to the sensor data of the motion sensor causes the coordinates to return to the origin. Here, the intensity filter is a filter applied to determine the signal strength, and when applied to a signal in which noise is present, the coordinates return to the origin. Note that the motion sensor's blind spot may be caused by the front pillar, center pillar, rear pillar, seats inside the vehicle, etc. In addition, the motion sensor's blind spot may also be caused by retrofittable headrest monitors, tall cargo, key chains attached to the rearview mirror, etc.

[0036] Furthermore, after identifying the position of the motion sensor's blind spot, if the strength of the signal from the sensor data at the position of the motion sensor's blind spot is equal to or greater than a threshold value multiple times, the detection unit 135 detects the position where the strength of the signal from the sensor data is equal to or greater than the threshold value multiple times as not being in the motion sensor's blind spot. For example, after identifying the position of the motion sensor's blind spot, if a headrest monitor that was in the motion sensor's blind spot is moved and is no longer in the motion sensor's blind spot, the detection unit 135 detects that the position is not in the motion sensor's blind spot.

[0037] The detection unit 135 also detects the blind spot area based on the position of the blind spot of the motion sensor and information about the size of the vehicle. For example, the detection unit 135 uses the mounting position of the motion sensor as the origin of coordinates and detects the angular range in which the position of the blind spot of the motion sensor is detected as the blind spot area of ​​the motion sensor (a radial area starting from the motion sensor). The detection unit 135 then excludes an interior area identified from the vehicle size obtained by the acquisition unit 132 from the blind spot area of ​​the motion sensor. Then, by excluding areas outside the detection range of the motion sensor from the blind spot area of ​​the motion sensor, the detection unit 135 detects the radial area other than the excluded part as the blind spot area.

[0038] When the detection unit 135 detects a blind spot of the motion sensor, the adjustment unit 136 adjusts at least one of the detection range and sensitivity of the motion sensor. For example, the adjustment unit 136 adjusts the settings of the motion sensor provided in the vehicle according to the blind spot of the motion sensor determined by the detection unit 135. For example, the adjustment unit 136 makes adjustments to exclude signals from the motion sensor's reception detection range for a position determined by the detection unit 135 to be in the motion sensor's blind spot. Furthermore, for example, when a position is estimated to be in the motion sensor's blind spot, the adjustment unit 136 adjusts the sensitivity for receiving signals from a predetermined angle (000° to 000°) or the detection range.

[0039] Furthermore, when a moving object is detected in a position where the user is not walking, the adjustment unit 136 adjusts at least one of the detection range and sensitivity of the moving object sensor. For example, when noise is generated in a position where the user is not walking, the adjustment unit 136 adjusts the sensitivity for receiving the signal of the moving object sensor to a lower level. In other words, when false detections frequently occur in a position where the user is not walking, the adjustment unit 136 adjusts the signal sensitivity to a lower level.

[0040] 2. Display Control Processing Next, the display control processing performed by the determination device 100 will be described with reference to FIGS. 2 to 4. FIGS. 2 to 4 are diagrams illustrating an example of the display control processing performed by the determination device 100 according to the embodiment. The display control unit 134 displays a display on the user's terminal. At this time, as shown in FIG. 2, the display control unit 134 can display the vehicle type selected by the user and a line around the vehicle around which the user should walk on the user's terminal. For example, as shown in FIG. 2, if the user selects a sedan as the vehicle type, the display control unit 134 controls the display of an overhead view of the sedan vehicle type on the user's terminal. Next, the display control unit 134 controls the display of an arrow on the user's terminal as information encouraging the user to walk around the vehicle within a distance of 80 cm from the vehicle, for example, as shown in FIG. 2.

[0041] For example, as shown in Fig. 2, the display control unit 134 controls the display of a line on the user's terminal, changing the display mode of the line to indicate that the position where the moving object was detected is the position where the user walked, based on the sensor data acquired by the acquisition unit 132. For example, when the user walks from the front right side of the vehicle to the rear right side as shown in Fig. 2, the display control unit 134 controls the display of the line on the user's terminal, using the sensor data of the user while walking. Here, the display control unit 134 controls the display of the line on the user's terminal, changing the display mode of the line from a black line to a red line, for example, to indicate that the position where the moving object was detected is the position where the user walked.

[0042] Furthermore, for example, the display control unit 134 can change the display mode for the position of the motion sensor's blind spot detected by the detection unit 135, as shown in FIG. 3. For example, as shown in FIG. 3, when a user walks from the front right side of the vehicle to the rear right side, the acquisition unit 132 acquires sensor data of the walking user. Here, if the signal strength included in the acquired sensor data is less than a threshold, the detection unit 135 detects the position of the moving object when the signal strength less than the threshold is received as the position of the motion sensor's blind spot. Then, the display control unit 134 changes the display mode for the detected position of the motion sensor's blind spot, for example, from a black line to a red line, and controls the display on the user's terminal.

[0043] [3. Detection Process] Next, blind spot detection performed by the determination device 100 will be described using FIG. 4 . FIG. 4 is a diagram illustrating an example of the detection process performed by the determination device 100 according to the embodiment. The detection unit 135 detects the location where a moving object is detected as the location where the user walked, based on the sensor data acquired by the acquisition unit 132. For example, if the signal strength included in the sensor data is below a threshold while the user is walking, the detection unit 135 detects the location of the moving object when a signal strength below the threshold is received as the location of the blind spot of the motion sensor. Furthermore, the detection unit 135 detects the range of angles within which the blind spot of the motion sensor is detected relative to the location where the motion sensor is installed as the blind spot area of ​​the motion sensor. As shown in FIG. 4 , the display control unit 134 can display the blind spot area of ​​the motion sensor detected by the detection unit 135 on the user's terminal using a graphic such as a triangle.

[0044] [4. Flowchart] Next, the processing by the determination device 100 configured as described above will be described with reference to the flowchart in Fig. 5. The flowchart in Fig. 5 is mainly executed by the control unit 130. This flowchart can also be configured as a program executed by the CPU of the control unit 130 to form a determination program. Note that the steps below can be executed in a different order, and some processing may be omitted.

[0045] First, the display control unit 134 receives a vehicle type selection from the user on the user's terminal (step S101). If the display control unit 134 receives a vehicle type selection from the user (step S101: Yes), the display control unit 134 subsequently displays an overhead view of the selected vehicle on the user's terminal (step S102).

[0046] On the other hand, if the display control unit 134 has not received a vehicle type selection from the user (step S101: No), it performs the process of step S101 again.

[0047] Here, when the bird's-eye view of the selected vehicle is displayed on the user's terminal, the display control unit 134 subsequently displays information encouraging the user to walk around the vehicle (step S103). The method of encouraging the user to walk around the vehicle is not limited to the display of information encouraging the user to walk around the vehicle on the user's terminal by the display control unit 134, but the notification unit 133 can also encourage the user to walk around the vehicle by voice or the like.

[0048] Next, the acquisition unit 132 acquires sensor data generated by a motion sensor provided in the vehicle (step S104). For example, the acquisition unit 132 acquires the sensor data generated by the motion sensor provided in the vehicle when the user is walking around the vehicle in accordance with information displayed by the display control unit 134 encouraging the user to walk.

[0049] Next, the detection unit 135 determines whether the value of the sensor data is less than the threshold value (step S105). If the detection unit 135 determines that the signal strength of the sensor data is less than the threshold value (step S105: Yes), the detection unit 135 detects the position where the signal strength is less than the threshold value as the position of the blind spot of the motion sensor (step S106). On the other hand, if the signal strength of the sensor data is not less than the threshold value (step S105: No), the detection unit 135 performs the process of step S104 again.

[0050] The adjustment unit 136 adjusts the sensitivity and detection range of the motion sensor based on the position detected as the blind spot (step S107).

[0051] 5. Effects The determination device 100 according to the embodiment includes an acquisition unit 132 that acquires sensor data generated by a motion sensor provided in a vehicle, and a detection unit 135 that detects the position of a blind spot of the motion sensor based on the sensor data acquired by the acquisition unit 132 when a user is walking around the vehicle.

[0052] As a result, the determination device 100 can detect blind spots caused by objects present inside the vehicle by detecting the blind spots of the motion sensor from sensor data acquired by the motion sensor while the user is walking around the vehicle. Furthermore, by storing the position of the motion sensor's blind spots as data, the determination device 100 supports the determination process as a motion detection function when a moving object enters the blind spot. In other words, by detecting the motion sensor's blind spots, the determination device 100 improves the accuracy of motion detection when used as a motion detection function.

[0053] Moreover, the determination device 100 according to the embodiment further includes a notification unit 133 that notifies the user of information encouraging the user to walk around the vehicle. As a result, the determination device 100 notifies the user of information encouraging the user to walk around the vehicle, thereby making it possible to detect blind spots caused by objects present inside the vehicle by having the user walk around the vehicle and detecting blind spots of the motion sensor.

[0054] Furthermore, the determination device 100 according to the embodiment further includes a display control unit 134 that controls the display of lines on the user's device to indicate where the user should walk around the vehicle. By displaying lines indicating where the user should walk on the user's device, the determination device 100 can prompt the user to walk to the appropriate location around the vehicle, and can detect blind spots caused by objects present inside the vehicle by detecting blind spots of the motion sensor. Furthermore, the determination device 100 can allow the user to determine where they should walk.

[0055] Furthermore, in the determination device 100 according to the embodiment, the display control unit 134 controls the terminal to display the position where the moving object is detected as the position where the user has walked, based on the sensor data acquired by the acquisition unit 132.

[0056] In this way, the determination device 100 can display the positions where the user has walked on the terminal, thereby allowing the user to understand that the motion sensor has detected the user and that blind spots have been detected appropriately. Furthermore, the determination device 100 can allow the user to understand the positions where they should walk.

[0057] Furthermore, in the determination device 100 according to the embodiment, the display control unit 134 controls the display of the lines around the vehicle to be changed depending on whether a blind spot has been detected, and displays the lines on the terminal. In this way, the determination device 100 can appropriately display the blind spot of the motion sensor to the user, thereby displaying the position of the blind spot of the motion sensor to the user.

[0058] Furthermore, in the determination device 100 according to the embodiment, the display control unit 134 controls the terminal to display information for presenting the walking speed to the user in accordance with the frequency output by the motion sensor. As a result, the determination device 100 presents the walking speed to the user in accordance with the frequency output by the motion sensor, and by having the user walk in accordance with the presented walking speed, the determination device 100 can appropriately obtain the position of the blind spot even when the interval between data acquisition from the motion sensor is long.

[0059] Furthermore, in the determination device 100 according to the embodiment, when the strength of the signal included in the sensor data is less than a threshold, the detection unit 135 detects the position where the signal strength is less than the threshold as the position of the blind spot of the motion sensor.

[0060] As a result, the determination device 100 can detect a blind spot caused by an object present inside the vehicle by detecting a position where the signal strength is less than the threshold as a blind spot of the motion sensor.

[0061] Moreover, the determination device 100 according to the embodiment further includes an adjustment unit 136 that adjusts at least one of the detection range and sensitivity of the motion sensor when the detection unit 135 detects a blind spot of the motion sensor.

[0062] This allows the determination device 100 to adjust the detection range and sensitivity of the motion sensor at a position where a blind spot is detected, etc., and prevents erroneous detection when the determination device 100 is used as a motion detection function. In other words, the determination device 100 adjusts the detection range and sensitivity of the motion sensor according to the position of the motion sensor's blind spot, thereby improving the accuracy of motion detection when used as a motion detection function.

[0063] Furthermore, in the determination device 100 according to the embodiment, when a moving object is detected in a position where the user is not walking, the adjustment unit 136 adjusts at least one of the detection range and sensitivity of the moving object sensor. As a result, when the determination device 100 detects noise in a position where the user is not walking, it is possible to prevent erroneous detection by adjusting the detection range and sensitivity of the moving object sensor.

[0064] Furthermore, in the determination device 100 according to the embodiment, the detection unit 135 detects the blind spot area from the position of the blind spot of the motion sensor and information about the size of the vehicle. In this way, the determination device 100 detects the blind spot area of ​​the motion sensor, thereby improving the accuracy of risk value determination when used as a motion detection function.

[0065] Second Embodiment In the first embodiment, an example of detecting the position of a blind spot of a motion sensor has been described, but in the second embodiment described below, an example of generating information related to the vehicle position will be described. Note that descriptions of content common to the first embodiment will be omitted as appropriate.

[0066] 1. Configuration of the Determination Device Next, a determination device 100A according to an embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example configuration of the determination device 100A according to an embodiment. As shown in Fig. 6, the control unit 130 of the determination device 100A includes a sensor unit 131, an acquisition unit 132, a notification unit 133, a display control unit 134, an adjustment unit 136, a generation unit 137, an output unit 138, a vehicle exterior detection unit 139, and a vehicle interior detection unit 140. Each unit included in the control unit 130 will be described below.

[0067] The acquisition unit 132 acquires sensor data generated by a motion sensor provided in the vehicle. For example, the acquisition unit 132 analyzes a signal received by a motion sensor provided in a rearview mirror and acquires the coordinates of a specified moving object from distance and angle information. Here, the rearview mirror is given as an example of the installation location of the motion sensor, but the motion sensor may also be installed near the rearview mirror or on a side mirror. That is, the motion sensor is installed in a location within the vehicle according to the purpose, such as a front pillar, a center pillar, a rear pillar, a rearview mirror, a side mirror, a ceiling, a seat, or a rear window. Furthermore, the motion sensor may be installed not only in a location within the vehicle but also in a location outside the vehicle.

[0068] While the user is walking around the vehicle, the generation unit 137 generates information about the vehicle position based on the sensor data acquired by the acquisition unit 132. The generation unit 137 generates, as the information about the vehicle position, information about either or both of the overall length and the overall width of the vehicle based on the sensor data acquired by the acquisition unit 132 while the user is walking.

[0069] First, the generation of either or both of the vehicle's overall length and overall width will be described. For example, in a situation where the user is walking within 80 cm of the vehicle from the driver's door toward the passenger's door in accordance with instructions from the display control unit 134, the generation unit 137 determines the two points where lines intersect perpendicularly on the trajectory of coordinates identified from the sensor data as the two ends of the vehicle's overall width, and generates the overall width from the distance between the two points. As in this example, the situation where the user is walking around the vehicle is not limited to the user walking around the vehicle in a complete circle, but may also be the user walking only along a portion of the vehicle's periphery, such as along the side of the vehicle. Note that "orthogonal" here does not necessarily mean that the angle between the two lines is a right angle, but may be within a predetermined range (e.g., "80° to 100°").

[0070] As another example, the generation unit 137 may generate information on the overall length and overall width of the vehicle from the shape of the coordinate trajectory of the moving object. Specifically, if the shape of the coordinate trajectory of the moving object when the user drives around the vehicle is rectangular, the generation unit 137 generates the overall width of the vehicle by subtracting a predetermined value from the shorter side, and the overall length of the vehicle by subtracting a predetermined value from the other orthogonal long side. Here, the predetermined value is, for example, 80 cm. Furthermore, the generation unit 137 may generate either or both of the overall length and overall width of the vehicle using the coordinate trajectory when the user drives around the vehicle and experimental data obtained by driving around the vehicle for one or more of the vehicle size, body type, and model. This allows for accurate vehicle size setting.

[0071] Furthermore, the generation unit 137 generates, as information about the vehicle position, information about the attachment position of the motion sensor based on the sensor data acquired by the acquisition unit 132 while the user is walking. For example, the generation unit 137 generates information about the attachment position of the motion sensor using the trajectory of coordinates of a moving object identified from the sensor data in a situation where the user is walking within 80 cm of the vehicle in accordance with instructions from the display control unit 134. For example, if the motion sensor is installed biased to the left side, the generation unit 137 generates information that the attachment position of the motion sensor is biased to the left side because, when the attachment position of the motion sensor is the origin of the coordinates, the center of the vehicle represented by the trajectory of the coordinates is located to the right of the origin of the coordinates.

[0072] The adjustment unit 136 adjusts at least one of the detection range and sensitivity of the motion sensor based on the information about the vehicle position generated by the generation unit 137. First, adjustment of the motion sensor according to either or both of the overall length and overall width of the vehicle will be described. For example, when the overall width of the vehicle generated by the generation unit 137 is greater than a predetermined threshold, the adjustment unit 136 expands the detection range of the motion sensor and / or increases its sensitivity.

[0073] Next, adjustment of the motion sensor according to the installation position of the motion sensor will be described. For example, in a situation where the installation position of the motion sensor generated by the generation unit 137 is biased from the center of the vehicle to the left side, the adjustment unit 136 performs one or both of the following: offsetting the inside area of ​​the vehicle and the outside area of ​​the vehicle, offsetting the distance risk area, expanding the detection range of the motion sensor on the right side of the vehicle, and adjusting the sensitivity. On the other hand, the adjustment unit 136 performs one or both of the following: reducing the detection range of the motion sensor on the left side of the vehicle and adjusting the sensitivity.

[0074] The output unit 138 outputs a predetermined notification according to the installation position of the motion sensor generated by the generation unit 137. For example, if the motion sensor is installed to the left or right of the center of the vehicle by a threshold value or more, the output unit 138 notifies the user to install the motion sensor near the center of the vehicle. The notification to the user can be, for example, a voice notification via a speaker or a user terminal. Furthermore, if a user input value for the installation position is acquired through input from the user, the output unit 138 may determine whether the user input value is close to the installation position of the motion sensor generated by the generation unit 137, and if the difference is greater than the threshold, the output unit 138 may notify the user to confirm the installation position. This can prevent input errors by the user when entering the user input value.

[0075] The outside-vehicle detection unit 139 detects a moving object outside the vehicle based on the sensor data and information related to the vehicle position. For example, to detect a moving object outside the vehicle, the outside-vehicle detection unit 139 detects the moving object from the intensity of a signal included in the sensor data outside the vehicle, which is specified from the vehicle size obtained by the generation unit 137.

[0076] As another example, the outside-vehicle detection unit 139 detects a moving object making a predetermined movement outside the vehicle based on a change in the intensity of a signal included in sensor data outside the vehicle. For example, the outside-vehicle detection unit 139 detects that there is a moving object approaching the vehicle when the intensity of the signal included in the sensor data acquired by the acquisition unit 132 is increasing. Furthermore, for example, the outside-vehicle detection unit 139 detects that there is a moving object moving away from the vehicle when the intensity of the signal included in the sensor data acquired by the acquisition unit 132 is decreasing.

[0077] In addition, when the adjustment unit 136 adjusts at least one of the detection range and sensitivity of the motion sensor, the outside-vehicle detection unit 139 detects a moving object outside the vehicle using the detection range and sensitivity of the motion sensor after the adjustment.

[0078] The outside-vehicle detection unit 139 calculates a risk value outside the vehicle based on information about the vehicle position, such as the overall length and overall width of the vehicle, generated by the generation unit 137. The outside-vehicle detection unit 139 then calculates the risk value by estimating the movement of moving objects outside the vehicle. A specific method for calculating the risk value outside the vehicle will be described later.

[0079] The interior detection unit 140 detects a moving object inside the vehicle based on the sensor data and information related to the vehicle position. For example, to detect a moving object inside the vehicle, the moving object is detected from the intensity of a signal included in the sensor data inside the vehicle, which is identified from the vehicle size obtained by the generation unit 137. Furthermore, for example, the interior detection unit 140 detects a moving object making a predetermined movement inside the vehicle based on the transition of the intensity of a signal included in the sensor data at a position other than outside the vehicle.

[0080] 2. Generation Process Next, the generation process performed by the determination device 100A will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the generation process performed by the determination device 100A according to the embodiment. The generation unit 137 generates information related to the vehicle position based on sensor data obtained when the user is walking around the vehicle.

[0081] First, the generation of either or both of the overall length and overall width of the vehicle will be described. For example, as shown in FIG. 7 , in a situation where the user is walking within 80 cm of the vehicle in accordance with instructions from the display control unit 134, from the front right end of the vehicle to the front left end of the vehicle via the rear of the vehicle, the generation unit 137 determines the positions of two points where straight lines intersect perpendicularly on the trajectory of coordinates identified from the sensor data as the two ends of the overall width of the vehicle, and generates the overall width from the distance between the two points. As in this example, the situation where the user is walking around the vehicle is not limited to when the user is walking around the vehicle in a complete circle, but may also be when the user is walking only along the side of the vehicle, or in other words, only along a portion of the periphery of the vehicle.

[0082] Another example will be described in which the generation unit 137 generates information on the overall length and / or overall width of the vehicle. For example, the generation unit 137 generates information on the overall length and overall width of the vehicle based on acquired sensor data in a situation in which the user is walking around the vehicle within 80 cm of the vehicle in accordance with instructions from the display control unit 134. Specifically, based on the trajectory of the coordinates of the moving object when the user walks around the vehicle, if the trajectory is rectangular, for example, the generation unit 137 generates the information on the overall width of the vehicle using the shorter side and the overall length of the vehicle using the other orthogonal long side.

[0083] Furthermore, the generation unit 137 generates information about the attachment position of the motion sensor. As shown in Fig. 7 , in a situation where the user is walking within 80 cm of the vehicle in accordance with instructions from the display control unit 134, the generation unit 137 generates information about the attachment position of the motion sensor using the trajectory of the coordinates of the moving object identified from the sensor data. For example, as shown in Fig. 7 , if the motion sensor is installed biased to the left side, the generation unit 137 generates information that the attachment position of the motion sensor is biased to the left side because, if the attachment position of the motion sensor represented by a triangle in Fig. 7 is the origin of the coordinates, the center of the vehicle represented by the trajectory of the coordinates is located to the right of the origin of the coordinates.

[0084] 8 and 9, the vehicle outside detection process performed by the determination device 100A will be described. Figures 8 and 9 are diagrams showing an example of the vehicle outside detection process performed by the determination device 100A according to the embodiment. The vehicle outside detection unit 139 detects a moving object outside the vehicle using a moving object sensor.

[0085] For example, to detect a moving object outside the vehicle, the outside-vehicle detection unit 139 detects the moving object from the intensity of a signal included in sensor data outside the vehicle that is identified from the vehicle size obtained by the generation unit 137. Furthermore, for example, the outside-vehicle detection unit 139 detects a moving object making a predetermined movement outside the vehicle from the transition of the intensity of a signal included in sensor data at a position other than inside the vehicle.

[0086] In addition, when the adjustment unit 136 adjusts at least one of the detection range and sensitivity of the moving object sensor, the outside vehicle detection unit 139 detects a moving object outside the vehicle using the detection range and sensitivity of the moving object sensor after the adjustment.

[0087] In addition, the outside-vehicle detection unit 139 estimates information about the position (distance risk) of a moving object from the movement of the moving object outside the vehicle, and information about the direction (directional risk) of the moving object, and calculates a risk value.

[0088] The directional risk refers to the risk associated with the moving object's direction of travel, determined from the coordinates of two or more consecutive moving object points acquired by the acquisition unit 132. For example, as shown in FIG. 9, the risk value associated with the moving object's direction of travel is indicated by 1 to 4 points. As shown in FIG. 9, the risk value is high when the moving object's direction of travel is toward the center of the moving object, and low when the moving object's direction of travel is away from the vehicle.

[0089] The vehicle exterior detection unit 139 can detect a moving object outside the vehicle using information on distance risk and directional risk. For example, the vehicle exterior detection unit 139 performs a risk analysis using either or both of distance risk and directional risk, and detects a moving object outside the vehicle when the risk point is equal to or greater than a threshold. The vehicle exterior detection unit 139 can also analyze the risk of an approaching moving object using information on distance risk and directional risk. For example, the vehicle exterior detection unit 139 performs a risk analysis using either or both of distance risk and directional risk, and detects an approaching moving object to the vehicle when the risk point is equal to or greater than a threshold.

[0090] Here, distance risk refers to the risk related to the position of a moving object according to the distance between the vehicle and the moving object acquired by the acquisition unit 132. For example, as shown in FIG. 8, a risk value according to the distance between the moving object and the center of the vehicle is indicated by a score ranging from 0 to 1. Also, as shown in FIG. 8, the closer the distance to the center of the vehicle, the higher the risk value, and the farther the distance, the lower the risk value. Note that an offset may be taken into account when determining the distance risk. In other words, even if the distance between the moving object sensor and the moving object is constant, if the relationship between the moving object sensor and the vehicle's position is different, the distance risk determination result will change, and therefore the distance risk may be adjusted according to the installation position of the moving object sensor.

[0091] [4. Flowchart] Next, the processing by the determination device 100A having the above-described configuration will be described with reference to the flowchart in Fig. 10. The flowchart in Fig. 10 is mainly executed by the control unit 130. Furthermore, this flowchart can be configured as a program executed by the CPU of the control unit 130 to form a determination program. Note that the steps below may be executed in a different order, and some processing may be omitted.

[0092] First, the display control unit 134 receives a vehicle type selection from the user on the user's terminal (step S201). If the display control unit 134 receives a vehicle type selection from the user (step S201: Yes), the display control unit 134 subsequently displays an overhead view of the selected vehicle on the user's terminal (step S202).

[0093] On the other hand, if the display control unit 134 has not received a vehicle type selection from the user (step S201: No), it performs the process of step S201 again.

[0094] Here, when the bird's-eye view of the selected vehicle is displayed on the user's terminal, the display control unit 134 subsequently displays a display encouraging the user to walk around the vehicle (step S203). The method of encouraging the user to walk around the vehicle is not limited to the display by the display control unit 134 of information encouraging the user to walk around the vehicle on the user's terminal or the like, but the notification unit 133 can also encourage the user to walk around the vehicle by voice or the like.

[0095] Next, the acquisition unit 132 acquires sensor data generated by a motion sensor provided in the vehicle (step S204). For example, the acquisition unit 132 acquires sensor data generated by a motion sensor provided in the vehicle when the user is walking around the vehicle in accordance with information displayed by the display control unit 134 encouraging the user to walk.

[0096] Next, the generation unit 137 generates either or both of the overall length and the overall width of the vehicle based on the sensor data acquired by the acquisition unit 132 (step S205). Note that the generation unit 137 can also generate information regarding the installation position of the motion sensor, for example.

[0097] The adjustment unit 136 performs a process of adjusting the sensitivity and detection range of the motion sensor based on the information about the vehicle position (step S206).

[0098] 5. Effects The determination device 100A according to the embodiment includes an acquisition unit 132 that acquires sensor data generated by a motion sensor provided in the vehicle, and a generation unit 137 that generates information related to the vehicle position based on the sensor data acquired by the acquisition unit 132 while the user is walking around the vehicle.

[0099] As a result, the determination device 100A can generate information regarding the vehicle position, such as the vehicle's overall length, overall width, and mounting position of the motion sensor, thereby appropriately grasping the vehicle's situation and performing highly accurate motion detection.

[0100] The determination device 100A according to the embodiment further includes a notification unit 133 that notifies the user of information encouraging the user to walk around the vehicle. As a result, the determination device 100A notifies the user of information encouraging the user to walk around the vehicle, thereby encouraging the user to walk around the vehicle and appropriately generating information relating to the vehicle position, thereby enabling highly accurate moving object detection.

[0101] The determination device 100A according to the embodiment further includes a display control unit 134 that performs control so that positions around the vehicle where the user should walk are displayed as lines on the user's terminal.

[0102] As a result, the determination device 100A can prompt the user to walk to the appropriate location around the vehicle by displaying a line indicating the location where the user should walk on the user's terminal, and can appropriately generate information related to the vehicle location. Furthermore, by allowing the user to know the location where they should walk, the determination device 100A can accurately generate information related to the vehicle location and perform moving object detection with high accuracy.

[0103] Furthermore, in the determination device 100A according to the embodiment, the display control unit 134 controls the terminal to display the position where the moving object is detected as the position where the user has walked, based on the sensor data acquired by the acquisition unit 132.

[0104] As a result, the determination device 100A displays the location where the user walked on the terminal, allowing the user to understand that the motion sensor is detecting the user, thereby accurately generating information regarding the vehicle location and performing highly accurate motion detection.

[0105] In addition, in the determination device 100A according to the embodiment, the generation unit 137 generates, as information regarding the vehicle position, information on either or both of the overall length and the overall width of the vehicle based on the sensor data acquired by the acquisition unit 132 while the user is walking.

[0106] As a result, the determination device 100A can confirm the vehicle's status by generating information on either or both of the vehicle's overall length and overall width, thereby enabling highly accurate moving object detection.

[0107] In addition, in the determination device 100A according to the embodiment, the generation unit 137 generates information on the installation position of the motion sensor as information on the vehicle position based on the sensor data acquired by the acquisition unit 132 while the user is walking.

[0108] As a result, the determination device 100A can check the vehicle's condition by generating information about the installation position of the moving object sensor, and can perform moving object detection with high accuracy.

[0109] Moreover, the determination device 100A according to the embodiment further includes an output unit 138 that outputs a predetermined notification in accordance with the attachment position of the motion sensor generated by the generation unit 137. In this way, the determination device 100A can perform moving object detection with high accuracy by notifying the output unit 138 when the attachment position of the motion sensor is inappropriate.

[0110] Moreover, the determination device 100A according to the embodiment further includes an adjustment unit 136 that adjusts at least one of the detection range and sensitivity of the motion sensor based on the information related to the vehicle position generated by the generation unit 137 .

[0111] As a result, the determination device 100A can perform moving object detection with high accuracy by adjusting at least one of the detection range and sensitivity of the moving object sensor in accordance with the information related to the vehicle position.

[0112] The determination device 100A according to the embodiment further includes an outside-vehicle detection unit 139 that detects a moving object outside the vehicle based on the sensor data and the information related to the vehicle position. This allows the determination device 100A to appropriately detect a moving object outside the vehicle in accordance with the sensor data and the information related to the vehicle position, thereby enabling highly accurate moving object detection.

[0113] The determination device 100A according to the embodiment further includes an interior detection unit 140 that detects a moving object inside the vehicle based on the sensor data and the information related to the vehicle position. This allows the determination device 100A to appropriately detect a moving object inside the vehicle in accordance with the sensor data and the information related to the vehicle position, thereby enabling highly accurate moving object detection.

[0114] (Modifications) [1. System Configuration] Up to this point, examples have been described in which the determinations according to the first and second embodiments are realized by the determination devices 100, 100A provided in a vehicle. Below, modifications of the above embodiments will be described. As a modification, an example will be described in which the determinations according to the first and second embodiments are realized by communication between a determination device 100B present on the cloud and an in-vehicle device 10 provided in a vehicle. FIG. 11 is a diagram showing the configuration of a determination system according to an embodiment. FIG. 11 shows a determination system 1 as an example of a determination system according to an embodiment. Note that descriptions of content common to the first and second embodiments will be omitted as appropriate.

[0115] As shown in FIG. 11 , the determination system 1 includes an on-board device 10 and a determination device 100B. The on-board device 10 and the determination device 100B are connected to each other via a network N so as to be able to communicate with each other via a wired or wireless connection. The determination system 1 shown in FIG. 14 may include any number of on-board devices 10 and any number of determination devices 100B. Here, if the on-board device 10 is an edge computer that performs edge processing near the user, the determination device 100B may be, for example, a cloud computer that performs processing on the cloud side. In other words, the determination device 100B may be a server device. As shown in FIG. 11 , the determination according to the embodiment is realized in the determination system 1 by transmitting and receiving information between the determination device 100B, which is a server device on the cloud, and the on-board device 10 installed in the vehicle.

[0116] The in-vehicle device 10 may be a dedicated sensor device built into or externally attached to the vehicle VEx, or may be a recording device (drive recorder) or other device installed in the vehicle VEx for crime prevention or to prevent tailgating.

[0117] The in-vehicle device 10 may also be configured with a sensor device and a notification device. As an example, the in-vehicle device 10 may be a composite device in which a sensor device and a notification device that are independent of each other are connected to each other so as to be able to communicate with each other. As another example, the in-vehicle device 10 may be a single device having a sensor function and a notification function.

[0118] Furthermore, a user can connect a predetermined sensor to a portable terminal device (e.g., a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, or the like) that they use on a daily basis and install a predetermined application, thereby substituting the portable terminal device as the in-vehicle device 10. For example, a portable terminal device that is equipped with a predetermined sensor or to which a predetermined sensor is connected can be understood as the in-vehicle device 10 referred to here. When the portable terminal device is used as the in-vehicle device 10, it is installed, for example, on the dashboard of the vehicle VEx while driving.

[0119] The in-vehicle device 10 may also include various sensors, such as a distance sensor, a motion sensor such as a microwave sensor or LiDAR, a temperature sensor, a microphone, a positioning sensor such as a GNSS sensor or GPS sensor, an acceleration sensor, a gyro sensor, an imaging device such as a camera, and an air pressure sensor.

[0120] The determination device 100B may acquire various data based on sensor information detected by these sensors (for example, by analyzing the sensor information). For example, the determination device 100B acquires information on moving objects inside and outside the vehicle from a moving object sensor. Also, for example, the determination device 100B acquires the temperature of the vehicle from a temperature sensor. Also, for example, the determination device 100B acquires sound from a microphone. Also, for example, the determination device 100B acquires angular velocity from a gyro sensor. Also, for example, the determination device 100B acquires moving image data of the outside captured from inside the vehicle VEx by a camera. Note that the determination device 100B may acquire sensor information detected not only by sensors provided in the on-vehicle device 10 but also by sensors provided in the vehicle VEx itself.

[0121] 2. Configuration of the Determination Device Next, a determination device 100B according to an embodiment will be described with reference to Fig. 12. Fig. 12 is a diagram showing an example configuration of the determination device 100B according to an embodiment. As shown in Fig. 12, the determination device 100B has a communication unit 110, a storage unit 120, and a control unit 130.

[0122] The control unit 130 is realized using a CPU, an NP, an FPGA, etc., and executes a processing program stored in a memory. As shown in Fig. 12 , the control unit 130 has a sensor unit 131, an acquisition unit 132, a notification unit 133, a display control unit 134, a detection unit 135, an adjustment unit 136, a generation unit 137, an output unit 138, a vehicle exterior detection unit 139, and a vehicle interior detection unit 140.

[0123] (Other) [1. Hardware Configuration] The determination device 100B according to the above-described embodiment and modified example is realized, for example, by a computer 1000 configured as shown in Fig. 13. Fig. 13 is a hardware configuration diagram showing an example of a computer that realizes the functions of the determination device 100B. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0124] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0125] The HDD 1400 stores programs executed by the CPU 1100 and data used by the programs. The communication interface 1500 receives data from other devices via a predetermined communication network and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0126] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0127] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0128] For example, when the computer 1000 functions as the determination device 100B according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0129] (Other) Although one example of an embodiment of the present invention has been described above, the present invention is not limited to the above example. That is, a person skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the gist of the present invention. Of course, as long as such modifications still include the determination device of the present invention, they are included in the scope of the present invention.

[0130] REFERENCE SIGNS LIST 1 Determination system 10 In-vehicle device 100 (100A, 100B) Determination device 110 Communication unit 120 Storage unit 130 Control unit 131 Sensor unit 132 Acquisition unit 133 Notification unit 134 Display control unit 135 Detection unit 136 Adjustment unit 137 Generation unit 138 Output unit 139 Outside vehicle detection unit 140 Inside vehicle detection unit

Claims

1. An acquisition unit that acquires sensor data generated by a moving body sensor provided inside a vehicle, and a detection unit that detects the position of a dead angle of the moving body sensor based on the sensor data acquired by the acquisition unit when a user is walking around the vehicle. A determination device characterized by comprising:

2. The determination device according to claim 1, further comprising a notification unit that notifies the user of information prompting walking around the vehicle.

3. The determination device according to claim 1, further comprising a display control unit that controls to display, on the user's terminal, with a line, the position where the user around the vehicle should walk.

4. The determination device according to claim 3, wherein the display control unit controls to display, on the terminal, the position where a moving body is detected as the position where the user has walked, based on the sensor data acquired by the acquisition unit.

5. The determination device according to claim 4, wherein the display control unit controls to change the display mode of the line around the vehicle according to whether the dead angle is detected and display it on the terminal.

6. The determination device according to claim 3, wherein the display control unit controls to display, on the terminal, information for presenting the walking speed to the user according to the frequency output by the moving body sensor.

7. The determination device according to claim 1, wherein the detection unit detects, as the position of the dead angle of the moving body sensor, the position where the intensity of the signal included in the sensor data is less than a threshold value when the intensity of the signal is less than the threshold value.

8. The determination device according to claim 1, further comprising an adjustment unit that adjusts at least one of the detection range and sensitivity of the moving body sensor when the dead angle of the moving body sensor is detected by the detection unit.

9. The determination device according to claim 8, wherein the adjustment unit adjusts at least one of the detection range and sensitivity of the moving body sensor when a moving body is detected at a position where the user is not walking.

10. The determination device according to claim 1, wherein the detection unit detects a dead angle area from the position of the dead angle of the moving body sensor and information regarding the size of the vehicle.

11. A determination method executed by a determination device, the method including: an acquisition step of acquiring sensor data generated by a moving body sensor provided in a vehicle; and a detection step of detecting a position of a dead angle of the moving body sensor based on the sensor data acquired in the acquisition step when a user is walking around the vehicle.

12. A determination program causing a computer to execute: an acquisition step of acquiring sensor data generated by a moving body sensor provided in a vehicle; and a detection step of detecting a position of a dead angle of the moving body sensor based on the sensor data acquired in the acquisition step when a user is walking around the vehicle.

Citation Information

Patent Citations

  • Vehicle control apparatus, parking assistance apparatus, vehicle control method, and parking assistance method

    JP2021008224A

  • Laser radar unit of vehicle

    JP2012237580A

  • Three-dimensional data processing apparatus, three-dimensional data processing method, and three-dimensional data processing program

    JP2015034711A

  • Information processing apparatus, information processing method, and program

    JP2020079997A

  • External environment recognition device

    WO2023013110A1