Information processing method and information processing device

Abstract

This enables more optimal parking maneuvers. [Solution] The information processing method is a method for notifying a vehicle user when an object is present around a parking space, wherein the method stores the driving path in the first parking, acquires first detected object information around the parking space in the first parking, acquires second detected object information around the parking space in the second parking performed after the first parking, the first parking is performed by manual driving, the second parking is performed by automatic parking based on the first parking, and if an undetected object that was not detected in the first parking is detected in the second parking, the notification in the second parking differs from the notification in the first parking, the notification in the second parking is a notification in which a virtual wall is superimposed in front of the undetected object in either the overhead image, the front image, or the rear image, and the notification in the second parking includes a first and a second form, the first form being more attention-grabbing to the user than the second form.

Description

Technical Field

[0001] The present disclosure relates to an information processing method and an information processing apparatus.

Background Art

[0002] Conventionally, when an object exists around a parking space where a vehicle is about to park, a device that gives a warning notice to a user (for example, a passenger) of the vehicle is known (for example, see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there is room for improvement in the notification aspect of conventional devices.

[0005] An object of the present disclosure is to provide an information processing method and an information processing apparatus that further improve the notification to a user when a vehicle parks.

Means for Solving the Problems

[0006] An information processing method according to one aspect of the present disclosure is an information processing method for notifying a vehicle user when an object is present around a parking space, wherein the method stores the driving path in a first parking, acquires first detected object information around the parking space in the first parking, acquires second detected object information around the parking space in a second parking performed after the first parking, the first parking is performed by manual driving, the second parking is performed by automatic parking based on the first parking, and if an undetected object that was not detected in the first parking is detected in the second parking, the notification in the second parking differs from the notification in the first parking, and the notification in the second parking is a notification in which a virtual wall is superimposed in front of the undetected object in either an overhead image, a front image, or a rear image, and the notification in the second parking includes a first aspect and a second aspect, the first aspect being more attention-grabbing to the user than the second aspect.

[0007] An information processing device according to one aspect of the present disclosure is an information processing device that notifies a vehicle user when an object is present around a parking space, and comprises a storage unit that stores the driving path in a first parking, and an acquisition unit that acquires first detected object information around the parking space in the first parking and second detected object information around the parking space in a second parking performed after the first parking, wherein the first parking is performed by manual driving and the second parking is performed by automatic parking based on the first parking, and if an undetected object that was not detected in the first parking is detected in the second parking, the notification in the second parking differs from the notification in the first parking and the notification in the second parking, wherein the notification in the second parking is a notification that superimposes a virtual wall in front of the undetected object in either an overhead image, a front image, or a rear image, and the notification in the second parking includes a first aspect and a second aspect, the first aspect being more attention-grabbing to the user than the second aspect. [Effects of the Invention]

[0008] This disclosure provides an information processing method and information processing device that further improve notifications to the user when a vehicle is parked. [Brief explanation of the drawing]

[0009] [Figure 1] Block diagram showing an example configuration of an information processing device and a vehicle according to Embodiment 1 of this disclosure. [Figure 2] This diagram schematically shows an example of the hardware configuration of a computer included in the information processing device according to Embodiments 1 and 2 of this disclosure. [Figure 3] Flowchart showing an example of operation of the information processing device according to Embodiment 1 of this disclosure [Figure 4] Block diagram showing an example configuration of an information processing device and a vehicle according to Embodiment 2 of this disclosure. [Figure 5] Flowchart showing an example of operation of the information processing device according to Embodiment 2 of this disclosure [Figure 6] Block diagram showing an example configuration of an information processing device relating to Modification 10 of this disclosure. [Modes for carrying out the invention]

[0010] Embodiments 1 and 2 of this disclosure will be described in detail below with reference to the drawings.

[0011] <Embodiment 1> First, an example of the configuration of the information processing device 100 and vehicle 1 according to Embodiment 1 will be described using Figure 1. Figure 1 is a block diagram showing an example of the configuration of the information processing device 100 and vehicle 1 according to Embodiment 1.

[0012] Vehicle 1 shown in Figure 1 is, for example, an automobile equipped with an automatic parking assist function (so-called home zone parking assist) that can automatically park in a designated parking space. Note that Figure 1 omits the illustration of the components necessary to realize the automatic parking assist function.

[0013] For example, vehicle 1 automatically drives from a predetermined position around the parking space to the parking space and parks there, based on a pre-set route (for example, a route learned based on manual driving).

[0014] In this embodiment, the parking space is a space that has been previously used by vehicle 1 and is pre-registered (set). Examples of such parking spaces include the parking space at home or a car-sharing facility where vehicle 1 repeatedly parks. Furthermore, the parking method of vehicle 1 is assumed to be, for example, reverse parking (also called backing up or reversing). However, this embodiment is also applicable to forward parking (also called forward parking). In the following embodiments, the parking performed in the past is also referred to as the first parking, and the parking performed in the present is also referred to as the second parking.

[0015] As shown in Figure 1, the vehicle 1 has an information processing device 100, a detection unit 200, and a notification unit 300. The information processing device 100 is electrically connected to the detection unit 200 and the notification unit 300, respectively.

[0016] The detection unit 200 is an on-board sensor (e.g., camera, sonar, LiDAR, etc.) that detects objects around the vehicle 1.

[0017] For example, when the automatic parking of vehicle 1 is performed, the detection unit 200 detects objects in the vicinity of the parking space (for example, objects existing between vehicle 1 and the parking space). The detection unit 200 then outputs detected object information, indicating the characteristics (for example, size, shape, type, etc.) and location of the detected object, to the information processing device 100.

[0018] Examples of detectable objects include frames and walls that constitute the partitions of parking spaces, and stationary objects such as utility poles, trees, and ornaments located around parking spaces. In this embodiment, in addition to the above-mentioned stationary objects, humans and animals are also included as detectable objects. The detection unit 200 may distinguish between humans and animals based on predetermined size and movement, for example, or it may distinguish between humans and animals using other known methods.

[0019] The notification unit 300 is an output device that notifies the user of the vehicle 1 (for example, the passengers in the vehicle 1).

[0020] For example, when an object is detected by the detection unit 200 around the parking space where the vehicle 1 is about to park, the notification unit 300 gives a warning notification (which may also be called a warning) to the user of the vehicle 1 under the control of the information processing device 100 (control unit 130).

[0021] In the present embodiment, it is assumed that the notification unit 300 is a speaker of a car navigation system provided in the vehicle interior. Also, in the present embodiment, it is assumed that the notification is an output of a predetermined sound (hereinafter referred to as a warning sound).

[0022] The information processing device 100 is a computer that controls the notification by the notification unit 300 based on the detection result by the detection unit 200 when the automatic parking of the vehicle 1 is performed. For example, the information processing device 100 may be realized by a computer for controlling the car navigation system.

[0023] As shown in FIG. 2, as hardware, the information processing device 100 has, for example, a CPU (Central Processing Unit) 50, a main storage device 502 such as a ROM (Read Only Memory) and a RAM (Random Access Memory), an auxiliary storage device 503 such as a hard disk and a flash memory storing a computer program, and a bus 504 connecting them.

[0024] The functions of the information processing device 100 described below are realized by the CPU 501 expanding and executing the computer program read from the auxiliary storage device 503 into the RAM of the main storage device 502. The computer program may be recorded on a predetermined recording medium and provided to the user or the like.

[0025] As shown in FIG. 1, the information processing device 100 includes a storage unit 110, a determination unit 120, and a control unit 130.

[0026] The memory unit 110 stores the detected object information acquired from the detection unit 200.

[0027] Detected object information is acquired by the detection unit 200 each time vehicle 1 parks in a designated parking space and stored in the storage unit 110. As a result, the storage unit 110 stores multiple past detected object information as learning information.

[0028] The determination unit 120 determines, based on current and past detected object information, whether or not there are any objects in the vicinity of the current parking space that were not detected in the past but have now been detected (hereinafter referred to as undetected objects). This will be explained in detail below.

[0029] This determination process is performed, for example, when vehicle 1 stops at a predetermined position around the parking space and the information processing device 100 receives an instruction operation to execute automatic parking (for example, when the user of vehicle 1 presses a button).

[0030] When the above operation is performed, the determination unit 120 first acquires current detected object information (an example of second detected object information) from the detection unit 200 and reads past detected object information (an example of first detected object information) from the storage unit 110. The determination unit 120 also corresponds to an example of an acquisition unit that acquires detected object information (the same applies to Embodiment 2 and each of the modified examples described later).

[0031] The determination unit 120 then classifies the currently detected object (for example, at the time the automatic parking execution instruction operation is performed) as either a detected object or an undetected object, based on the current detected object information and past detected object information.

[0032] Detected objects are those that were detected during previous parking sessions. On the other hand, undetected objects, as mentioned above, are those that were not detected during previous parking sessions and were newly detected this time.

[0033] The classification described above is performed, for example, using a machine learning similarity classification method that compares the features of an object with the features of a learned detected object. In this case, undetected objects may also be called untrained objects, and detected objects may also be called trained objects. Note that the above classification may also be performed by applying other known techniques.

[0034] If the classification results show that even one undetected object, the determination unit 120 determines that there is an undetected object in the vicinity of the parking space. On the other hand, if there are no undetected objects, the determination unit 120 determines that there is no undetected object in the vicinity of the parking space.

[0035] Furthermore, if there is even one undetected object, the determination unit 120 determines whether or not a person or animal is included among those undetected objects.

[0036] Regarding the determination process here (the process of determining the type of object), since well-known techniques such as machine learning can be applied, we will omit the explanation of that process.

[0037] The control unit 130 controls the notifications made by the notification unit 300.

[0038] In this embodiment, the control unit 130 controls the volume of the warning sound output from the notification unit 300 according to the determination result from the determination unit 120. This will be explained in detail below.

[0039] If the determination unit 120 determines that there are no undetected objects (in other words, if only detected objects exist), the control unit 130 will output a low-volume warning sound (an example of the third mode) from the notification unit 300.

[0040] If the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 will output a warning sound of medium volume (an example of the second mode) from the notification unit 300.

[0041] If the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 outputs a loud warning sound (an example of the first embodiment).

[0042] The volume of the warning sound increases in the order of low, medium, and high. Therefore, the degree of alertness increases in the order of low, medium, and high. If the determination unit 120 determines that no undetected objects exist, the control unit 130 may output a warning sound at the volume set by the user from the notification unit 300. If the determination unit 120 determines that an undetected object exists, the control unit 130 may output a warning sound at a volume higher than the volume set by the user from the notification unit 300.

[0043] As described above, in this embodiment, if the determination unit 120 determines that an undetected object exists, the control unit 130 increases the volume of the warning sound.

[0044] The warning sound may be emitted before vehicle 1 begins moving toward the parking space, or when the distance between vehicle 1 and the undetected object falls below a predetermined value while vehicle 1 is moving toward the parking space. However, if an undetected object is present (in the case of a medium or loud volume output), it is preferable to notify the user earlier from a safety standpoint, so outputting the warning before vehicle 1 begins moving is preferable.

[0045] Furthermore, the current detected object information is stored in the memory unit 110 and used as past detected object information the next time parking is performed.

[0046] Furthermore, if the control unit 130 changes the volume of the warning sound to a medium or high volume, it will change it back to a low volume after the parking of vehicle 1 is complete (for example, when the ignition is turned off or when the ignition is turned on again).

[0047] The configuration example of the information processing device 100 and vehicle 1 according to Embodiment 1 has been described above.

[0048] Next, an example of the operation of the information processing device 100 according to Embodiment 1 will be explained using Figure 3. Figure 3 is a flowchart showing an example of the operation of the information processing device 100 according to Embodiment 1.

[0049] The flow shown in Figure 3 is initiated, for example, when Vehicle 1 is located in a predetermined position around the parking space and the user of Vehicle 1 issues an instruction to perform automatic parking.

[0050] First, the determination unit 120 classifies the currently detected object as either a detected object or an undetected object based on the current detected object information obtained from the detection unit 200 and past detected object information read from the storage unit 110 (step ST1).

[0051] Next, the determination unit 120 determines, based on the classification results, whether or not there are undetected objects around the parking space (step ST2).

[0052] If no undetected objects are present around the parking space (Step ST2: NO), the control unit 130 outputs a warning sound at a low volume from the notification unit 300 (Step ST6).

[0053] If there are undetected objects around the parking space (Step ST2: YES), the determination unit 120 determines whether or not the undetected objects include a person or an animal (Step ST3).

[0054] If the undetected objects include a person or an animal (Step ST3: YES), the control unit 130 causes the notification unit 300 to output a loud warning sound (Step ST4).

[0055] If the undetected objects do not include people or animals (step ST3: NO), the control unit 130 outputs a warning sound at a medium volume from the notification unit 300 (step ST5).

[0056] The operation example of the information processing device 100 according to Embodiment 1 has been described above.

[0057] <Embodiment 2> In Embodiment 1, the case in which the information processing device 100 is applied to an in-vehicle device (for example, a car navigation system) was described as an example. However, the information processing device 100 may also be applied to a mobile terminal used by the user of the vehicle 1 (for example, a smartphone, tablet, etc.). For example, the functions of the determination unit 120 and the control unit 130 described in Embodiment 1 may be executed on the user's mobile terminal. A specific example of this will be described below with reference to Figures 4 and 5.

[0058] First, an example of the configuration of the information processing device 100 and vehicle 1 according to Embodiment 2 will be described using Figure 4. Figure 4 is a block diagram showing an example of the configuration of the information processing device 100 and vehicle 1 according to Embodiment 2. In Figure 4, the same reference numerals are used for the same components as in Figure 1. The explanation of these components will be omitted as appropriate.

[0059] As shown in Figure 4, the vehicle 1 has a storage unit 110, a detection unit 200, and a communication unit 400.

[0060] The communication unit 400 is a communication device that communicates wirelessly with the information processing device 100.

[0061] Specifically, the communication unit 400 transmits current and past detected object information to the information processing device 100. This transmission occurs, for example, when vehicle 1 begins parking in a parking space (more specifically, when an automatic parking instruction operation is performed).

[0062] The information processing device 100 is a terminal device that controls notifications from the notification unit 150 based on detected object information received from the vehicle 1 when the vehicle 1 is automatically parked. For example, as described above, the information processing device 100 may be implemented as a mobile terminal such as a smartphone or tablet.

[0063] Although the explanation will be omitted, the information processing device 100 shown in Figure 4 has the same hardware as in Embodiment 1, as shown in Figure 2, and the following functions are realized thereby.

[0064] As shown in Figure 4, the information processing device 100 includes a determination unit 120, a control unit 130, a communication unit 140, and a notification unit 150.

[0065] The communication unit 140 is a communication device that communicates wirelessly with the vehicle 1.

[0066] Specifically, the communication unit 140 receives current detected object information and past detected object information, for example, when vehicle 1 begins to park in a parking space (more specifically, when an automatic parking execution instruction operation is performed).

[0067] The detected object information received by the communication unit 140 is used in the processing of the determination unit 120, similar to the first embodiment.

[0068] The notification unit 150, similar to the notification unit 300 described in Embodiment 1, is an output device that notifies the user of the vehicle 1 to be aware of the presence of an object in the vicinity of the vehicle 1.

[0069] In this embodiment, the notification unit 150 is assumed to be a speaker provided in a mobile terminal. Furthermore, in this embodiment, the notification is assumed to be the output of a warning sound.

[0070] The volume of the warning sound output from the notification unit 150 is controlled by the control unit 130, as in the first embodiment.

[0071] The above describes an example of the configuration of the information processing device 100 and the vehicle 1 according to Embodiment 2.

[0072] Next, an example of the operation of the information processing device 100 according to Embodiment 2 will be explained using Figure 5. Figure 5 is a flowchart showing an example of the operation of the information processing device 100 according to Embodiment 2.

[0073] The flow shown in Figure 5 starts, for example, when Vehicle 1 is in a predetermined position around the parking space and the user of Vehicle 1 issues an instruction to perform automatic parking. During the automatic parking of Vehicle 1, the user may be inside or outside Vehicle 1.

[0074] Although not shown in the diagram, when an instruction to execute automatic parking is given, the communication unit 400 shown in Figure 4 transmits the current detected object information and past detected object information to the information processing device 100.

[0075] First, the communication unit 140 receives current and past detected object information transmitted from the communication unit 400 (step ST11).

[0076] Next, the determination unit 120 classifies the currently detected object as either a detected object or an undetected object based on the current detected object information and past detected object information (step ST12).

[0077] Next, the determination unit 120 determines, based on the classification results, whether or not there are undetected objects around the parking space (step ST13).

[0078] If no undetected objects are found around the parking space (step ST13: NO), the control unit 130 outputs a warning sound at a low volume from the notification unit 150 (step ST17).

[0079] If there are undetected objects around the parking space (step ST13: YES), the determination unit 120 determines whether or not the undetected objects include a person or an animal (step ST14).

[0080] If the undetected objects include a person or an animal (step ST14: YES), the control unit 130 causes the notification unit 150 to output a loud warning sound (step ST15).

[0081] If the undetected objects do not include people or animals (step ST14: NO), the control unit 130 causes the notification unit 150 to output a warning sound at a medium volume (step ST16).

[0082] The operation example of the information processing device 100 according to Embodiment 2 has been described above.

[0083] <Effects and Effects> The information processing device 100 of Embodiments 1 and 2 is an information processing device 100 that notifies the user of vehicle 1 when an object is present around a parking space, and is characterized by comprising: a storage unit that stores first detected object information (past detected object information) around the parking space during a first (past) parking; an acquisition unit that acquires second detected object information (current detected object information) around the parking space during a second (present) parking performed after the first parking; a determination unit 120 that determines whether there are undetected objects that were not detected during the first parking based on the first detected object information and the second detected object information; and a control unit 130 that changes the notification method if an undetected object is present.

[0084] This feature means that if the risk of parking is potentially greater than in previous instances, the notification will be changed to a more alert format, making it easier for users to notice the notification and improving safety.

[0085] In other words, the information processing device 100 of Embodiments 1 and 2 can further improve notifications to the user when the vehicle is parked.

[0086] Furthermore, in the information processing device 100 of Embodiments 1 and 2, when no undetected objects are present, notifications are issued in a manner that is less alarming than when undetected objects are present, thereby reducing user annoyance and improving convenience.

[0087] Furthermore, in Home Zone Parking Assist, the vehicle follows the same path as when the user was manually driving. More specifically, in Home Zone Parking Assist, the vehicle follows the path that was taken without colliding with any objects during manual driving, so it will not collide with detected objects. Therefore, excessive warnings about detected objects would be annoying to the user. On the other hand, undetected objects still have the potential to collide even in Home Zone Parking Assist, so providing warnings can improve safety.

[0088] <Variation> The embodiments 1 and 2 described above are merely examples of how the present disclosure may be implemented, and the technical scope of the present disclosure should not be limited by them. In other words, the present disclosure can be implemented in various ways without departing from its essence or its main features.

[0089] The following describes some variations applicable to Embodiments 1 and 2.

[0090] [Example 1] In Embodiments 1 and 2, the example described was when the vehicle 1 performs automatic parking, but the parking may also be performed by manual driving.

[0091] In that case, the flow shown in Figures 3 and 5 may be initiated, for example, when Vehicle 1 is in a predetermined position around the parking space and the user of Vehicle 1 performs an operation to reverse Vehicle 1.

[0092] [Differentiation 2] In embodiments 1 and 2, the storage unit 110 was described as storing multiple past detection object information as an example, but the invention is not limited to this.

[0093] For example, past detected object information may consist only of detected object information showing the detection result from the previous (most recent) parking. However, it is preferable to use multiple past detected object information sources because this improves the accuracy of the processing by the determination unit 120.

[0094] [Difference 3] In Embodiments 1 and 2, the mode of notification was described using the volume of the output warning sound as an example, but it may also be the length of the output warning sound.

[0095] For example, if the determination unit 120 determines that no undetected objects exist, the control unit 130 will intermittently output a warning sound of a third length (an example of the third mode) from the notification unit 300 (or notification unit 150; the same applies hereinafter).

[0096] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 intermittently outputs a warning sound from the notification unit 300 that has a second length longer than the third length (an example of the second embodiment).

[0097] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 will continuously output a warning sound from the notification unit 300 that has a first length longer than the second length (an example of the first embodiment).

[0098] The level of warning increases in the order of the third length, the second length, and then the first length.

[0099] Furthermore, the length of the warning sound described in this modified example may be combined with the volume of the warning sound described in Embodiments 1 and 2. That is, the notification mode may be a first length with a high volume, a second length with a medium volume, or a third length with a low volume.

[0100] [Differentiation Example 4] In embodiments 1 and 2, the notification was described using the example of outputting a warning sound, but it may also be the display of an image. In this case, the notification unit 300 could be, for example, the display of a car navigation system. The notification unit 150 could be, for example, the display of a mobile terminal.

[0101] For example, if the determination unit 120 determines that there are no undetected objects, the control unit 130 displays a third image (an example of the third aspect) on the notification unit 300 (or notification unit 150; the same applies hereinafter).

[0102] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 will display a second image (an example of the second form) different from the third image on the notification unit 300.

[0103] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 causes the notification unit 300 to display a first image (an example of the first form) that is different from the third image and the second image.

[0104] The level of warning increases in the order of the third image, the second image, and then the first image. The third image may be an image that indicates the presence of an object that has been detected in the past, for example, using text or pictures. The second image may be an image that indicates the presence of an undetected object, for example, using text or pictures. The first image may be an image that indicates the presence of a human or animal, for example, using text or pictures.

[0105] Alternatively, for example, the third image may be predominantly green, the second image may be predominantly yellow, and the first image may be predominantly red. Furthermore, each image may have at least one of the following properties: saturation, brightness, or luminance.

[0106] Furthermore, in overhead, front, and rear images, when undetected objects are enclosed in a frame and the frames are superimposed, the frames of undetected objects may be displayed in a different color than the frames of detected objects. Alternatively, detected objects may not be enclosed in a frame, while undetected objects may be highlighted by enclosing them in a frame.

[0107] Furthermore, when displaying a virtual wall in front of undetected objects in overhead, front, and rear images, the frame of the undetected object may be displayed in a different color than the frame of the detected object. Alternatively, detected objects may not be surrounded by a frame, while undetected objects may be highlighted by surrounding them with a frame.

[0108] Furthermore, the embodiment of this modification may refer not only to the type of image displayed, but also to the image display pattern. For example, the control unit 130 may display the first image on the notification unit 300 by rapidly blinking it, the second image on the notification unit 300 by slowly blinking it, and the third image on the notification unit 300 without blinking it.

[0109] [Difference 5] In Embodiments 1 and 2, the notification was described using the example of outputting a warning sound, but it may also be vibration of an instrument or device that the user touches. In this case, the notification unit 300 could be, for example, the steering wheel that the user is holding or the seat that the user is sitting in. The notification unit 150 could be, for example, the vibration function of a mobile terminal.

[0110] For example, if the determination unit 120 determines that no undetected objects exist, the control unit 130 vibrates the notification unit 300 (or notification unit 150; the same applies hereinafter) at a third magnitude (an example of the third embodiment).

[0111] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 vibrates the notification unit 300 at a second magnitude greater than the third magnitude (an example of the second embodiment).

[0112] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 vibrates the notification unit 300 at a first magnitude greater than the second magnitude (an example of the first embodiment).

[0113] The level of warning increases in the order of the third size, second size, and first size.

[0114] [Modification 6] In embodiments 1 and 2, if the determination unit 120 determines that an undetected object exists (including cases where the undetected object includes a person or an animal), the control unit 130 may, in addition to outputting a warning sound, display an image on the notification unit 300 (e.g., the display of a car navigation system) or notification unit 150 (e.g., the display of a mobile terminal) that highlights the position of the undetected object relative to the position of the vehicle 1. In this case, the control unit 130 may also display the distance from the vehicle 1 to the undetected object in the image.

[0115] This makes it easier for the user of vehicle 1 to understand the positional relationship between vehicle 1 and undetected objects, thereby further improving safety.

[0116] [Difference 7] In embodiments 1 and 2, if the determination unit 120 determines that no undetected objects exist, the control unit 130 may set a shorter warning distance instead of outputting a warning sound at a low volume. The warning distance is the distance between the vehicle 1 and the detected object at which the output of the warning sound begins.

[0117] This delays the timing of the warning sound, thus reducing user annoyance.

[0118] [Differentiation 8] In embodiments 1 and 2, if the determination unit 120 determines that an undetected object exists, the control unit 130 may, in addition to outputting a warning sound, transmit an instruction to reduce the speed of the vehicle 1 (including an instruction to set the vehicle speed to zero) to the drive system (not shown) of the vehicle 1.

[0119] This reduces the possibility of vehicle 1 coming into contact with an undetected object, thereby further improving safety.

[0120] [Modification 9] In embodiments 1 and 2, the vehicle 1 may have a determination unit (different from the determination unit 120 shown in Figures 1 and 5) that determines whether or not the vehicle 1 is present in the vicinity of the parking space.

[0121] The method for determining whether or not vehicle 1 is present in the vicinity of a parking space may be, for example, a method of comparing location information acquired by an on-board GPS (Global Positioning System) receiver with pre-set location information of the vicinity of the parking space, or a method of comparing images captured by an on-board camera with pre-set images of the vicinity of the parking space (for example, by matching extracted feature points), or a combination of these two methods.

[0122] [Example 10] In Embodiment 2, as shown in Figure 4, the determination unit 120 is provided in the information processing device 100, which is a mobile terminal. However, the determination unit 120 may be provided outside the mobile terminal.

[0123] This specific example will be explained below using Figure 6. Figure 6 is a block diagram showing an example configuration of the information processing devices 100 and 500 according to this modified example. In Figure 6, the same reference numerals are used for the same components as in Figures 1 and 4. Explanations of these components will be omitted as appropriate.

[0124] The information processing device 100 shown in Figure 6 is the same as in Embodiment 2, except that the determination unit 120 is omitted from the configuration shown in Figure 4.

[0125] The information processing device 500 shown in Figure 6 is, for example, a device mounted on vehicle 1. As shown in Figure 6, the information processing device 500 has a storage unit 110, a determination unit 120, a detection unit 200, and a communication unit 400. Note that the detection unit 200 does not necessarily have to be included in the information processing device 500 (however, it is mounted on vehicle 1).

[0126] In this modified example, if the determination unit 120 determines that an undetected object exists, the communication unit 400 transmits change information to the information processing device 100 so that the notification method may be changed.

[0127] For example, if the undetected objects include a person or an animal, the communication unit 400 transmits first change information to the information processing device 100. When the communication unit 140 in the information processing device 100 receives the first change information, the control unit 130 causes the notification unit 150 to perform a notification in the first manner (for example, outputting a loud warning sound).

[0128] Furthermore, for example, if the undetected objects do not include people or animals, the communication unit 400 transmits a second change information to the information processing device 100. When the communication unit 140 in the information processing device 100 receives the second change information, the control unit 130 causes the notification unit 150 to perform a second type of notification (for example, outputting a warning sound at a medium volume).

[0129] Furthermore, for example, if no undetected objects exist, the communication unit 400 transmits a third change information to the information processing device 100. When the communication unit 140 in the information processing device 100 receives the third change information, the control unit 130 causes the notification unit 150 to perform a notification in the third manner (for example, outputting a warning sound at a low volume).

[0130] This modified example may be combined with the modified example 8 described above. Specifically, the information processing device 500 shown in Figure 6 may have a control unit that, in addition to executing a notification (for example, outputting a warning sound) when an undetected object is present, transmits an instruction to reduce the speed of the vehicle 1 (including an instruction to set the vehicle speed to zero) to the drive system (not shown) of the vehicle 1.

[0131] [Example 11] In embodiments 1 and 2, the case where the detection unit 200 is an in-vehicle sensor was used as an example, but the invention is not limited to this.

[0132] For example, the detection unit 200 may be an external sensor located in or near the parking space, capable of short-range wireless communication with a communication device mounted on the vehicle 1 (for example, the communication unit 400 shown in Figure 4).

[0133] In this case, the communication device of vehicle 1 may receive current detected object information from an external sensor when vehicle 1 arrives at a predetermined location around the parking space.

[0134] The above explains the variations. The variations described above may be combined as appropriate. [Industrial applicability]

[0135] The information processing method and information processing device disclosed herein are useful for technologies that assist in vehicle parking. [Explanation of Symbols]

[0136] 1 vehicle 100, 500 Information Processing Devices 110 Storage section 120 Judgment section 130 Control Unit 140 Communications Department 150 Notification Department 200 detection unit 300 Notification Department 400 Communications Department

Claims

1. An information processing method for notifying a vehicle user when an object is present around a parking space, The driving route in the first parking spot is memorized, In the first parking, information on first detected objects around the parking space is acquired, and in the second parking performed after the first parking, information on second detected objects around the parking space is acquired. The first parking is performed by manual driving. The second parking is performed by automatic parking based on the first parking. If an undetected object that was not detected in the first parking is detected in the second parking, the notification method in the first parking and the notification method in the second parking will be different. The notification in the second parking situation is a notification in which a virtual wall is superimposed in front of the undetected object in either the overhead view, the front view, or the rear view. The notification in the second parking includes the first and second aspects, The first embodiment is more effective in attracting the user's attention than the second embodiment. Information processing methods.

2. If the aforementioned undetected object is detected in the second parking area, it is determined whether or not the undetected object includes a person or an animal. If the undetected object includes a person or an animal, the notification in the second parking area is performed in the first manner. If the undetected object does not include a person or an animal, the notification in the second parking is performed in the second manner. The information processing method according to claim 1.

3. If the undetected object is not detected in the second parking area, a notification is performed in the second parking area in a third manner. The second embodiment is more effective in attracting the user's attention than the third embodiment. The information processing method according to claim 1.

4. If the aforementioned undetected object is present, control is performed to reduce the speed of the vehicle. The information processing method according to claim 1.

5. The notification for the second parking situation is displayed on the car navigation system's display. The information processing method according to claim 1.

6. An information processing device that notifies the vehicle user if an object is present around the parking space, A storage unit that stores the driving route during the first parking, The system includes an acquisition unit that acquires first detected object information around the parking space during the first parking, and acquires second detected object information around the parking space during the second parking performed after the first parking, The first parking is performed by manual driving. The second parking is performed by automatic parking based on the first parking. If an undetected object that was not detected in the first parking is detected in the second parking, the notification method in the first parking and the notification method in the second parking will be different. The notification in the second parking situation is a notification in which a virtual wall is superimposed in front of the undetected object in either the overhead view, the front view, or the rear view. The notification in the second parking includes the first and second aspects, The first embodiment is more effective in attracting the user's attention than the second embodiment. Information processing device.

7. If the aforementioned undetected object is detected in the second parking area, a determination unit determines whether or not the undetected object includes a person or an animal. A control unit that, if the undetected object includes a person or an animal, performs a notification in the second parking in the first mode, and if the undetected object does not include a person or an animal, performs a notification in the second parking in the second mode, The information processing apparatus according to claim 6, further comprising:

8. The system further includes a control unit that, if the undetected object is not detected in the second parking area, performs a notification in the second parking area in a third manner, The second embodiment is more effective in attracting the user's attention than the third embodiment. The information processing apparatus according to claim 6.

9. The system further includes a control unit that performs control to reduce the speed of the vehicle if the aforementioned undetected object is present. The information processing apparatus according to claim 6.

10. The notification for the second parking situation is displayed on the car navigation system's display. The information processing apparatus according to claim 6.

Images