Information processing device and information processing method

Abstract

To provide an information processor and an information processing method for further improving notifications to users when vehicles are parked.SOLUTION: An information processor, which notifies a user of a vehicle when an object is present in the vicinity of a parking space, includes: a storage unit for storing first detected object information in the vicinity of the parking space in a first parking session; an acquisition unit for acquiring second detected object information in the vicinity of the parking space in a second parking session performed after the first parking session; a determination unit that determines, based on the first detected object information and the second detected object information, whether there is an undetected object that has not been detected during the first parking session; and a control unit that changes a manner of notification when the undetected object exists.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and an information processing method. [Background technology]

[0002] BACKGROUND ART Conventionally, there is known a device that issues a warning to a vehicle user (for example, a passenger) when an object is present around a parking space where the vehicle is about to park (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2015 / 060354 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional devices have room for improvement in terms of notification.

[0005] An object of the present disclosure is to provide an information processing device and an information processing method that further improve notification to a user when parking a vehicle. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present disclosure is an information processing device that notifies a vehicle user when an object is present in the vicinity of a parking space, the information processing device including: a storage unit that stores first detected object information in the vicinity of the parking space in a first parking; Re an acquisition unit that acquires second detected object information around the parking space in the second parking area; a determination unit that determines whether there is an undetected object that has not been detected in the first parking area based on the first detected object information and the second detected object information; and a control unit that changes the mode of the notification when there is an undetected object. When the undetected object exists, the determination unit determines whether the undetected object includes a person or an animal, and when the undetected object includes a person or an animal, the control unit executes the notification in a first manner, and when the undetected object does not include a person or an animal, the control unit executes the notification in a second manner, and the first manner is a manner that more strongly attracts the user's attention than the second manner..

[0007] An information processing device according to one aspect of the present disclosure is an information processing device that communicates with a mobile terminal that notifies a vehicle user when an object is present in the vicinity of a parking space, the information processing device including: a storage unit that stores first detected object information in the vicinity of the parking space in a first parking; Re an acquisition unit that acquires second detected object information around the parking space in the second parking space; a determination unit that determines whether an undetected object that has not been detected in the first parking space exists based on the first detected object information and the second detected object information; and a communication unit that, if the undetected object exists, transmits change information to the mobile device to change the mode of the notification in the mobile device. When the undetected object exists, the determination unit determines whether the undetected object includes a person or an animal, and when the undetected object includes a person or an animal, the communication unit transmits to the mobile terminal first change information for executing the notification in a first manner, and when the undetected object does not include a person or an animal, transmits to the mobile terminal second change information for executing the notification in a second manner, the first manner being a manner that more strongly attracts the user's attention than the second manner. .

[0008] An information processing method according to one aspect of the present disclosure is an information processing method executed by a device that notifies a vehicle user when an object is present in the vicinity of a parking space, the information processing method including storing first detected object information in the vicinity of the parking space in a first parking, and Re and acquiring second detected object information around the parking space in a second parking space, determining whether there is an undetected object that has not been detected in the first parking space based on the first detected object information and the second detected object information, and if there is an undetected object, changing the manner of the notification. If the undetected object exists, it is determined whether the undetected object includes a person or an animal, and if the undetected object includes a person or an animal, the notification is executed in a first manner, and if the undetected object does not include a person or an animal, the notification is executed in a second manner, and the first manner is a manner that more strongly attracts the user's attention than the second manner.

[0009] An information processing method according to one aspect of the present disclosure is an information processing method executed by a device that communicates with a mobile terminal that notifies a vehicle user when an object is present in the vicinity of a parking space, the information processing method including storing first detected object information in the vicinity of the parking space in a first parking, and Reand acquires second detected object information around the parking space in a second parking space, determines whether there is an undetected object that has not been detected in the first parking space based on the first detected object information and the second detected object information, and if there is an undetected object, transmits information to the mobile device for changing the notification mode in the mobile device. If the undetected object is present, it is determined whether the undetected object includes a person or an animal, and if the undetected object includes a person or an animal, first change information for executing the notification in a first manner is sent to the mobile terminal, and if the undetected object does not include a person or an animal, second change information for executing the notification in a second manner is sent to the mobile terminal, the first manner being a manner that more strongly attracts the user's attention than the second manner. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to provide an information processing device and an information processing method that further improve notifications to a user when parking a vehicle. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram illustrating an example configuration of an information processing device and a vehicle according to a first embodiment of the present disclosure. [Figure 2] FIG. 1 is a diagram schematically illustrating an example of the hardware configuration of a computer included in an information processing device according to first and second embodiments of the present disclosure. [Figure 3] 1 is a flowchart illustrating an example of an operation of an information processing device according to a first embodiment of the present disclosure. [Figure 4] FIG. 10 is a block diagram illustrating an example configuration of an information processing device and a vehicle according to a second embodiment of the present disclosure. [Figure 5] 10 is a flowchart illustrating an example of the operation of an information processing device according to a second embodiment of the present disclosure. [Figure 6] FIG. 16 is a block diagram showing a configuration example of an information processing device according to a tenth modification of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, first and second embodiments of the present disclosure will be described in detail with reference to the drawings.

[0013] <First Embodiment> First, a configuration example of an information processing device 100 and a vehicle 1 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing a configuration example of an information processing device 100 and a vehicle 1 according to the first embodiment.

[0014] 1 is an automobile equipped with an automatic parking assistance function (so-called home zone parking assistance) that can automatically park the vehicle in a predetermined parking space. Note that components for realizing the automatic parking assistance function are not shown in FIG.

[0015] For example, the vehicle 1 automatically drives from a predetermined position around the parking space to the parking space based on a preset route (for example, a route learned based on manual driving), and parks there.

[0016] In this embodiment, the parking space is assumed to be a space where the vehicle 1 has parked in the past and that has been registered (set) in advance. Examples of such parking spaces include a parking space at home or a car sharing facility where the vehicle 1 repeatedly parks. Furthermore, the parking method of the vehicle 1 is assumed to be, for example, backward parking (also called back parking or backward parking). However, this embodiment is also applicable to forward parking (also called forward parking). Furthermore, in the following embodiments, parking performed in the past is also referred to as first parking, and parking currently being performed is also referred to as second parking.

[0017] 1, the vehicle 1 includes an information processing device 100, a detection unit 200, and a notification unit 300. The information processing device 100 is electrically connected to each of the detection unit 200 and the notification unit 300.

[0018] The detection unit 200 is an in-vehicle sensor (for example, a camera, a sonar, a LiDAR, or the like) that detects objects around the vehicle 1.

[0019] For example, when automatic parking of the vehicle 1 is performed, the detection unit 200 detects an object around the parking space (for example, an object existing between the vehicle 1 and the parking space). Then, the detection unit 200 outputs detected object information indicating the characteristics (for example, size, shape, type, etc.) and position of the detected object to the information processing device 100.

[0020] Examples of detected objects include stationary objects such as frames and walls that divide parking spaces, utility poles, trees, and ornaments around the parking spaces. In this embodiment, detected objects include not only the stationary objects but also humans and animals. The detection unit 200 may distinguish between humans and animals based on predetermined size and movement, or may use other known methods to distinguish between humans and animals.

[0021] The notification unit 300 is an output device that notifies the user of the vehicle 1 (for example, the passenger of the vehicle 1).

[0022] For example, when the detection unit 200 detects an object in the vicinity of the parking space where the vehicle 1 is attempting to park, the notification unit 300, under the control of the information processing device 100 (control unit 130), issues a notification (which may also be called a warning) to the user of the vehicle 1 to draw their attention.

[0023] In this embodiment, it is assumed that notification unit 300 is a speaker of a car navigation system provided in the vehicle cabin. Also, in this embodiment, it is assumed that notification is the output of a predetermined sound (hereinafter referred to as a warning sound).

[0024] The information processing device 100 is a computer that controls notification by the notification unit 300 based on the detection result by the detection unit 200 when automatic parking of the vehicle 1 is performed. For example, the information processing device 100 may be realized by a control computer of a car navigation system.

[0025] As shown in FIG. 2, the information processing device 100 has, as hardware, for example, a CPU (Central Processing Unit) 501, a main memory device 502 such as a ROM (Read Only Memory) 502 or a RAM (Random Access Memory), a hard disk storing computer programs, an auxiliary memory device 503 such as a flash memory, and a bus 504 connecting them.

[0026] The functions of the information processing device 100 described below are realized by the CPU 501 loading a computer program read from the auxiliary storage device 503 into the RAM of the main storage device 502 and executing the program. Note that the computer program may be recorded on a predetermined recording medium and provided to a user or the like.

[0027] As shown in FIG. 1, the information processing device 100 includes a storage unit 110, a determination unit 120, and a control unit .

[0028] The storage unit 110 stores the detected object information acquired from the detection unit 200.

[0029] The detected object information is acquired by the detection unit 200 every time the vehicle 1 is parked in a predetermined parking space, and is stored in the memory unit 110. As a result, the memory unit 110 accumulates multiple pieces of past detected object information as learning information.

[0030] Based on the current and past detected object information, the determination unit 120 determines whether or not there is an object (hereinafter referred to as an undetected object) that has not been detected in the past and has been newly detected this time in the vicinity of the current parking space. This will be explained in detail below.

[0031] This determination process is performed, for example, when the vehicle 1 stops at a predetermined position around a parking space and the information processing device 100 receives an instruction operation to execute automatic parking (for example, pressing a button by the user of the vehicle 1).

[0032] When the above operation is performed, first, determination unit 120 acquires current detected object information (an example of second detected object information) from detection unit 200, and reads out past detected object information (an example of first detected object information) from storage unit 110. Note that determination unit 120 also corresponds to an example of an acquisition unit that acquires detected object information (the same applies to the second embodiment and each modified example described below).

[0033] Then, based on the current detected object information and the past detected object information, the determination unit 120 classifies the detected object at the current time (for example, at the time when the automatic parking execution instruction operation is performed) as either a detected object or an undetected object.

[0034] A detected object is an object that was detected when the vehicle was previously parked, while an undetected object is an object that was not detected when the vehicle was previously parked and has now been newly detected, as described above.

[0035] The above-mentioned classification is performed, for example, using a machine learning similarity classification technique that compares the features of an object with the features of a learned detected object. In this case, an undetected object may be referred to as an unlearned object, and a detected object may be referred to as a learned object. Note that the above classification may also be performed using other known techniques.

[0036] If the classification result indicates that there is at least one undetected object, the determination unit 120 determines that there is an undetected object in the vicinity of the parking space. On the other hand, if there is no undetected object, the determination unit 120 determines that there is no undetected object in the vicinity of the parking space.

[0037] Furthermore, if there is even one undetected object, the determination unit 120 determines whether or not the undetected object includes a person or an animal.

[0038] It should be noted that the determination process (processing for determining the type of object) here can be performed using known techniques such as machine learning, and therefore a description thereof will be omitted.

[0039] The control unit 130 controls the notification performed by the notification unit 300 .

[0040] In this embodiment, control unit 130 controls the volume (sound volume) of the warning sound output from notification unit 300 in accordance with the determination result of determination unit 120. This will be explained in detail below.

[0041] If the determination unit 120 determines that there are no undetected objects (in other words, there are only detected objects), the control unit 130 causes the notification unit 300 to output a warning sound at a low volume (an example of the third aspect).

[0042] If the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 causes the notification unit 300 to output a warning sound at a medium volume (an example of the second aspect).

[0043] If the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 outputs a loud warning sound (an example of the first mode).

[0044] The volume of the warning sound increases in the order of low, medium, and high. Therefore, the level of attention increases in the order of low, medium, and high. Note that if the determination unit 120 determines that no undetected object exists, the control unit 130 may cause the notification unit 300 to output a warning sound at a volume set by the user, and if the determination unit 120 determines that an undetected object exists, the control unit 130 may cause the notification unit 300 to output a warning sound at a volume higher than the volume set by the user.

[0045] As described above, in this embodiment, when the determination unit 120 determines that an undetected object is present, the control unit 130 increases the volume of the warning sound.

[0046] The warning sound may be output before the vehicle 1 starts moving toward the parking space, or may be output when the distance between the vehicle 1 moving toward the parking space and the undetected object becomes less than a predetermined value. However, if an undetected object exists (in the case of outputting a medium or high volume), it is preferable to notify the user as early as possible from the viewpoint of safety, so it is preferable to output the warning sound before the vehicle 1 starts moving.

[0047] Additionally, the current detected object information is stored in the storage unit 110 and is used as the past detected object information the next time the vehicle is parked.

[0048] In addition, when the control unit 130 changes the volume of the warning sound to medium or high, it changes it to low volume, for example, after parking of the vehicle 1 is completed (for example, when the ignition is turned off or the next time the ignition is turned on).

[0049] The configuration examples of the information processing device 100 and the vehicle 1 according to the first embodiment have been described above.

[0050] Next, an example of the operation of the information processing device 100 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of the operation of the information processing device 100 according to the first embodiment.

[0051] The flow shown in FIG. 3 starts, for example, when the vehicle 1 is located at a predetermined position around a parking space and the user of the vehicle 1 performs an operation to instruct execution of automatic parking.

[0052] First, the determination unit 120 classifies the currently detected object as either a detected object or an undetected object based on the currently detected object information acquired from the detection unit 200 and the past detected object information read from the memory unit 110 (step ST1).

[0053] Next, the determination unit 120 determines whether or not an undetected object exists around the parking space based on the classification result (step ST2).

[0054] If there is no undetected object around the parking space (step ST2: NO), the control unit 130 causes the notification unit 300 to output a warning sound at a low volume (step ST6).

[0055] If an undetected object is present around the parking space (step ST2: YES), the determination unit 120 determines whether the undetected object includes a person or an animal (step ST3).

[0056] If the undetected objects include a person or an animal (step ST3: YES), the control unit 130 causes the notification unit 300 to output a warning sound at a high volume (step ST4).

[0057] If the undetected objects do not include a person or an animal (step ST3: NO), the control unit 130 causes the notification unit 300 to output a warning sound at a medium volume (step ST5).

[0058] An example of the operation of the information processing device 100 according to the first embodiment has been described above.

[0059] <Embodiment 2> In the first embodiment, the case where the information processing device 100 is applied to an in-vehicle device (for example, a car navigation system) has been described as an example, but the information processing device 100 may also be applied to a mobile terminal (for example, a smartphone, a tablet, etc.) used by a user of the vehicle 1. For example, the functions of the determination unit 120 and the control unit 130 described in the first embodiment may be executed by the user's mobile terminal. A specific example of this will be described below with reference to FIGS. 4 and 5.

[0060] First, a configuration example of the information processing device 100 and the vehicle 1 according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing a configuration example of the information processing device 100 and the vehicle 1 according to the second embodiment. In Fig. 4, the same components as those in Fig. 1 are denoted by the same reference numerals. Description of these components will be omitted where appropriate.

[0061] As shown in FIG. 4, the vehicle 1 includes a storage unit 110, a detection unit 200, and a communication unit 400.

[0062] The communication unit 400 is a communication device that performs wireless communication with the information processing device 100 .

[0063] Specifically, the communication unit 400 transmits the current detected object information and the past detected object information to the information processing device 100. This transmission is performed, for example, when the vehicle 1 starts parking in a parking space (more specifically, when an instruction to execute automatic parking is given).

[0064] The information processing device 100 is a terminal device that controls notification by the notification unit 150 based on detected object information received from the vehicle 1 when automatic parking of the vehicle 1 is performed. For example, as described above, the information processing device 100 may be realized by a mobile terminal such as a smartphone or a tablet.

[0065] Although the description will be omitted, the information processing device 100 shown in FIG. 4 has the hardware shown in FIG. 2, as in the first embodiment, and thereby realizes the following functions.

[0066] As shown in FIG. 4, the information processing device 100 includes a determination unit 120, a control unit 130, a communication unit 140, and a notification unit 150.

[0067] The communication unit 140 is a communication device that performs wireless communication with the vehicle 1 .

[0068] Specifically, the communication unit 140 receives current detected object information and past detected object information, for example, when the vehicle 1 starts parking in a parking space (more specifically, when an instruction operation to execute automatic parking is performed).

[0069] The detected object information received by communication section 140 is used in processing by determination section 120, as in the first embodiment.

[0070] The notification unit 150 is an output device that issues a warning to the user of the vehicle 1 when an object is present around the vehicle 1, similar to the notification unit 300 described in the first embodiment.

[0071] In this embodiment, it is assumed that the notification unit 150 is a speaker provided in the mobile terminal, and that the notification is the output of a warning sound.

[0072] The volume of the warning sound output from the notification unit 150 is controlled by the control unit 130, as in the first embodiment.

[0073] The configuration examples of the information processing device 100 and the vehicle 1 according to the second embodiment have been described above.

[0074] Next, an example of the operation of the information processing device 100 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the operation of the information processing device 100 according to the second embodiment.

[0075] 5 starts, for example, when vehicle 1 is located at a predetermined position near a parking space and an instruction operation to execute automatic parking is performed by the user of vehicle 1. Note that while automatic parking of vehicle 1 is being performed, the user may be inside or outside vehicle 1.

[0076] Although not shown in the drawing, when an instruction to execute automatic parking is given, communication unit 400 shown in FIG. 4 transmits current detected object information and past detected object information to information processing device 100.

[0077] First, communication section 140 receives the current detected object information and the past detected object information transmitted from communication section 400 (step ST11).

[0078] Next, the determination unit 120 classifies the currently detected object into either a detected object or an undetected object based on the currently detected object information and the past detected object information (step ST12).

[0079] Next, the determination unit 120 determines whether or not an undetected object exists around the parking space based on the classification result (step ST13).

[0080] If there is no undetected object around the parking space (step ST13: NO), the control unit 130 causes the notification unit 150 to output a warning sound at a low volume (step ST17).

[0081] If an undetected object is present around the parking space (step ST13: YES), the determination unit 120 determines whether the undetected object includes a person or an animal (step ST14).

[0082] If the undetected objects include a person or an animal (step ST14: YES), the control unit 130 causes the notification unit 150 to output a warning sound at a high volume (step ST15).

[0083] If the undetected objects do not include a person or an animal (step ST14: NO), the control unit 130 causes the notification unit 150 to output a warning sound at a medium volume (step ST16).

[0084] An example of the operation of the information processing device 100 according to the second embodiment has been described above.

[0085] <Action and effect> The information processing device 100 of embodiments 1 and 2 is an information processing device 100 that notifies the user of the vehicle 1 when an object is present in the vicinity of a parking space, and is characterized by having a memory unit that stores first detected object information (past detected object information) around the parking space in a first (past) parking, an acquisition unit that acquires second detected object information (current detected object information) around the parking space in a second (current) parking that is performed after the first parking, a determination unit 120 that determines whether there is an undetected object that has not been detected in the first parking based on the first detected object information and the second detected object information, and a control unit 130 that changes the mode of notification when an undetected object is present.

[0086] With this feature, if there is a possibility that the risk is greater than when parking in the past, the notification will be changed to a more alert notification, making it easier for the user to notice the notification and improving safety.

[0087] That is, the information processing device 100 according to the first and second embodiments can further improve the notification to the user when parking the vehicle.

[0088] Furthermore, in the information processing device 100 of the first and second embodiments, when there is no undetected object, the notification is executed in a manner that calls for less attention than when there is an undetected object, thereby reducing the annoyance for the user and improving convenience.

[0089] Furthermore, with home zone parking assistance, the vehicle travels along the same route as when the user was driving manually. Furthermore, with home zone parking assistance, the vehicle travels along the same route as when the user was driving manually, so it will not collide with detected objects. Therefore, excessive warnings about detected objects can be irritating to the user. On the other hand, because undetected objects may still collide with the home zone parking assistance, warnings can improve safety.

[0090] <Modification> The first and second embodiments described above are merely examples of specific embodiments for carrying out the present disclosure, and the technical scope of the present disclosure should not be construed as being limited by them. In other words, the present disclosure can be embodied in various forms without departing from the gist or main features thereof.

[0091] Modifications applicable to the first and second embodiments will be described below.

[0092] [Variation 1] In the first and second embodiments, the vehicle 1 is described as performing automatic parking, but the vehicle 1 may be manually parked.

[0093] In this case, the flow shown in Figures 3 and 5 may be started, for example, when vehicle 1 is located at a predetermined position around the parking space and the user of vehicle 1 performs an operation to reverse vehicle 1.

[0094] [Variation 2] In the first and second embodiments, the case where a plurality of pieces of past detected object information are stored in storage unit 110 has been described as an example, but the present invention is not limited to this.

[0095] For example, the past detected object information may be only the detected object information indicating the detection result at the previous (most recent) parking. However, it is preferable to use multiple pieces of past detected object information because this improves the accuracy of the processing by the determination unit 120.

[0096] [Variation 3] In the first and second embodiments, the notification mode is explained as being the volume of the output warning sound, but it may be the length of the output warning sound.

[0097] For example, if the determination unit 120 determines that there is no undetected object, the control unit 130 causes the notification unit 300 (or the notification unit 150; the same applies below) to intermittently output a warning sound of a third length (an example of a third aspect).

[0098] Furthermore, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 causes the notification unit 300 to intermittently output a warning sound of a second length (an example of the second aspect) that is longer than the third length.

[0099] Also, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 causes the notification unit 300 to continuously output a warning sound of a first length (an example of a first aspect) that is longer than the second length.

[0100] The degree of warning increases in the order of the third length, the second length, and the first length.

[0101] The length of the warning sound described in this modification may be combined with the volume of the warning sound described in the first and second embodiments. That is, the notification mode may be a first length and a high volume, a second length and a medium volume, and a third length and a low volume.

[0102] [Variation 4] In the first and second embodiments, the notification is explained as an example of outputting a warning sound, but it may be an image display. In this case, the notification unit 300 may be, for example, a display of a car navigation system. Furthermore, the notification unit 150 may be, for example, a display of a mobile terminal.

[0103] For example, if the determination unit 120 determines that there is no undetected object, the control unit 130 causes the notification unit 300 (or the notification unit 150; the same applies below) to display a third image (an example of a third aspect).

[0104] Also, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 causes the notification unit 300 to display a second image (an example of the second aspect) different from the third image.

[0105] Also, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 causes the notification unit 300 to display a first image (an example of the first aspect) that is different from the third image and the second image.

[0106] The level of alertness increases in the order of the third image, the second image, and the first image. The third image may be, for example, an image indicating, by text, a picture, or the like, that an object previously detected is present. The second image may be an image indicating, by text, a picture, or the like, that an undetected object is present. The first image may be an image indicating, by text, a picture, or the like, that a human or animal is present.

[0107] Alternatively, for example, the third image may be a green-based image, the second image may be a yellow-based image, and the first image may be a red-based image. Also, at least one of saturation, lightness, and luminance may be different for each image.

[0108] Furthermore, when undetected objects are surrounded by frames in the overhead image, front image, and rear image and the frames are displayed in a superimposed manner, the frames of the undetected objects may be displayed in a color different from the frames of the detected objects.Furthermore, undetected objects may be highlighted by surrounding them with frames without surrounding detected objects with frames.

[0109] Furthermore, when a virtual wall is superimposed in front of an undetected object in an overhead image, a front image, or a rear image, the frame of the undetected object may be displayed in a color different from that of the frame of a detected object. Also, the undetected object may be highlighted by being surrounded by a frame, without surrounding the detected object with a frame.

[0110] Note that this modified example may be implemented not only by the type of image to be displayed, but also by the image display pattern. For example, control unit 130 may cause notification unit 300 to display a first image by flashing it quickly, a second image by flashing it slowly, and a third image by not flashing it.

[0111] [Variation 5] In the first and second embodiments, the notification is explained as an example of outputting a warning sound, but it may be vibration of an appliance or device that the user touches. In this case, the notification unit 300 may be, for example, a steering wheel held by the user or a seat on which the user is seated. Furthermore, the notification unit 150 may be, for example, a vibration function of a mobile terminal.

[0112] For example, if the determination unit 120 determines that there is no undetected object, the control unit 130 vibrates the notification unit 300 (or the notification unit 150; the same applies below) at a third magnitude (an example of a third mode).

[0113] Also, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object does not include a person or an animal, the control unit 130 vibrates the notification unit 300 at a second magnitude (an example of a second aspect) greater than the third magnitude.

[0114] Also, for example, if the determination unit 120 determines that an undetected object exists and that the undetected object includes a person or an animal, the control unit 130 vibrates the notification unit 300 at a first magnitude (an example of a first aspect) that is greater than the second magnitude.

[0115] The degree of warning increases in the order of third, second, and first magnitude.

[0116] [Variation 6] In the first and second embodiments, when the determination unit 120 determines that an undetected object exists (including the case where the undetected object includes a person or an animal), the control unit 130 may output an alarm sound and may also cause the notification unit 300 (for example, a display of a car navigation system) or the notification unit 150 (for example, a display of a mobile terminal) to display an image that highlights the position of the undetected object relative to the position of the vehicle 1. In addition, at this time, the control unit 130 may cause the image to display the distance from the vehicle 1 to the undetected object.

[0117] This makes it easier for the user of the vehicle 1 to understand the positional relationship between the vehicle 1 and the undetected object, thereby further improving safety.

[0118] [Variation 7] In the first and second embodiments, when the determination unit 120 determines that no undetected object exists, the control unit 130 may set a short warning distance instead of outputting a warning sound at a low volume. The warning distance is the distance between the vehicle 1 and the detected object at which output of the warning sound starts.

[0119] This delays the timing at which the warning sound is output, thereby reducing the annoyance to the user.

[0120] [Variation 8] In embodiments 1 and 2, when the judgment unit 120 determines that an undetected object exists, the control unit 130 may, in addition to outputting a warning sound, send an instruction to reduce the speed of the vehicle 1 (including an instruction to set the vehicle speed to zero) to the drive system (not shown) of the vehicle 1.

[0121] This reduces the possibility that the vehicle 1 will come into contact with an undetected object, further improving safety.

[0122] [Variation 9] In the first and second embodiments, the vehicle 1 may have a determination unit (different from the determination unit 120 shown in FIGS. 1 and 5) that determines whether the vehicle 1 is present in the vicinity of a parking space.

[0123] The method of determining whether vehicle 1 is located near a parking space may be, for example, a method of comparing location information acquired by an on-board GPS (Global Positioning System) receiver with location information around a pre-set parking space, a method of comparing an image captured by an on-board camera with an image around a pre-set parking space (for example, by comparing extracted feature points), or a combination of these two methods.

[0124] [Variation 10] In the second embodiment, as shown in FIG. 4, the case where the determination unit 120 is provided in the information processing device 100, which is a mobile terminal, has been exemplified, but the determination unit 120 may be provided outside the mobile terminal.

[0125] A specific example of this will be described below with reference to Fig. 6. Fig. 6 is a block diagram showing an example of the configuration of information processing devices 100 and 500 according to this modification. In Fig. 6, the same components as those in Figs. 1 and 4 are denoted by the same reference numerals. Description of these components will be omitted where appropriate.

[0126] The information processing device 100 shown in FIG. 6 is the same as that of the second embodiment except that the determination unit 120 is omitted from the configuration shown in FIG.

[0127] The information processing device 500 shown in Fig. 6 is, for example, a device mounted on the vehicle 1. As shown in Fig. 6, the information processing device 500 has a storage unit 110, a determination unit 120, a detection unit 200, and a communication unit 400. Note that the detection unit 200 does not have to be included in the information processing device 500 (however, it is mounted on the vehicle 1).

[0128] In this modification, when the determination unit 120 determines that an undetected object exists, the communication unit 400 transmits to the information processing device 100 change information for changing the mode of notification in the information processing device 100.

[0129] For example, when the undetected object includes a person or an animal, the communication unit 400 transmits first change information to the information processing device 100. In the information processing device 100, when the communication unit 140 receives the first change information, the control unit 130 causes the notification unit 150 to execute notification in a first manner (for example, outputting a warning sound at a high volume).

[0130] Furthermore, for example, when the undetected objects do not include a person or an animal, the communication unit 400 transmits second change information to the information processing device 100. In the information processing device 100, when the communication unit 140 receives the second change information, the control unit 130 causes the notification unit 150 to execute notification in a second manner (for example, outputting a warning sound at a medium volume).

[0131] Furthermore, for example, when there is no undetected object, the communication unit 400 transmits third change information to the information processing device 100. In the information processing device 100, when the communication unit 140 receives the third change information, the control unit 130 causes the notification unit 150 to execute notification in a third manner (for example, outputting a warning sound at a low volume).

[0132] This modification may be combined with the above-described modification 8. Specifically, the information processing device 500 shown in Fig. 6 may have a control unit that, when an undetected object is present, not only performs notification (e.g., outputs a warning sound) but also transmits an instruction to reduce the speed of the vehicle 1 (including an instruction to set the vehicle speed to zero) to a drive system (not shown) of the vehicle 1.

[0133] [Variation 11] In the first and second embodiments, the detection unit 200 is an in-vehicle sensor, but the present invention is not limited to this.

[0134] For example, the detection unit 200 may be an external sensor that is provided in or near a parking space and is capable of short-range wireless communication with a communication device (for example, the communication unit 400 shown in FIG. 4) mounted on the vehicle 1.

[0135] In this case, the communication device of the vehicle 1 may receive the currently detected object information from the external sensor when the vehicle 1 arrives at a predetermined position around the parking space.

[0136] The above-described modified examples may be combined as appropriate. [Industrial Applicability]

[0137] The information processing device and information processing method of the present disclosure are useful for technology that assists in parking a vehicle. [Explanation of symbols]

[0138] 1 vehicle 100, 500 Information processing equipment 110 Storage section 120 Judgment section 130 control section 140 Communications Department 150 Notification Department 200 Detection unit 300 Notification Department 400 Communications Department

Claims

1. An information processing device that notifies a vehicle user when an object is present in the vicinity of a parking space, a storage unit that stores first detected object information around the parking space in the first parking; an acquisition unit that acquires second detected object information around the parking space in a second parking operation that is performed after the first parking operation; a determination unit that determines whether an undetected object that has not been detected in the first parking area exists based on the first detected object information and the second detected object information; a control unit that changes the manner of the notification when the undetected object is present, The determination unit If the undetected object exists, determining whether the undetected object includes a person or an animal; The control unit If the undetected object includes a person or an animal, the notification is performed in a first manner; If the undetected object does not include a person or an animal, the notification is performed in a second manner; The first aspect is a manner that more strongly attracts the user's attention than the second manner; Information processing device.

2. The control unit If the undetected object is present, change the notification mode to a mode different from the notification mode in the first parking. The information processing device according to claim 1 .

3. The control unit If the undetected object is not present, the notification is performed in a third manner that calls the user's attention less strongly than the second manner. The information processing device according to claim 1 .

4. the notification is an output of sound; The aspect is the volume of the sound. The information processing device according to claim 1 .

5. the notification is a display of an image; The aspect is the type of the image. The information processing device according to claim 1 .

6. the notification is a vibration of an implement that the user touches; The aspect is the magnitude of the vibration. The information processing device according to claim 1 .

7. The control unit If the undetected object is present, control is performed to reduce the speed of the vehicle. The information processing device according to claim 1 .

8. The information processing device is a device mounted on the vehicle. The information processing device according to claim 1 .

9. the information processing device is a mobile terminal used by a user of the vehicle, The information processing device according to claim 1 .

10. An information processing device that communicates with a mobile terminal that notifies a vehicle user when an object is present in the vicinity of a parking space, a storage unit that stores first detected object information around the parking space in the first parking; an acquisition unit that acquires second detected object information around the parking space in a second parking operation that is performed after the first parking operation; a determination unit that determines whether an undetected object that has not been detected in the first parking area exists based on the first detected object information and the second detected object information; a communication unit that transmits, to the mobile terminal, change information for changing the mode of the notification in the mobile terminal when the undetected object is present; The determination unit If the undetected object exists, determining whether the undetected object includes a person or an animal; The communication unit If the undetected object includes a person or an animal, transmitting first change information to the mobile terminal for executing the notification in a first manner; If the undetected object does not include a person or an animal, second change information for executing the notification in a second manner is transmitted to the mobile terminal; The first aspect is a manner that more strongly attracts the user's attention than the second manner; Information processing device.

11. The communication unit If the undetected object is present, the change information for changing the notification mode in the mobile terminal to a mode different from the notification mode in the first parking is transmitted to the mobile terminal. The information processing device according to claim 10.

12. The communication unit If the undetected object is not present, third change information is transmitted to the mobile terminal to execute the notification in a third manner that attracts the user's attention less strongly than the second manner. The information processing device according to claim 10.

13. the notification is an output of sound; The aspect is the volume of the sound. The information processing device according to claim 10.

14. the notification is a display of an image; The aspect is the type of the image. The information processing device according to claim 10.

15. the notification is a vibration of an implement that the user touches; The aspect is the magnitude of the vibration. The information processing device according to claim 10.

16. Further, a control unit performs control to reduce the speed of the vehicle when the undetected object is present. The information processing device according to claim 10.

17. The information processing device is a device mounted on the vehicle. The information processing device according to claim 10.

18. 1. An information processing method executed by a device that notifies a vehicle user when an object is present in the vicinity of a parking space, comprising: storing first detected object information around the parking space in the first parking; acquiring second detected object information around the parking space in a second parking operation performed after the first parking operation; determining whether an undetected object exists in the first parking area based on the first detected object information and the second detected object information; If the undetected object exists, change the manner of the notification; If the undetected object exists, determining whether the undetected object includes a person or an animal; If the undetected object includes a person or an animal, the notification is performed in a first manner; If the undetected object does not include a person or an animal, the notification is performed in a second manner; The first aspect is a manner that more strongly attracts the user's attention than the second manner; Information processing methods.

19. An information processing method executed by a device that communicates with a mobile terminal that notifies a vehicle user when an object is present in the vicinity of a parking space, comprising: storing first detected object information around the parking space in the first parking; acquiring second detected object information around the parking space in a second parking operation performed after the first parking operation; determining whether an undetected object exists in the first parking area based on the first detected object information and the second detected object information; If the undetected object exists, information for changing the mode of the notification in the mobile terminal is transmitted to the mobile terminal; If the undetected object exists, determining whether the undetected object includes a person or an animal; If the undetected object includes a person or an animal, transmitting first change information to the mobile terminal for executing the notification in a first manner; If the undetected object does not include a person or an animal, second change information for executing the notification in a second manner is transmitted to the mobile terminal; The first aspect is a manner that more strongly attracts the user's attention than the second manner; Information processing methods.

Images