Information processing device, information processing method, program, and projection system

Abstract

An information processing device according to one embodiment of the present invention comprises an acquisition unit and a projection control unit. The acquisition unit acquires speed-related information regarding the speed of a vehicle. The projection control unit uses the speed-related information as a basis to control the display of a projection pattern projected onto the road surface around the vehicle from a projection unit mounted to the vehicle.

Description

[Technical field]

[0001] The present technology relates to an information processing device, an information processing method, a program, and a projection device that can be applied to display control of a projection pattern projected from a vehicle onto a road surface. [Background technology]

[0002] Patent Document 1 describes a predicted driving trajectory display device that displays a predicted driving trajectory of a vehicle on the ground surface. In this device, the predicted driving trajectory of the vehicle is calculated from the steering angle of the steering wheel of the vehicle and forward / reverse information indicating the forward / reverse of the vehicle. Then, the irradiation angle of a laser emitter mounted on the vehicle is controlled, and the predicted driving trajectory is drawn on the ground surface (paragraphs

[0021] ,

[0022] ,

[0023] , FIG. 7, etc. of the specification of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-036005 A Summary of the Invention [Problem to be solved by the invention]

[0004] In this way, by displaying the direction of travel outside the vehicle, it is possible to inform pedestrians outside the vehicle and drivers of other vehicles of the vehicle's destination. However, it can be difficult to confirm the vehicle's behavior, such as acceleration or deceleration, from outside the vehicle. For this reason, there is a demand for technology that can communicate the vehicle's behavior to the outside of the vehicle in an easy-to-understand manner.

[0005] In view of the above circumstances, an object of the present technology is to provide an information processing device, an information processing method, a program, and a projection device that are capable of communicating vehicle behavior to the outside of the vehicle in an easily understandable manner. [Means for solving the problem]

[0006] In order to achieve the above object, an information processing device according to an embodiment of the present technology includes an acquisition unit and a projection control unit. The acquisition unit acquires speed-related information regarding a speed of a vehicle. The projection control unit controls display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle, based on the speed-related information.

[0007] In this information processing device, a projection pattern is projected onto the surrounding road surface from a projection unit installed in the vehicle. The display of this projection pattern is controlled based on speed-related information related to the vehicle's speed. This makes it possible to change the projection pattern according to the vehicle's behavior, making it possible to easily communicate the vehicle's behavior to those outside the vehicle.

[0008] An information processing method according to one embodiment of the present technology is an information processing method executed by a computer system, and includes obtaining speed-related information regarding a speed of a vehicle. A display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle is controlled based on the speed-related information.

[0009] A program according to one embodiment of the present technology causes a computer system to execute the following steps. Obtaining speed-related information regarding the speed of the vehicle. A step of controlling display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle based on the speed-related information.

[0010] A projection device according to an embodiment of the present technology includes a projection unit, an acquisition unit, and a projection control unit. The projection unit is mounted on a vehicle and projects a projection pattern onto a road surface around the vehicle. The acquisition unit acquires speed-related information regarding a speed of the vehicle. The projection control unit controls display of the projection pattern projected from the projection unit based on the speed-related information. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic diagram showing the appearance of a vehicle equipped with a projection device according to a first embodiment of the present technology. [Diagram 2] FIG. 4 is a schematic diagram showing an example of a projection pattern. [Diagram 3] 1 is a schematic diagram showing an example of a scene onto which a projection pattern is projected. FIG. [Figure 4] 1 is a block diagram showing an example of the configuration of a projection device according to a first embodiment. [Diagram 5] 10 is a flowchart showing an example of a basic operation of the projection device. [Figure 6] 6 is a time chart showing an example of display control of a line pattern. [Figure 7] 2 is a schematic diagram showing an example of a line pattern according to the running state of the vehicle 1. FIG. [Figure 8] 11 is a table showing an example of control of the width of a line pattern. [Figure 9] 11 is a table showing an example of control of the length of a line pattern. [Figure 10] FIG. 2 is a schematic diagram for explaining a standard blind spot distance L0. [Figure 11] FIG. 11 is a block diagram showing an example of the configuration of a projection device according to a second embodiment. [Figure 12] 4 is a block diagram showing an example of the configuration of a surrounding environment recognition unit; [Figure 13] 10 is a flowchart showing an example of a basic operation of the projection device. [Figure 14] 10A and 10B are schematic diagrams showing an example of a rear pattern according to the degree of brake operation; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[0013] <First embodiment> Fig. 1 is a schematic diagram showing the appearance of a vehicle equipped with a projection device according to a first embodiment of the present technology. Fig. 1A is a perspective view showing a configuration example of the vehicle 1, and Fig. 1B is a top view of the vehicle 1. The vehicle 1 is equipped with a projection device 100 that projects an image onto a road surface around the vehicle 1.

[0014] The projection device 100 has a plurality of projection units 10. The projection units 10 are elements (projectors) that project images by irradiating light onto a road surface. Hereinafter, the images projected from the projection units 10 onto the road surface around the vehicle 1 will be referred to as projection patterns. In the projection device 100, it is possible to individually control the projection patterns projected from each projection unit 10. The specific configuration of the projection units 10 will be described later.

[0015] 1A and 1B show eight projection units 10a to 10h provided on a vehicle 1. In the example shown in Fig. 1, the projection units 10a to 10d and the projection units 10e to 10h are arranged symmetrically to each other on the left and right sides of the bottom of the vehicle 1. Projection units 10a and 10e are disposed at the bottom of the front side of vehicle 1 (e.g., the bottom of the front bumper) and project a projection pattern, for example, in front of vehicle 1. Projection units 10b and 10f are disposed at the bottom of the front side of the front door, and projection units 10c and 10g are disposed at the bottom of the rear side of the rear door. Projection units 10b and 10f and projection units 10c and 10g project a projection pattern, for example, to the side of vehicle 1. Projection units 10d and 10h are disposed at the bottom of the rear side of vehicle 1 (e.g., the bottom of the rear bumper) and project a projection pattern, for example, to the rear of vehicle 1. 1B, for the sake of convenience, each projection unit 10 (projector) is shown protruding from the vehicle body so that the position of each projection unit 10 (projector) in the top view of the vehicle 10 can be seen. In an actual configuration, the projection units 10 are housed under the vehicle body and installed so as not to be visible from above. This makes it possible to mount the projection device 100 without impairing the appearance of the vehicle 10. 1B, each projection unit 10 may be installed so as to protrude from the vehicle body. This makes it possible to expand the range over which a projection pattern can be projected, for example.

[0016] The arrangement and number of the projection units 10 are not limited. For example, the projection unit 10 (projection units 10a and 10e in FIG. 1) that projects a pattern ahead of the vehicle 10 may be installed on the front of the vehicle body. Specifically, the projection unit 10 may be provided around the headlights (above, below, left, and right of the headlights, etc.) or around the fog lamps (above, below, left, and right of the fog lamps, etc.). The projection unit 10 may also be provided at the position of the front grille or in the center of the entire vehicle body. Furthermore, projection patterns for the left front and right front may be projected from a single projection unit 10. Furthermore, for example, the projection unit 10 (projection units 10b, 10c, 10f, and 10g in FIG. 1) that projects a pattern onto the side of the vehicle 10 may be provided at the bottom of a side mirror or on the lower side of a B-pillar that separates the front and rear doors (at the center in the front-to-rear direction of the vehicle). Furthermore, for example, the projection units 10 (projection units 10d and 10h in FIG. 1) that project a pattern rearward of the vehicle 10 may be installed on the rear surface of the vehicle body. Specifically, the projection units 10 may be provided around the brake lights (above, below, left, and right of the brake lights, etc.), around the license plate (above, below, left, and right of the license plate, etc.), or in the center of the rear surface of the vehicle body, etc. Furthermore, the projection patterns for the left rear and right rear may be projected from one projection unit 10. Alternatively, the projection unit 10 may be appropriately disposed at a position where a desired projection pattern can be projected.

[0017] Fig. 2 is a schematic diagram showing an example of a projection pattern, and Fig. 3 is a schematic diagram showing an example of a scene onto which the projection pattern is projected. In this embodiment, a plurality of projection modes are selected according to the operating conditions of the vehicle 1, and a projection pattern 2 corresponding to the projection mode is projected. 2A to 2D are schematic diagrams illustrating the projection patterns 2 projected in each of the projection modes, namely, the normal driving mode, the low-speed driving mode, the reverse mode, and the parking mode.

[0018] Of the multiple projection modes, the modes other than the parking mode are modes in which the vehicle 1 actually travels. In these modes in which the vehicle 1 travels (FIGS. 2A to 2C), a line pattern 3 extending in a line shape is used as the projection pattern 2. Thus, the projection pattern 2 includes a line-shaped pattern (line pattern 3). The line pattern 3 is, for example, a continuous strip-shaped pattern. Alternatively, the line pattern 3 may be configured by arranging small patterns in a line shape at regular intervals. By using such a line pattern 3, it is possible to represent the behavior of the vehicle 1 while it is running. This will be described in detail later.

[0019] In this embodiment, the line pattern 3 includes a first line pattern projected forward in the traveling direction 4 of the vehicle 1 and a second line pattern projected backward in the traveling direction 4. 2A to 2C show a schematic diagram of an arrow indicating a traveling direction 4 of the vehicle 1. The size of the arrow indicates the speed of the vehicle 1. A pattern projected forward with respect to this traveling direction 4 is a first pattern, and a pattern projected backward is a second pattern. In this embodiment, a third pattern (a center line 3b, described later) projected onto the road surface around the center of the vehicle 1 (the road surface extending from below the vehicle 1 to the sides) is used.

[0020] As described later, the projection device 100 calculates a predicted trajectory 5 along which the vehicle 1 is predicted to pass, and a passing trajectory 6 along which the vehicle 1 has passed. The predicted trajectory 5 and the passing trajectory 6 are represented using a first pattern and a second pattern. That is, the first pattern is generated as a line pattern 3 representing the predicted trajectory 5 of the vehicle 1, and the second pattern is generated as a line pattern 3 representing the passing trajectory of the vehicle 1.

[0021] The normal driving mode, low-speed driving mode, and reverse mode in which line pattern 3 is used, and the parking mode in which a pattern other than line pattern 3 is used will be described below.

[0022] Fig. 2A shows an example of a projection pattern 2 projected in the normal driving mode. The upper and lower drawings in Fig. 2A are schematic diagrams of the vehicle 1 as viewed from the side and from above. Here, the normal driving mode is a projection mode that is selected, for example, when the vehicle 1 is traveling forward normally without slowing down. The normal driving mode is selected, for example, when the vehicle 1 is traveling at a speed faster than a general slow-down speed (for example, less than 10 km / h). Therefore, the normal driving mode is used when traveling forward in a driving lane, not when traveling in a manner that requires slowing down, such as for stopping, turning right, turning left, or parking.

[0023] In the normal driving mode, three types of line patterns 3, a front line 3a, a center line 3b, and a rear line 3c, are projected as the projection pattern 2. Each of the lines 3a to 3c is configured as a pair of line patterns 3 projected on the left and right sides of the vehicle. The forward lines 3a are line patterns 3 projected onto the road surface in front of the vehicle 1. The forward lines 3a on the left and right sides are projected, for example, from projection units 10a and 10e shown in FIG. The center line 3b is a line pattern 3 projected onto the road surface to the side from below the vehicle 1. The left center line 3b is projected, for example, from projection units 10b and 10c, and the right center line 3b is projected, for example, from projection units 10f and 10g. The rear lines 3c are line patterns 3 projected onto the road surface behind the vehicle 1. The left and right rear lines 3c are projected, for example, from projection units 10d and 10h. The correspondence between the lines 3a to 3c and the projection units 10 is not limited to the above example, and a configuration in which one line pattern 3 is projected using two projection units 10, for example, is also possible.

[0024] As described above, the line pattern 3 shown in FIG. 2A is projected while the vehicle 1 is traveling forward. Therefore, in the normal driving mode, the ahead line 3a becomes a linear first pattern projected forward in the traveling direction of the vehicle 1, and is generated as the line pattern 3 representing the predicted trajectory 5 of the vehicle 1. Specifically, the line shape of the ahead line 3a is set to represent the predicted trajectory 5 of the front tires of the vehicle 1. In the normal driving mode, the rear line 3c is a second line-shaped pattern projected rearward in the traveling direction of the vehicle 1, and is generated as the line pattern 3 representing the passing trajectory 6 of the vehicle 1. Specifically, the line shape of the rear line 3c is set to represent the passing trajectory 6 of the rear tires of the vehicle 1. In the normal driving mode, the center line 3b (third pattern) is used as a line-shaped illumination that illuminates both sides of the center of the vehicle 1.

[0025] 3A shows a schematic diagram of a scene in which the normal driving mode is applied. In this scene, a forward line 3a representing a predicted trajectory 5, a rearward line 3c representing a passing trajectory 6, and a center line 3b as a linear illumination are projected onto the road surface around a vehicle 1 traveling at a relatively high speed in a driving lane. In this way, the line pattern 3 representing the predicted trajectory 5, the passing trajectory 6, etc. are projected around the vehicle 1. This makes it possible to explicitly inform pedestrians outside the vehicle and drivers of other vehicles of the traveling direction and driving history of the vehicle 1, and also makes it possible to effectively present the vehicle 1 while it is moving.

[0026] An example of the projection pattern 2 projected in the low-speed driving mode is shown in Fig. 2B. The upper and lower drawings in Fig. 2B are schematic diagrams of the vehicle 1 as viewed from the side and from above. Here, the low-speed driving mode is a projection mode that is selected, for example, when the vehicle 1 is moving forward slowly. Therefore, the low-speed driving mode is used when driving that requires slowing down, such as for stopping, turning right or left, or parking. In the low-speed driving mode, similarly to the normal driving mode described above, three types of line patterns 3, that is, a front line 3a, a center line 3b, and a rear line 3c, are projected as the projection pattern 2.

[0027] The line pattern 3 shown in FIG. 2B is projected while the vehicle 1 is traveling forward, similar to FIG. 2A. Therefore, in the low-speed driving mode, the line ahead 3a becomes a first linear pattern projected forward in the traveling direction of the vehicle 1, and is generated as the line pattern 3 representing the predicted trajectory 5 of the vehicle 1. Specifically, the line shape of the line ahead 3a is set to represent the predicted trajectory 5 of the front tires of the vehicle 1. In the low-speed driving mode, the rear line 3c becomes a line-shaped second pattern projected backward in the traveling direction of the vehicle 1, and is generated as the line pattern 3 representing the passing trajectory 6 of the vehicle 1. Specifically, the line shape of the rear line 3c is set to represent the passing trajectory 6 of the rear tires of the vehicle 1.

[0028] In the low-speed driving mode, the center line 3b (third pattern) is generated as the line pattern 3 representing the predicted trajectory 5 of the vehicle 1. Specifically, the line shape of the center line 3b is set to represent the predicted trajectory 5 of the rear tires of the vehicle 1. This makes it possible to clearly show pedestrians and the like the path that the rear tires are predicted to follow when the vehicle 1 moves forward slowly. This makes it possible to reduce the risk of being caught in a vehicle when turning right or left.

[0029] 3B is a schematic diagram showing a state in which the vehicle 1a is being driven in a parking lot as an example of a scene in which the low-speed driving mode is applied. The vehicle 1a is moving forward to leave the parking space on the right side of the figure. When the stopped vehicle 1a moves forward in this way, it is driven slowly, so the low-speed driving mode is used. Here, a forward line 3a representing a predicted trajectory 5 of the front tires and a center line 3b representing a predicted trajectory 5 of the rear tires are projected onto the road surface around the vehicle 1a. Note that in Fig. 3B, a rearward line 3c representing a passing trajectory 6 of the rear tires of the vehicle 1a is omitted from illustration. In this way, the line pattern 3 representing the predicted trajectories 5 of the front and rear tires is projected around the vehicle 1a. This makes it possible to alert pedestrians and sufficiently prevent accidents such as entrapment or contact. The forward line 3a may be set to represent the width of the vehicle 1. For example, the distance between the right and left lines is set to the maximum width of the body of the vehicle 1. This makes it possible to encourage steering operations, etc., to be mindful of the vehicle width.

[0030] FIG. 2C shows an example of a projection pattern 2 projected in reverse mode. Here, the reverse mode is a projection mode that is selected when the vehicle 1 is traveling backward (backing up). The reverse mode is used, for example, when parking by moving backward. In the reverse mode, similarly to each of the driving modes described above, three types of line patterns 3, that is, a front line 3a, a center line 3b, and a rear line 3c, are projected as the projection pattern 2.

[0031] The line pattern 3 shown in FIG. 2C is projected while the vehicle 1 is traveling in reverse. Therefore, in the reverse mode, the forward line 3a becomes a line-shaped second pattern projected backward in the traveling direction of the vehicle 1. In this case, the forward line 3a is generated as a line pattern 3 representing the passing trajectory 6 of the vehicle 1. Specifically, the line shape of the forward line 3a is set to represent the passing trajectory 6 of the front tires of the vehicle 1. In the reverse mode, the rear line 3c becomes a first line-shaped pattern projected forward in the traveling direction of the vehicle 1. In this case, the rear line 3c is generated as a line pattern 3 representing a predicted trajectory 5 of the vehicle 1. Specifically, the line shape of the rear line 3c is set to represent the predicted trajectory 5 of the rear tires of the vehicle 1.

[0032] In the reverse mode, the center line 3b (third pattern) is generated as the line pattern 3 representing the predicted trajectory 5 of the vehicle 1. Specifically, the line shape of the center line 3b is set to represent the predicted trajectory 5 of the front tires of the vehicle 1. This makes it possible to clearly show pedestrians and the like the path that the front tires are expected to follow when the vehicle 1 moves backwards. This makes it possible to reduce the risk of being caught in the vehicle when parking.

[0033] 3B is a schematic diagram showing a vehicle 1b being driven in a parking lot as an example of a scene in which the reverse mode is applied. The vehicle 1b is moving backwards to park in a parking space on the left side of the drawing. Here, a rear line 3c representing a predicted trajectory 5 of the rear tires and a center line 3b representing a predicted trajectory 5 of the front tires are projected onto the road surface around the vehicle 1b. Note that in Fig. 3B, the front line 3a representing the passing trajectory 6 of the front tires of the vehicle 1b is omitted from illustration. In this way, the line pattern 3 representing the predicted trajectory 5 of the front and rear tires is projected around the vehicle 1b, making it possible to sufficiently avoid accidents such as getting caught in something or hitting something when backing up. As in the case of forward movement, the rear line 3c may be set to indicate the width of the vehicle 1. This makes it possible to perform operations such as backing up while checking the vehicle width.

[0034] FIG. 2D shows an example of a projection pattern 2 projected in the parking mode. Here, the parking mode is a projection mode that is selected when the shift position of the vehicle 1 is in parking ("P"), that is, when the vehicle 1 is at a standstill. In the parking mode, the above-mentioned line pattern 3 is not displayed, and a lighting pattern (hereinafter referred to as a parking pattern 7) that surrounds the entire circumference of the vehicle 1 is projected as the projection pattern 2. Here, front lighting 7a, side lighting 7b, and rear lighting 7c are used as the parking pattern 7. Each of the lighting 7a to 7c is a gradation pattern in which the color becomes lighter as it moves away from the vehicle 1. The design of the parking pattern 7 is not limited.

[0035] In this way, the projection pattern 2 includes the stopping pattern 7 that is different from the line pattern 3. In this embodiment, the stopping pattern 7 is an example of another pattern. By using the stopping pattern 7, it is possible to inform pedestrians and others outside the vehicle that the vehicle 1 is stopped with the shift position set to parking, i.e., that the vehicle 1 is not moving. This allows, for example, pedestrians and other vehicles to pass around the vehicle 1 safely. Note that the mode is not limited to the above-mentioned projection mode, and other modes may be set. For example, a welcome light mode that displays a predetermined illumination pattern when the driver unlocks the vehicle 1, opens the door, starts the engine, etc. may be set.

[0036] FIG. 4 is a block diagram showing an example of the configuration of the projection device 100 according to the first embodiment. In the projection device 100, the display of the various projection patterns 2 described above is controlled based on speed-related information related to the speed of the vehicle 1. That is, the projection pattern 2 is adjusted, etc., using information on the speed of the vehicle 1, a change in speed (acceleration), or an accelerator operation or a brake operation that changes the speed of the vehicle 1. The projection device 100 includes the above-mentioned projection unit 10, a vehicle information sensor unit 11, a storage unit 15, and a controller 20.

[0037] The projection unit 10 is an element that irradiates light to project the projection pattern 2, and is configured so that the shape, color, etc. of the projection pattern 2 can be changed. For example, a projector that emits laser light as irradiation light is used as the projection unit 10. By using laser light, it is possible to display a highly bright projection pattern 2 from a long distance. Note that, in addition to a laser light source, an LED light source, a lamp light source, or the like may be used.

[0038] The method of modulating the irradiated light is not limited, and for example, a light modulation element using a transmissive liquid crystal panel or MEMS (Micro Electro Mechanical Systems) is used. In addition, by combining a phase modulation element using a reflective liquid crystal panel, it becomes possible to project light in a predetermined range. This makes it possible to significantly improve the brightness of the projection pattern 2. Besides, the specific configuration of the projection unit 10 is not limited, and for example, a projection light capable of modulating the irradiated light, a laser light source, or the like may be used.

[0039] The vehicle information sensor unit 11 has sensors that detect information relating to the state of each part of the vehicle 1 . Specifically, a steering angle sensor that detects the steering angle of the steering wheel, a speed sensor that detects the traveling speed of the vehicle 1, and an acceleration sensor that detects the acceleration applied to the vehicle 1 are provided. The vehicle information sensor unit 11 also has an accelerator opening sensor that detects the opening of an accelerator, and a brake opening sensor that detects the opening of a brake (the strength of the brake). The vehicle information sensor unit 11 also has an accelerator pedal pressure sensor (see FIG. 6) that detects the pressure applied to the accelerator pedal (accelerator operation force) and a brake pedal pressure sensor that detects the pressure applied to the brake pedal (brake operation force). These pressure sensors may be sensors that detect the total pressure value applied to the pedal, or sensors that detect the pressure distribution.

[0040] The vehicle information sensor unit 11 also has a shift position sensor that detects the position of a shift lever (shift position), and a side brake sensor that detects whether a side brake is on or off. In addition, an ignition sensor that detects whether the ignition switch is on / off, a turn signal sensor that detects whether the turn signal is on / off, a hazard sensor that detects whether the hazard lamps are on / off, a light sensor that detects whether the headlights are on / off or whether the headlights are switched between high beam / low beam (passing), etc. may be provided. In addition, any sensor that detects information about the vehicle 1 may be used as the vehicle information sensor unit 11.

[0041] The storage unit 15 is a non-volatile storage device. For example, a recording medium using a solid-state element such as an SSD (Solid State Drive) or a magnetic recording medium such as an HDD (Hard Disk Drive) is used as the storage unit 15. In addition, the type of recording medium used as the storage unit 15 is not limited, and any recording medium that non-temporarily records data may be used.

[0042] The storage unit 15 stores a control program for controlling the overall operation of the projection device 100. The control program corresponds to the program according to the present embodiment. The storage unit 15 also functions as a computer-readable recording medium on which the program is recorded. The storage unit 15 also stores data specifying the shape, color, etc. of the projection pattern 2. In addition, the type of data stored in the storage unit 15 is not limited, and any data necessary for the operation of the projection device 100 may be stored.

[0043] The controller 20 controls the operation of each block of the projection device 100. The controller 20 has a hardware configuration required for a computer, such as a CPU and memory (RAM, ROM). The CPU loads a control program stored in the storage unit 15 into the RAM and executes it, thereby executing various processes. The controller 20 functions as an information processing device according to this embodiment.

[0044] A PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array) or other devices such as an ASIC (Application Specific Integrated Circuit) may be used as the controller 20. Also, a processor such as a GPU (Graphics Processing Unit) may be used as the controller 20.

[0045] In this embodiment, the CPU of the controller 20 executes the program according to this embodiment to realize functional blocks including a vehicle information acquisition unit 21, a trajectory calculation unit 22, a projection image determination unit 23, and a video data generation unit 24. These functional blocks execute the information processing method according to this embodiment. In order to realize each functional block, dedicated hardware such as an IC (integrated circuit) may be used as appropriate. Furthermore, these functional blocks may be realized by another computer or the like capable of communicating with the controller 20.

[0046] The vehicle information acquisition unit 21 acquires information about the vehicle 1 detected by each sensor of the vehicle information sensor unit 11 (vehicle information). In this embodiment, the vehicle information acquisition unit 21 acquires speed-related information related to the speed of the vehicle 1. The speed-related information includes information indicating the speed of the vehicle 1, acceleration and deceleration that change with the speed, and information regarding operations (accelerator operation and brake operation) that change these physical quantities. As the speed-related information, speed information indicating the speed of the vehicle 1 and acceleration information indicating the acceleration of the vehicle 1 are obtained. For example, the detection results of a speed sensor and an acceleration sensor are read as the speed information and acceleration information.

[0047] Additionally, accelerator information and brake information are acquired as the speed-related information. Among these, accelerator information includes the accelerator opening and the pressure applied to the accelerator pedal (accelerator operation force). Brake information includes the brake opening and the pressure applied to the brake pedal (brake operation force). For example, the detection results of the accelerator opening sensor and the accelerator pedal pressure sensor are read as the accelerator opening and operation force. Furthermore, the detection results of the brake opening sensor and the brake pedal pressure sensor are read as the brake opening and operation force.

[0048] Further, the vehicle information acquisition unit 21 acquires driving state information related to the driving state of the vehicle 1. As the driving state information, shift lever information and side brake information are acquired. Of these, the shift lever information includes information indicating the state of the shift position of the vehicle 1. Furthermore, the side brake information includes information indicating the state of the side brake of the vehicle 1. For example, the detection results of the shift position sensor and the side brake sensor are read as the shift lever information and the side brake information. Furthermore, steering angle information indicating the steering angle of the steering wheel is acquired by the vehicle information acquisition unit 21. For example, the detection result of a steering angle sensor is read as the steering angle information. In addition, the detection results of the sensors constituting the vehicle information sensor unit 11 are acquired as appropriate. In this embodiment, the vehicle information acquisition unit 21 corresponds to an acquisition unit.

[0049] The trajectory calculation unit 22 calculates a predicted trajectory 5 and a passing trajectory 6 of the vehicle 1 (see FIGS. 2 and 3). In this embodiment, the trajectory calculation unit 22 estimates a predicted trajectory 5 along which the vehicle 1 is predicted to pass, based on steering angle information, speed information, and acceleration information of the vehicle 1. Here, for example, the trajectory of the front tires (or rear tires) predicted when the vehicle 1 travels with the current steering angle, speed, and acceleration is estimated. At this time, corrections may be made as appropriate according to centrifugal force, tire grip force, and the like. Instead of the predicted trajectory 5 of the tires, for example, the trajectory of the center of the vehicle 1 may be estimated. The method for estimating the predicted trajectory 5 is not limited, and for example, a technique such as a trajectory prediction process used in automatic driving or the like can be applied.

[0050] In this embodiment, the behavior of the vehicle 1 is recorded to calculate a passing path 6 of the vehicle 1. Here, the passing path 6 of the front tires (or rear tires) is calculated from the records of the steering angle, speed, and acceleration of the vehicle 1. For this process, a technique such as dead reckoning can be used. Alternatively, GPS positioning, WiFi positioning, etc. may be used. Also, for example, the predicted trajectory 5 can be recorded and used as the passing trajectory 6. The method for estimating the passing trajectory 6 is not limited, and any process capable of reproducing the trajectory of the vehicle 1 may be used, for example. In this embodiment, the trajectory calculation unit 22 functions as a predicted trajectory calculation unit and a passing trajectory calculation unit.

[0051] The projection image determination unit 23 determines the display contents and display parameters of the projection pattern 2, and outputs the data of the projection pattern 2. This processing is processing for controlling the display of the projection pattern 2. In the projection device 100, the projection image determination unit 23 controls the display of the projection pattern 2 projected onto the road surface around the vehicle 1 from the projection unit 10 mounted on the vehicle 1 based on the speed-related information. For example, a process is executed to set detailed display parameters of the projection pattern 2 according to the speed-related information. In this process, typically, display parameters (color, width, length, blinking, etc.) of a line pattern 3 (see FIGS. 2A to 2C) among the projection pattern 2 are set.

[0052] In this embodiment, the projection image determination unit 23 controls the display parameters of the line pattern 3 in response to at least one of an accelerator operation and a brake operation in the vehicle 1. For example, when the accelerator and brakes of vehicle 1 are operated, the speed and acceleration of vehicle 1 change. Information indicating such changes in the behavior of vehicle 1 is acquired as speed-related information, and the display of line pattern 3 is adjusted according to the contents of the information. This makes it possible to present the behavior of vehicle 1, such as whether it is accelerating or decelerating, to the outside of the vehicle as line pattern 3.

[0053] Moreover, the projection image determination unit 23 controls the shape of the line pattern 3 so as to represent the trajectory of the vehicle 1 calculated by the trajectory calculation unit 22 (the predicted trajectory 5 and the passing trajectory 6). Specifically, the projection image determination unit 23 generates a first pattern representing the predicted trajectory 5. For example, when the vehicle 1 travels forward (reverses), the shape of the forward line 3a (rear line 3c) which is the first pattern is set to a shape that follows the predicted trajectory 5. Further, the projection image determination unit 23 generates a second pattern representing the passing trajectory 6. For example, when the vehicle 1 travels forward (backward), the shape of the rear line 3c (forward line 3a) which is the second pattern is set to a shape that follows the passing trajectory 6. Furthermore, the distance between the left and right lines of the front line 3a (or rear line 3c) may be set to represent the width of the vehicle. In this embodiment, the projection image determination unit 23 corresponds to a projection control unit.

[0054] The video data generating unit 24 generates video data to be output to each projection unit 10 based on the data of the projection pattern 2 output from the projection image determining unit 23 . For example, a frame image is generated that represents the shape of the projection pattern 2 as seen from above the vehicle 1. Processing is then performed on this frame image to correct distortion, brightness bias, and other issues that accompany projection, in accordance with the projection angle and other factors of each projection unit 10. A series of frame images in which distortion and other issues have been corrected in this manner becomes video data. In addition, any image processing or the like may be performed in order to properly project the projection pattern 2.

[0055] Fig. 5 is a flowchart showing an example of a basic operation of the projection device 100. The process shown in Fig. 5 is, for example, a loop process that is repeatedly executed during the operation of the projection device 100. Here, display control in projection modes (normal driving mode, low-speed driving mode, and reverse mode) in which a line pattern 3 is projected as the projection pattern 2 will be described. First, the vehicle information acquisition unit 21 acquires speed-related information (step 101). Specifically, speed information, acceleration information, accelerator information (accelerator opening and operating force), and brake information (brake opening and operating force) are read as speed-related information from sensors provided in various parts of the vehicle 1. At this time, driving state information (shift lever information, handbrake information), steering angle information, etc. are also read.

[0056] Next, the trajectory calculation unit 22 calculates the trajectory (the predicted trajectory 5 and the passing trajectory 6) of the vehicle 1 (step 102). For example, as shown in FIGS. 2A and 2B, in a projection mode (normal driving mode, low-speed driving mode) used during forward driving, a predicted trajectory 5 of the front tires of the vehicle 1 and a passing trajectory 6 of the rear tires are calculated. On the other hand, as shown in FIG. 2C, in a projection mode (reverse mode) used while traveling backward, a passing trajectory 6 of the front tires of the vehicle 1 and a predicted trajectory 5 of the rear tires are calculated. During the parking mode, a process of calculating the predicted trajectory 5 in accordance with the steering angle, etc. may be executed. Alternatively, during the parking mode, the trajectory may not be calculated.

[0057] Next, the projection pattern 2 is determined by the projection image determination unit 23 (step 103). Specifically, the length of the line pattern 3 is adjusted according to the vehicle speed (speed information). Moreover, the width of the line pattern 3 is adjusted according to the degree of accelerator opening or brake opening. In addition, the color of the line pattern 3 may be adjusted in accordance with the speed, acceleration, etc. of the vehicle 1, and the presence or absence of blinking, etc. may be set. Thus, in this embodiment, at least one display parameter of the length, width, color, and blinking of the line pattern 3 is controlled. As described above, the shape of the line pattern 3 is appropriately set so as to represent the forecasted trajectory 5 and the passing trajectory 6.

[0058] Next, the video data generating unit 24 generates video data to be output to each projection unit 10 based on the data of the line pattern 3 (step 104). For example, a frame image representing the line pattern 3 is generated. Video data is generated by executing a correction process on this frame image according to the projection angle of the projection unit 10, etc. The generated video data is output to each projection unit 10. Then, the projection units 10 provided in the vehicle 1 project the corresponding line patterns 3 based on the image data (step 105). For example, the projection units 10a and 10e shown in Fig. 1 project the front line 3a, the projection units 10b, 10c, 10f, and 10g project the center line 3b, and the projection units 10d and 10h project the rear line 3c.

[0059] Fig. 6 is a time chart showing an example of display control of line pattern 3. In the following, the display control of line pattern 3 in response to accelerator operation will be specifically described with reference to Fig. 6. 6 is a schematic diagram showing accelerator operation by driver 30 at each timing, in which the foot of driver 30, accelerator pedal 31, and accelerator pedal pressure sensor (pressure sensor 32) are each shown in schematic form. The graphs in the middle of Fig. 6 are schematic time charts showing changes in speed-related information accompanying accelerator operation. From the top, the graphs show changes over time in the following parameters: brake pedal pressure (brake operation force), accelerator pedal pressure (accelerator operation force), accelerator opening (driving torque), and driving speed. The diagrams in the lower part of Fig. 6 are schematic diagrams showing examples of the projection pattern 2 at each timing. Here, the stopping pattern 7 and the line pattern 3 (the front line 3a and the rear line 3c) are shown as the projection pattern 2. Note that the center line 3b is omitted from the illustration.

[0060] As shown in the upper part of Fig. 6, a pressure sensor 32 is provided across the front surface of accelerator pedal 31. This pressure sensor 32 can detect the operating force of the accelerator when driver 30 operates the accelerator. From this operating force, it is possible to detect a state in which driver 30 is not touching the pedal with his / her foot, a state in which his / her foot is placed on the pedal (no force is being applied), a state in which the pedal is being pressed with only play (not exceeding the reaction force), a state in which the pedal is being pressed, a state in which the pedal position is being maintained, a state in which the pedal is being released, and the like.

[0061] In the following, it is assumed that the shift position of the vehicle 1 is in drive "D." In addition, the period during which the display content and control content of the projection pattern 2 change will be described as being divided into periods T0 to T5. Period T0 (time t0 to t1) is the period from when the driver 30 depresses the brake pedal until he or she releases the brake pedal. At this time, the driver 30's foot is not in contact with the accelerator pedal 31, and the load (pressure) on the accelerator pedal is zero. As shown in Fig. 6, period T0 is a period in which the speed is 0 and the brakes are applied. This state is a state (first state) in which the vehicle 1 is stopped and does not move in response to an accelerator operation in the vehicle 1. In this case, the projection image determination unit 23 sets the parking mode and selects the stopping pattern 7 as the projection pattern 2. That is, in the first state, the stopping pattern 7 is projected.

[0062] The state after time t1 is a state (second state) in which the vehicle 1 is capable of moving in response to an accelerator operation in the vehicle 1. In this case, the projection image determination unit 23 sets a low-speed driving mode and selects the line pattern 3 as the projection pattern 2. That is, in the second state, the line pattern 3 is projected.

[0063] In FIG. 6, the line pattern 3 is projected from time t1 until time t12 when the vehicle 1 is stopped by a brake operation. 6, when the vehicle 1 is stopped and no brake operation is being performed, the parking mode is switched to the low-speed drive mode. This is an example of control for switching the projection pattern 2 (projection mode) based on brake information.

[0064] Period T1 (times t1 to t3) is the period from when the driver 30 releases his / her feet from the brake and accelerator to when the driver 30 places his / her foot on the accelerator pedal 31. For example, when the driver 30 touches his / her foot to the accelerator pedal 31 at time t2, the output of the pressure sensor 32 rises to a pressure equivalent to that obtained when the driver places his / her foot on the accelerator pedal 31 without applying any force (time t3). When the accelerator pedal is operated, the opening of the accelerator does not change until the pedal is depressed beyond a certain reaction force (play of the accelerator pedal 31). The pressure at time t3 is equal to or less than the reaction force. During this period T1, a pattern with a short length and a narrow width is projected as the front line 3a, and a pattern with a constant length and width, for example, is projected as the rear line 3c.

[0065] Period T2 (times t3 to t5) is the period from when the driver 30 places his / her foot on the accelerator pedal 31 until he / she depresses the accelerator pedal 31 and opens the accelerator. For example, when the driver 30 depresses the accelerator at time t4, the force (load) acting on the pedal increases and exceeds the reaction force at time t5. Therefore, from time t5 onwards, the opening of the accelerator increases and the vehicle 1 starts to move. In this period T2, a pattern with a short length and a medium width is projected as the front line 3a, and a pattern with the same length and width as in period T1 is projected as the rear line 3c.

[0066] In this manner, in this embodiment, a state in which the accelerator operation is not immediately started (period T1) and a state in which the accelerator operation can be immediately started (period T2) are detected from the accelerator operation force, and the width of the forward line 3a is switched accordingly. This makes it possible to inform pedestrians outside the vehicle whether the driver 30 is about to start the vehicle 1 immediately or not.

[0067] Period T3 (times t5 to t9) is a period during which the vehicle 1 accelerates to a constant speed, and then maintains that speed while traveling. For example, after time t5, when the accelerator is released, the accelerator pedal 31 is depressed until time t6. The force applied to the pedal continues to increase. After that, the amount of depression (force applied to the pedal) is maintained until time t7, and the pedal is released by a constant amount toward time t8 so as to maintain the speed. After time t8, the force applied to the pedal is balanced with the reaction force. 6, the operations from time t5 to time t8 are transmitted as acceleration commands to the vehicle 1. As a result, the accelerator opening and the speed of the vehicle 1 increase until time t8. Moreover, the operation from time t8 to time t9 is an operation for maintaining the speed, so that the accelerator opening and the speed of the vehicle 1 are maintained during this period.

[0068] In the projection device 100, the speed of the vehicle 1 is monitored during the acceleration period from time t5 to t8. Then, at the timing when the speed of the vehicle 1 exceeds a predetermined threshold speed (creeping speed), the projection mode is switched from the low-speed driving mode to the normal driving mode. In this case, for example, the center line 3b (not shown) is switched from the pattern representing the predicted trajectory 5 to an illumination pattern (see FIG. 2, etc.). This control is an example of control for switching the control content (projection mode) of the projection pattern 2 based on speed information. In the following, control in the normal driving mode will be mainly described.

[0069] In the period T3, the faster the speed of the vehicle 1, the longer the length of the forward line 3a (first pattern) is set (see FIG. 9). Also, the greater the accelerator opening, the wider the width of the forward line 3a (first pattern) is set (see FIG. 8). As a result, the length of the front line 3a in period T3 becomes longer and the width becomes wider than those in periods T1 and T2. This makes it possible to present the speed, acceleration, and other information of the vehicle 1 to those ahead in the traveling direction of the vehicle 1.

[0070] In addition, in the period T3, for example, the length and width of the rear line 3c are controlled in the same manner as the front line 3a. That is, the faster the speed of the vehicle 1, the longer the length of the rear line 3c (second pattern) is set. Also, the larger the accelerator opening, the larger the width of the rear line 3c (second pattern) is set. This makes it possible to present the speed, acceleration, and other information of the vehicle 1 to those behind the vehicle 1 in the traveling direction. During the period from time t5 to time t8, the speed and accelerator opening of the vehicle 1 are maintained. Therefore, the lengths and widths of the front line 3a and the rear line 3c are also maintained. In the period T3, fixed values ​​may be used for the length and width of the rear line 3c.

[0071] Period T4 (times t9 to t12) is the period until vehicle 1 stops. For example, when driver 30 reduces the force applied to accelerator pedal 31, the accelerator opening decreases, and the speed of vehicle 1 decreases. In Fig. 6, the accelerator opening becomes 0 at time t10. After time t10, the vehicle 1 travels by inertia, but its speed continues to decrease. Then, at time t12, the driver 30 applies the brakes, and the vehicle 1 stops at time t12.

[0072] 6, when deceleration of the vehicle 1 (negative acceleration in the traveling direction) is detected, as in period T4, the width of the front line 3a is fixed to a narrow value, and the width of the rear line 3c is fixed to a wide value. This makes it possible to clearly indicate to the outside the vehicle that the vehicle 1 is decelerating. This control is an example of control for setting the width of the front line 3a and the rear line 3c based on the deceleration (acceleration information) of the vehicle 1 or a decrease in the speed or accelerator opening. The lengths of the front line 3a and the rear line 3c are adjusted according to the speed of the vehicle 1, similarly to the period T3.

[0073] In period T5 (after time t12), the vehicle 1, which had been traveling, comes to a complete stop. At time t12, for example, the shift position is in drive "D" and the brake is depressed. In this case, the projection mode is switched to the parking mode, and a stopping pattern 7 is projected as the projection pattern 2.

[0074] In this manner, in this embodiment, the display parameters of at least the front line 3a (first pattern) are controlled in response to the accelerator operation. In this case, the projection device functions as a device that presents accelerator operation information. This allows information such as the speed of the vehicle 1 and whether it is accelerating or decelerating in the traveling direction of the vehicle 1 to be presented, making it possible to easily convey the behavior of the vehicle 1. As a result, it becomes possible to call the attention of pedestrians outside the vehicle, for example.

[0075] Furthermore, the display control of the projection pattern 2 according to the accelerator operation shown in Fig. 6 may be applied when performing a brake operation. When performing a brake operation, it is important to communicate the behavior of the vehicle 1 to those behind in the traveling direction of the vehicle 1. For this reason, for example, when the vehicle 1 is moving forward as shown in Fig. 6 (the shift position is "D"), the display parameters of the rear line 3c, which is projected at least backward in the traveling direction 4 (second pattern), are controlled.

[0076] For example, similar to the control using the accelerator opening during period T3, the greater the brake opening (brake torque), the greater the width of the rear line 3c is set. Also, the length of the rear line 3c may be controlled according to the speed at the time of braking (deceleration). In this case, the slower the speed, the smaller the length of the rear line 3c is set. Alternatively, the slower the speed, the greater the length of the rear line 3c is set. Such control is applied, for example, to a period (for example, from time t11 to t12) when the advancing vehicle 1 is stopped by braking. In addition, control of line width, etc. using the brake opening may be applied to the front line 3a.

[0077] In this manner, in this embodiment, the display parameters of at least the rear line 3c (second pattern) are controlled in response to the brake operation. In this case, the projection device functions as a device that presents brake operation information. This makes it possible to inform the driver of the vehicle 1 of its behavior during braking in an easy-to-understand manner by displaying the speed and deceleration of the vehicle 1 to those behind the vehicle 1. As a result, it becomes possible to alert the driver of the following vehicle, for example.

[0078] FIG. 7 is a schematic diagram showing an example of the line pattern 3 according to the running state of the vehicle 1. As shown in FIG. FIG. 7A shows a schematic example of a projection pattern 2 that is projected when the vehicle 1 moves forward (the shift position is "D"). This is the projection pattern 2 that is used, for example, in the low-speed driving mode and the normal driving mode. Hereinafter, these modes may be collectively referred to as the driving mode. In this case, the projection pattern 2 is a line pattern 3, and includes a forward line 3a and a rearward line 3c. The forward line 3a is a first pattern projected forward in the traveling direction of the vehicle 1, and the rearward line 3c is a second pattern projected backward in the traveling direction of the vehicle 1.

[0079] In the example shown in Fig. 7A, the front line 3a and the rear line 3c are set in different colors. By changing the colors of the front and rear lines, it is possible to clearly indicate the traveling direction. The forward line 3a is set to a color such as blue, which makes it possible to distinguish the forward line 3a from, for example, headlights and brake lights, and improves the visibility of the forward line 3a. The rear line 3c is set to a color such as red, which makes it possible to realize a display that expands the red brake lamp.

[0080] 7B is a schematic diagram showing an example of a projection pattern 2 that is projected when the vehicle 1 is stopped (the shift position is "P"). In this case, the projection pattern 2 is a stopping pattern 7. Here, the colors of the front lighting 7a and the rear lighting 7c are set to different colors. The forward lighting 7a is set to a blue color, for example, similar to the forward line 3a in Fig. 7A. The rear lighting 7c is set to a red color, for example, similar to the rear line 3c in Fig. 7A. This makes it possible to reduce the sense of incongruity when switching between the driving mode and the parking mode.

[0081] 7C is a schematic diagram showing an example of the projection pattern 2 that is projected when the vehicle 1 moves backward (the shift position is "R"). This is the projection pattern 2 that is used in the reverse mode, for example. In this case, the projection pattern 2 is a line pattern 3, and includes a forward line 3a and a rearward line 3c. The forward line 3a is a second pattern projected backward in the traveling direction of the vehicle 1, and the rearward line 3c is a first pattern projected forward in the traveling direction of the vehicle 1.

[0082] In the example shown in Fig. 7C, the front line 3a and the rear line 3c are set to the same color. By making the front and rear lines the same color, it is possible to clearly indicate the difference from the driving mode, that is, the state in which the vehicle 1 is moving backward. The front line 3a and the rear line 3c are set to a color of, for example, blue, so that a color different from the brake lights is displayed on the rear side, which is the traveling direction of the vehicle 1, making it possible to inform the driver that the vehicle 1 is reversing.

[0083] In addition to the above-mentioned settings, any color setting is possible. For example, the front and rear lines may be set to the same color in the driving mode, and the front and rear lines may be set to different colors in the reverse mode. Also, other colors such as green, purple, orange, etc. may be used. Furthermore, the color and brightness (luminance) may be adjusted depending on the state of the projection target (road surface, etc.) and the illuminance environment so that the projection pattern 2 is easy to see.

[0084] FIG. 8 is a table showing an example of control of the width of the line pattern 3. In FIG. Here, the width of the line pattern 3 means the width of the lines projected on the right and left sides of the vehicle 1 (see FIG. 7). In the following, the width of the first pattern is referred to as W1, and the width of the second pattern is referred to as W2.

[0085] The table in FIG. 8A shows an example of setting the width of the first pattern in response to the accelerator operation. In this table, the states in which the driver 30 has his / her feet on the brake pedal and the accelerator pedal ("Feet On") and the states in which the driver has his / her feet off the pedal ("No Feet") are separately shown. The three columns on the left side of the table show setting examples for the shift positions of parking ("P"), neutral ("N"), and drive / reverse ("DorR").

[0086] For example, the first pattern in the drive position is the front line 3a, and the first pattern in the reverse position is the rear line 3c. Moreover, the first pattern in the neutral position is a line pattern 3 (a forward line 3a or a rearward line 3c) that is projected forward in the traveling direction of the vehicle 1 when control is performed. When the vehicle 1 is stopped in the neutral position, both the front line 3a and the rear line 3c are subject to control as the first pattern.

[0087] For example, when the shift position is in parking, regardless of the accelerator opening ("Accel Pedal Opening") or the position of the driver's 30 feet, the projection pattern 2 is set to the stopping pattern 7 ("Parking Sign"). Furthermore, when the shift position is neutral, regardless of the accelerator opening or the position of the driver's 30 feet, the width W1 of the line pattern 3 projected forward in the traveling direction 4 is set to 1% of the maximum line width, which is 100%.

[0088] Next, setting examples for the drive position and the reverse position will be described. As shown in Fig. 8A, when the brake pedal is "Feet On" and the accelerator pedal is "No Feet", W1 is set to 1%. This corresponds to the state of period T0 in Fig. 6, for example. Here, unlike the control in Fig. 6, a first pattern with a width of 1% is projected instead of stopping pattern 7. Also, when both the brake pedal and the accelerator pedal are in "No Feet" state, W1 is set to 3%. This corresponds to the state of the period T1 in FIG. When the accelerator pedal is "Feet On" and the load on the accelerator is equal to or less than the reaction force (see period T2 in FIG. 6), a process of widening the width of the first pattern may be executed.

[0089] When the brake pedal is in "No Feet" and the accelerator pedal is in "Feet On", the width of the first pattern is controlled according to the accelerator opening. This corresponds to the state of period T3 in FIG. 6, for example. For example, when the accelerator opening is between 0% and 10%, W1 is set to 5%. When the accelerator opening is between 10% and 20%, W1 is set to 10%. After that, the width W1 of the first pattern is set to increase by 10% for every 10% increase in the accelerator opening. In this manner, in this embodiment, the greater the accelerator opening, the greater the width W1 of the first pattern is set. This makes it possible to present the degree of acceleration of the vehicle 1 in the traveling direction as the width of the line pattern 3. The control of width according to accelerator operation shown in FIG. 8A may be applied to the control of width W2 of the second pattern projected rearward in the traveling direction.

[0090] The table in Fig. 8B shows examples of setting the width W2 of the second pattern according to the brake operation. In this table, the state in which the driver 30 places his / her foot on the brake pedal (item "Feet On") and the state in which the driver does not place his / her foot on the brake pedal (item "No Feet") are listed separately. In addition, the three columns on the left side of the table show setting examples for each shift position ("P", "N", "DorR").

[0091] For example, when the shift position is in parking, regardless of the brake pedal opening ("Brake Pedal Opening") or the position of the driver's 30 feet, the projection pattern 2 is set to the stopping pattern 7 ("Parking Sign"). Furthermore, when the shift position is in neutral, the line pattern 3 projected rearward in the traveling direction 4 is set to an extremely thin line, regardless of the brake opening or the foot position of the driver 30. An extremely thin line is, for example, a thin line with a line width of 1% or less.

[0092] Next, setting examples for the drive position and the reverse position will be described. As shown in FIG. 8B, when the brake pedal is in "No Feet" state, the second pattern is set to a very thin line. When the brake pedal is "Feet On," the width W2 of the second pattern is controlled in accordance with the depression of the brake. For example, when the brake opening is 0% or more and less than 10%, W2 is set to the width of an ultra-thin line. When the brake opening is 10% or more and less than 20%, W2 is set to 10%. In this way, when the brake operation is being performed reliably, the width W2 of the second pattern changes rapidly. Thereafter, the width W2 of the second pattern is set to increase by 10% every time the brake opening increases by 10%. In this manner, in this embodiment, the greater the brake opening, the greater the width W2 of the second pattern is set, which makes it possible to present the degree of deceleration of the vehicle 1, etc., as the width of the line pattern 3 behind the vehicle in the traveling direction.

[0093] 8A and 8B, the display contents of the projection pattern 2 and the control contents of the display parameters are switched according to the state of the shift position. However, the display contents and the control contents may be switched with reference to the state of the parking brake, etc. For example, even if the vehicle is in neutral, if the parking brake is on, control may be executed to project the parking pattern 7. In this manner, in this embodiment, the type of projection pattern 2 or the control contents of the display parameters of the projection pattern 2 are switched based on information on the state of the shift position or the state of the side brake (driving state information). This makes it possible to appropriately switch and project the projection pattern 2, etc., suited to the driving state of the vehicle 1.

[0094] FIG. 9 is a table showing an example of control of the length of line pattern 3. Here, the length of the line pattern 3 means the length of the lines projected on the right and left sides of the vehicle 1 (see FIG. 7). The shape of the line pattern 3 is a straight line or a curve, and its length is expressed as a line length or an arc length. In the following, the length of the first pattern is referred to as L1, and the length of the second pattern is referred to as L2.

[0095] The table in Fig. 9A shows an example of setting the length L1 of the first pattern projected forward in the traveling direction according to the speed ("Speed") of the vehicle 1. This setting is applicable, for example, to both the case where the vehicle 1 moves forward (drive mode) and the case where the vehicle 1 moves backward (reverse mode). As shown in the margin of FIG. 9A, in this embodiment, the sum of the standard blind spot distance L0 for each vehicle 1 and the distance L1' is set as the length L1 of the first pattern.

[0096] FIG. 10 is a schematic diagram for explaining the standard blind spot distance L0. The standard blind spot distance L0 is a blind spot distance calculated assuming a standard viewpoint position P of the driver 30 in the vehicle 1. Fig. 10 shows a schematic diagram of the blind spot range in front of the vehicle 1 (the shaded area in the figure). The standard blind spot distance L0 is, for example, the distance from the position where the road surface becomes visible from the viewpoint position P (the end of the blind spot range) to the end of the vehicle 1. This distance L0 is a distance according to the shape of the vehicle 1, the position of the seats, etc., and is calculated by setting the viewpoint position P for each vehicle 1. Moreover, the standard blind spot distance L0 to the rear of the vehicle 1 can be calculated using a similar method.

[0097] 9A is the value of distance L1' obtained by subtracting the standard blind spot distance L0 from the length L1 of the first pattern. This makes it possible to appropriately set the length L1 of the first pattern regardless of differences in blind spots for each vehicle 1. If the speed is less than 10 km / h, L1' is set to 3 m. If the speed is between 10km / h and 20km / h, L1' is set to 5m. If the speed is between 20km / h and 30km / h, L1' is set to 10m. If the speed is between 30km / h and 40km / h, L1' is set to 18m. If the speed is between 40km / h and 50km / h, L1' is set to 28m. If the speed is between 50 and 60 km / h, L1' is set to 40 m. If the speed is between 60km / h and 70km / h, L1' is set to 54m. If the speed is between 70 and 80 km / h, L1' is set to 72 m. If the speed is between 80km / h and 90km / h, L1' is set to 89m. If the speed is between 90km / h and 100km / h, L1' is set to 108m. Thereafter, at speeds above 100 km / h, L1' is set to 108 m. These distances are calculated based on the stopping distance of the vehicle 1 in each speed range.

[0098] The table in Fig. 9B shows an example of setting the length L2 of the second pattern projected backward in the traveling direction according to the speed ("Speed") of the vehicle 1. The length L2 is the distance from the rear end of the vehicle 1 in the traveling direction to the front end of the pattern, as shown in Fig. 7, for example. If the speed is less than 10 km / h, set L2=3 m. If the speed is between 10km / h and 20km / h, L2 is set to 6m. If the speed is between 20km / h and 30km / h, L2 is set to 8m. If the speed is between 30km / h and 40km / h, L2 is set to 11m. If the speed is between 40km / h and 50km / h, L2 is set to 14m. If the speed is between 50km / h and 60km / h, L2 is set to 17m. If the speed is between 60km / h and 70km / h, L2 is set to 19m. If the speed is between 70km / h and 80km / h, L2 is set to 22m. If the speed is between 80km / h and 90km / h, L2 is set to 25m. If the speed is between 90km / h and 100km / h, L2 is set to 28m. Thereafter, at speeds above 100 km / h, L2 is set to 28 m. These distances are values ​​calculated based on the free running distance of the vehicle 1 in each speed range.

[0099] In this manner, in this embodiment, the lengths of the first pattern and the second pattern are set to be greater as the speed of the vehicle 1 increases. This makes it possible to clearly present the degree of speed of the vehicle 1 even in a situation where it is difficult to grasp the speed of the vehicle 1 (evening, nighttime, rainy weather, etc.). It should be noted that there is no limitation on the length of the line pattern 3. For example, it is possible to control the length by setting a minimum distance up to a certain speed, and setting a length corresponding to the travel distance for several seconds (e.g., 3 seconds) above that speed. Also, a length indicating an optimal inter-vehicle distance may be set for each traveling speed. This may be done by referring to the stopping distance of the vehicle 1 as described above, or by using a statistical value calculated from traffic accident data or the like.

[0100] As described above, in the controller 20 according to this embodiment, the projection pattern 2 is projected onto the surrounding road surface from the projection unit 10 provided in the vehicle 1. The display of this projection pattern 2 is controlled based on speed-related information related to the speed of the vehicle 1. This makes it possible to change the projection pattern 2 according to the behavior of the vehicle 1, and to communicate the behavior of the vehicle 1 to the outside of the vehicle in an easily understandable manner.

[0101] Ways to indicate the driver's driving operation to the outside of the vehicle include turn signals, brakes, hazard lights, etc. However, with these methods, it is difficult to convey operations that involve acceleration and deceleration, such as accelerator operation and brake operation, or the degree of acceleration and deceleration. Therefore, others around the vehicle cannot tell whether the car is trying to accelerate or not. It is also difficult to determine how fast cars are traveling, which can make it difficult to judge whether pedestrians can cross safely, for example. This could disrupt smooth traffic flow.

[0102] Another way to know the acceleration of a car is to listen to the engine sound, but this only applies when the accelerator is being operated excessively. Furthermore, electric vehicles (EVs) are equipped with a sound output device to inform pedestrians that the car is moving, but this is mainly used to inform pedestrians that the car is moving, and it is difficult to inform them of operations that involve acceleration / deceleration or speed, etc.

[0103] In this embodiment, the display of the projection pattern 2 is controlled based on the speed-related information. For example, by controlling the display parameters of the line pattern 3, which is the projection pattern 2, according to the speed, etc., it is possible to present the speed and acceleration of the vehicle 1 on the road surface. This makes it possible to intuitively convey to pedestrians outside the vehicle and drivers of other vehicles whether the vehicle 1 is accelerating or not, or how fast the vehicle 1 is going. As a result, it becomes possible to call the attention of surrounding traffic.

[0104] In addition, because a visually comprehensible sign like projection pattern 2 is used, it is possible to maintain a quiet traffic environment compared to when artificial voice or other output is used. Even in environments where visibility is poor, such as at night or during rainy weather, projection pattern 2 can be used to reliably communicate the behavior of vehicle 1. As a result, it is possible to sufficiently reduce the risk of traffic accidents.

[0105] <Second embodiment> A projection device according to a second embodiment of the present technology will be described below. In the following description, the description of the same configurations and operations as those of the projection device 100 described in the above embodiment will be omitted or simplified.

[0106] FIG. 11 is a block diagram showing an example of the configuration of a projection device according to the second embodiment. In this embodiment, as display control of the projection pattern 2 using speed-related information related to the speed of the vehicle 1, the display of the second pattern projected backward in the traveling direction is controlled in a stepwise manner according to the degree of braking operation. 11, the projection device 200 includes a projection unit 210, a vehicle information sensor unit 211, a surrounding environment sensor unit 212, a storage unit 215, and a controller 220. Among these, the projection unit 210, the vehicle information sensor unit 211, and the storage unit 215 are configured similarly to the projection unit 10, the vehicle information sensor unit 11, and the storage unit 15 shown in FIG.

[0107] The surrounding environment sensor unit 212 has a sensor that detects the state of the surrounding environment of the vehicle 1 . In this embodiment, as the surrounding environment sensor unit 212, a rear sensor for detecting an object behind the vehicle 1 is provided. As the rear sensor, for example, a rear camera (rear camera) installed at the rear of the vehicle 1 is used. The rear camera captures the view behind the vehicle 1 including the following vehicle, etc. In addition, for example, a radar sensor, an ultrasonic sensor, a LiDAR sensor, etc. installed at the rear of the vehicle 1 may be used as the rear sensor. These sensors detect the positions of objects behind the vehicle 1, such as the following vehicle, etc. In addition, cameras (front camera and side camera) facing forward and to the sides of the vehicle 1, distance measuring sensors, and the like may be provided.

[0108] The controller 220 controls the operation of each block of the projection device 200. In this embodiment, the CPU of the controller 220 executes the program according to this embodiment stored in the storage unit 215, thereby realizing functional blocks including a vehicle information acquisition unit 221, a trajectory calculation unit 222, a projection image determination unit 223, a video data generation unit 224, and a surrounding environment recognition unit 225. Among these, the vehicle information acquisition unit 221, the trajectory calculation unit 222, and the video data generation unit 224 are configured in the same manner as the vehicle information acquisition unit 21, the trajectory calculation unit 22, and the video data generation unit 24 shown in FIG. 4, for example.

[0109] The projection image determination unit 223 determines the display contents and display parameters of the projection pattern 2, and outputs the data of the projection pattern 2. In this embodiment, the projection image determination unit 223 estimates the degree of the brake operation based on the deceleration parameter, and discontinuously changes the second pattern according to the degree of the brake operation. Here, the deceleration parameter is speed-related information capable of expressing the deceleration of the vehicle 1. Specifically, at least one of the deceleration of the vehicle 1 (negative acceleration with respect to the traveling direction), the operating force of the brake, and the opening degree of the brake is used as the deceleration parameter. The degree of braking operation refers to the strength of the braking operation by the driver 30. In the projection image determination unit 223, normal braking, strong braking, sudden braking, etc. are detected from the degree of the braking operation. Then, the display parameters of the second pattern are set to change stepwise in accordance with these operations.

[0110] FIG. 12 is a block diagram showing an example of the configuration of the surrounding environment recognition unit 225. As shown in FIG. The surrounding environment recognition unit 225 executes recognition processing regarding the surrounding environment of the vehicle 1 based on the output of the surrounding environment sensor unit 212. Then, it detects objects (pedestrians, other vehicles, curbs, etc.) present around the vehicle 1, and calculates various information regarding the objects. The surrounding environment recognition unit 225 has an object detection unit 230 and a relative speed calculation unit 231 .

[0111] The object detection unit 230 detects objects around the vehicle 1 based on the detection result of the surrounding environment sensor unit 212. As the object detection unit 230, for example, a learning device that executes image recognition processing using machine learning or the like is used. For example, in a configuration in which a camera is provided as the surrounding environment sensor unit 212, an image captured by the camera is input to the object detection unit 230. In this case, objects in the input image are detected and their attributes are identified using reference information previously generated by learning. The reference information is, for example, dictionary information that associates object types with features and stores them. When a DNN (Deep Neural Network) or the like is used as the learning device, recognition model information or the like is used as the reference information. In this process, objects around the vehicle 1 are detected, and attributes of objects such as cars (for example, types of cars such as large vehicles such as passenger cars, trucks, and buses), motorcycles, bicycles, people, etc. are identified. Each detected object is assigned an ID, for example a serial number. Furthermore, the position in the image is specified for each detected object, and the distance (relative distance) from the position in the image to the object may be calculated. From the object detection unit 230, ID information, attribute information, and distance information (or position information) for each object are output and input to the relative speed calculation unit 231.

[0112] The relative speed calculation unit 231 calculates the relative speed of the object with respect to the vehicle 1 based on the information about the object output from the object detection unit 230 . For example, for each object, the change in distance per unit time is calculated, and the relative speed with respect to the host vehicle (vehicle 1) is calculated from the change in distance. The relative speed calculation unit 231 outputs ID information, attribute information, distance information (or position information), and speed information for each object, and inputs them to the projection image determination unit 223.

[0113] Furthermore, when a radar sensor, ultrasonic sensor, LiDAR sensor, or the like other than a camera is used as the surrounding environment sensor unit 212, the object detection unit 230 detects the position and distance of the object, and an ID is assigned to the detected object. Then, the relative speed calculation unit 231 calculates the relative speed of the detected object. In this case, the output from the surrounding environment recognition unit 225 is the ID information, distance information (or position information), and speed information of the object. The distance information may be information on the distance itself or information corresponding to the distance.

[0114] In this embodiment, among the surroundings of the vehicle 1, objects particularly behind the vehicle 1 are detected. That is, the surrounding environment recognition unit 225 calculates following vehicle information regarding the vehicle following the vehicle 1 based on the detection results of the rear camera, etc. Therefore, the surrounding environment recognition unit 225 calculates and acquires the following vehicle information. The following vehicle information includes the ID information of the following vehicle, attribute information, distance information indicating the inter-vehicle distance (or position information indicating the relative position), and speed information indicating the relative speed. Note that the following vehicle is a vehicle that travels behind the vehicle 1, and includes automobiles, motorcycles, bicycles, etc. In this embodiment, the vehicle information acquisition unit 221 and the surrounding environment recognition unit 225 described above implement an acquisition unit.

[0115] Fig. 13 is a flowchart showing an example of a basic operation of the projection device 200. Fig. 14 is a schematic diagram showing an example of a rear pattern (second pattern) according to the degree of brake operation.

[0116] 13 is, for example, a loop process that is repeatedly executed during the operation of the projection device 200. This process may also be executed when a following vehicle is detected, when the relative speed of the following vehicle is fast, or when the distance between the following vehicle and the vehicle is short, etc. First, the vehicle information acquisition unit 221 acquires speed-related information (step 201), and then the trajectory calculation unit 222 calculates the trajectory (the predicted trajectory 5 and the passing trajectory 6) of the vehicle 1 (step 202).

[0117] Next, the projection image determination unit 223 estimates the degree of braking operation (step 203). For example, the brake operation force (load applied to the brake), the brake opening (brake torque), and the value of the deceleration during the brake operation and the amount of change thereof are estimated as the degree of the brake operation. Alternatively, the degree of the brake operation may be estimated by combining these deceleration parameters. There are no limitations on the method of estimating the degree of the brake operation.

[0118] Next, it is determined whether the degree of the brake operation is equal to or greater than a first threshold value (step 204). The first threshold value is, for example, a threshold value for detecting a relatively strong brake operation. For example, a value of about 50%, 60%, or 70% of the degree of the brake operation estimated at the time of sudden braking is set as the first threshold value. The first threshold value can be set appropriately.

[0119] If the degree of the brake operation is less than the first threshold value (No in step 204), the projection image determination unit 223 determines to project the second pattern in normal display (step 205). The normal display is a display method for normal brake operation. For example, the display method in which the width is adjusted according to the opening degree of the accelerator or brake, which has been described with reference to Figs. 6 and 8, and the method in which a predetermined fixed width is set, are used as the normal display. 14A is a schematic diagram showing an example of the second pattern (rear line 3c) in normal display. In this example, the rear line 3c is projected with a relatively narrow width. The rear line 3c is also set to the same red color as the brake lamp 35, for example.

[0120] Returning to FIG. 13, if the degree of brake operation is equal to or greater than the first threshold (Yes in step 204), it is determined whether the degree of brake operation is equal to or greater than the second threshold (step 206). The first threshold is, for example, a threshold for detecting sudden braking. For example, a value of about 80% or 90% of the degree of brake operation estimated at the time of sudden braking is set as the second threshold. The second threshold can be set appropriately.

[0121] If the degree of the brake operation is less than the second threshold value (No in step 206), the projection image determination unit 223 determines that the second pattern is to be displayed with a relatively thick fixed width (step 205). This method can be said to be a method of statically highlighting and displaying the second pattern. For example, the width of the second pattern is set to the maximum width, or the width of the second pattern may be set to about 90% or 80% of the maximum width. 14B is a schematic diagram showing a display example of the second pattern (rear line 3c) displayed in a thick width. Here, the rear line 3c is projected with a fixed width set to be thicker than the normal display. As a result, the thick rear line 3c is projected in addition to the brake lamp 35, so that a strong braking operation of the vehicle 1 can be emphasized and communicated to the following vehicles.

[0122] Returning to FIG. 13, if the degree of the brake operation is equal to or greater than the second threshold value (Yes in step 206), the projection image determination unit 223 determines that the second pattern is to be projected in a blinking display (step 208). The blinking display is a display method in which the second pattern is displayed by blinking, and can be said to be a method in which the second pattern is dynamically highlighted and displayed. FIG. 14C is a schematic diagram showing an example of the display of the second pattern (rear line 3c) in the blinking display. In the blinking display, for example, the width of the rear line 3c is set to be equal to or greater than the fixed width in FIG. 14B. At least a part of the rear line 3c is displayed to blink. When a part of the rear line 3c blinks, it is also possible to display the blinking part moving. That is, the rear line 3c may be displayed as an animation. As a result, the blinking rear line 3c is projected in addition to the brake lamp 35, so that the sudden braking operation of the vehicle 1 can be conveyed with sufficient emphasis. As a result, it is possible to effectively attract the attention of following vehicles, etc.

[0123] Returning to FIG. 13, in steps 205, 207, and 208, After the display of the pattern 2 is set, the image data generating unit 224 generates image data to be output to each projection unit 210 based on the set data (step 209). Then, each projection unit 210 provided in the vehicle 1 projects the corresponding line pattern 3 based on the image data (step 210).

[0124] Thus, in this embodiment, the projection image determination unit 223 increases the width of the second pattern when the degree of braking operation is equal to or greater than the first threshold and less than a second threshold that is greater than the first threshold, and blinks the second pattern when the degree of braking operation is equal to or greater than the second threshold. This makes it possible to clearly communicate to following vehicles traveling outside the vehicle when the vehicle 1 is decelerating quickly or when a sudden stop is expected.

[0125] In the operation example shown in Fig. 13, the discontinuous display control of the second pattern according to the degree of braking operation has been described. Instead of the degree of braking operation, it is also possible to control the second pattern discontinuously according to the risk of collision with a following vehicle. Specifically, the projection image determination unit 223 estimates the collision risk with the following vehicle based on the following vehicle information. Then, a process is executed to gradually change the display of the rear pattern (second pattern) according to the collision risk. This process is, for example, a process shown in Fig. 13, which is executed using the collision risk with the following vehicle instead of the degree of the brake operation.

[0126] 12, in the projection device 200, the surrounding environment recognition unit 225 calculates following vehicle information (information such as the relative distance and relative speed with respect to the following vehicle). Using this following vehicle information, the collision risk is estimated (corresponding to step 205). The collision risk is set to a higher value, for example, as the relative distance to the following vehicle becomes shorter and as the relative speed to the following vehicle becomes faster. As an example, the relative speed / relative distance is calculated as the collision risk. Alternatively, the collision risk may be calculated from either the relative distance or the relative speed. Furthermore, the collision risk may be calculated by taking into account the deceleration amount of the host vehicle 1, etc., with reference to braking information, etc.

[0127] In addition, a first threshold and a second threshold are set for determining the collision risk. The first threshold is set to a value of, for example, about 30% to 50% of the maximum collision risk. The second threshold is set to a value of, for example, 50% or more of the maximum collision risk. Of course, the present invention is not limited to this, and each threshold may be set so as to call attention at an appropriate timing.

[0128] For example, when the collision risk is estimated, it is determined whether the collision risk is equal to or greater than a first threshold (corresponding to step 204). For example, if the collision risk is less than the first threshold, the normal display of the second pattern is executed (corresponding to step 205). If the collision risk is equal to or greater than the first threshold, it is determined whether the collision risk is equal to or greater than the second threshold (corresponding to step 206). For example, if the collision risk is less than the second threshold, the second pattern is displayed in a thicker width (corresponding to step 207). If the collision risk is equal to or greater than the second threshold, the second pattern is displayed in a blinking manner (corresponding to step 208). As a result, the display of the second pattern (typically the rear line 3c) changes discontinuously according to the risk of collision with the following vehicle. As a result, it is possible to clearly communicate to the following vehicles traveling outside the vehicle that the possibility of a collision with the vehicle 1 is increasing.

[0129] There have been reported accidents where a following vehicle has collided with a stopped vehicle at a traffic light or at the end of a traffic jam. To prevent such accidents, operations such as "pushing the brakes to flash the brake lights" and "turning on the hazard lights" are recommended as self-defense measures. As a method for automating such operations, for example, a method is considered in which the following vehicle is monitored and the hazard lights are automatically flashed when there is a risk of a rear-end collision. However, such operations may not be sufficiently effective, and an effective warning method for making the driver of the following vehicle aware that the vehicle has stopped is required.

[0130] In this embodiment, a rear line 3c (second pattern) that displays the trajectory of the wheels is projected behind the traveling vehicle 1. This second pattern is switched to a thicker line display (see FIG. 14B) or a blinking display (see FIG. 14C) depending on the degree of braking. In this way, it is possible to call the driver of the following vehicle's attention to the road ahead using not only a static display but also a dynamic display. This makes it possible to sufficiently avoid the occurrence of a collision with the following vehicle.

[0131] <Other embodiments> The present technology is not limited to the above-described embodiment, and various other embodiments can be realized.

[0132] In the above embodiment, a pattern representing the vehicle's trajectory (passing trajectory or predicted trajectory) is set as the main line pattern. However, the present invention is not limited to this, and it is also possible to use a fixed straight line pattern extending along the front-rear direction of the vehicle 1, for example. Alternatively, a pattern in which the ends of the left and right lines are closed may be used. In addition, a pattern of any shape, size, or color may be used as the projection pattern.

[0133] In the process described with reference to FIG. 13 etc., the pattern (rear line) that serves as a warning display to the following vehicle is switched and displayed. In addition to this, it is also possible to emit a warning sound, for example, using a directional speaker, toward the following vehicle. In this case, since an auditory warning sound is transmitted together with a warning such as a flashing display, it is possible to effectively inform the following vehicle of the braking operation and the risk of collision.

[0134] In the above, a single controller is exemplified as an embodiment of the information processing device according to the present technology. However, the controller may be configured separately, and the information processing device according to the present technology may be realized by any computer connected to the controller via wired or wireless communication. For example, the information processing method according to the present technology may be executed by a cloud server. Alternatively, the controller and another computer may work together to execute the information processing method according to the present technology.

[0135] That is, the information processing method and program according to the present technology can be executed not only in a computer system composed of a single computer, but also in a computer system in which multiple computers operate in conjunction with each other. In this disclosure, a system means a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing are both systems.

[0136] The information processing method and program execution according to the present technology by a computer system includes both cases where, for example, acquisition of speed-related information, control of display of a projection pattern, etc., are executed by a single computer, and cases where each process is executed by a different computer. Furthermore, execution of each process by a specific computer includes having another computer execute part or all of the process and acquiring the results.

[0137] In other words, the information processing method and program according to the present technology can also be applied to a cloud computing configuration in which a single function is shared and processed jointly by multiple devices via a network.

[0138] It is also possible to combine at least two of the characteristic parts of the present technology described above. That is, the various characteristic parts described in each embodiment may be arbitrarily combined without distinction between the embodiments. In addition, the various effects described above are merely examples and are not limited thereto, and other effects may be exhibited.

[0139] In this disclosure, the terms "same", "equal", "orthogonal", etc. are concepts that include "substantially the same", "substantially equal", "substantially orthogonal", etc. For example, a state that falls within a predetermined range (e.g., a range of ±10%) based on "completely the same", "completely equal", "completely orthogonal", etc. is also included.

[0140] The present technology can also be configured as follows. (1) an acquisition unit for acquiring speed-related information regarding a speed of a vehicle; a projection control unit that controls display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle based on the speed-related information; An information processing device comprising: (2) An information processing device according to (1), the projection pattern includes a line-shaped pattern, The projection control unit controls at least one display parameter of the length, width, color, and blinking of the line pattern. Information processing device. (3) An information processing device according to (2), The projection control unit controls display parameters of the line-shaped pattern in response to at least one of an accelerator operation and a brake operation in the vehicle. Information processing device. (4) An information processing device according to (3), the line-shaped pattern includes a first line-shaped pattern projected forward in a traveling direction of the vehicle and a second line-shaped pattern projected backward in the traveling direction, The projection control unit controls at least a display parameter of the first pattern in response to the accelerator operation, and controls at least a display parameter of the second pattern in response to the brake operation. Information processing device. (5) An information processing device according to (4), The speed-related information includes an accelerator opening degree, The projection control unit increases a width of the first pattern as the opening degree of the accelerator increases. Information processing device. (6) An information processing device according to (4) or (5), The speed-related information includes a brake opening degree, The projection control unit increases a width of the second pattern as the opening degree of the brake increases. Information processing device. (7) An information processing device according to any one of (4) to (6), the speed-related information includes a speed of the vehicle; The projection control unit increases lengths of the first pattern and the second pattern as the speed of the vehicle increases. Information processing device. (8) An information processing device according to any one of (4) to (7), The speed-related information includes a deceleration parameter including at least one of a deceleration of the vehicle, a brake operation force, and a brake opening degree, The projection control unit estimates a degree of the brake operation based on the deceleration parameter, and discontinuously changes the second pattern according to the degree of the brake operation. Information processing device. (9) An information processing device according to (8), The projection control unit increases a width of the second pattern when the degree of the brake operation is equal to or greater than a first threshold and less than a second threshold that is greater than the first threshold, and blinks the second pattern when the degree of the brake operation is equal to or greater than the second threshold. Information processing device. (10) An information processing device according to any one of (4) to (7), The acquisition unit acquires following vehicle information regarding a following vehicle of the vehicle, The projection control unit estimates a collision risk with the following vehicle based on the following vehicle information, and discontinuously changes the second pattern in accordance with the collision risk. Information processing device. (11) The information processing device according to any one of (4) to (10), further comprising: a predicted trajectory calculation unit that calculates a predicted trajectory along which the vehicle is predicted to pass; The projection control unit generates the first pattern representing the predicted trajectory. Information processing device. (12) The information processing device according to any one of (4) to (11), further comprising: A passing trajectory calculation unit is provided for calculating a passing trajectory of the vehicle, The projection control unit generates the second pattern representing the passing trajectory. Information processing device. (13) An information processing device according to any one of (2) to (12), the projection pattern includes a pattern other than the line-shaped pattern, The projection control unit selects the other pattern as the projection pattern in a first state in which the vehicle is stopped and does not move in response to an accelerator operation on the vehicle, and selects the line-shaped pattern as the projection pattern in a second state in which the vehicle can move in response to an accelerator operation on the vehicle. Information processing device. (14) An information processing device according to any one of (1) to (13), The acquisition unit acquires driving state information related to a driving state of the vehicle, The projection control unit switches the type of the projection pattern or the control content of the display parameters of the projection pattern based on the traveling state information. Information processing device. (15) An information processing device according to (14), The driving condition information includes at least one of a state of a shift position of the vehicle and a state of a side brake of the vehicle. Information processing device. (16) Obtain speed-related information about the speed of the vehicle; A projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle is controlled based on the speed-related information. The information processing method is executed by a computer system. (17) obtaining speed-related information relating to a speed of the vehicle; controlling display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle based on the speed-related information; A program that causes a computer system to execute the above. (18) A projection unit mounted on a vehicle and configured to project a projection pattern onto a road surface around the vehicle; An acquisition unit that acquires speed-related information regarding a speed of the vehicle; a projection control unit that controls display of the projection pattern projected from the projection unit based on the speed-related information; A projection device comprising: [Explanation of symbols]

[0141] 1, 1a, 1b…Vehicle 2. Projection pattern 3...Line pattern 3a…Front line 3b…Central line 3c…Rear line 4…Direction of travel 5…Predicted trajectory 6…Passing trajectory 7...Stopping pattern 10, 10a~10h, 210...Projection section 15, 215...Storage section 20, 220…Controller 21, 221…Vehicle information acquisition section 22, 222...trajectory calculation section 23, 223...projection image determination unit 30…Driver 225…Surrounding Area Awareness Division 100, 200...projection device

Claims

1. an acquisition unit for acquiring speed-related information relating to a speed of a vehicle; a projection control unit that controls display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle based on the speed-related information; Equipped with the projection pattern includes a line-shaped pattern and another pattern different from the line-shaped pattern, The projection control unit selects the other pattern as the projection pattern in a first state in which the vehicle is stopped and does not move in response to an accelerator operation on the vehicle, and selects the line-shaped pattern as the projection pattern in a second state in which the vehicle can move in response to an accelerator operation on the vehicle. Information processing device.

2. 2. The information processing device according to claim 1, The projection control unit controls at least one display parameter of the length, width, color, and blinking of the line pattern. Information processing device.

3. 3. The information processing device according to claim 2, The projection control unit controls display parameters of the line-shaped pattern in response to at least one of an accelerator operation and a brake operation in the vehicle. Information processing device.

4. 4. The information processing device according to claim 3, the line-shaped pattern includes a first line-shaped pattern projected forward in a traveling direction of the vehicle and a second line-shaped pattern projected backward in the traveling direction, The projection control unit controls at least a display parameter of the first pattern in response to the accelerator operation, and controls at least a display parameter of the second pattern in response to the brake operation. Information processing device.

5. 5. The information processing device according to claim 4, The speed-related information includes an accelerator opening degree, The projection control unit increases a width of the first pattern as the opening degree of the accelerator increases. Information processing device.

6. 5. The information processing device according to claim 4, The speed-related information includes a brake opening degree, The projection control unit increases a width of the second pattern as the opening degree of the brake increases. Information processing device.

7. 5. The information processing device according to claim 4, the speed-related information includes a speed of the vehicle; The projection control unit increases lengths of the first pattern and the second pattern as the speed of the vehicle increases. Information processing device.

8. 5. The information processing device according to claim 4, The speed-related information includes a deceleration parameter including at least one of a deceleration of the vehicle, a brake operation force, and a brake opening degree, The projection control unit estimates a degree of the brake operation based on the deceleration parameter, and discontinuously changes the second pattern according to the degree of the brake operation. Information processing device.

9. 9. The information processing device according to claim 8, The projection control unit increases a width of the second pattern when the degree of the brake operation is equal to or greater than a first threshold and less than a second threshold that is greater than the first threshold, and blinks the second pattern when the degree of the brake operation is equal to or greater than the second threshold. Information processing device.

10. 5. The information processing device according to claim 4, The acquisition unit acquires following vehicle information regarding a following vehicle of the vehicle, The projection control unit estimates a collision risk with the following vehicle based on the following vehicle information, and discontinuously changes the second pattern in accordance with the collision risk. Information processing device.

11. The information processing device according to claim 4, further comprising: a predicted trajectory calculation unit that calculates a predicted trajectory along which the vehicle is predicted to pass; The projection control unit generates the first pattern representing the predicted trajectory. Information processing device.

12. The information processing device according to claim 4, further comprising: A passing trajectory calculation unit is provided for calculating a passing trajectory of the vehicle, The projection control unit generates the second pattern representing the passing trajectory. Information processing device.

13. 2. The information processing device according to claim 1, The acquisition unit acquires driving state information related to a driving state of the vehicle, The projection control unit switches the type of the projection pattern or the control content of the display parameters of the projection pattern based on the traveling state information. Information processing device.

14. The information processing device according to claim 13, The driving condition information includes at least one of a state of a shift position of the vehicle and a state of a side brake of the vehicle. Information processing device.

15. obtaining speed related information relating to a speed of a vehicle; controlling display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle based on the speed-related information; An information processing method executed by a computer system, comprising: the projection pattern includes a line-shaped pattern and another pattern different from the line-shaped pattern, The step of controlling the display of the projection pattern includes selecting the other pattern as the projection pattern in a first state in which the vehicle is stopped and does not move in response to an accelerator operation on the vehicle, and selecting the line-shaped pattern as the projection pattern in a second state in which the vehicle can move in response to an accelerator operation on the vehicle. Information processing methods.

16. obtaining speed related information relating to a speed of a vehicle; controlling display of a projection pattern projected onto a road surface around the vehicle from a projection unit mounted on the vehicle based on the speed-related information; A program for causing a computer system to execute the above, the projection pattern includes a line-shaped pattern and another pattern different from the line-shaped pattern, The step of controlling the display of the projection pattern includes selecting the other pattern as the projection pattern in a first state in which the vehicle is stopped and does not move in response to an accelerator operation on the vehicle, and selecting the line-shaped pattern as the projection pattern in a second state in which the vehicle can move in response to an accelerator operation on the vehicle. program.

17. A projection unit that is mounted on a vehicle and projects a projection pattern onto a road surface around the vehicle; An acquisition unit that acquires speed-related information regarding a speed of the vehicle; a projection control unit that controls display of the projection pattern projected from the projection unit based on the speed-related information; Equipped with the projection pattern includes a line-shaped pattern and another pattern different from the line-shaped pattern, The projection control unit selects the other pattern as the projection pattern in a first state in which the vehicle is stopped and does not move in response to an accelerator operation on the vehicle, and selects the line-shaped pattern as the projection pattern in a second state in which the vehicle can move in response to an accelerator operation on the vehicle. Projection system.

Images