Display control device, display control method, and display controlling program

Abstract

To provide a display control device that can display an image so as to enable a user to more feel a movement state of a vehicle.SOLUTION: A display control device includes a processing unit 1 for controlling a display mode of an image group including a reference image and an interlocking image of which display mode changes interlocking with a change of a display mode of the reference image so as to correspond to a movement mode of a vehicle.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present application relates to the technical fields of a display control device, a display control method, and a display control program. More specifically, the present application relates to the technical fields of a display control device and a display control method that perform control for displaying an image, and a program for the display control device. [Background technology]

[0002] In recent years, various techniques have been developed for displaying images while a moving object such as a vehicle is moving. One example of such conventional techniques is the technique described in Patent Document 1 below.

[0003] The technology described in Patent Document 1 is configured to change and display content that can be displayed during autonomous driving in accordance with the vehicle's behavior, with the aim of reducing motion sickness in passengers during autonomous driving. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-271613 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology described in Patent Document 1, the changes in the displayed content are monotonous, and there is a demand for image display that allows passengers to better experience the moving state of the vehicle.

[0006] Therefore, the present application has been made in consideration of the above problems and demands, and one example of the object of the application is to provide a display control device and a display control method, as well as a program for the display control device, that are capable of displaying images so that the moving state of the vehicle can be more vividly experienced. [Means for solving the problem]

[0007] In order to solve the above problem, the invention described in claim 1 comprises a control means for controlling the display mode of a group of images consisting of a reference image and a linked image whose display mode changes in conjunction with a change in the display mode of the reference image, in accordance with the movement mode of a moving object.

[0008] In order to solve the above problem, the invention described in claim 13 is a display control method executed in a display control device equipped with a control means, and includes a control step of controlling, by the control means, the display mode of a group of images consisting of a reference image and a linked image whose display mode changes in conjunction with a change in the display mode of the reference image, in accordance with the movement mode of a moving body.

[0009] In order to solve the above problem, the invention described in claim 14 causes a computer to function as the display control device described in any one of claims 1 to 12. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of a display control device according to an embodiment. [Diagram 2] 1 is a block diagram showing a schematic configuration of a projection device according to an embodiment. [Diagram 3] 4 is a flowchart showing a display control process according to the embodiment. [Figure 4] FIG. 11 is a diagram (I) illustrating a display mode of an image group according to an embodiment. [Diagram 5] FIG. 2 is a diagram (II) illustrating a display mode of an image group in the embodiment. [Figure 6] FIG. 3 is a diagram (III) illustrating an example of a display mode of an image group according to the embodiment. [Figure 7] FIG. 4 is a diagram (IV) illustrating a display mode of an image group according to an embodiment. [Figure 8] FIG. 11 is a diagram (V) illustrating a display mode of an image group according to the embodiment. [Figure 9]FIG. 11 is a diagram (I) illustrating the display mode of an image group relating to each modified example, where (a) is a diagram illustrating the display mode of an image group relating to the fifth modified example, (b) is a diagram illustrating the display mode of an image group relating to the sixth modified example, (c) and (d) are diagrams illustrating the display mode of an image group relating to the seventh modified example, and (e) is a diagram illustrating the display mode of an image group relating to the eighth modified example. [Figure 10] FIG. 2 is a diagram (II) illustrating the display mode of the image group relating to each modified example, where (a) and (b) are diagrams illustrating the display mode of the image group relating to the ninth modified example, (c) is a diagram illustrating the display mode of the image group relating to the tenth modified example, (d) is a diagram illustrating the display mode of the image group relating to the eleventh modified example, (e) is a diagram illustrating the display mode of the image group relating to the twelfth modified example, and (f) is a diagram illustrating the display mode of the image group relating to the thirteenth modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Next, an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram showing a schematic configuration of a display control device according to the embodiment.

[0012] As shown in FIG. 1, a display control device S according to the embodiment is configured to include a control means 1.

[0013] In this configuration, the control means 1 controls the display mode of the image group including the first image element and the second image element, which as a whole indicates the traveling direction of the moving object, in accordance with the moving mode of the moving object. At this time, the control means 1 moves the relative position of the second image element with respect to the first image element in a moving direction corresponding to the direction of acceleration applied to the moving object in accordance with the moving mode of the moving object.

[0014] As described above, according to the operation of the display control device S of the embodiment, the display mode of the image group consisting of the first image element and the second image element is controlled in accordance with the movement mode of the moving object. At this time, the relative position of the second image element with respect to the first image element is moved in a movement direction corresponding to the direction of acceleration applied to the moving object according to the movement mode of the moving object, so that the image group can be displayed so that the movement mode of the moving object can be experienced. EXAMPLES

[0015] Next, specific examples corresponding to the above-described embodiment will be described with reference to Fig. 2 to Fig. 8. The examples described below are examples in which the present application is applied to display control in a projection device that displays an image by projection onto, for example, a ceiling part inside a vehicle, which is an example of a moving body according to the embodiment.

[0016] Fig. 2 is a block diagram showing a schematic configuration of a projection device according to an embodiment, Fig. 3 is a flowchart showing a display control process according to an embodiment, and Fig. 4 to Fig. 8 are diagrams showing examples of display modes of an image group according to an embodiment. In Fig. 2, the same component numbers as those in the display control device S are used for the components of the embodiment corresponding to the components in the display control S according to the embodiment shown in Fig. 1.

[0017] As shown in FIG. 2, the projection device P according to the embodiment is mounted on the vehicle. In the following description, the vehicle on which the projection device P is mounted is simply referred to as a "vehicle". The projection device P may be incorporated in an audio device or a navigation device mounted on the vehicle. The projection device P is configured with a processing unit 1 including a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), etc. (not shown), a projection unit 2 including a projection light source and a focus adjustment unit, etc., a sensor unit 3 including a global positioning system (GPS) sensor, an acceleration sensor, a steering angle sensor, a volume sensor, etc., an operation unit 4 including a remote control or operation buttons, etc., and a storage unit 5 including a hard disc drive (HDD) or a solid state drive (SSD), etc. In this case, the processing unit 1 corresponds to an example of the control means 1 according to the embodiment, an example of the "rotation control means" according to the present application, an example of the "movement control means", an example of the "size control means", an example of the "movement path image display control means", and an example of the "sound change image display control means". The sensor unit 3 corresponds to an example of the "speed information acquiring means" and an example of the "sound information acquiring means" according to the present application.

[0018] In the above configuration, the storage unit 5 stores in advance material images that are materials for forming an image projected and displayed by the projection device P according to the embodiment. The storage unit 5 also stores in advance map data indicating roads along which the vehicle is moving or is scheduled to move. On the other hand, the sensor unit 3 detects the vehicle speed, steering angle, acceleration applied to the vehicle, and the like based on the output from the GPS sensor, etc., and outputs the respective detection results to the processing unit 1. If the projection device P is incorporated in, for example, the navigation device, the sensor unit 3 may obtain the detection results from an acceleration sensor or the like constituting the navigation device. If there is a sound such as music being emitted in the vehicle cabin while the image according to the embodiment is projected and displayed, the sensor unit 3 detects the volume of the sound and outputs the detection result to the processing unit 1. As for the information indicating the volume, in addition to the detection result from the sensor unit 3, the processing unit 1 may obtain information indicating the volume corresponding to a setting operation of the volume, for example, or the processing unit 1 may obtain information indicating the volume from a device (not shown) other than the projection device P. Furthermore, when an operation is performed by the user of the projection device P on the operation unit 4, the operation unit 4 generates an operation signal corresponding to the operation and outputs it to the processing unit 1. In response to each detection result from the sensor unit 3, the processing unit 1 uses material images stored in the storage unit 5 to generate image information corresponding to the image according to the embodiment to be projected and displayed on the ceiling or the like, and outputs the image information to the projection unit 2. The projection unit 2 then projects an image corresponding to the image information output from the processing unit 1 onto the ceiling or the like.

[0019] Next, the display control process according to the embodiment will be specifically described with reference to FIGS.

[0020] 3, the processing unit 1 monitors whether or not a start operation for starting the display control process according to the embodiment has been performed on the operation unit 4 after, for example, a power switch (not shown) of the projection device P has been turned on, based on the operation signal, etc. (step S1). If the start operation has not been performed in the monitoring of step S1 (step S1: NO), the processing unit 1 transitions to, for example, another process as the projection device P.

[0021] On the other hand, when the start operation is performed in the monitoring of step S1 (step S1: YES), the processing unit 1 acquires acceleration information indicating the detection result of the acceleration applied to the vehicle, steering angle information indicating the detection result of the steering angle of the vehicle, and volume information indicating the detection result of the volume of the sound emitted in the vehicle cabin from the sensor unit 3, etc. (steps S2 to S4). In addition, the processing unit 1 acquires road information indicating the shape (whether the road is straight or curved (including the direction of the curve), etc.) of each of the road on which the vehicle is currently traveling and the road to be traveled, from the map data stored in the storage unit 5 (step S5). Here, the order of the above steps S2 to S5 is not limited to the order shown in FIG. 3, and these orders may be interchanged, or the steps S2 to S5 may be performed simultaneously.

[0022] Thereafter, the processing unit 1 generates image information corresponding to the image according to the embodiment to be projected and displayed on the ceiling or the like, using the material images stored in the storage unit 5 based on the acceleration information etc. acquired in steps S2 to S4 and the road information acquired in step S5 (step S6). The processing unit 1 then outputs the generated image information to the projection unit 2, which projects the image on the ceiling or the like and displays it (step S7). The processes in steps S6 and S7 will be described in detail later.

[0023] Thereafter, the processing unit 1 monitors whether or not a termination operation to terminate the display control process according to the embodiment has been performed on the operation unit 4 based on the operation signal or the like (step S8). If the termination operation has not been performed in the monitoring of step S8 (step S8: NO), the processing unit 1 returns to step S2 and repeats the series of display control processes described above. On the other hand, if the termination operation has been performed in the monitoring of step S8 (step S8: YES), the processing unit 1 transitions to another process as the projection device P, for example.

[0024] Next, the above-mentioned processes in steps S6 and S7 will be described with reference to specific examples of images projected and displayed, with reference to Figures 4 to 8. In Figures 4 to 8, the downward direction in the drawings is the traveling direction of the vehicle.

[0025] First, when the vehicle is moving straight and the road along which the vehicle is to travel is also a straight road, the image shown in FIG. 4(a) is projected and displayed on the projection area AR of the ceiling or the like. At this time, the processing unit 1 displays the main images G0 to G8, each of which is an equilateral triangle, arranged so as to form a triangle as a whole as shown in FIG. 4(a). The triangular image group formed by the main images G0 to G8 corresponds to an example of an image group according to the embodiment. The main image G0 corresponds to an example of a "reference image" according to the present application, and the main images G1 to G8 correspond to an example of a "linked image" according to the present application. In the following description, the triangular image group formed by the main images G0 to G8 is simply referred to as an "image group". Since the shape of this image group is a downward triangle as a whole, the image group indicates the traveling direction of the vehicle. In addition, the processing unit 1 displays, as backgrounds of the image group, a plurality of first background images 10, which are composed of a plurality of straight lines substantially parallel to the traveling direction of the vehicle and have a shape similar to each of the main images G0 to G8 as a whole, and a plurality of road images 11, each of which is, for example, linear and shows the shape of the road on which the vehicle has traveled or will travel. At this time, the processing unit 1 displays the first background image 10 and the road image 11 while moving them from bottom to top in FIG. 4 in the projection area AR at a speed corresponding to the moving speed of the vehicle. In addition, with regard to the road image 11, for example, when a route is being set or automatic driving is being performed, the processing unit 1 changes the shape of the road image 11 displayed below the image group in the projection area AR to match the shape of the road on which the vehicle will travel. Furthermore, the processing unit 1 may change the shape of the road image 11 displayed above the image group in the projection area AR to match the shape of the road on which the vehicle has passed. In this case, the processing unit 1 may switch between the position of the road image 11 having a shape corresponding to the shape of the road to be traveled and the position of the road image 11 having a shape corresponding to the shape of the road that has been passed, with the position of the image group as the boundary, or may switch between a position either before or after the position of the image group. The shape of the road image 11 may be, for example, a strip-like shape, as long as it can evoke a road. Also, not only may the shape of each road image 11 be such that it can evoke a road by itself, but the shape of a plurality of road images 11 may be such that it can evoke a road as a whole.More specifically, for example, the entire shape formed by a plurality of road images 11 may be such that it is possible to evoke a road, such as by forming a shape in which a road is reminiscent of successive dot-like road images 11.

[0026] Next, for example, when the steering wheel of the vehicle is rotated clockwise to change the traveling direction of the vehicle to the right, the processing unit 1 projects and displays the image shown in Fig. 4(b) in the projection area AR. At this time, the processing unit 1 projects and displays each of the main images G0 to G8 while rotating them counterclockwise in accordance with the change in steering angle caused by the steering wheel operation. In this case, the processing unit 1 may simultaneously start the rotation of each of the main images G0 to G8, or may start the rotation of the main images G1 to G8 while delaying the rotation of the main images G1 to G8 by a preset time, for example, as the main images are further away from the main image G0.

[0027] In addition, the processing unit 1 moves the main images G0 to G8 in a movement direction (leftward in FIG. 4(b) in the example shown in FIG. 4(b)) corresponding to the direction of acceleration indicated by the acceleration information (the direction of acceleration becomes leftward in FIG. 4(b) in the example shown in FIG. 4(b)) since the vehicle's traveling direction changes to the right). At this time, the processing unit 1 moves the main images G1 to G8 with a delay of about the amount of the main images G1 to G8 that are projected and displayed away from the main image G0. In this case, the movement of the main images G1 to G8 may start simultaneously with the movement of the main image G0, or may start with a delay of a preset delay time. Furthermore, when rotating and moving the main images G0 to G8, the processing unit 1 projects and displays them so as to maintain the positional relationship of each image group, that is, for example, the positional relationship in which the main images G1 to G3 form a first triangle with the main image G0 as the apex, and the main images G4 to G8 form a second triangle with the main image G0 as the apex. At this time, the processing unit 1 controls the positional relationship, for example, by the position of the center of the circumscribing circle of each of the main images G0 to G8. Furthermore, the processing unit 1 projects and displays each first background image 10 at a position corresponding to the position of the corresponding main image G0 to G8. In addition to these, the processing unit 1 projects and displays a road image 11 by changing the direction according to the change in the traveling direction of the vehicle, as exemplified in FIG. 4(b). Furthermore, the processing unit 1 projects and displays a second background image 12 similar to the main image G0 to G8 at a position that becomes the background of one of the main images G0 to G8. In the example shown in FIG. 4(b), a part of the second background image 12 corresponding to the main image G3 is projected and displayed at a position corresponding to the position of the main image G3.

[0028] When projecting each of the main images G0 to G8, the first background image 10, the road image 11 and the second background image 12, the processing unit 1 reads out the corresponding material images from the memory unit 5 and uses them to control the projection.

[0029] Next, an image projected and displayed in the projection area AR at the timing when the steering wheel is rotated clockwise from the state illustrated in Fig. 4(b) is illustrated using Fig. 5(a). As illustrated in Fig. 5(a), the main images G0 to G8 are continuously rotated and moved further from the state illustrated in Fig. 4(b) and then projected and displayed. Furthermore, in response to the traveling direction of the vehicle due to the rotation of the steering wheel, each of the first background images 10 is projected and displayed together with the main images G0 to G8, and further the direction of the road image 11 is changed and the road image 11 is projected and displayed.

[0030] Next, Figure 5(b) illustrates an example of an image that is projected and displayed in the projection area AR at the timing when the steering wheel starts to be rotated counterclockwise (i.e., when the steering wheel starts to be returned) from the state illustrated in Figure 5(a) (i.e., the state when the steering wheel has finished rotating).

[0031] That is, when the steering wheel is turned counterclockwise to return the vehicle to a straight running direction, the processing unit 1 projects and displays each of the main images G0 to G8 while rotating them clockwise (i.e., returning them to their original direction) in accordance with the change in steering angle caused by the steering wheel operation in the counterclockwise direction, as shown in Fig. 5(b) for example. In this case, the processing unit 1 may simultaneously start the rotation of each of the main images G0 to G8, or may start the rotation of the main images G1 to G8 while delaying the rotation of the main images G1 to G8 by a preset time for those images that are farther away from the main image G0.

[0032] In addition, the processing unit 1 moves the main images G0 to G8 in a movement direction (the right direction in FIG. 5(b) in the example shown in FIG. 5(b)) corresponding to the direction of acceleration indicated by the acceleration information (the direction of acceleration is the right direction in FIG. 5(b) since the traveling direction of the vehicle changes to a straight line (returns) in the example shown in FIG. 5(b)) in a linked manner (i.e., moves them to return to their original positions (see FIG. 4(a))). At this time, the processing unit 1 moves the main images G1 to G8 with a delay of about the main images G1 to G8 that are projected and displayed away from the main image G0. The movement of the main images G1 to G8 in this case may also be started simultaneously with the movement of the main image G0, or may be started with a delay of a preset delay time. In addition, when rotating and moving the main images G0 to G8, the processing unit 1 projects and displays them so as to maintain their respective positional relationships as an image group, as in the example shown in FIG. 4(b). In addition, the processing unit 1 projects and displays the road image 11, changing the direction according to the change in the traveling direction of the vehicle, as exemplified in Fig. 5(b). Furthermore, the processing unit 1 projects and displays the second background image 12, which becomes the background of any one of the main images G0 to G8. In the case exemplified in Fig. 5(b), parts of the second background image 12 corresponding to the main image G1, the main image G3, the main image G5, and the main image G7 are projected and displayed at positions corresponding to the positions of the main image G3, etc. Then, when the counterclockwise rotation of the steering wheel is completed and the vehicle returns to going straight, the processing unit 1 projects the image exemplified in Fig. 4(a) again onto the projection area AR.

[0033] Next, an image that is projected and displayed in the projection area AR when the steering wheel is operated in a rotation direction opposite to that described with reference to FIGS. 4(b) and 5 will be described with reference to FIG.

[0034] That is, when the steering wheel of the vehicle is rotated counterclockwise to change the traveling direction of the vehicle to the left, the processing unit 1 projects and displays the image shown in Fig. 6(a) in the projection area AR. At this time, the processing unit 1 projects and displays each of the main images G0 to G8 while rotating them clockwise in accordance with the change in steering angle caused by the steering wheel operation. The manner of rotation at this time is the same as that described with reference to Fig. 4(b), except that the direction of rotation is reversed.

[0035] In addition, the processing unit 1 moves the main images G0 to G8 in a movement direction (rightward in FIG. 5(a) in the case of the example shown in FIG. 5(a)) corresponding to the direction of acceleration indicated by the acceleration information (the direction of acceleration becomes rightward in FIG. 5(a) in the case of the example shown in FIG. 5(a)) since the traveling direction of the vehicle changes to the left). The manner of the movement in this case is the same as that described with reference to FIG. 4(b) except that the moving direction is reversed. In addition, the processing unit 1 projects and displays the road image 11 by changing the direction according to the change in the traveling direction of the vehicle, as shown in the example shown in FIG. 5(a). Furthermore, the processing unit 1 projects and displays a second background image 12 similar to the main image G0 to G8 at a position that becomes the background of one of the main images G0 to G8. In the example shown in Figure 4(b), portions of the second background image 12 corresponding to main image G1, main image G2, main image G3, and main image G5 are projected and displayed at positions corresponding to the positions of the main image G1, etc.

[0036] Next, an image projected and displayed in the projection area AR at the timing when the steering wheel is rotated counterclockwise from the state illustrated in Fig. 6(a) is illustrated using Fig. 6(b). As illustrated in Fig. 6(b), the main images G0 to G8 are continuously rotated and moved further from the state illustrated in Fig. 6(a) and then projected and displayed. Furthermore, in response to the traveling direction of the vehicle due to the rotation of the steering wheel, each of the first background images 10 is projected and displayed together with the main images G0 to G8, and further the direction of the road image 11 is changed and the road image 11 is projected and displayed.

[0037] Next, Figure 6(c) shows an example of an image that is projected and displayed in the projection area AR when the steering wheel starts to be rotated clockwise (i.e., when the steering wheel starts to be returned) after the steering wheel has finished rotating, as shown in Figure 6(b).

[0038] That is, when the steering wheel is rotated clockwise to return the vehicle to a straight running direction, the processing unit 1 projects and displays each of the main images G0 to G8 while rotating them counterclockwise (i.e., returning them to their original direction) in accordance with the change in steering angle caused by the clockwise steering operation, as shown in Fig. 6(c). The manner of rotation at this time is the same as that described with reference to Fig. 5(b), except that the direction of rotation is reversed.

[0039] In addition, the processing unit 1 moves the main images G0 to G8 in a moving direction (left direction in FIG. 6(c) in the example shown in FIG. 6(c)) corresponding to the direction of acceleration indicated by the acceleration information (the direction of acceleration is the left direction in FIG. 6(c) since the traveling direction of the vehicle changes to a straight line in the example shown in FIG. 6(c)) in a linked manner (i.e., moves them to return to their original positions (see FIG. 4(a))). The manner of the linked movement at this time is the same as that described using FIG. 5(b) except that the moving direction is reversed. In addition, the processing unit 1 projects and displays the road image 11 by changing the direction according to the change in the traveling direction of the vehicle as shown in FIG. 6(c). Furthermore, the processing unit 1 projects and displays the second background image 12 that becomes the background of any of the main images G0 to G8. In the example shown in FIG. 6(c), a part of the second background image 12 corresponding to each of the main images G1 and G3 is projected and displayed at a position corresponding to the position of the main image G1, etc. Then, when the clockwise rotation of the steering wheel is completed and the vehicle returns to moving straight, the processing unit 1 projects the image exemplified in FIG. 4(a) again onto the projection area AR.

[0040] Next, in addition to the control of the manner of projection onto the projection area AR according to the operation of the steering wheel described with reference to Fig. 4(b) to Fig. 6, the control of the manner of projection according to the volume of music, for example, played in the vehicle in parallel with the projection, will be described with reference to Fig. 7 and Fig. 8. Note that the changes in rotation and position of the main images G0 to G8 and the road image 11, etc. shown in Fig. 7 and Fig. 8 are changes according to the operation of the steering wheel (see Fig. 4(b) to Fig. 6).

[0041] The control of the projection mode according to the volume is mainly performed based on the volume information. Then, the processing unit 1 changes the size of the second background image 12 and the sizes of the main images G0 to G8 based on the volume information, thereby projecting the volume change in a visually recognizable manner.

[0042] More specifically, for example, as illustrated in Fig. 7 and Fig. 8(b), when the traveling direction of the vehicle is changed in response to the operation of the steering wheel, and the volume of the music being emitted into the vehicle at the same time changes, the processing unit 1 controls the size of part or all of the second background image 12 so that, for example, the larger the volume, or the smaller the volume, the larger the size, and projects and displays the second background image 12. In this case, the processing unit 1 may change the size of each second background image 12 in the same manner as illustrated in Fig. 7(a), or may change the size in different ways as illustrated in Fig. 7(b) or Fig. 8(b). Furthermore, as illustrated in Fig. 8(a), the processing unit 1 also changes the size of the second background image 12 based on the change in volume even when the vehicle is moving straight ahead.

[0043] In addition to changing the size of second background image 12, processing unit 1 may change the color of second background image 12 according to the volume and content of the music (such as the chorus part or parts that should be listened to quietly).

[0044] As described above, according to the display control process of the embodiment, the projection mode of the image group consisting of the main image G0 etc. is controlled in accordance with the movement mode of the vehicle, so that the image group can be projected and displayed so that the movement mode of the vehicle can be experienced.

[0045] In addition, the projection mode of the image group consisting of the main image G0 and multiple main images G1 to G8 is controlled in accordance with the vehicle's movement mode, so that the image group can be projected and displayed so that the vehicle's movement mode can be more realistically experienced.

[0046] Furthermore, since the group of images has a triangular shape that indicates the vehicle's overall direction of travel, the group of images can be projected and displayed so that the vehicle's movement, including its direction of travel, can be more easily experienced.

[0047] Furthermore, the main image G0 and the main images G1 to G8 are rotated in response to a change in the steering angle, and the main images G0 and the main images G1 to G8 are moved in a moving direction corresponding to the direction of acceleration applied to the vehicle in an interlocking manner as an image group, and further, the main images G1 to G8 are moved in the moving direction with a delay as much as the main images G1 to G8 projected and displayed away from the main image G0. Thus, the image group can be projected and displayed so that the acceleration applied to the vehicle can be experienced.

[0048] Furthermore, while maintaining the relative relationship between the projection (display) position of the main image G0 and the projection (display) positions of the main images G1 to G8, the main image G0 and the main images G1 to G8 are rotated and moved in conjunction with each other, so that the images can be projected and displayed to provide a more realistic experience of the vehicle's movement.

[0049] Furthermore, since the road image 11 showing the shape of the road is projected and displayed together with the image group, the vehicle's movement can be experienced with a more realistic feeling, and the shape of the road along which the vehicle is scheduled to travel can be predicted.

[0050] Furthermore, the road image 11 is projected and displayed so that the faster the vehicle's moving speed is, the faster the road image 11 changes, so that the viewer can experience the vehicle's moving mode with a more realistic feeling.

[0051] In addition, in parallel with the projection of the main image G0 and the main images G1 to G8, the second background image 12 is projected and displayed while changing the projection mode in response to changes in the music being played inside the vehicle, thereby enhancing the sense of realism and allowing the user to experience changes in the music along with the movement of the vehicle.

[0052] Furthermore, since the second background image 12 is projected and displayed at a position corresponding to the position of the corresponding main image G0 or main image G1 to main image G8, the user can more easily experience the change in sound along with the manner in which the vehicle moves.

[0053] [Variations] Next, a number of modified examples corresponding to the embodiment will be described.

[0054] (1) First Modification First, as a first modified example, in addition to the above-mentioned embodiment, the processing unit 1 may control, for example, to change the size of at least one of the main image G0 or the main image G1 to the main image G8 in accordance with the change in the moving speed of the vehicle. For example, the processing unit 1 may control so that the size of at least one of the main image G0 or the main image G1 to the main image G8 becomes smaller as the moving speed of the vehicle becomes faster (see FIG. 7). In this case, the images can be projected and displayed so that the change in speed can be more easily felt.

[0055] (2) Second Modification Next, as a second modified example, the processing unit 1 may project the main image G0 and the main images G1 to G8 while changing the intervals between the main image G0 and the main images G1 to G8 in response to the change in the volume (see Figs. 7 and 8). In this case, it is more interesting to experience the change in volume or music along with the movement of the vehicle.

[0056] (3) Third Modification Next, as a third modified example, the processing unit 1 may detect the rotation angle when rotating or moving the main image G0 etc., using the detection result of the sensor unit 3 of the traveling direction of the vehicle.

[0057] (4) Fourth Variation Next, as a fourth modification, the processing unit 1 may project and display the main image G0 and the main images G1 to G8 while changing the size of the main image G0 and the main images G1 to G8 in response to the change in the volume. In this case, it is more interesting and the user can experience the change in the sound along with the movement of the vehicle.

[0058] (5) Fifth Variation Next, a fifth modified example will be described with reference to Fig. 9(a), which is a diagram illustrating an example of a display mode of an image group according to the fifth modified example.

[0059] As illustrated in FIG. 9(a), in a fifth modified example, the processing unit 1 may project / display the inclination of the vehicle due to movement or the inclination of the vehicle due to the terrain as a change in the shape of the image group. More specifically, the processing unit 1 first detects, for example, the roll angle of the vehicle (the inclination angle around an axis parallel to the traveling direction of the vehicle) using the acceleration sensor of the sensor unit 3. Then, the processing unit 1 projects / displays the image group in accordance with the detected roll angle so as to rotate the image group in the direction of the roll angle around an axis indicating the traveling direction (indicated by a dashed arrow in the left of FIG. 9(a)) as the rotation axis, as illustrated as the image group GG1 in the left of FIG. 9(a). Note that the processing unit 1 may project / display the image group so as to shift (slide) each main image in the direction of the roll angle in accordance with the detected roll angle, as illustrated as the image group GG2 in the center of FIG. 9(a), or may project / display the image group so as to separate and move away from each main image in the direction of the roll angle, as illustrated as the image group GG3 in the right of FIG. 9(a). Furthermore, the processing unit 1 may detect the pitch angle of the vehicle (the tilt angle around an axis perpendicular and horizontal to the traveling direction of the vehicle) using the sensor unit 3, and change the projection / display mode of the image group according to the detection result.

[0060] (6) Sixth Variation Next, a sixth modified example will be described with reference to Fig. 9(b), which is a diagram illustrating an example of a display mode of an image group according to the sixth modified example.

[0061] As illustrated in FIG. 9(b), as a sixth modified example, the processing unit 1 may project / display the state of acceleration of the vehicle accompanying the movement as a change in the shape of the image group. More specifically, the processing unit 1 detects the acceleration of the vehicle during acceleration using an acceleration sensor of the sensor unit 3. Then, the processing unit 1 projects / displays the image group in a shape that extends backward or diagonally backward as a whole or expresses inertia due to acceleration, according to the detected acceleration, as illustrated as the image group GG4 on the left side of FIG. 9(b). Furthermore, the processing unit 1 may project / display the image group in a shape that extends forward as a whole as illustrated as the image group GG5 in the center of FIG. 9(b), or may project / display the image group in a shape that extends forward and backward as a whole as illustrated as the image group GG6 on the right side of FIG. 9(b).

[0062] (7) Seventh Variation Next, the seventh modified example will be described with reference to Fig. 9(c) and Fig. 9(d), which are diagrams illustrating examples of display modes of an image group according to the seventh modified example.

[0063] As illustrated in Fig. 9(c) and Fig. 9(d), as a seventh modified example, the processing unit 1 may project / display the speed of the vehicle accompanying the movement as a change in the display mode of the image group. More specifically, the processing unit 1 detects the speed of the vehicle using an acceleration sensor or the like of the sensor unit 3. After that, when the detected speed becomes faster, the processing unit 1 moves the projection / display position of the image group GG7 when the speed is slow to a position corresponding to the detected speed together with a speed display SP showing the specific speed, as illustrated in Fig. 9(c), and projects / displays them as an image group GG8. In this case, it is preferable that the processing unit 1 projects / displays the image group GG7, for example, in a different color from the image group GG8. Furthermore, when the detected speed becomes faster, the processing unit 1 may project / display the image group GG9, which was projected / displayed small when the speed was slow, as an image group GG10 having a size corresponding to the detected speed together with a frame image F showing a gradual increase in speed, as illustrated in Fig. 9(d).

[0064] (8) Eighth Variation Next, an eighth modified example will be described with reference to Fig. 9(e), which is a diagram illustrating an example of a display mode of an image group according to the eighth modified example.

[0065] As illustrated in FIG. 9(e), in the eighth modified example, the processing unit 1 may project / display the state of deceleration of the vehicle accompanying its movement as a change in the shape of the image group. More specifically, the processing unit 1 detects the acceleration of the vehicle during deceleration using an acceleration sensor in the sensor unit 3. Then, the processing unit 1 projects / displays the image group in a shape that is squashed in the front-rear direction as a whole (i.e., a shape opposite to that in the sixth modified example) according to the detected acceleration, as illustrated in the image group GG11 on the left side of FIG. 9(e). Furthermore, when deceleration due to sudden braking is detected, the processing unit 1 preferably projects / displays two image groups of different sizes superimposed on each other in red, for example, and displays an exclamation mark in the center, as illustrated in the image group GG12 on the right side of FIG. 9(e).

[0066] (9) Ninth Variation Next, a ninth modified example will be described with reference to Fig. 10(a) and Fig. 10(b), which are diagrams illustrating examples of display modes of an image group according to the ninth modified example.

[0067] As illustrated in FIG. 10(a), as a ninth modified example, the processing unit 1 may project / display the starting or reversing of the vehicle as a change in the shape of the image group. More specifically, the processing unit 1 may project / display a point group PG consisting of nine points moving separately as illustrated in the left side of FIG. 10(a) when, for example, the accessory switch of the vehicle is turned on or the brake is applied, and switch to project / display the image group GG when the engine is actually started or the brake is released. Furthermore, the processing unit 1 may flip the image group GG and project / display the image group GGI illustrated in FIG. 10(b) when the shift lever of the vehicle is in the reverse position (R position). In addition, the processing unit 1 may project / display the image group GG as a preset arrival mode when the shift lever of the vehicle is in the parking position (P position), or may change the color of the entire image group GG to red or change the shape of the image group GG itself to a round shape when the vehicle is stopped at a red light.

[0068] (10) 10th Variation Next, a tenth modified example will be described with reference to Fig. 10(c), which is a diagram illustrating examples of display modes of an image group according to the tenth modified example.

[0069] As illustrated in FIG. 10(c), as a tenth modified example, the processing unit 1 may project / display an image group showing the state of another vehicle other than the vehicle on which the projection device P is mounted (hereinafter, the other vehicle other than the vehicle on which the projection device P is mounted is simply referred to as "other vehicle") together with the image group GG. More specifically, the processing unit 1 detects the position of the other vehicle and its relationship with the vehicle, for example, by so-called vehicle-to-vehicle communication, an in-vehicle camera, or a so-called LiDAR (Laser imaging Detection and Ranging) sensor, and projects / displays the detection result as illustrated in FIG. 10(c). In this case, in the example illustrated in FIG. 10(c), a large other vehicle is moving to the left rear of the vehicle on the road R on which the vehicle is moving, and an image group GG13 showing the large other vehicle is projected / displayed as an image group larger (or made up of more main images) than the image group GG showing the vehicle. 10(c), a small vehicle (e.g., a motorcycle) is moving to the right front of the vehicle on the road R, and an image group GG14 showing the small vehicle is projected / displayed as an image group smaller than the image group GG (or consisting of fewer main images). At this time, the processing unit 1 may project / display a warning that a large vehicle is approaching and that the vehicle may be shaken by the large vehicle together with the image group GG13. The processing unit 1 may also project / display a warning that a small vehicle is cutting in and that the vehicle may be forced to brake suddenly.

[0070] (11) 11th Variation Next, an eleventh modified example will be described with reference to Fig. 10(d), which is a diagram illustrating examples of display modes of an image group according to the eleventh modified example.

[0071] As illustrated in FIG. 10(d), as an eleventh modified example, the processing unit 1 may project / display the operation state of the turn signal of the vehicle as a change in the shape of the image group. More specifically, the processing unit 1 detects the operation state of the turn signal by, for example, the sensor unit 3. Then, depending on the detected operation state, for example, when the right turn signal is operating, the processing unit 1 may project / display the display color of the main image on the right edge of the image group GG in place of orange, as illustrated in FIG. 10(d), and may additionally project / display a plurality of triangular images that become gradually smaller to the right. In addition, the processing unit 1 may use the sensor unit 3 to determine the shape of the road along which the vehicle will travel, the surrounding conditions, or the behavior of the vehicle, such as whether the next movement of the vehicle will be a right / left turn or a lane change, and project / display the result in advance as a change in the display mode of the image group GG.

[0072] (12) 12th Variation Next, the twelfth modified example will be described with reference to Fig. 10(e), which is a diagram illustrating examples of display modes of the image group according to the twelfth modified example.

[0073] As shown in Fig. 10(e), as a twelfth modified example, the processing unit 1 may project / display a ribbon-shaped image group GG16 in which triangular main images are connected vertically, for example, instead of the image group according to the embodiment. As the twelfth modified example, the processing unit 1 executes steps S1 to S5 in the display control process (see Fig. 3) according to the embodiment, and then, at the stage of generating the images to be projected / displayed, projects / displays the image group GG16 shown in Fig. 10(e).

[0074] (13) Thirteenth Variation Next, the thirteenth modified example will be described with reference to Fig. 10(f), which is a diagram illustrating examples of display modes of the image group according to the thirteenth modified example.

[0075] As a thirteenth modified example, when the so-called driving mode of the vehicle when the image group GG1 etc. or the main image G0 etc. in the above-mentioned embodiment and each modified example is set to "normal mode", the shape of the image group and the main image projected / displayed in other driving modes (e.g., other driving modes such as "sport mode" and "eco mode") may be different from the shape of the image group or the main image G0 etc. in the embodiment and each modified example, for example, for each driving mode. More specifically, in the case of the above-mentioned eco mode (low fuel consumption mode), instead of the image group GG according to the embodiment, an image group GG17 having a shape consisting of a gentle curve as a whole as exemplified in FIG. 10(f) may be projected / displayed, thereby expressing the behavior of the vehicle, etc. In this way, the shape of the main image G0 etc. or the image group GG1 etc. is not limited to a triangle, and may be, for example, an ellipse or an arrow shape, or a shape that can evoke a state in which the vehicle is moving, such as the moving direction of the vehicle.

[0076] (14) Other variations As other modified examples, first, the information used to control the aspects of the image group GG etc. in the embodiment and each modified example includes the following information in addition to the snake angle etc. in the embodiment and each modified example. - Vehicle information Engine RPM - Vehicle size (body size) - Driving support system using traffic signal information (information on the timing of traffic signal changes, etc.) - Information showing the number of passengers and their seating positions (internal camera images, etc.) - Information on driving modes during autonomous driving, etc. ●Outside the vehicle Information about the surrounding environment (highways, tunnels, weather, railroad crossings, etc.) Date and time information - Information showing road shape (shape, bumps, gradient, etc.) -Information on the presence or absence of pedestrians or falling objects - Road condition information (wet / dry, etc.) -Signal status information -Other information related to vehicle behavior

[0077] On the other hand, more general examples of display elements (such as the image group GG or the main image G0 in the embodiment and each modified example) controlled using the above information include the following: - Display element showing vehicle · Scale of display elements (thickness, length, size, etc.) - Rotation angle of the display element (can also be displayed to show the gradient of the road or the sense of acceleration / deceleration) Transparency of display elements Position of display elements Orientation of display elements Arrangement of display elements (see, for example, the twelfth modified example) Number of display elements - Shape of display elements (curvature of corners, shape of circle, square, etc.) · Display element materials (colors, images, etc.) Distance between display elements Display elements showing the outside of the vehicle · Scale of display elements (thickness, length, etc.) Angle of display elements (degree of curvature) Transparency of display elements Position of display elements The number and density of display elements - Shape of display elements (e.g. particles instead of lines) -Material of display elements (color, image, etc., used when using road images, for example) -Display element showing the center of gravity distance between display elements corresponding to the outside world Display elements that show the overall shape of display elements that correspond to the outside world (such as displaying fallen objects or sinkholes on the road) - Display element showing the reaction speed of braking etc. to changes in the outside world (if the car reacts in advance based on this, it will contribute to safety and security) - Display element showing the camera angle of the external camera (displaying the view in front of the vehicle contributes to safety and security) - Display elements showing information about other vehicles other than vehicle information

[0078] Next, as a second other modified example, the processing unit 1 may control the state of the image group GG based on future vehicle behavior when setting a route or during automatic driving, in addition to changing the state of the image group GG based on actual vehicle behavior, etc. Furthermore, the processing unit 1 can also control the state of the image group GG, etc., using vehicle behavior predicted, for example, when so-called cruise control or a lane keeping function is executed, other than when setting a route or during automatic driving, or vehicle behavior predicted based on the road shape of a road without branches, such as a mountain road or an expressway.

[0079] Next, as a third other variant example, in the display control process of the embodiment, main images G1 to G8 correspond to examples of the "linked images" of the present application, but in addition to this, one or more triangular main images are sufficient as examples of the "linked images" of the present application.

[0080] In addition, the display control process according to the embodiment may be performed not only in the case where the image is projected and displayed on the ceiling or the like, but also in the case where the image is displayed on, for example, the console of the vehicle as an image of a conventional navigation device. In this case, it is preferable that the image is displayed so that the top of the image faces forward in the traveling direction (i.e., upside down in the case of the examples shown in Figures 4 to 10).

[0081] Furthermore, the display control process according to the embodiment may be executed not only for projection / display in a vehicle, but also in, for example, a home or portable game device or the like.

[0082] In addition, a program corresponding to the flowchart shown in FIG. 3 can be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and then read out and executed by a general-purpose microcomputer or the like, thereby causing the microcomputer or the like to function as the processing unit 2 of the embodiment. [Explanation of symbols]

[0083] 1 Control means (processing section) 2 Projection section 10. First background image 11 Road Images 12 Second background image S Display control device P Projection Equipment G0, G1, G2, G3, G4, G5, G6, G7, G8 Main Image

Claims

[Claim 1] A display control device characterized by comprising a control means for controlling the display mode of a group of images consisting of a reference image and a linked image whose display mode changes in conjunction with changes in the display mode of the reference image, in accordance with the movement mode of a moving object.

Images