Display System
The display system addresses the ineffectiveness of existing motion sickness prevention by dynamically adjusting image size and position based on vehicle motion, ensuring a seamless viewing experience without additional graphics, thereby preventing motion sickness in moving vehicles.
Patent Information
- Application Number
- JP2022171925
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-10-27
- Publication Date
- 2026-01-21
- Estimated Expiration
- 2042-10-27
AI Technical Summary
Existing motion sickness prevention systems in moving objects, such as vehicles, are cumbersome and ineffective, particularly in autonomously driven vehicles, as they display additional shapes alongside images, which can disrupt the occupant's viewing experience and fail to prevent motion sickness effectively.
A display system that adjusts the size and position of images on a display unit based on the motion of the vehicle, using motion information to match the bodily sensations with visual information, without displaying additional graphics for sickness prevention.
The system effectively prevents motion sickness by aligning the visual and physical sensations of the occupant, reducing inconvenience and enhancing the viewing experience by adjusting image size and position in response to vehicle movements.
Smart Images

Figure 0007803246000001 
Figure 0007803246000002 
Figure 0007803246000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a display system mounted on a moving body. [Background technology]
[0002] In moving objects such as vehicles and ships, occupants may become motion sick when viewing images displayed on a display device. This so-called motion sickness occurs, for example, when the bodily sensations experienced when the vehicle accelerates, decelerates, or turns do not match the visual information obtained when viewing the images. A technology has been proposed to prevent the onset of motion sickness that occurs when viewing images on such moving objects. Patent Document 1 discloses a technology in which, in addition to the displayed image, a number of figures of predetermined shapes, such as circles or squares, are displayed on the windshield or liquid crystal display as motion sickness prevention information, and the motion sickness prevention information is moved and displayed in accordance with the movement of the vehicle, thereby matching the bodily sensations experienced by the occupants with the visual information. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2021-86552 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the motion sickness prevention system of Patent Document 1, a large number of shapes such as circles that serve as motion sickness prevention information are displayed in addition to the display image, which can be cumbersome for occupants when viewing the displayed images. In particular, in autonomously driven vehicles, it is expected that occupants will view moving images displayed on a display device such as a liquid crystal display, and the presence of motion sickness prevention information can be very cumbersome when viewing such moving images. Furthermore, it is expected that occupants will be viewing moving images on a liquid crystal display or reading during autonomous driving, and in such cases, displaying motion sickness prevention information on the windshield will not provide the effect of "motion sickness prevention." Thus, there is still room for further improvement in motion sickness prevention in moving objects. [Means for solving the problem]
[0005] The present disclosure has been made to solve at least part of the above-mentioned problems, and can be realized in the following aspects. [Form 1] A display system mounted on a moving body and used, comprising: a display device having a display unit capable of displaying images; and a control device for controlling the display device, the control device having a motion information acquisition unit that acquires motion information indicating at least one of a predicted motion of the moving body and a real motion that is the actual motion of the moving body; and a display adjustment unit that adjusts at least one of the size and position of the display image as seen by an occupant of the moving body by adjusting at least one of the size of the display image displayed on the display unit, the display position of the display image on the display unit, and the position of the display unit in accordance with the motion of the moving body indicated by the motion information, wherein the display unit is disposed on the moving body in the direction of travel of the moving body as seen by the occupant, and the display adjustment unit adjusts at least one of (e1) moving the display position downward when the motion information indicates that the motion of the moving body is leaning forward, and (f1) moving the display position upward when the motion information indicates that the motion of the moving body is leaning backward in accordance with the motion of the moving body indicated by the motion information. [Mode 2] A display system mounted on a moving body and used, comprising: a display device having a display unit capable of displaying images; and a control device for controlling the display device, the control device having: a motion information acquisition unit that acquires motion information indicating at least one of a predicted motion of the moving body and a real motion that is an actual motion of the moving body; and a display adjustment unit that adjusts at least one of a size of a display image displayed on the display unit, a display position of the display image on the display unit, and a position of the display unit, in accordance with the motion of the moving body indicated by the motion information, thereby adjusting at least one of a size and a position of the display image as seen by an occupant of the moving body, wherein the display unit is disposed in the moving body in a traveling direction of the moving body as seen by the occupant, and the display adjustment unit (a3) when the motion of the moving body indicated by the motion information is acceleration, displays the display unit to the occupant in a direction parallel to the traveling direction of the moving body. (b2) moving the display unit closer to the occupant in a direction parallel to the moving direction of the moving body when the movement information indicates that the moving body is decelerating; (c3) moving the display unit to the left when the movement information indicates that the moving body is turning right; and (d3) moving the display unit to the right when the movement information indicates that the moving body is turning left, according to the movement of the moving body indicated by the movement information, and the display adjustment unit performs at least one of: (a4) adjusting the approaching speed of the display unit in accordance with the magnitude of the acceleration of the moving body; (b4) adjusting the moving away speed of the display image in accordance with the magnitude of the deceleration of the moving body; (c4) adjusting the moving left speed of the display unit in accordance with the moving speed of the moving body when turning right; and (d4) adjusting the moving right speed of the display unit in accordance with the moving speed of the moving body when turning left.
[0006] (1) According to one aspect of the present disclosure, there is provided a display system for use mounted on a moving body, the display system including: a display device having a display unit capable of displaying an image; and a control device for controlling the display device, the control device including: a motion information acquisition unit that acquires motion information indicating at least one of a predicted motion of the moving body and a real motion that is an actual motion of the moving body; and a display adjustment unit that adjusts at least one of a size of a display image displayed on the display unit, a display position of the display image on the display unit, and a position of the display unit, in accordance with the motion of the moving body indicated by the motion information, thereby adjusting at least one of the size and position of the display image as seen by an occupant of the moving body. According to this display system, the display adjustment unit adjusts at least one of the size and position of the display image displayed on the display unit and the display position of the display unit in accordance with the movement of the moving body indicated by the movement information, thereby adjusting at least one of the size and position of the display image as seen by the occupant of the moving body. This makes it possible to match the bodily sensation of the movement of the moving body with the information obtained visually when viewing the display image. This makes it possible to prevent occupants of the moving body from feeling sick when viewing the display image. Furthermore, since the display unit does not display graphics or other elements to prevent sickness in addition to the display image, it is possible to reduce the inconvenience to the occupants. (2) In the display system of the above form, the display system may further include a position adjustment device connected to the display device and adjusting the position of the display device within the moving body, and the display adjustment unit may control the position adjustment device to adjust the position of the display device within the moving body, thereby displacing the position of the display unit and adjusting at least one of the size and position of the display image as seen by the occupant. According to this type of display system, the display adjustment unit controls the position adjustment device to adjust the position of the display device within the vehicle, thereby displacing the position of the display unit and adjusting at least one of the size and position of the displayed image as seen by the occupant, thereby ensuring that at least one of the size and position of the displayed image as seen by the occupant can be adjusted. (3) In the display system of the above form, the moving body has at least one of a navigation device having set route information, a status sensor that detects the current operating state of the moving body, and an imaging device that images the surroundings of the moving body, and the control device further has an operation prediction unit that identifies the predicted operation from at least one of the route information acquired from the navigation device, the operating state detected by the status sensor, and the image obtained by the imaging device, and the operation information acquisition unit may acquire information indicating the predicted operation identified by the operation prediction unit as the operation information. According to this form of display system, the control device further has an action prediction unit that identifies a predicted action from at least one of the route information acquired from the navigation device, the action state detected by the status sensor, and the captured image obtained by the imaging device, and the action information acquisition unit acquires information indicating the predicted action identified by the action prediction unit as action information, so that highly accurate actions can be predicted as predicted actions, and since such highly accurate predicted actions are used as action information, the occurrence of motion sickness can be more reliably suppressed. (4) In the display system of the above form, the moving body may have a status sensor that detects the current operating state of the moving body, and the operation information acquisition unit may acquire information indicating the operating state detected by the status sensor as the operation information indicating the actual operation. According to this type of display system, the motion information acquisition unit acquires information indicating the motion state detected by the state sensor possessed by the moving body as motion information indicating the actual motion, so that highly accurate motion can be identified as the actual motion, and since the information indicating such highly accurate motion state is used as motion information, the occurrence of motion sickness can be more reliably suppressed. (5) In the display system of the above form, the display unit is disposed in the moving body in the direction of travel of the moving body as seen by the occupant, and the display adjustment unit may adjust at least one of the following in accordance with the movement of the moving body indicated by the movement information: (a1) enlarging the display image when the movement information indicates that the moving body is accelerating; (b1) reducing the display image when the movement information indicates that the moving body is decelerating; (c1) moving the display position to the left when the movement information indicates that the moving body is turning right; (d1) moving the display position to the right when the movement information indicates that the moving body is turning left; (e1) moving the display position down when the movement information indicates that the moving body is leaning forward; and (f1) moving the display position up when the movement information indicates that the moving body is leaning backward. According to this type of display system, at least one of the following is adjusted according to the movement of the moving body indicated by the movement information: enlarging the display image when the moving body's movement is accelerating; reducing the display image when the moving body's movement is decelerating; moving the display position to the left when the moving body's movement is turning right; moving the display position to the right when the moving body's movement is turning left; moving the display position down when the moving body's movement is leaning forward; and moving the display position up when the moving body's movement is leaning backward.This makes it possible to more closely match the physical sensation of the moving body's movement with the information obtained visually when viewing the display image. (6) In the display system of the above form, the display adjustment unit may perform at least one of the following: (a2) adjusting the magnification ratio of the display image in accordance with the magnitude of the acceleration of the moving body; (b2) adjusting the reduction ratio of the display image in accordance with the magnitude of the deceleration of the moving body; (c2) adjusting the speed at which the display position moves to the left in accordance with the speed at which the moving body moves when turning right; (d2) adjusting the speed at which the display position moves to the right in accordance with the speed at which the moving body moves when turning left; (e2) adjusting the amount of downward movement of the display position in accordance with the angle of forward tilt of the moving body; and (f2) adjusting the amount of upward movement of the display position in accordance with the angle of backward tilt of the moving body. According to this type of display system, at least one of the following is performed: adjusting the magnification rate of the display image according to the magnitude of the acceleration of the moving body; adjusting the reduction rate of the display image according to the magnitude of the deceleration of the moving body; adjusting the speed at which the display position moves to the left according to the speed at which the moving body moves when turning right; adjusting the speed at which the display position moves to the right according to the speed at which the moving body moves when turning left; adjusting the amount of downward movement of the display position according to the angle at which the moving body leans forward; and adjusting the amount of upward movement of the display position according to the angle at which the moving body leans backward, thereby making it possible to more closely match the physical sensation of the moving body's movement with the information obtained visually when viewing the display image. (7) In the display system of the above form, the display unit is disposed in the moving body in the direction of travel of the moving body as seen from the occupant, and the display adjustment unit may adjust at least one of the following in accordance with the movement of the moving body indicated by the movement information: (a3) when the movement of the moving body indicated by the movement information is accelerating, move the display unit closer to the occupant in a direction parallel to the direction of travel of the moving body; (b3) when the movement of the moving body indicated by the movement information is decelerating, move the display unit away from the occupant in a direction parallel to the direction of travel of the moving body; (c3) when the movement of the moving body indicated by the movement information is turning right, move the display unit to the left; (d3) when the movement of the moving body indicated by the movement information is turning left, move the display unit to the right; (e3) when the movement information is turning forward, move the display unit downward; and (f3) when the movement information is turning backward, move the display unit upward. According to this type of display system, at least one of the following is adjusted according to the movement of the moving body indicated by the movement information: when the movement of the moving body is accelerating, the display unit is moved closer to the occupant in a direction parallel to the direction of travel of the moving body; when the movement of the moving body is decelerating, the display unit is moved away from the occupant in a direction parallel to the direction of travel of the moving body; when the movement of the moving body is turning right, the display unit is moved left; when the movement of the moving body is turning left, the display unit is moved right; when the movement of the moving body is leaning forward, the display unit is moved down; and when the movement of the moving body is leaning backward, the display unit is moved up.This makes it possible to more closely match the physical sensation of the movement of the moving body with the information obtained visually when viewing the displayed image. (8) In the display system of the above form, the display adjustment unit may perform at least one of the following: (a4) adjusting the approach speed of the display unit in accordance with the magnitude of the acceleration of the moving body; (b4) adjusting the receding speed of the display image in accordance with the magnitude of the deceleration of the moving body; (c4) adjusting the left movement speed of the display unit in accordance with the movement speed of the moving body when turning right; (d4) adjusting the right movement speed of the display unit in accordance with the movement speed of the moving body when turning left; (e4) adjusting the downward movement amount of the display unit in accordance with the forward tilt angle of the moving body; and (f4) adjusting the upward movement amount of the display unit in accordance with the backward tilt angle of the moving body. According to this type of display system, at least one of the following is performed: adjusting the approach speed of the display unit according to the magnitude of the acceleration of the moving body; adjusting the receding speed of the display unit according to the magnitude of the deceleration of the moving body; adjusting the left movement speed of the display unit according to the movement speed of the moving body when turning right; adjusting the right movement speed of the display unit according to the movement speed of the moving body when turning left; adjusting the amount of downward movement of the display unit according to the angle of forward tilt of the moving body; and adjusting the amount of upward movement of the display unit according to the angle of backward tilt of the moving body, thereby making it possible to more closely match the physical sensation of the moving body's movement with the information obtained visually when viewing the displayed image. The present disclosure can be realized in various forms, such as a vehicle equipped with a display system, a display position adjustment device, a display adjustment method, a computer program for realizing these systems, devices, and methods, and a storage medium storing such a computer program. [Brief explanation of the drawings]
[0007] [Figure 1] 1 is a block diagram showing a configuration of a display system according to an embodiment of the present disclosure. [Figure 2] FIG. 10 is an explanatory diagram showing a specific example of application of the display system to a vehicle. [Figure 3] FIG. 10 is an explanatory diagram showing a specific example of application of the display system to a vehicle. [Figure 4] 10 is a flowchart showing the procedure of a display adjustment process in the first embodiment. [Figure 5] 10A to 10C are explanatory diagrams illustrating a change in a display image when a display adjustment process is executed in the present embodiment. [Figure 6] 10 is a flowchart showing the procedure of a display adjustment process in the second embodiment. [Figure 7] 10 is a flowchart showing the procedure of a display adjustment process in the second embodiment. [Figure 8] 11 is a flowchart showing the procedure of a display adjustment process in the third embodiment. [Figure 9] 10A and 10B are explanatory diagrams schematically showing changes in the display device and the displayed image when a display adjustment process is executed in the third embodiment. [Figure 10] 10 is a flowchart showing the procedure of a display adjustment process in the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] A. First embodiment: A1. System Configuration: FIG. 1 is a block diagram showing the configuration of a display system 100 according to an embodiment of the present disclosure. In this embodiment, the display system 100 is mounted on a vehicle VL for use. In this embodiment, the vehicle VL is capable of both manual and automatic driving. Automatic driving refers to driving in which at least some of the driving functions, such as steering, acceleration, and braking, are automated. Note that the vehicle VL may be capable of only manual driving or only automatic driving. Furthermore, the display system 100 may be mounted on and used in any type of moving object, such as a ship or an aircraft, in addition to the vehicle VL.
[0009] In addition to the display system 100, the vehicle VL is equipped with a status sensor 901, an imaging device 902, and a navigation device 903. The status sensor 901 is a sensor for detecting the current operating state of the vehicle VL. Examples of the status sensor 901 include a vehicle speed sensor, a yaw rate sensor, a gyro sensor, an acceleration sensor, a load (G) sensor, a temperature sensor, a brightness sensor, and a rainwater sensor. In this embodiment, a sensor capable of detecting four types of operating states of the vehicle VL, at least while the vehicle VL is traveling, namely, whether the vehicle VL is accelerating, decelerating, turning right, turning left, leaning forward, or leaning backward, is used as the status sensor 901. "Leaning forward" refers to a state in which the front side of the vehicle VL faces upward relative to the horizontal direction. For example, the vehicle VL leans forward when traveling uphill. "Leaning backward" refers to a state in which the rear side of the vehicle VL faces upward relative to the horizontal direction (in other words, the front side of the vehicle VL faces downward). For example, when traveling downhill, the vehicle VL tilts forward.
[0010] The imaging device 902 captures images of the surroundings of the vehicle VL to obtain captured images. These captured images are used, for example, to identify the current location of the vehicle VL and to identify obstacles such as other vehicles and pedestrians around the vehicle VL. The navigation device 903 has route information 904 set by the occupant of the vehicle VL. In the vehicle VL, map information and a planned route are displayed using the display system 100, and the vehicle VL is automatically driven according to the route information 904.
[0011] The display system 100 includes a display device 20, a position adjustment device 30, and a control device 10. The display device 20 includes a display unit 21, a microphone 22, a speaker 23, and a camera 24. The display unit 21 is capable of displaying images. The term "image" refers to a broad concept that includes not only still images showing various operation menu screens and various SNS content, but also moving images such as video showing the surrounding situation obtained by a status sensor (described later) and video content such as movies. In this embodiment, the display unit 21 is configured as a liquid crystal display device with a touch panel function.
[0012] The position adjustment device 30 is connected to the display device 20 and adjusts the position of the display device 20 within the vehicle VL (a passenger compartment CA, which will be described later). The detailed configuration of the position adjustment device 30 will be described later.
[0013] The control device 10 controls the display device 20. "Controlling the display device 20" has a broad meaning that includes not only controlling the display operation and display content of the display device 20, but also adjusting the position of the display device 20 by controlling the position adjustment device 30. In this embodiment, the control device 10 is configured as a computer including a CPU 11, a wireless communication device 12, a ROM 13, and a RAM 14, which are capable of communicating with each other via an internal bus 15. For example, the control device 10 may be configured as an ECU (Electronic Control Unit) mounted on the vehicle VL. A control program is stored in the ROM 13 in advance, and the CPU 11 loads and executes the control program in the RAM 14, thereby functioning as a motion prediction unit 111, a motion information acquisition unit 112, and a display adjustment unit 113.
[0014] The operation prediction unit 111 identifies a predicted operation of the vehicle VL (hereinafter referred to as "predicted operation"). In this embodiment, the predicted operation means the operation of the vehicle VL 1 to 10 seconds from now. For example, it may be the operation of the vehicle VL 3 seconds from now. Note that the "predicted operation" is not limited to 1 to 10 seconds, but may be the operation of the vehicle VL after any time period less than 1 second or longer than 10 seconds. In this embodiment, the operation prediction unit 111 identifies a predicted operation from at least one of the route information 904 acquired from the navigation device 903, the operation state of the vehicle VL detected by the status sensor 901 (hereinafter also simply referred to as "operation state"), and the captured image acquired by the imaging device 902. For example, if it is estimated based on the route information 904 that the vehicle VL will approach a right curve in 3 seconds given its current vehicle speed, the predicted operation is identified as "turn right." Furthermore, for example, if the acceleration detected by the acceleration sensor is a positive acceleration in the traveling direction of the vehicle VL, the predicted operation is identified as "accelerate." Also, for example, if an uphill road about 20 to 30 meters ahead is captured in the image obtained by the imaging device 902, "leaning forward" is identified as the predicted movement. Note that a plurality of pieces of information may be combined to identify a predicted movement, such as, for example, if it is identified based on the route information 904 that a left curve will be reached in 3 seconds, and an acceleration to the left and a yaw rate to the left are detected, "turning left" is identified.
[0015] The motion information acquisition unit 112 acquires motion information indicating a predicted motion from the motion prediction unit 111 .
[0016] The display adjustment unit 113 adjusts the size and position of the display image displayed on the display unit 21 as seen by the occupant. As will be described later, in this embodiment, the display adjustment unit 113 adjusts the size and position of the display image displayed on the display unit 21 as seen by the occupant by adjusting the size and display position of the display image on the display unit 21.
[0017] The wireless communication device 12 performs wireless communication with the display device 20 and the position adjustment device 30. For example, wireless communication may be performed using wireless LAN defined in IEEE802.11, or wireless communication defined in any standard such as Bluetooth (registered trademark) or ZigBee (registered trademark). Note that the control device 10 may include a wired communication device instead of the wireless communication device 12 and perform wired communication with the display device 20 and the position adjustment device 30.
[0018] 2 and 3 are explanatory diagrams showing a specific example of application of the display system 100 to a vehicle VL. Note that in FIG. 3, the reference numerals of some of the elements constituting the display device 20 are omitted for convenience of illustration. As shown in FIGS. 2 and 3, the display device 20 and the position adjustment device 30 of the display system 100 are disposed in the passenger compartment CA, and the other elements are disposed in the front passenger compartment FR. FIGS. 2 and 3 show the interior of the passenger compartment CA of the vehicle VL during autonomous driving. In the example of FIG. 2, an occupant p1 is seated in a seat DRS disposed in the passenger compartment CA, and the occupant p1 is viewing a moving image (not shown) displayed on the display device 20. In this embodiment, during autonomous driving, the steering device 800 is basically accommodated in a storage space SP provided in the dashboard 700, as shown in FIG. 2. This storage space SP has an opening 703 on the passenger compartment CA side, and the steering device 800 and the position adjustment device 30 are inserted and removed through the opening 703. In contrast to this, for example, when the time to switch from automatic driving to manual driving approaches, the steering device 800 is exposed from the accommodation space SP into the passenger compartment CA through the opening 703 and can be operated by the occupant p1, as shown in Fig. 3. In the example of Fig. 3, the occupant p1 checks map information on the display unit 21 and operates a menu screen to change the reclining angle of the seat DRS or the seat position.
[0019] As shown in FIGS. 2 and 3 , the position adjustment device 30 functions like a link mechanism to adjust the position of the display device 20 in the passenger compartment CA. This allows the display device 20 to be displaced forward, backward, to the right, left, upper, or lower as viewed from the occupant p1. One end of the position adjustment device 30 is fixed to a support member (not shown) provided in the front passenger compartment FR via the accommodation space SP, and the other end is connected to the display device 20. The position adjustment device 30 includes a first arm 321, a first joint 322, a second arm 323, a second joint 324, a third arm 325, a third joint 326, a fourth arm 327, and a fourth joint 328. The position adjustment device 30 also includes a drive unit (not shown) having a motor that independently drives each of the joints 322 to 328. The driving section drives the motors in response to instructions from the control device 10, thereby driving (moving) each of the joints 322 to 328 independently.
[0020] The first arm 321 is connected to the display device 20. In this embodiment, one end of the first arm 321 is connected to the display device 20 via a connector (not shown) for adjusting the angle. This allows the position adjustment device 30 to tilt the display device 20 so that the display device 20 forms an angle with respect to the vertical direction. The first joint 322 connects the other end of the first arm 321 to the second arm 323. The first joint 322 is a ball joint that can displace the first arm 321 by bending the first arm 321 in the front-rear direction, the up-down direction, and the left-right direction of the vehicle VL. FIG. 2 shows a state in which the first joint 322 is extended so that the first arm 321 is disposed further rearward of the vehicle VL than in the state shown in FIG. 3. By bending the first arm 321, the display device 20 connected to the first arm 321 is displaced rearward of the vehicle VL.
[0021] The second arm 323 is connected to the first arm 321 via a first joint 322. The second arm 323 is connected to a third arm 325 via a second joint 324. The second joint 324 connects the second arm 323 to the third arm 325. The second joint 324 is a ball joint that can displace the second arm 323 in the front-rear direction, the up-down direction, and the left-right direction of the vehicle VL by bending the second arm 323 in these directions. FIG. 2 shows a state in which the second joint 324 is extended so that the second arm 323 is disposed further rearward of the vehicle VL than in the state shown in FIG. 3. As the second arm 323 is displaced, the display device 20 connected to the first arm 321, which is connected to the second arm 323 via the first joint 322, is displaced rearward of the vehicle VL.
[0022] The third arm 325 is connected to the fourth arm 327 via a third joint 326. The third joint 326 is a ball joint that allows the third arm 325 to bend in the front-rear direction, the up-down direction, and the left-right direction of the vehicle VL. By displacing the third arm 325, the display device 20 connected to the third arm 325 via the first joint 322 and the second joint 324 can also be displaced.
[0023] The fourth arm 327 is connected to a fourth joint 328. The fourth joint 328 is connected to a support member (not shown) provided in the front passenger compartment FR on the opposite side of the dashboard 700 from the passenger compartment CA. This fixes the position adjustment device 30 to the vehicle VL. The fourth joint 328 is a ball joint that can displace the fourth arm 327 by bending the fourth arm 327 in the front-rear direction, the up-down direction, and the left-right direction of the vehicle 1. In this embodiment, the inclination of the steering device 800 and the position of the position adjustment device 30 are adjusted so that the steering device 800 and the position of the position adjustment device 30 do not come into contact with each other.
[0024] A2. Display adjustment process: Fig. 4 is a flowchart showing the procedure of the display adjustment process in the first embodiment. In the display system 100 having the above configuration, the display adjustment process shown in Fig. 4 is executed after the vehicle VL is started (after it is started). The display adjustment process is a process for adjusting at least one of the size and position of the display image (hereinafter also simply referred to as "display image") displayed on the display unit 21 as seen by the occupant p1 of the vehicle VL.
[0025] The motion information acquisition unit 112 acquires motion information regarding a predicted motion from the motion prediction unit 111 (step S100). The display adjustment unit 113 identifies a predicted motion based on the motion information acquired in step S100 (step S105).
[0026] The display adjustment unit 113 determines whether the predicted motion is "acceleration" (step S110). If it is determined that the predicted motion is "acceleration" (step S110: YES), the display adjustment unit 113 enlarges the display image (step S115). In this embodiment, the enlargement ratio in step S115 is a predetermined value.
[0027] If it is determined that the predicted motion is not "acceleration" (step S110: NO), the display adjustment unit 113 determines whether the predicted motion is "deceleration" (step S120). If it is determined that the predicted motion is "deceleration" (step S120: YES), the display adjustment unit 113 reduces the display image (step S125). In this embodiment, the reduction ratio in step S125 is a predetermined value.
[0028] If it is determined that the predicted action is not "slow down" (step S120: NO), the display adjustment unit 113 determines whether the predicted action is "turn right" (step S130). If it is determined that the predicted action is "turn right" (step S130: YES), the display adjustment unit 113 moves the display position of the display image to the left (step S135). In this embodiment, the amount of movement in step S135 is a predetermined value.
[0029] If it is determined that the predicted action is not "turn right" (step S130: NO), the display adjustment unit 113 determines whether the predicted action is "turn left" (step S140). If it is determined that the predicted action is "turn left" (step S140: YES), the display adjustment unit 113 moves the display position of the display image to the right (step S145). In this embodiment, the amount of movement in step S145 is a predetermined value.
[0030] If it is determined that the predicted motion is not "turn left" (step S140: NO), display adjustment unit 113 determines whether the predicted motion is "lean forward" (step S150). If it is determined that the predicted motion is "lean forward" (step S150: YES), display adjustment unit 113 moves the display position of the display image downward (step S155). In this embodiment, the amount of movement in step S155 is a predetermined value.
[0031] If it is determined that the predicted motion is not "leaning forward" (step S150: NO), display adjustment unit 113 determines whether the predicted motion is "leaning backward" (step S160). If it is determined that the predicted motion is "leaning backward" (step S160: YES), display adjustment unit 113 moves the display position of the display image upward (step S165). In this embodiment, the amount of movement in step S165 is a predetermined value.
[0032] On the other hand, if it is determined that the predicted motion is not "tilt backward" (step S160: NO), the process returns to step S100. The process also returns to step S100 after the above-described steps S115, S125, S135, S145, S155, and S165 are completed.
[0033] 5 is an explanatory diagram that schematically shows changes in the display image when the display adjustment process of this embodiment is executed. In Fig. 5, the upper row shows a display image C1 that is displayed on the display unit 21 when the vehicle VL is traveling straight at a constant speed, and the lower row shows C1 that is displayed on the display unit 21 when the vehicle VL accelerates, decelerates, turns right, turns left, leans forward, or leans backward.
[0034] As a result of step S115 described above, the display image C1 is enlarged and displayed on the display unit 21. Therefore, the display image C1 enlarges in accordance with the bodily sensation of acceleration, and the occupant p1 feels as if it is approaching him / her, so that the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0035] As a result of step S125 described above, the display image C1 is reduced and displayed on the display unit 21. Therefore, the display image C1 reduces in size in accordance with the bodily sensation of deceleration, and the occupant p1 feels as if it is moving away from him / her, so that the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0036] As a result of step S135, the display image C1 is displayed shifted to the left. Therefore, the occupant p1 feels as if the display image C1 is shifting to the left in accordance with the bodily sensation of turning right, and therefore the bodily sensation and the visual information obtained by the occupant p1 coincide with each other.
[0037] As a result of step S145, the display image C1 is displayed shifted to the right. Therefore, the occupant p1 feels as if the display image C1 is shifting to the right in accordance with the bodily sensation of turning left, and therefore the bodily sensation and the visual information obtained by the occupant p1 coincide with each other.
[0038] As a result of step S155, the display image C1 is displayed while moving downward. Therefore, the occupant p1 feels as if the display image C1 is moving downward in accordance with the bodily sensation of leaning forward, and therefore the bodily sensation and the visual information obtained by the occupant p1 coincide with each other.
[0039] As a result of step S165, the display image C1 is displayed while being moved upward. Therefore, the occupant p1 feels as if the display image C1 is moving upward in accordance with the bodily sensation of leaning backward, and therefore the bodily sensation and the visual information obtained by the occupant p1 coincide with each other.
[0040] In this way, the display adjustment process matches the information the occupant p1 experiences with the information they see, which can prevent the occupant p1 from becoming motion sick when viewing the display image C1 in the vehicle VL.
[0041] According to the display system 100 of the first embodiment described above, the display adjustment unit 113 adjusts at least one of the size and position of the display image C1 displayed on the display unit 21 in accordance with the operation of the vehicle VL indicated by the operation information, thereby adjusting at least one of the size and position of the display image C1 as seen by the occupant p1 of the vehicle VL. This allows the bodily sensation of the operation of the vehicle VL to match the information obtained visually when viewing the display image. This prevents the occupant p1 from becoming sick when viewing the display image in the vehicle VL. Furthermore, since the display unit 21 does not display any graphics or other elements to prevent sickness in addition to the display image, the annoyance to the occupant p1 can be reduced.
[0042] The control device 10 further includes an action prediction unit 111 that identifies a predicted action from at least one of the route information 904 acquired from the navigation device 903, the action state detected by the state sensor 901, and the captured image obtained by the imaging device 902. The action information acquisition unit 112 acquires information indicating the predicted action identified by the action prediction unit 111 as action information, so that highly accurate actions can be predicted as predicted actions, and since such highly accurate predicted actions are used as action information, the occurrence of motion sickness can be more reliably suppressed.
[0043] In addition, at least one of the following is adjusted according to the movement of the moving body indicated by the movement information: enlarging the display image C1 when the movement of the vehicle VL is accelerating; reducing the display image C1 when the movement of the vehicle VL is decelerating; moving the display position of the display image C1 to the left when the movement of the vehicle VL is turning right; moving the display position of the display image C1 to the right when the movement of the vehicle VL is turning left; moving the display position of the display image C1 down when the movement of the vehicle VL is leaning forward; and moving the display position of the display image C1 up when the movement of the vehicle VL is leaning backward.This makes it possible to more closely match the physical sensation of the movement of the vehicle VL with the information obtained visually when viewing the display image C1.
[0044] B. Second embodiment: The display system 100 of the second embodiment has the same configuration as the display system 100 of the first embodiment, so the same components are given the same reference numerals and detailed description thereof will be omitted.
[0045] 6 and 7 are flowcharts showing the steps of the display adjustment process in the second embodiment. The display adjustment process in the second embodiment differs from the display adjustment process of the first embodiment shown in Fig. 4 in that steps S112, S122, S132, S142, S152, and S162 are additionally executed. The other steps in the display adjustment process of the second embodiment are the same as those in the first embodiment, so the same steps are denoted by the same reference numerals and detailed descriptions thereof will be omitted.
[0046] As shown in FIGS. 6 and 7, if the predicted operation is determined to be "acceleration" (step S110: YES), before executing step S115, the display adjustment unit 113 adjusts the magnification ratio of the display image C1 according to the magnitude of the acceleration of the vehicle VL (step S112). Specifically, the magnification ratio is adjusted to be larger as the acceleration increases. Note that the relationship between the acceleration and the magnification ratio in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After step S112 is completed, the above-mentioned step S115 is executed. Therefore, in step S115, the display image C1 is displayed on the display unit 21 at the magnification ratio adjusted according to the acceleration.
[0047] If it is determined that the predicted operation is "deceleration" (step S120: YES), before executing step S125, the display adjustment unit 113 adjusts the reduction rate of the display image C1 according to the magnitude of the deceleration of the vehicle VL (step S122). Specifically, the greater the deceleration, the larger the deceleration rate is adjusted to be. Note that the relationship between the deceleration and the reduction rate in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After completing step S122, the above-mentioned step S125 is executed. Therefore, in step S125, the display image C1 is displayed on the display unit 21 at a reduction rate adjusted according to the acceleration.
[0048] If it is determined that the predicted operation is "turn right" (step S130: YES), before executing step S135, the display adjustment unit 113 adjusts the amount of movement of the display position of the display image C1 according to the moving speed of the vehicle VL when turning right (step S132). Specifically, the greater the moving speed when turning right, the greater the amount of movement of the display position is adjusted. Note that in this case, the relationship between the moving speed of the vehicle VL and the amount of movement of the display position is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After completing step S132, the above-mentioned step S135 is executed. Therefore, in step S135, the display image C1 is moved to the left by the amount of movement adjusted according to the moving speed of the vehicle VL, and is displayed on the display unit 21.
[0049] If it is determined that the predicted operation is "turn left" (step S140: YES), before executing step S145, the display adjustment unit 113 adjusts the amount of movement of the display position of the display image C1 according to the moving speed of the vehicle VL when turning left (step S142). Specifically, the greater the moving speed when turning left, the greater the amount of movement of the display position is adjusted. Note that in this case, the relationship between the moving speed of the vehicle VL and the amount of movement of the display position is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After completing step S142, the above-mentioned step S145 is executed. Therefore, in step S145, the display image C1 is moved to the right by the amount of movement adjusted according to the moving speed of the vehicle VL and is displayed on the display unit 21.
[0050] If it is determined that the predicted operation is "forward tilt" (step S150: YES), before executing step S155, the display adjustment unit 113 adjusts the amount of movement of the display position of the display image C1 according to the angle of forward tilt of the vehicle VL (step S152). Specifically, the greater the angle of forward tilt, the greater the amount of movement of the display position is adjusted. Note that the relationship between the angle of forward tilt and the amount of movement of the display position in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After step S152 is completed, the above-mentioned step S155 is executed. Therefore, in step S155, the display image C1 is moved downward by the amount of movement adjusted according to the angle of forward tilt and is displayed on the display unit 21.
[0051] If it is determined that the predicted operation is "tilt backward" (step S160: YES), before executing step S165, the display adjustment unit 113 adjusts the amount of movement of the display position of the display image C1 according to the angle of tilt backward of the vehicle VL (step S162). Specifically, the greater the angle of tilt backward, the greater the amount of movement of the display position is adjusted. Note that the relationship between the angle of tilt backward and the amount of movement of the display position in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After step S162 is completed, the above-mentioned step S165 is executed. Therefore, in step S165, the display image C1 is moved upward by the amount of movement adjusted according to the angle of tilt backward, and is displayed on the display unit 21.
[0052] The display system 100 of the second embodiment described above has the same effects as the display system 100 of the first embodiment. In addition, since at least one of the following is performed: adjusting the magnification ratio of the display image C1 in accordance with the magnitude of the acceleration of the vehicle VL; adjusting the reduction ratio of the display image C1 in accordance with the magnitude of the deceleration of the vehicle VL; adjusting the speed at which the display position moves to the left in accordance with the speed at which the vehicle VL is moving when turning right; adjusting the speed at which the display position moves to the right in accordance with the speed at which the vehicle VL is moving when turning left; adjusting the amount of downward movement of the display position in accordance with the angle at which the vehicle VL is leaning forward; and adjusting the amount of upward movement of the display position in accordance with the angle at which the vehicle VL is leaning backward, the bodily sensation of the operation of the vehicle VL can be made to match more closely the information obtained visually when viewing the display image.
[0053] C. Third embodiment: The display system 100 of the third embodiment has the same configuration as the display system 100 of the first embodiment, so the same components are given the same reference numerals and detailed description thereof will be omitted.
[0054] Fig. 8 is a flowchart showing the steps of the display adjustment process in the third embodiment. The display adjustment process in the third embodiment differs from the display adjustment process of the first embodiment shown in Fig. 4 in that steps S215, S225, S235, S245, S255, and S265 are executed instead of steps S115, S125, S135, S145, S155, and S165. The other steps in the display adjustment process of the third embodiment are the same as those in the first embodiment, so the same steps are denoted by the same reference numerals and detailed descriptions thereof will be omitted.
[0055] 8, when it is determined that the predicted operation is "acceleration" (step S110: YES), the display adjustment unit 113 controls the position adjustment device 30 to adjust the position of the display device 20, thereby bringing the display unit 21 closer to the occupant p1 in a direction parallel to the traveling direction of the vehicle VL (the longitudinal direction of the vehicle VL) (step S215). In this embodiment, the approach speed of the display unit 21 in step S215 is a predetermined value.
[0056] If it is determined that the predicted operation is "deceleration" (step S120: YES), the display adjustment unit 113 controls the position adjustment device 30 to adjust the position of the display device 20, thereby moving the display unit 21 away from the occupant p1 in a direction parallel to the traveling direction of the vehicle VL (the longitudinal direction of the vehicle VL) (step S225). In this embodiment, the moving-away speed of the display unit 21 in step S225 is a predetermined value.
[0057] If it is determined that the predicted action is "turn right" (step S130: YES), the display adjustment unit 113 controls the position adjustment device 30 to adjust the position of the display device 20, thereby moving the display unit 21 to the left (step S235). In this embodiment, the amount of movement of the display unit 21 in step S235 is a predetermined value.
[0058] If it is determined that the predicted action is "turn left" (step S140: YES), the display adjustment unit 113 controls the position adjustment device 30 to adjust the position of the display device 20, thereby moving the display unit 21 to the right (step S245). In this embodiment, the amount of movement of the display unit 21 in step S245 is a predetermined value.
[0059] If the predicted motion is determined to be "leaning forward" (step S150: YES), the display adjustment unit 113 controls the position adjustment device 30 to adjust the position of the display device 20, thereby moving the display unit 21 downward (step S255). In this embodiment, the amount of movement of the display unit 21 in step S255 is a predetermined value.
[0060] If it is determined that the predicted motion is "tilt backward" (step S160: YES), the display adjustment unit 113 controls the position adjustment device 30 to adjust the position of the display device 20, thereby moving the display unit 21 upward (step S265). In this embodiment, the amount of movement of the display unit 21 in step S265 is a predetermined value.
[0061] 9 is an explanatory diagram that schematically shows changes in the display device 20 and the display image C1 when the display adjustment process in the third embodiment is executed. In Fig. 9, the upper row shows the display image C1 that is displayed on the display unit 21 when the vehicle VL is traveling straight at a constant speed, and the middle and lower rows show C1 that is displayed on the display unit 21 when the vehicle VL accelerates, decelerates, turns right, turns left, leans forward, and leans backward.
[0062] As a result of step S215, the display device 20 moves closer to the occupant p1. As a result, the display image C1 seen by the occupant p1 is enlarged. As a result, the display image C1 appears to be enlarged in accordance with the bodily sensation of acceleration, and therefore, the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0063] As a result of step S225, the display device 20 moves away from the occupant p1. As a result, the display image C1 seen by the occupant p1 shrinks. As a result, the display image C1 appears to shrink in accordance with the bodily sensation of deceleration, and the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0064] As a result of step S235 described above, the display device 20 moves to the left. Therefore, the display image C1 seen by the occupant p1 moves to the left. Therefore, the occupant p1 feels as if the display image C1 is moving to the left in accordance with the bodily sensation of turning right, and therefore, the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0065] As a result of step S245 described above, the display device 20 moves to the right. Therefore, the display image C1 seen by the occupant p1 moves to the right. Therefore, the occupant p1 feels as if the display image C1 is moving to the right in accordance with the bodily sensation of turning left, and therefore, the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0066] As a result of step S255 described above, the display device 20 moves downward. Therefore, the display image C1 seen by the occupant p1 moves downward. Therefore, the occupant p1 feels as if the display image C1 is moving downward in accordance with the bodily sensation of leaning forward, and therefore, the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0067] As a result of step S265 described above, the display device 20 moves upward. Therefore, the display image C1 seen by the occupant p1 moves upward. Therefore, the occupant p1 feels as if the display image C1 is moving upward in accordance with the bodily sensation of leaning forward, and therefore, the bodily sensation and the information obtained visually by the occupant p1 coincide with each other.
[0068] The display system 100 of the third embodiment described above has the same effects as the display system 100 of the first embodiment. In addition, at least one of the following is adjusted in accordance with the operation of the vehicle VL indicated by the operation information: moving the display unit 21 closer to the occupant p1 in a direction parallel to the traveling direction of the vehicle VL when the operation of the vehicle VL is accelerating; moving the display unit 21 away from the occupant p1 in a direction parallel to the traveling direction of the moving body when the operation of the vehicle VL is decelerating; moving the display unit 21 to the left when the operation of the vehicle VL is turning right; moving the display unit 21 to the right when the operation of the vehicle VL is turning left; moving the display unit 21 downward when the operation of the vehicle VL is leaning forward; and moving the display unit 21 upward when the operation of the vehicle VL is leaning backward. This makes it possible to more closely match the bodily sensation of the operation of the vehicle VL with the information obtained visually when viewing the display image C1.
[0069] D. Fourth embodiment: The display system 100 of the fourth embodiment has the same configuration as the display system 100 of the first embodiment, so the same components are given the same reference numerals and detailed description thereof will be omitted.
[0070] 10 is a flowchart showing the steps of the display adjustment process in the fourth embodiment. The display adjustment process in the fourth embodiment differs from the display adjustment process in the third embodiment shown in FIG. 8 in that steps S212, S222, S232, S242, S252, and S262 are additionally executed. The other steps in the display adjustment process in the fourth embodiment are the same as those in the third embodiment, so the same steps are denoted by the same reference numerals and detailed descriptions thereof are omitted. Note that the steps preceding the steps shown in FIG. 10 are the same as those in the second embodiment shown in FIG. 6, so are not shown.
[0071] As shown in FIGS. 6 and 10, if the predicted operation is determined to be "acceleration" (step S110: YES), before executing step S215, the display adjustment unit 113 adjusts the approach speed of the display unit 21 according to the magnitude of the acceleration of the vehicle VL (step S212). Specifically, the greater the acceleration, the greater the approach speed is adjusted to be. Note that the relationship between the acceleration and the approach speed in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After step S212 is completed, the above-mentioned step S215 is executed. Therefore, in step S215, the display unit 21 approaches the occupant p1 at the approach speed adjusted according to the acceleration.
[0072] If it is determined that the predicted operation is "deceleration" (step S120: YES), before executing step S225, the display adjustment unit 113 adjusts the moving away speed of the display unit 21 according to the magnitude of the deceleration of the vehicle VL (step S222). Specifically, the greater the deceleration, the greater the moving away speed is adjusted. Note that the relationship between the deceleration and the moving away speed in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After completing step S222, the above-mentioned step S225 is executed. Therefore, in step S125, the display unit 21 moves away from the occupant p1 at an approaching speed adjusted according to the magnitude of the deceleration.
[0073] If it is determined that the predicted operation is "turn right" (step S130: YES), before executing step S235, the display adjustment unit 113 adjusts the amount of movement of the display unit 21 to the left according to the moving speed of the vehicle VL when turning right (step S232). Specifically, the greater the moving speed when turning right, the greater the amount of movement of the display unit 21 is adjusted. Note that in this case, the relationship between the moving speed of the vehicle VL and the amount of movement of the display unit 21 is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After completing step S232, the above-mentioned step S235 is executed. Therefore, in step S235, the display unit 21 moves to the left by the amount of movement adjusted according to the moving speed of the vehicle VL.
[0074] If it is determined that the predicted operation is "turn left" (step S140: YES), before executing step S245, the display adjustment unit 113 adjusts the amount of movement of the display unit 21 to the right according to the moving speed of the vehicle VL when turning left (step S242). Specifically, the greater the moving speed when turning left, the greater the amount of movement of the display unit 21 is adjusted. Note that in this case, the relationship between the moving speed of the vehicle VL and the amount of movement of the display unit 21 is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After completing step S242, the above-mentioned step S245 is executed. Therefore, in step S245, the display unit 21 moves to the right by the amount of movement adjusted according to the moving speed of the vehicle VL.
[0075] If it is determined that the predicted motion is "tilt forward" (step S150: YES), before executing step S255, display adjustment unit 113 adjusts the downward movement amount of display unit 21 according to the angle of forward tilt (step S252). Specifically, the greater the angle of forward tilt, the greater the adjustment amount of movement of display unit 21. Note that the relationship between the angle of forward tilt and the movement amount of display unit 21 in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After step S252 is completed, the above-mentioned step S255 is executed. Therefore, in step S255, display unit 21 moves downward by the movement amount adjusted according to the angle of forward tilt.
[0076] If it is determined that the predicted action is "tilt backward" (step S160: YES), before executing step S265, display adjustment unit 113 adjusts the amount of upward movement of display unit 21 according to the angle of tilt backward (step S262). Specifically, the greater the angle of tilt backward, the greater the amount of movement of display unit 21 is adjusted. Note that the relationship between the angle of tilt backward and the amount of movement of display unit 21 in this case is not limited to a linear proportional relationship, and may be an exponential relationship or a stepwise relationship. After step S262 is completed, the above-mentioned step S265 is executed. Therefore, in step S265, display unit 21 moves upward by the amount of movement adjusted according to the angle of tilt backward.
[0077] The display system 100 of the fourth embodiment described above has the same effects as the display systems 100 of the first and third embodiments. In addition, since at least one of the following is performed: adjusting the approach speed of the display unit 21 in accordance with the magnitude of the acceleration of the vehicle VL; adjusting the receding speed of the display unit 21 in accordance with the magnitude of the deceleration of the vehicle VL; adjusting the left movement speed of the display unit 21 in accordance with the movement speed when the vehicle VL turns right; adjusting the right movement speed of the display unit 21 in accordance with the movement speed when the vehicle VL turns left; adjusting the downward movement amount of the display unit 21 in accordance with the forward tilt angle of the vehicle VL; and adjusting the upward movement amount of the display unit 21 in accordance with the backward tilt angle of the vehicle VL, it is possible to further match the bodily sensation of the operation of the vehicle VL with the information obtained visually when viewing the display image C1.
[0078] E. Other Embodiments: (E1) In step S100 of the display adjustment process in each embodiment, the motion information acquisition unit 112 acquires motion information regarding a predicted motion. However, instead of the predicted motion, motion information regarding a real motion may be acquired. Then, in step S105, instead of the predicted motion, a real motion may be identified, and steps S110 to S265 may be executed according to the real motion. The "real motion" refers to the actual motion (current motion) of the vehicle VL. For example, if the real motion is determined to be "the vehicle VL is turning right" based on motion information including captured images and detection information from an acceleration sensor, steps S135 and S235 described above may be executed, and the display position of the display image C1 and the position of the display unit 21 may be moved to the left. Even with this configuration, the same effects as those of each embodiment can be achieved. It is noted that motion information regarding a predicted motion and motion information regarding a real motion may be used in combination. For example, if the motion indicated by both pieces of motion information is recognized as "acceleration," step S115 or S215 may be executed, and if the motion indicated by at least one piece of motion information is not "acceleration," steps S115 to S165 or S215 to S265 may not be executed and the process may return to step S100.
[0079] (E2) In each embodiment, the operation prediction unit 111 identifies a predicted operation from at least one of the route information 904 acquired from the navigation device 903, the operation state detected by the status sensor 901, and the captured image obtained by the imaging device 902. Here, the operation prediction unit 111 may be configured to identify a predicted operation based only on the route information 904, and the status sensor 901 and the imaging device 902 may be omitted. Similarly, the operation prediction unit 111 may be configured to identify a predicted operation based only on the captured image obtained by the imaging device 902, and the navigation device 903 and the status sensor 901 may be omitted. Similarly, the operation prediction unit 111 may be configured to identify a predicted operation based only on the operation state detected by the status sensor 901, and the imaging device 902 and the navigation device 903 may be omitted.
[0080] (E3) In each embodiment, the predicted motion of the vehicle VL is identified as one of acceleration, deceleration, turning right, turning left, leaning forward, and leaning backward. However, the present disclosure is not limited to this. The predicted motion may be identified from a motion group that omits one or more of acceleration, deceleration, turning right, turning left, leaning forward, and leaning backward. In this case, in the first and second embodiments, only the size or display position of the display image C1 may be adjusted. Furthermore, in the third and fourth embodiments, the movement direction of the display unit 21 may be adjusted only in the forward and backward directions or in the up, down, left, and right directions. Furthermore, a combination of two or more of acceleration, deceleration, turning right, turning left, leaning forward, and leaning backward may be identified as the predicted motion. For example, a combination of "deceleration" and "right turn" may be identified as the predicted motion. In such an example, for example, the display image C1 may be reduced in size and the display position of the display image C1 on the display unit 21 may be moved to the left.
[0081] (E4) The embodiments may be combined. For example, the first embodiment and the third embodiment may be combined, and when the predicted operation is "acceleration," step S115 may be executed to enlarge the display image C1, and step S215 may be executed to move the display unit 21 closer to the occupant. Similarly, at least one of steps S125 and S225 may be executed together, steps S135 and S235 may be executed together, steps S145 and S245 may be executed together, steps S155 and S255 may be executed together, or steps S165 and S265 may be executed together.
[0082] (E5) In the third and fourth embodiments, the position of the display device 20 (display unit 21) is adjusted, but the position of the seat DRS may be adjusted instead of or in addition to the position of the display device 20 (display unit 21). In such a configuration, the seat DRS is configured to be movable not only forward and backward but also up, down, left, and right.
[0083] (E6) The display system 100 in each embodiment is merely an example and can be modified in various ways. For example, in each embodiment, the steering device 800 in the vehicle VL can be accommodated in the accommodation space SP. However, it may not be accommodated in the accommodation space SP and may be always exposed to the driver's seat. Furthermore, in the first and second embodiments, the display device 20 may be fixed to the instrument panel, the ceiling of the passenger compartment CA, or the like, and may not move. Furthermore, in any driving situation, the vertical position of the display device 20 may be aligned with the line of sight of the occupant p1 or positioned above the line of sight. In this configuration, for example, the face of the occupant p1 may be captured by the camera 24, and the direction of the line of sight may be identified from the captured image. This configuration can prevent the occupant p1 from looking downward and becoming more susceptible to motion sickness. In a configuration in which the vehicle VL has multiple occupants and only one display device 20, the line of sight of each person may be identified, and the position of the display device 20 may be adjusted based on the average position, the highest position, the lowest position, etc. in the vertical direction. Also, instead of or in addition to the display device 20, an image may be displayed on the inside of the windshield.
[0084] The present disclosure is not limited to the above-described embodiments and can be realized in various configurations without departing from the spirit thereof. For example, the technical features in each embodiment corresponding to the technical features in the form described in the Summary of the Invention section can be appropriately replaced or combined to solve some or all of the above-described problems or achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]
[0085] 1...vehicle, 10...control device, 11...CPU, 12...wireless communication device, 13...ROM, 14...RAM, 15...internal bus, 20...display device, 21...display unit, 22...microphone, 23...speaker, 24...camera, 30...position adjustment device, 100...display system, 111...motion prediction unit, 112...motion information acquisition unit, 113...display adjustment unit, 321...first arm, 322...first joint, 323...second arm, 3 24...second joint, 325...third arm, 326...third joint, 327...fourth arm, 328...fourth joint, 700...dashboard, 703...opening, 800...steering device, 901...status sensor, 902...imaging device, 903...navigation device, 904...route information, C1...display image, CA...passenger compartment, DRS...seat, FR...front passenger compartment, SP...storage space, VL...vehicle, p1...occupant
Claims
1. A display system mounted on a moving body, a display device having a display unit capable of displaying an image; A control device that controls the display device, a motion information acquisition unit that acquires motion information indicating at least one of a predicted motion of the moving object and an actual motion that is an actual motion of the moving object; a control device having a display adjustment unit that adjusts at least one of the size and position of the display image displayed on the display unit and the display position of the display unit, in accordance with the operation of the moving body indicated by the operation information, thereby adjusting at least one of the size and position of the display image as seen by an occupant of the moving body; Equipped with the display unit is disposed in the moving body in a traveling direction of the moving body as seen from the occupant, The display adjustment unit (e1) moving the display position downward when the motion of the moving object indicated by the motion information is leaning forward; (f1) moving the display position upward when the motion of the moving object indicated by the motion information is tilting backward; and adjusting at least one of the above in accordance with the motion of the moving object indicated by the motion information.
2. A display system mounted on a moving body, a display device having a display unit capable of displaying an image; A control device that controls the display device, a motion information acquisition unit that acquires motion information indicating at least one of a predicted motion of the moving object and an actual motion that is an actual motion of the moving object; a control device having a display adjustment unit that adjusts at least one of the size and position of the display image displayed on the display unit and the display position of the display unit, in accordance with the operation of the moving body indicated by the operation information, thereby adjusting at least one of the size and position of the display image as seen by an occupant of the moving body; Equipped with the display unit is disposed in the moving body in a traveling direction of the moving body as seen from the occupant, The display adjustment unit (a3) when the motion of the moving object indicated by the motion information is acceleration, bringing the display unit closer to the occupant in a direction parallel to the traveling direction of the moving object; (b3) when the motion of the moving object indicated by the motion information is deceleration, moving the display unit away from the occupant in a direction parallel to the traveling direction of the moving object; (c3) moving the display unit to the left when the motion of the moving object indicated by the motion information is to turn right; (d3) moving the display unit to the right when the motion of the moving object indicated by the motion information is to turn left; and adjusting at least one of the above in accordance with the motion of the moving object indicated by the motion information; The display adjustment unit (a4) adjusting the approach speed of the display unit in accordance with the magnitude of the acceleration of the moving object; (b4) adjusting the moving away speed of the display image in accordance with the magnitude of the deceleration of the moving object; (c4) adjusting the speed at which the display unit moves to the left in accordance with the speed at which the moving object turns right; (d4) adjusting the speed at which the display unit moves to the right in accordance with the speed at which the moving object turns left; A display system that performs at least one of the following:
3. 3. The display system according to claim 1, a position adjustment device connected to the display device and configured to adjust the position of the display device within the moving object; The display adjustment unit controls the position adjustment device to adjust the position of the display device within the vehicle, thereby displacing the position of the display unit and adjusting at least one of the size and position of the display image as seen by the occupant.
4. 3. The display system according to claim 1, the moving body has at least one of a navigation device having set route information, a state sensor that detects a current operating state of the moving body, and an imaging device that captures an image of the surroundings of the moving body; the control device further includes an action prediction unit that identifies the predicted action from at least one of route information acquired from the navigation device, the action state detected by the state sensor, and an image acquired by the imaging device; The motion information acquisition unit acquires, as the motion information, information indicating the predicted motion identified by the motion prediction unit.
5. 3. The display system according to claim 1, the moving body has a state sensor that detects a current operating state of the moving body; The motion information acquisition unit acquires information indicating the motion state detected by the state sensor as the motion information indicating the actual motion.
6. 3. The display system according to claim 1, The display adjustment unit (a1) enlarging the display image when the motion of the moving object indicated by the motion information is acceleration; (b1) reducing the display image when the motion of the moving object indicated by the motion information is deceleration; (c1) moving the display position to the left when the motion of the moving object indicated by the motion information is to turn right; (d1) moving the display position to the right when the motion of the moving object indicated by the motion information is to turn left; and adjusting at least one of the above in accordance with the motion of the moving object indicated by the motion information.
7. 2. The display system of claim 1, The display adjustment unit (a2) adjusting the magnification of the display image in accordance with the magnitude of the acceleration of the moving object; (b2) adjusting a reduction ratio of the display image in accordance with the magnitude of deceleration of the moving object; (c2) adjusting the speed at which the display position moves to the left in accordance with the speed at which the moving object turns right; (d2) adjusting the speed at which the display position moves to the right in accordance with the speed at which the moving object turns left; (e2) adjusting the downward movement amount of the display position in accordance with the angle of forward tilt of the moving body; (f2) adjusting the amount of upward movement of the display position in accordance with the angle of backward tilt of the moving body; A display system that performs at least one of the following:
8. 3. The display system according to claim 1, The display adjustment unit (e3) moving the display unit downward when the motion of the moving object indicated by the motion information is a forward tilt; and (f3) moving the display unit upward when the motion of the moving object indicated by the motion information is tilting backward; and and adjusting at least one of the above in accordance with the motion of the moving object indicated by the motion information.
9. 9. The display system of claim 8, The display adjustment unit (e4) adjusting the downward movement amount of the display unit in accordance with the angle of forward tilt of the moving object; (f4) adjusting the amount of upward movement of the display unit in accordance with the angle of backward tilt of the moving body; A display system that performs at least one of the following:
Citation Information
Patent Citations
On-vehicle information providing system
JP2004322726A
Vehicle control system, vehicle control method, and vehicle control program
JP2018076027A
Information processor, display method, and display program
JP2021086552A
Display device
JP2021175640A
On-vehicle display device
WO2005016697A1