Vehicular video display device

Abstract

To suppress visually induced motion sickness of an occupant.SOLUTION: A vehicular video display device 100 includes: a display unit 2 mounted on a vehicle, for displaying a video content; an information acquisition unit 11 for acquiring occupant information on a condition of an occupant in the vehicle; and a control unit 12 for determining whether the occupant suffers from visually induced motion sickness on the basis of the occupant information acquired by the information acquisition unit 11, and controlling the display unit 2 so as to change the type of the video content when determining that the occupant suffers from the visually induced motion sickness.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a vehicle video display device that displays video content inside a vehicle.

Background Art

[0002] Conventionally, as this type of device, a device that projects an image from a projector onto a vehicle wall surface has been known (see, for example, Patent Document 1). In the device described in Patent Document 1, the projection angle of the image by the projector is adjusted according to the reclining angle of the rear seat where the passenger watching the image is seated.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in recent years, the need to enjoy video content on a large screen inside a vehicle has been increasing. However, when watching video content on a large screen in the limited space inside a vehicle, passengers are likely to experience motion sickness.

Means for Solving the Problems

[0005] A vehicle video display device according to an aspect of the present invention includes a display unit mounted on a vehicle and configured to display video content, an information acquisition unit configured to acquire passenger information regarding the state of a passenger in the vehicle, and a control unit configured to determine whether the passenger is experiencing motion sickness based on the passenger information acquired by the information acquisition unit, and to control the display unit to change the type of video content when it is determined that the passenger is experiencing motion sickness.

Effects of the Invention

[0006] According to the present invention, it is possible to suppress motion sickness of passengers.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described with reference to FIGS. 1 to 3. In recent years, the need to enjoy video content on a large screen inside a vehicle has been increasing. However, when viewing video content on a large screen in the limited space inside a vehicle, the occupant is likely to experience motion sickness. That is, generally, the optimal distance from the viewer to the screen (optimal viewing distance) is about three times the height of the screen. However, when viewing video content on a large screen in the limited space inside a vehicle, it is difficult to secure the optimal viewing distance. Therefore, in the present embodiment, the vehicle video display device is configured as follows so that motion sickness of the occupant can be suppressed even when viewing video content on a large screen in the limited space inside the vehicle.

[0009] FIG. 1 is a schematic diagram showing, with a part of vehicle 1 cut away, the state in which an occupant of vehicle 1 equipped with a vehicle video display device according to an embodiment of the present invention views video content. Hereinafter, for convenience, the front-rear direction and the up-down direction as shown in the drawing are defined, and the configuration of each part will be described according to this definition. As shown in FIG. 1, vehicle 1 is a two-row seat vehicle having a front seat located in front of the vehicle and a rear seat located behind the front seat, and the front seat is composed of a driver's seat and a passenger seat. Note that, for convenience, one front seat (driver's seat or passenger seat) is shown in FIG. 1.

[0010] Inside the vehicle 1, a display unit 2 capable of displaying video content on a large screen is provided. In the example of FIG. 1, the display unit 2 is configured as a projector system including a projector 2a and a screen 2b. The projector 2a has a pan-tilt mechanism and a zoom mechanism, and is configured to be able to change the projection range. The screen 2b is attached to an arbitrary location inside the vehicle, for example, the ceiling 1a of the vehicle 1, using a fixture 3 such as a clip. When the screen 2b is attached to the ceiling 1a of the vehicle 1, a wide projection range can be ensured, and video content can be viewed on a large screen. Note that the display unit 2 may be configured as a liquid crystal display or the like attached to the instrument panel, the back of the front seat, the ceiling, etc., or may be configured as an aerial display that forms an aerial image of the video in the vehicle interior space.

[0011] The seat 4 of each seat in the vehicle 1 has a seat cushion portion 4a that supports the occupant's buttocks, a seat back portion 4b that supports the occupant's back, and a headrest portion 4c that is provided at the upper part of the seat back portion 4b and supports the occupant's head. The seat cushion portion 4a has a front-rear position adjustment mechanism that can slide in the front-rear direction and can be fixed at an arbitrary position. The seat back portion 4b has a reclining mechanism that can fix the inclination angle with respect to the seat cushion portion 4a at an arbitrary angle. The headrest portion 4c has an up-down position adjustment mechanism that can move upward from the upper end portion of the seat back portion 4b and can be fixed at a predetermined position.

[0012] A center console 5 is provided between the two left and right seats 4 of the front seats and the rear seats. The projector 2a can be arranged at an arbitrary location inside the vehicle. When the screen 2b is attached to the ceiling 1a of the vehicle 1, the projector 2a can be arranged, for example, on the center console 5 so as to project video content in the direction of the screen 2b, that is, toward the upper space of the occupant. Note that only the center console (rear center console) 5 provided between the rear seats is shown in FIG. 1, and an example of arranging the projector 2a on the rear center console 5 is shown.

[0013] Once the positions of the projector 2a and the screen 2b are determined, the initial setting of the projection range can be performed using the pan-tilt mechanism and the zoom mechanism of the projector 2a. The initial setting is performed so that, with the seats 4 of all seats reclined while the vehicle 1 is stopped, the projection range is suitable for each occupant to view the test still image. In the initial setting, in addition to the projection range for displaying a single large screen (full screen display) that all occupants view, the projection range for displaying a plurality of screens (multi-display display) at positions corresponding to each seat can be set.

[0014] FIG. 2 is a block diagram schematically showing a main configuration of a vehicle video display device (hereinafter, the device) 100 according to an embodiment of the present invention. As shown in FIG. 2, the device 100 includes a display unit 2 (projector 2a), a controller 10 that controls the display unit 2, a user terminal 6 capable of outputting video content, a camera 7 capable of photographing an occupant of the vehicle 1, and a sensor 8 capable of detecting a running state of the vehicle 1. The controller 10 is connected to each of the display unit 2 (projector 2a), the user terminal 6, the camera 7, and the sensor 8 by wire or wirelessly.

[0015] As the user terminal 6 capable of outputting video content, for example, portable devices such as a smartphone, a portable game machine, and a video camera carried by an occupant can be used. The entertainment system mounted on the vehicle 1 can also be used as the user terminal 6. The user terminal 6 outputs a video signal corresponding to the video content selected according to an operation by the occupant who is the user to the projector 2a via the controller 10.

[0016] The user terminal 6 may transmit (output) a video file corresponding to the video content selected according to the operation by the occupant to the controller 10. The video file transmitted from the user terminal 6 to the controller 10 is stored in the memory of the controller 10. In the memory of the controller 10, video files and image files such as scenery that do not include either characters or people are stored in advance. The video file transmitted from the user terminal 6 to the controller 10 may be stored together with the files stored in advance in the memory of the controller 10, or may be stored after deleting the files stored in advance.

[0017] When the user terminal 6 outputs a video signal or a video file corresponding to the video content, it transmits video information regarding the video content to the controller 10. The video information includes information regarding the type of the video content. The information regarding the type of the video content is information regarding whether the video content is a game or a video other than a game. The information regarding the type of the video content may be information indicating whether the user terminal 6 is a portable game machine. That is, if the user terminal 6 is a portable game machine, the video content output from the user terminal 6 is a game, and if the user terminal 6 is other than a portable game machine, it can be determined that the video content output from the user terminal 6 is a video other than a game. The information regarding the type of the video content for a video other than a game also includes information regarding whether the video content is a first video including at least one of characters and people and a second video including neither characters nor people.

[0018] As the camera 7 capable of photographing the occupants of the vehicle 1, for example, an in-vehicle camera provided on the instrument panel or the like of the vehicle 1 and determining whether the driver is awake by photographing the face of the driver can be used. Such a camera 7 can also photograph the faces of the occupants in the passenger seat and the rear seat. In this case, the controller 10 is connected to an electronic control unit mounted on the vehicle 1 and into which a signal from the camera 7 is input, and is connected to the camera 7 via the electronic control unit.

[0019] As the sensor 8 capable of detecting the running state of the vehicle 1, for example, a vehicle speed sensor mounted on the vehicle 1 can be used as the sensor 8. In this case, the controller 10 is connected to an electronic control unit to which a signal from the vehicle speed sensor (sensor 8) mounted on the vehicle 1 is input, and is connected to the sensor 8 via the electronic control unit. It is also possible to use a positioning sensor such as GPS mounted on a smartphone or wearable device carried by a passenger. In this case, the moving speed of the vehicle 1 can be estimated based on the time-series position information detected by the positioning sensor (sensor 8).

[0020] The controller 10 includes a computer having a processor such as a CPU, memories such as a ROM and a RAM, and other peripheral circuits, and is built in, for example, the projector 2a. The controller 10 may include an independent computer not built in the projector 2a, or a user terminal such as a smartphone carried by a passenger may be used as the controller 10. The processor of the controller 10 functions as the information acquisition unit 11 and the control unit 12 by executing a program stored in the memory in advance.

[0021] The information acquisition unit 11 acquires video information transmitted from the user terminal 6, passenger information regarding the state of the passengers of the vehicle 1 photographed by the camera 7, and traveling information regarding the running state of the vehicle 1 detected by the sensor 8. Specifically, the passenger information is image information including the faces of the passengers of the vehicle 1 photographed by the camera 7, and includes information regarding the direction of the line of sight of each passenger, information regarding the complexion of each passenger, information regarding the expression of each passenger, and the like. Specifically, the traveling information is information on the moving speed of the vehicle 1 detected by the vehicle speed sensor (sensor 8) or time-series position information detected by the positioning sensor (sensor 8).

[0022] The control unit 12 controls the display unit 2 to display video content by transmitting a video signal to the display unit 2, and also controls the display unit 2 to change the type of video content based on the passenger information and driving information acquired by the information acquisition unit 11. More specifically, it compares the state of the passengers before the start of the vehicle 1's travel or before the start of the display of video content with the state of the passengers after the start of the vehicle 1's travel and after the start of the display of video content, and determines whether the passengers are suffering from video sickness based on the comparison result. Then, when it is determined that the passengers are suffering from video sickness, it controls the display unit 2 to change the type of video content.

[0023] The control unit 12 monitors the moving speed of the vehicle 1 included in the driving information to determine whether the vehicle 1 has started to travel, that is, whether the operation of the vehicle 1 in the current driving cycle (movement from one point to another point, including travel and temporary stop) has started. Then, when the display of video content by the display unit 2 is started and the travel of the vehicle 1 is started, it monitors the change in the state of each passenger and determines whether each passenger is suffering from video sickness. When the travel of the vehicle 1 is started after the display of video content by the display unit 2 is started, it determines whether the passengers are suffering from video sickness by comparing the state of the passengers (initial state) when the vehicle 1 started to travel with the current state of the passengers. When the display of video content by the display unit 2 is started after the travel of the vehicle 1 is started, it determines whether the passengers are suffering from video sickness by comparing the state of the passengers (initial state) when the display of video content by the display unit 2 was started with the current state of the passengers.

[0024] Based on the occupant information (image information), the control unit 12 determines whether the occupant's line of sight is directed towards the predetermined display unit 2 (screen 2b). When the time or frequency of the occupant diverting their line of sight from the video content increases, it is determined that the occupant is suffering from motion sickness due to the video. The time the occupant diverts their line of sight from the video content is calculated every predetermined time, and can be calculated as the length of time during the predetermined time when the direction of the occupant's line of sight is outside the range where the video content displayed on the display unit 2 can be viewed. The frequency of the occupant diverting their line of sight from the video content is calculated every predetermined time, and can be calculated as the number of times the direction of the occupant's line of sight is outside the range where the video content displayed on the display unit 2 can be viewed during the predetermined time.

[0025] Also, based on the occupant information, the control unit 12 identifies the occupant's facial color, and when the occupant's facial color approaches white, it is determined that the occupant is suffering from motion sickness due to the video. The occupant's facial color can be quantified, for example, as brightness. When the value of the brightness increases, it can be determined that the occupant's facial color has approached white.

[0026] Also, based on the occupant information, the control unit 12 identifies the occupant's expression. When the occupant's expression becomes an expression indicating pain, or when the expressionless state continues for a predetermined time or more, it is determined that the occupant is suffering from motion sickness due to the video. The occupant's expression (such as the corners of the mouth, etc.) can be classified by fitting it to either the pattern of expressions corresponding to a plurality of predetermined emotions or the pattern of an expressionless face. When the occupant's expression is classified as an expression indicating pain, it is determined that the occupant is suffering from motion sickness due to the video. When the occupant's expression is classified as expressionless, the calculation of the duration of the expressionless state is started, and when the duration of the expressionless state becomes a predetermined time or more, it is determined that the occupant is suffering from motion sickness due to the video.

[0027] Motion sickness occurs when there is a discrepancy between the motion information (information regarding the magnitude of the moving speed, the direction and magnitude of the acceleration, etc.) that enters the viewer's eyes and the motion information felt by the body such as the inner ear, muscles, and joints, causing the brain to become confused and the autonomic nerves to be disrupted. Therefore, when a passenger in vehicle 1 watches video content, the more the video content demands the viewer's (passenger's) viewpoint movement, the more likely it is that a discrepancy will occur between the motion information that enters the eyes and the motion information felt by the body, making the passenger more prone to motion sickness. When the passenger experiences motion sickness while watching video content during the driving of vehicle 1, by changing the type of the displayed video content to one that requires less viewpoint movement, the discrepancy between the motion information that enters the eyes and the motion information felt by the body can be suppressed. In this case, the passenger can be recovered from the state of motion sickness, and further motion sickness can be suppressed.

[0028] When it is determined that any of the passengers is suffering from motion sickness, the control unit 12 immediately controls the display unit 2 to change the type of the video content. More specifically, when the type of the currently displayed video content is a game, the control unit 12 controls the display unit 2 to change the type of the video content to a video other than a game. In this case, instead of the game video content output from the user terminal 6, video content (second video) such as a scenery that does not include any characters or text is displayed based on a video file stored in advance in the memory of the controller 10. When a portable game console and a device other than the portable game console are connected to the controller 10 as the user terminal 6, it may be switched from the video content of the portable game console to the video content of the device other than the portable game console. When the type of the currently displayed video content is the first video, the control unit 12 controls the display unit 2 to change the type of the video content to the second video. In this case, instead of the first video content output from the user terminal 6, a still image is displayed based on an image file stored in advance in the memory of the controller 10.

[0029] FIG. 3 is a flowchart showing an example of the processing executed by the controller 10. The processing shown in this flowchart is started, for example, when the controller 10 is activated, and is repeated at a predetermined cycle until the controller 10 is stopped. As shown in FIG. 3, first, in step S1, video information, passenger information, and driving information are acquired. Next, in step S2, based on the driving information acquired in step S1, it is determined whether the vehicle 1 is running while video content is being displayed on the display unit 2. If the determination in step S2 is negative, the process proceeds to step S3, where the current state of the passenger (the time or frequency of looking away from the video content, the brightness of the facial color, the expression (such as the corners of the mouth)) is determined based on the passenger information acquired in step S1, recorded and updated in the memory of the controller 10 as the initial state of the passenger, and then the process returns to step S1. If the determination in step S2 is positive, the process proceeds to step S4, where the current state of the passenger is determined based on the passenger information acquired in step S1 and compared with the initial state of the passenger stored in the memory of the controller 10. Next, in step S5, based on the comparison result of step S4, it is determined whether there is a passenger suffering from motion sickness due to the video. If the determination in step S5 is negative, the process ends. If the determination in step S5 is positive, the process proceeds to step S6, where the type of the video content is changed.

[0030] That is, when the video content is being displayed and the vehicle 1 is running, the state of the passenger is constantly monitored, and when a passenger suffering from motion sickness due to the video is detected, the type of the video content is immediately changed (steps S1 to S6). This makes it possible to quickly recover even if a passenger suffers from motion sickness due to the video, and to suppress the motion sickness of the passenger caused by viewing the video content even when viewing the video content on a large screen in the limited space inside the vehicle.

[0031] According to this embodiment, the following operational effects can be achieved. (1) The device 100 is mounted on the vehicle 1 and includes a display unit 2 for displaying video content, an information acquisition unit 11 for acquiring passenger information regarding the state of the passengers in the vehicle 1, and a control unit 12 for determining whether a passenger is suffering from video sickness based on the passenger information acquired by the information acquisition unit 11 and controlling the display unit 2 to change the type of the video content when it is determined that the passenger is suffering from video sickness (FIG. 1, FIG. 2). Thereby, even when a passenger suffers from video sickness, the passenger can recover, and even when viewing video content on a large screen in the limited space inside the vehicle, it is possible to suppress the video sickness of the passenger caused by viewing the video content.

[0032] (2) The types of the video content include games and videos other than games. When it is determined that a passenger is suffering from video sickness while the type of the video content is a game, the control unit 12 controls the display unit 2 to change the type of the video content to a video other than a game. Thereby, it is possible to suppress the viewpoint movement when viewing the video content, appropriately recover the passenger from the state of video sickness, and suppress further video sickness.

[0033] (3) The types of the video content include a first video including at least one of characters and persons and a second video not including any of characters and persons. When it is determined that a passenger is suffering from video sickness while the type of the video content is the first video, the control unit 12 controls the display unit 2 to change the type of the video content to the second video. Thereby, it is possible to further suppress the viewpoint movement when viewing the video content, further appropriately recover the passenger from the state of video sickness, and further suppress further video sickness.

[0034] (4) The information acquisition unit 11 further acquires driving information regarding the driving state of the vehicle 1. The passenger information includes information regarding the direction of the passenger's line of sight. Based on the passenger information and the driving information acquired by the information acquisition unit 11, the control unit 12 compares the direction of the passenger's line of sight before the start of driving of the vehicle 1 or before the start of display of video content with the direction of the passenger's line of sight after the start of driving of the vehicle and after the start of display of video content, and determines that the passenger is suffering from motion sickness if the time or frequency of the passenger's line of sight deviating from the video content increases based on the comparison result. Thereby, it is possible to accurately determine whether or not the passenger is suffering from motion sickness.

[0035] (5) The information acquisition unit 11 further acquires driving information regarding the driving state of the vehicle 1. The passenger information includes information regarding the complexion of the passenger. Based on the passenger information and the driving information acquired by the information acquisition unit 11, the control unit 12 compares the complexion of the passenger before the start of driving of the vehicle 1 or before the start of display of video content with the complexion of the passenger after the start of driving of the vehicle 1 and after the start of display of video content, and determines that the passenger is suffering from motion sickness if the passenger's complexion approaches white based on the comparison result. Thereby, it is possible to accurately determine whether or not the passenger is suffering from motion sickness.

[0036] (6) The information acquisition unit 11 further acquires driving information regarding the driving state of the vehicle 1. The passenger information includes information regarding the expression of the passenger. Based on the passenger information and the driving information acquired by the information acquisition unit 11, the control unit 12 compares the state of the passenger's expression before the start of driving of the vehicle 1 or before the start of display of video content with the state of the passenger's expression after the start of driving of the vehicle 1 and after the start of display of video content, and determines that the passenger is suffering from motion sickness if the passenger's expression shows pain or if the expressionless state continues for a predetermined time or more based on the comparison result. Thereby, it is possible to accurately determine whether or not the passenger is suffering from motion sickness.

[0037] (7) The display unit 2 has a projector 2a that projects video content toward the upper space of the occupant. When projecting video content toward the upper space of the occupant using the projector 2a, a wide projection range can be secured on the ceiling 1a of the vehicle 1, and the video content can be displayed on a large screen. In this case, while the viewing experience of the video content by the occupant can be improved, the occupant is more likely to get motion sickness from the video. By monitoring the state of the occupant and immediately changing the type of video content when the occupant gets motion sickness from the video to recover, it is possible to suppress the occupant's motion sickness from the video even when viewing the video content on a large screen in the limited space inside the vehicle.

[0038] In the above embodiment, the specific arrangement example of the display unit 2 (the projector 2a and the screen 2b) has been shown and described with reference to FIG. 1 and the like. However, the display unit mounted on the vehicle and displaying the video content is not limited to such a configuration. For example, the projector 2a may be arranged on the floor or the like of the vehicle 1, or may be attached to the ceiling 1a or the like.

[0039] The above description is merely an example, and the present invention is not limited to the above-described embodiments and modifications as long as the features of the present invention are not impaired. It is also possible to arbitrarily combine one or more of the above embodiments and modifications, and it is also possible to combine the modifications with each other.

Description of Reference Numerals

[0040] 1 Vehicle, 2 Display unit, 2a Projector, 2b Screen, 3 Fixture, 4 Seat, 4a Seat cushion part, 4b Seat back part, 4c Headrest part, 5 Center console, 6 User terminal, 7 Camera, 8 Sensor, 10 Controller, 11 Information acquisition unit, 12 Control unit, 100 Vehicle video display device (device)

Claims

1. A display unit mounted on a vehicle and configured to display video content; An information acquisition unit configured to acquire passenger information regarding the state of a passenger in the vehicle; A control unit configured to determine whether the passenger is suffering from video motion sickness based on the passenger information acquired by the information acquisition unit, and to control the display unit to change the type of the video content when it is determined that the passenger is suffering from video motion sickness. A vehicle video display device characterized by comprising the above components.

2. The vehicle video display device according to claim 1, wherein the types of the video content include games and videos other than games, and when the type of the video content is a game and it is determined that the passenger is suffering from video motion sickness, the control unit controls the display unit to change the type of the video content to a video other than the game. A vehicle video display device characterized by this feature.

3. The vehicle video display device according to claim 1, wherein the types of the video content include a first video including at least one of characters and people and a second video not including any of characters and people, and when the type of the video content is the first video and it is determined that the passenger is suffering from video motion sickness, the control unit controls the display unit to change the type of the video content to the second video. A vehicle video display device characterized by this feature.

4. In the vehicle video display device according to any one of claims 1 to 3, the information acquisition unit further acquires driving information regarding the driving state of the vehicle, the passenger information includes information regarding the direction of the passenger's line of sight, and the control unit compares the direction of the passenger's line of sight before the start of driving of the vehicle or before the start of display of the video content with the direction of the passenger's line of sight after the start of driving of the vehicle and after the start of display of the video content based on the passenger information and the driving information acquired by the information acquisition unit, and determines that the passenger is suffering from video motion sickness when the time or frequency of the passenger diverting the line of sight from the video content increases based on the comparison result. A vehicle video display device characterized by this feature.

5. In the vehicle video display device according to any one of claims 1 to 3, the information acquisition unit further acquires driving information regarding the driving state of the vehicle, the passenger information includes information regarding the complexion of the passenger, The control unit compares the color of the occupant before the start of the vehicle's travel or before the start of the display of the video content, based on the occupant information and the driving information acquired by the information acquisition unit, with the color of the occupant after the start of the vehicle's travel and after the start of the display of the video content. When the color of the occupant approaches white based on the comparison result, it is determined that the occupant is suffering from motion sickness. A vehicle video display device characterized by this.

6. In the vehicle video display device according to any one of claims 1 to 3, the information acquisition unit further acquires driving information regarding the driving state of the vehicle, the occupant information includes information regarding the expression of the occupant, the control unit compares the state of the occupant's expression before the start of the vehicle's travel or before the start of the display of the video content, based on the occupant information and the driving information acquired by the information acquisition unit, with the state of the occupant's expression after the start of the vehicle's travel and after the start of the display of the video content. When the occupant's expression becomes an expression showing pain based on the comparison result, or when the expressionless state continues for a predetermined time or more, it is determined that the occupant is suffering from motion sickness. A vehicle video display device characterized by this.

7. In the vehicle video display device according to any one of claims 1 to 3, the display unit has a projector that projects the video content toward the upper space of the occupant. A vehicle video display device characterized by this.

Images