Display control method and display control device
The display control method and device address the challenge of managing three-dimensional image depth in vehicles by calculating occupant immersion and adjusting image depth based on parallax, thereby maintaining passenger attention.
Patent Information
- Application Number
- JP2021139017
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-27
- Publication Date
- 2025-06-18
- Estimated Expiration
- 2041-08-27
AI Technical Summary
Existing technologies for controlling in-vehicle displays cannot effectively manage the three-dimensional depth of three-dimensional images, leading to a potential decrease in passenger attention during high immersion levels.
A display control method and device that calculate the degree of immersion of an occupant in a three-dimensional image and adjust the three-dimensional depth based on the amount of parallax between two images forming the three-dimensional image, thereby maintaining appropriate attention levels.
The solution effectively suppresses decreases in passenger attention by adjusting the three-dimensional depth of displayed images according to the occupant's immersion level, ensuring a balance between engagement and attention to driving.
Smart Images

Figure 0007694262000001 
Figure 0007694262000002 
Figure 0007694262000003
Abstract
Description
Technical Field
[0001] The present invention relates to a display control method and a display control device.
Background Art
[0002] As a technology for controlling image information provided to a passenger, for example, there is a technology disclosed in Patent Document 1. In the technology disclosed in Patent Document 1, a concentration evaluation value when a passenger views in-vehicle display is calculated. Then, based on the value of the calculated concentration evaluation value, the amount of information of the display and the display intensity (luminance, size, contrast) of the display objects displayed around are changed.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] The technology disclosed in Patent Document 1 is a technology for changing the amount of information of the display and the display intensity according to the concentration evaluation value of the passenger. Therefore, in the technology disclosed in Patent Document 1, when displaying a three-dimensional image such as a map including depth and the front-back direction position of a building as image information provided to a passenger, it is impossible to control the three-dimensional depth of the three-dimensional image. For this reason, as the immersion degree (concentration) of the passenger with respect to the three-dimensional image increases, there is a possibility that the attention degree of the passenger to driving decreases.
[0005] An object of the present invention is to provide a display control method and a display control device capable of suppressing a decrease in the attention of a passenger in view of the above problems.
Means for Solving the Problems
[0006] According to one aspect of the present invention, the degree of immersion of an occupant in a three-dimensional image displayed on an image display unit is calculated, and the height of the calculated degree of immersion is determined. Then, a display control method and a display control device are provided that control the three-dimensional depth of the three-dimensional image according to the amount of parallax with respect to two images forming the three-dimensional image displayed on the image display unit according to the determined height of the degree of immersion.
Effect of the Invention
[0007] According to the present invention, by controlling the three-dimensional depth of the three-dimensional image displayed on the image display unit according to the height of the degree of immersion of the occupant in the three-dimensional image, it is possible to provide a display control method and a display control device capable of suppressing a decrease in the attention of the occupant.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Modes for Carrying Out the Invention
[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals, and redundant explanations are omitted. Each drawing is schematic and may differ from the actual one. The following embodiments illustrate devices and methods for embodying the technical idea of the present invention, and the technical idea of the present invention is not limited to the devices and methods illustrated in the following embodiments. The technical idea of the present invention can be variously modified within the technical scope described in the claims.
[0010] (First Embodiment) Hereinafter, the first embodiment of the present invention will be described with reference to the drawings. (Configuration) The configuration of the display control device 1 will be described with reference to FIG. 1. The display control device 1 is provided in a moving body that moves by manual operation by an occupant or automatic operation by a system, such as a vehicle, a ship, or an aircraft. In the first embodiment, the case where the vehicle as a moving body is provided with the display control device 1 will be described. The display control device 1 further includes a brain activity amount detection unit 10, a visual recognition target grasping unit 20, an immersion degree calculation unit 30, an immersion degree determination unit 40, and a display control unit 50.
[0011] Note that the display control device 1 is an electronic control unit and includes a processor and peripheral components of the processor. The processor may be, for example, a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The visual recognition target grasping unit 20, the immersion degree calculation unit 30, the immersion degree determination unit 40, and the display control unit 50 may be arranged at an arbitrary position inside the vehicle, for example. Further, the visual recognition target grasping unit 20, the immersion degree calculation unit 30, the immersion degree determination unit 40, and the display control unit 50 may be arranged outside the vehicle (such as a base station), and may be configured to communicate with a configuration arranged in the vehicle via a communication network or the like.
[0012] (Brain Activity Amount Detection Unit) The brain activity detection unit 10 includes a brain activity measurement unit 10a and a blink detection unit 10b. The brain activity measurement unit 10a measures the state of the occupant's brain activity and outputs brain activity information, which is information including the measured state of the brain activity, to the immersion degree calculation unit 30. The state of the brain activity is any one of the occupant's brain waves, the occupant's brain magnetic field, and the occupant's brain potential. Therefore, the brain activity measurement unit 10a measures the occupant's brain activity using any one of the occupant's brain waves, the occupant's brain magnetic field, and the occupant's brain potential.
[0013] Specifically, the brain activity measurement unit 10a can be formed using means for measuring radio waves caused by brain activity, means for measuring magnetic fields caused by brain activity, means for measuring the potential arranged on the surface of the occupant's scalp, an electroencephalograph, a magnetoencephalograph, an electroencephalogram meter, etc. In addition, the brain activity measurement unit 10a is preferably capable of measuring the object to be measured with high time resolution. Furthermore, the brain activity measurement unit 10a is preferably non-contact type, but may also be contact type. As the non-contact type brain activity measurement unit 10a, for example, "Neurobiomonitor Headrest" manufactured by Freer Logic can be used. Also, as the non-contact type brain activity measurement unit 10a, for example, "RICOH MEG" of a magnetoencephalogram measurement system can also be used.
[0014] The blink detection unit 10b detects the blink movement of the eyes of the occupant. Note that the blink detection unit 10b may be configured to be realized as at least one of hardware and software. The blink detection unit 10b can detect the blink movement of the occupant based on, for example, electrooculogram (EOG: Electro Oculo Graphy).
[0015] Further, the blink detection unit 10b may be configured to estimate the potential generated by the blink of the occupant by applying, for example, the blink potential removal technique of an electroencephalogram analysis system (BESA Research 7.0). In the configuration applying the blink potential removal technique of the electroencephalogram analysis system, the potential generated by the blink of the occupant is estimated based on a model created in advance regarding what scalp potentials are generated by blinks. As described above, the blink detection unit 10b detects the blink operation of the eyes of the occupant and outputs blink information, which is information including the detected blink operation, to the immersion degree calculation unit 30. Note that the "blink operation" includes at least one of "immediately after a blink", "immediately after closing the eyes during a blink", "immediately before a blink", "before and after a blink", "during a blink", "instant of a blink", "period of blinking", and "period elapsed from closing the blinked eye to fully opening it".
[0016] <Visual recognition target grasping unit> The visual recognition target grasping unit 20 grasps the target being visually recognized among a plurality of visual recognition targets arranged in the vehicle interior. Further, the visual recognition target grasping unit 20 outputs visual recognition target information, which is information including the grasped visual recognition target, to the immersion degree calculation unit 30. Further, a visual recognition target detection unit SC is connected to the visual recognition target grasping unit 20. The visual recognition target detection unit SC is formed by using, for example, an imaging device (such as a stereo camera or a monocular camera) capable of imaging a target and is arranged in the vehicle interior. The target imaged by the visual recognition target detection unit SC is the occupant in the vehicle interior, specifically, the line of sight of the occupant.
[0017] Further, the visual recognition target grasping unit 20 stores in advance the spatial coordinates set for each of a plurality of visual recognition targets arranged in the vehicle interior. Note that the spatial coordinates set for each of the plurality of visual recognition targets may be coordinates indicating a region or coordinates indicating a point. The plurality of visual targets are, for example, the display screen of a navigation system, the display screen of a meter provided on an instrument panel, the display screen provided on a rearview mirror, and the like. In the first embodiment, as an example, a case will be described in which the plurality of visual targets are three visual targets, namely, the display screen of a navigation system, the display screen of a meter provided on an instrument panel, and the display screen provided on a rearview mirror. Further, in the first embodiment, a case will be described in which all of the plurality of visual targets are display screens provided in a display device capable of displaying three-dimensional images.
[0018] When the visual target grasping unit 20 grasps the target being visually recognized by the occupant, it refers to the line of sight imaged by the visual target detection unit SC and a plurality of spatial coordinates stored in advance. Then, when detecting the spatial coordinate towards which the line of sight imaged by the visual target detection unit SC is directed among the plurality of spatial coordinates stored in advance, the visual target set with the detected spatial coordinate is grasped as the target being visually recognized by the occupant.
[0019] <Degree of immersion calculation unit> The degree of immersion calculation unit 30 calculates the degree of immersion of the occupant with respect to the target being visually recognized by the occupant in the vehicle interior, using the state of brain activity included in the brain activity information, the blinking motion included in the blinking information, and the visual target included in the visual target information. Further, the degree of immersion calculation unit 30 outputs the degree of immersion calculation information, which is information including the calculated degree of immersion, to the degree of immersion determination unit 40. When calculating the degree of immersion, for example, the degree of immersion is calculated according to the magnitude of the activity amount of the brain activity during the blinking motion. As a specific example, when the brain potential immediately after blinking is large, the degree of immersion is calculated to be low, and when the brain potential immediately after blinking is small, the degree of immersion is calculated to be high.
[0020] In the first embodiment, as an example, a configuration of the degree of immersion calculation unit 30 will be described in which, in order to improve the accuracy of calculating the degree of immersion, the average value of the activity amounts of the brain activity during a plurality of blinking motions is calculated, and further, the degree of immersion is calculated based on the calculated average value. In this case, the immersion degree calculation unit 30 calculates the immersion degree using the blink-evoked potential, for example, by adding and averaging the brain waves measured by the brain activity measurement unit 10a with the blink operation detected by the blink detection unit 10b as a trigger. The "blink-evoked potential" is a negative scalp potential that reflects the reset of the brain.
[0021] Here, the reason for calculating the immersion degree using the blink-evoked potential will be explained. It is known that blinking resets the brain by increasing the activity of the network that is activated during the resting state at the moment of blinking. Therefore, it is possible to obtain the "blink-evoked potential" by using a method such as adding and averaging brain waves with blinking as a trigger. As an example, in a state where the occupant's immersion degree with respect to the image displayed on the display is high, the degree of resetting the brain by blinking becomes shallow, so the "blink-evoked potential" becomes small. On the other hand, in a state where the occupant's immersion degree with respect to the image displayed on the display is low, the degree of resetting the brain by blinking becomes deep, so the "blink-evoked potential" becomes large.
[0022] Therefore, the immersion degree calculation unit 30 calculates the immersion degree to be low when the activity amount of the brain activity is large (for example, the maximum value of the waveform of the brain waves during a certain period immediately after blinking) based on the magnitude of the activity amount of the brain activity at the time of blinking. On the other hand, when the activity amount of the brain activity is small, the immersion degree is calculated to be high. Note that when the time of the blink operation detected by the blink detection unit 10b is the "time point", the immersion degree calculation unit 30 may cut out the state of the brain activity for a certain time (a certain period) before and after the "time point" or after (immediately after) the "time point", and calculate the immersion degree based on the cut-out state of the brain activity.
[0023] <Immersion Degree Discrimination Unit> The immersion degree discrimination unit 40 discriminates the height of the occupant's immersion degree with respect to the three-dimensional image displayed on the object being visually recognized by the occupant, using the immersion degree included in the immersion degree calculation information and a preset immersion degree threshold. Further, the immersion degree discrimination unit 40 outputs immersion degree discrimination information, which is information including the discriminated height of the immersion degree, to the display control unit 50. The immersion threshold is set individually for, for example, an image (3D image) to be displayed on an object being visually recognized by an occupant. As a specific example, the immersion threshold set for a 3D map is set higher than the immersion threshold set for a 3D camera image. Note that the setting of the immersion threshold is not limited to this setting, and it is also possible to set the immersion threshold set for a 3D map lower than the immersion threshold set for a 3D camera image.
[0024] As described above, the height of the immersion degree included in the immersion degree discrimination information is one of the discrimination results where the immersion degree exceeds the immersion threshold, the discrimination result where the immersion degree is the same as the immersion threshold, and the discrimination result where the immersion degree is less than the immersion threshold. In addition, as the height of the immersion degree included in the immersion degree discrimination information, the discrimination result where the immersion degree exceeds the immersion threshold includes the degree of deviation between the immersion threshold and the immersion degree. Similarly, as the height of the immersion degree included in the immersion degree discrimination information, the discrimination result where the immersion degree is less than the immersion threshold includes the degree of deviation between the immersion threshold and the immersion degree.
[0025] <Display control unit> The display control unit 50 controls the image to be displayed on the image display unit DP based on the height of the immersion degree included in the immersion degree discrimination information. Further, the display control unit 50 outputs image information, which is information including the controlled image, to the image display unit DP. Note that the processing performed by the display control unit 50 will be described later. The image display unit DP is a display device capable of displaying a 3D image. In the first embodiment, as an example, a case will be described where the image display unit DP is formed including, for example, a display screen of a navigation system, a display screen of a meter provided in an instrument panel, a display screen provided in a rearview mirror, etc. That is, a plurality of image display units DP are arranged in the vehicle interior.
[0026] On the image display unit DP as the display screen of the navigation system, for example, a 3D map is displayed as a map screen including the position of the own vehicle and surrounding vehicles and the surroundings of the own vehicle. On the image display unit DP as the display screen of the meter, for example, numbers, indicators, etc. of a three-dimensional image are displayed as the vehicle speed, remaining fuel amount, etc. of the vehicle. On the image display unit DP as the display screen provided on the rearview mirror, for example, a synthesized image of the outside of the vehicle captured by a plurality of cameras or a line indicating a virtual area suitable for parking, etc., a three-dimensional camera image is displayed.
[0027] <Processing performed by the display control unit 50> When the display control unit 50 receives the input of the immersion degree determination information from the immersion degree determination unit 40, it controls the image to be displayed on the image display unit DP according to the image (three-dimensional image or two-dimensional image) currently displayed on the image display unit DP and the height of the immersion degree included in the immersion degree determination information. Specifically, when the image currently displayed on the image display unit DP is a three-dimensional image as shown in FIG. 2, and the height of the immersion degree included in the immersion degree determination information is the same as the immersion degree threshold, the display control unit 50 performs control not to change the three-dimensional depth of the image currently displayed on the image display unit DP.
[0028] Note that the three-dimensional depth is the depth corresponding to the amount of parallax with respect to the two images forming the three-dimensional image. Also, for example, the three-dimensional depth may be the ratio of parallax to the distance in the depth direction (parallax / distance in the depth direction). In this case, the parallax is set so that the difference in parallax for two objects with different positions in the depth direction is larger (the sense of perspective is emphasized) for a three-dimensional image with a deeper three-dimensional depth. Also, FIG. 2 shows the display screen DS of the image display unit DP, both eyes (right eye ER, left eye EL) of the occupant viewing the display screen DS, and the object OBW recognized by the occupant with both eyes as a three-dimensional image.
[0029] As shown in FIG. 2, in the three-dimensional image, an object OBR and an object OBL are arranged on the image display unit DP such that the line of sight of the right eye ER and the line of sight of the left eye EL intersect, and the object OBR and the object OBL are separated from each other. Thereby, a parallax is generated between the object OBR and the object OBL, and a stereoscopic object OBW is virtually visually recognized at a position closer to the occupant than the display screen DS. Note that the object OBR is an object visually recognized by the occupant with the right eye ER. Also, the object OBL is an object visually recognized by the occupant with the left eye EL. That is, the two images forming the three-dimensional image (object OBW) are the object OBR and the object OBL.
[0030] Further, when the image displayed on the image display unit DP is a three-dimensional image as shown in FIG. 2, the display control unit 50 performs control to reduce the three-dimensional depth of the image displayed on the image display unit DP when the height of the immersion degree included in the immersion degree determination information exceeds the immersion degree threshold. When performing control to reduce the three-dimensional depth of the image displayed on the image display unit DP, the image displayed on the image display unit DP changes from a three-dimensional image as shown in FIG. 2 to a two-dimensional image as shown in FIG. 3, for example.
[0031] Further, when the image displayed on the image display unit DP is a three-dimensional image as shown in FIG. 2, the display control unit 50 performs control to increase the three-dimensional depth of the image displayed on the image display unit DP when the height of the immersion degree included in the immersion degree determination information is less than the immersion degree threshold. When performing control to increase the three-dimensional depth of the image displayed on the image display unit DP, the image displayed on the image display unit DP changes from a three-dimensional image as shown in FIG. 2 to a three-dimensional image with a large parallax as shown in FIG. 4, for example. Note that the three-dimensional image with a large parallax as shown in FIG. 4 is an image in which the line of sight of the right eye ER and the line of sight of the left eye EL intersect, and the distance between the object OBR and the object OBL is larger compared to the three-dimensional image as shown in FIG. 2.
[0032] (Operation) Next, with reference to FIGS. 1 to 4 and using FIG. 5, an example of the operation of the display control device 1 during vehicle travel will be described. In step S1, the brain activity measurement unit 10a measures the brain waves of the occupant. In step S2, the visual target recognition unit 20 measures whether the occupant is visually recognizing a plurality of visual targets arranged in the vehicle interior. In step S3, the visual target recognition unit 20 determines whether the occupant is visually recognizing any one of the plurality of visual targets arranged in the vehicle interior. If it is determined that the occupant is visually recognizing the visual target (step S3: Yes), the process proceeds to step S4. On the other hand, if it is determined that the occupant is not visually recognizing the visual target (step S3: No), the process returns to step S1. As a result, in step S3, the visual target recognition unit 20 identifies the target that the occupant is visually recognizing among the plurality of visual targets arranged in the vehicle interior.
[0033] In step S4, the immersion degree calculation unit 30 calculates the immersion degree of the occupant with respect to the visual target identified in step S3. In step S5, the immersion degree discrimination unit 40 determines whether the immersion degree calculated in step S4 is the same as a preset immersion degree threshold. If it is determined that the immersion degree calculated in step S4 is the same as the immersion degree threshold (step S5: Yes), the process proceeds to step S6. On the other hand, if it is determined that the immersion degree calculated in step S4 is different from the immersion degree threshold (step S5: No), the process proceeds to step S7.
[0034] In step S6, the display control unit 50 performs control not to change the three-dimensional depth of the image displayed on the image display unit DP, and then the process ends. As a result, when the immersion degree of the occupant is appropriate (the immersion degree is the same as the immersion degree threshold) with respect to the three-dimensional image that the occupant is visually recognizing, the three-dimensional depth of the three-dimensional image is not changed, and an appropriate three-dimensional depth for the occupant is maintained. In step S7, the immersion degree determination unit 40 determines whether the immersion degree calculated in step S4 exceeds the immersion degree threshold. If it is determined that the immersion degree calculated in step S4 exceeds the immersion degree threshold (step S7: Yes), the process proceeds to step S8. On the other hand, if it is determined that the immersion degree calculated in step S4 is less than the immersion degree threshold (step S7: No), the process proceeds to step S10.
[0035] In step S8, the immersion degree determination unit 40 determines that the immersion degree of the occupant with respect to the visual recognition target is high. In step S9, the display control unit 50 performs control to reduce the three-dimensional depth of the image displayed on the image display unit DP (see FIGS. 2 and 3), and the process returns to step S1. Thereby, for the three-dimensional image being viewed by the occupant, when the immersion degree of the occupant is high, by reducing the three-dimensional depth of the three-dimensional image, the three-dimensional depth is controlled to an appropriate depth for the occupant.
[0036] In step S10, the immersion degree determination unit 40 determines that the immersion degree of the occupant with respect to the visual recognition target is low. In step S11, the display control unit 50 performs control to increase the three-dimensional depth of the image displayed on the image display unit DP (see FIGS. 2 and 4), and the process returns to step S1. Thereby, for the three-dimensional image being viewed by the occupant, when the immersion degree of the occupant is low, by increasing the three-dimensional depth of the three-dimensional image, the three-dimensional depth is controlled to an appropriate depth for the occupant.
[0037] By performing the above-described processing, for example, when a three-dimensional map is displayed on the display screen of the navigation system, for an occupant who becomes engrossed in the three-dimensional map, control is performed to reduce the three-dimensional depth when the immersion degree in the three-dimensional map is high. Thereby, it is suppressed that the immersion degree of the occupant with respect to the three-dimensional map three-dimensional image becomes high. Also, for example, for a passenger who can more easily grasp the position and distance from a three-dimensional map than a two-dimensional map, when the immersion level in the three-dimensional map is low, control is performed to increase the three-dimensional depth, thereby increasing the amount of information in the three-dimensional map.
[0038] That is, since a three-dimensional image has more information in the front-back direction than a two-dimensional image, when a three-dimensional image is displayed in a scene where information in the front-back direction is unnecessary (for example, when driving straight on a highway), too much information about distance and position is displayed. For this reason, the passenger becomes engrossed in the three-dimensional image, and the immersion level in the three-dimensional image increases. Also, in a two-dimensional image, since there is less information about distance and position, the immersion level is low. Therefore, by performing control to reduce the three-dimensional depth, control to change the three-dimensional image to a two-dimensional image, or control to reduce the display, it is possible to suppress a decrease in the passenger's attention.
[0039] On the other hand, in a scene where information in the front-back direction is necessary (for example, when looking for a turning angle in a three-dimensional map displayed on the display screen of a navigation system on a general road), the three-dimensional image makes it easier to understand the position and distance of the turning angle than a two-dimensional image, and the immersion level is low. Also, in a two-dimensional image, since it is difficult to understand the position and distance of the turning angle, it is necessary to reconstruct a small amount of display information in the mind, and the immersion level becomes high. Therefore, by performing control to increase the three-dimensional depth, it is possible to suppress a decrease in the passenger's attention.
[0040] As described above, in the display control method using the display control device 1 of the first embodiment, the immersion level of the passenger in the three-dimensional image displayed on the image display unit DP is calculated, and the height of the calculated immersion level is determined. Then, the three-dimensional depth of the three-dimensional image is controlled according to the height of the determined immersion level, based on the amount of parallax between the two images forming the three-dimensional image displayed on the image display unit DP.
[0041] In addition, the three-dimensional depth is controlled such that the higher the determined degree of immersion, the shallower the three-dimensional depth. Further, the degree of immersion is calculated by measuring the brain activity of the occupant using any one of the brain waves of the occupant, the brain magnetic field of the occupant, and the brain potential of the occupant. Furthermore, the brain activity of the occupant is measured, and the degree of immersion is determined based on the magnitude of the measured brain activity. Also, for a plurality of image display units DP, one image display unit DP being viewed by the occupant among the plurality of image display units DP is identified using the line of sight of the occupant and a plurality of three-dimensional image coordinates which are spatial coordinates set for each of the plurality of image display units DP. Then, the three-dimensional depth of the three-dimensional image displayed on the identified one image display unit DP is controlled. Also, for the three-dimensional image being viewed by the occupant, when the calculated degree of immersion is higher than a preset degree-of-immersion threshold value, the three-dimensional depth is controlled so as to become shallower. On the other hand, when the calculated degree of immersion is lower than the degree-of-immersion threshold value, the three-dimensional depth is controlled so as to become deeper.
[0042] Note that the above-described first embodiment is an example of the present invention, and the present invention is not limited to the above-described first embodiment, and various modifications can be made according to the design and the like as long as they do not depart from the technical idea of the present invention in forms other than this embodiment.
[0043] (Effect of the First Embodiment) In the case of the display control method using the display control device 1 of the first embodiment, the following-described effects can be achieved. (1) The degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP is calculated, and the height of the calculated degree of immersion is determined. Then, the three-dimensional depth of the three-dimensional image is controlled according to the height of the determined degree of immersion in accordance with the amount of parallax with respect to the two images forming the three-dimensional image displayed on the image display unit DP. Therefore, it becomes possible to control the three-dimensional depth of the three-dimensional image displayed on the image display unit DP to an appropriate three-dimensional depth according to the height of the degree of immersion of the occupant (driver of the vehicle). As a result, it becomes possible to provide a display control method that suppresses an increase in the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP and suppresses a decrease in the attention of the occupant.
[0044] (2) Control the three-dimensional depth so that the higher the determined degree of immersion, the shallower the three-dimensional depth. Therefore, it becomes possible to control the three-dimensional depth so that the higher the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP, the shallower the three-dimensional depth of the three-dimensional image. As a result, by making the three-dimensional depth of the three-dimensional image shallower as the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP increases, the degree of immersion of the occupant can be reduced, so it becomes possible to suppress a decrease in the attention of the occupant.
[0045] (3) Calculate the degree of immersion by measuring the brain activity of the occupant using any one of the brain waves, brain magnetic field, and brain potential of the occupant. As a result, it becomes possible to measure the brain activity of the occupant with high time resolution, and it becomes possible to improve the accuracy of discriminating the degree of immersion of the occupant. Therefore, it becomes possible to improve the accuracy of controlling the three-dimensional depth.
[0046] (4) Measure the brain activity of the occupant and determine the height of the degree of immersion based on the magnitude of the measured brain activity. As a result, the brain activity measurement unit 10a can measure the magnitude of the activity of the occupant with high accuracy, and it becomes possible to improve the discrimination accuracy of the degree of immersion. Therefore, it becomes possible to improve the accuracy of controlling the three-dimensional depth.
[0047] (5) For a plurality of image display units DP, using the line of sight of the occupant and a plurality of three-dimensional image coordinates that are spatial coordinates set for each of the plurality of image display units DP, identify one image display unit that the occupant is viewing among the plurality of image display units. Then, control the three-dimensional depth of the three-dimensional image displayed on the identified one image display unit DP. As a result, it becomes possible to control the three-dimensional depth according to the degree of immersion of the occupant only when it is determined that the occupant is viewing the image display unit DP. Therefore, unnecessary processing is not performed when the occupant is not viewing the image display unit DP, and the computational load can be reduced.
[0048] (6) For the three-dimensional image being viewed by the occupant, when the calculated degree of immersion is higher than a preset degree-of-immersion threshold, the three-dimensional depth is controlled so that the three-dimensional depth becomes shallower. On the other hand, when the calculated degree of immersion is lower than the degree-of-immersion threshold, the three-dimensional depth is controlled so that the three-dimensional depth becomes deeper. Therefore, it becomes possible to control the three-dimensional depth so that as the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP increases, the three-dimensional depth of the three-dimensional image becomes shallower. Also, it becomes possible to control the three-dimensional depth so that as the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP decreases, the three-dimensional depth of the three-dimensional image becomes deeper.
[0049] As a result, as the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP increases, by making the three-dimensional depth of the three-dimensional image shallower, it is possible to suppress a decrease in the occupant's attention because the degree of immersion of the occupant is reduced. Also, as the degree of immersion of the occupant in the three-dimensional image decreases, a margin is generated that allows the three-dimensional depth of the three-dimensional image displayed on the image display unit DP to be controlled deeper, so it becomes possible to increase the amount of information displayed on the image display unit DP.
[0050] Also, in the case of the display control device 1 of the first embodiment, it becomes possible to achieve the effects described below. (7) It includes a degree-of-immersion calculation unit 30 that calculates the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit DP, and a degree-of-immersion determination unit 40 that determines the height of the degree of immersion of the occupant in the three-dimensional image. In addition, it includes a display control unit 50 that controls the three-dimensional depth of the three-dimensional image according to the amount of disparity between two images forming the three-dimensional image displayed on the image display unit DP, according to the determined height of the degree of immersion.
[0051] Therefore, it becomes possible to control the three-dimensional depth of the three-dimensional image displayed on the image display unit DP to an appropriate three-dimensional depth according to the level of the occupant's (the driver of the vehicle) immersion degree. As a result, it becomes possible to provide the display control device 1 that can suppress an increase in the occupant's immersion degree with respect to the three-dimensional image displayed on the image display unit DP and suppress a decrease in the occupant's attention.
[0052] (Modification Example of the First Embodiment) (1) In the first embodiment, the three-dimensional depth is controlled such that the higher the determined immersion degree, the shallower the three-dimensional depth. However, the present invention is not limited to this. That is, the three-dimensional depth may be controlled such that the higher the determined immersion degree, the deeper the three-dimensional depth. In this case, it becomes possible to control the three-dimensional depth such that the higher the occupant's immersion degree with respect to the three-dimensional image displayed on the image display unit DP, the deeper the three-dimensional depth of the three-dimensional image.
[0053] As a result, when the occupant's spatial perception ability is relatively low, contrary to the case where the occupant's immersion degree with respect to the three-dimensional image displayed on the image display unit DP is high, it becomes possible to increase the three-dimensional depth. Thereby, it becomes easier for the occupant to grasp the sense of distance in the front-rear direction, and it becomes possible to reduce the occupant's immersion degree, so that it becomes possible to suppress a decrease in the occupant's attention to driving. That is, for example, when the occupant originally has a low spatial perception ability, there is a high possibility that the two-dimensional camera image (an image with a three-dimensional depth of zero) will be stared at (immersed) without being able to understand the sense of distance, rather than the three-dimensional camera image. In this case, by increasing the three-dimensional depth of the three-dimensional image as the occupant's immersion degree increases, it becomes easier to understand the sense of distance in the front-rear direction, and it becomes possible to reduce the possibility of staring at (immersing in) the three-dimensional image.
[0054] (2) In the first embodiment, when the calculated immersion degree exceeds the immersion degree threshold, control is performed to change the image displayed on the image display unit DP from a three-dimensional image to a two-dimensional image (see FIGS. 2 and 3). However, the present invention is not limited to this. That is, when the calculated immersion degree exceeds the immersion degree threshold, for example, the greater the degree of deviation between the calculated immersion degree and the immersion degree threshold, the greater the degree of increasing the shallowness of the three-dimensional depth of the image displayed on the image display unit DP may be controlled.
[0055] (3) In the first embodiment, when the calculated immersion degree is less than the immersion degree threshold, control is performed to change the image displayed on the image display unit DP to a three-dimensional image with a large parallax (see FIGS. 2 and 4). However, the present invention is not limited to this. That is, when the calculated immersion degree is less than the immersion degree threshold, for example, the greater the degree of deviation between the calculated immersion degree and the immersion degree threshold, the greater the degree of increasing the depth of the three-dimensional depth of the image displayed on the image display unit DP may be controlled.
[0056] (4) In the first embodiment, the immersion degree is calculated according to the brain activity during the eye blinking operation of the occupant. However, the present invention is not limited to this. That is, for example, the immersion degree may be calculated according to the brain activity when the eyeball is stationary using the eye fixation related potential (EFRP).
[0057] (Second Embodiment) Hereinafter, a second embodiment of the present invention will be described with reference to the drawings. (Configuration) The configuration of the second embodiment will be described with reference to FIGS. 1 to 5 and using FIG. 6. In the drawings and the following description, the same components as those in the above-described first embodiment are denoted by the same reference numerals. Also, in the following description, the description of the same components as those in the above-described first embodiment may be omitted. The configuration of the display control device 1 will be described using FIG. 6. The display control device 1 includes a brain activity amount detection unit 10, a visual recognition target grasping unit 20, an immersion degree calculation unit 30, a database 60, an immersion degree determination unit 40, and a display control unit 50. The configurations of the brain activity amount detection unit 10, the visual recognition target grasping unit 20, the immersion degree calculation unit 30, and the display control unit 50 are the same as those in the above-described first embodiment.
[0058] <Database> The database 60 stores an immersion degree determination threshold value used for determining the immersion degree. Also, the database 60 is formed using, for example, a small-capacity high-speed memory (e.g., cache memory) including SRAM (Static Random Access Memory) or the like. Further, the database 60 is formed using, for example, fixed storage means such as HDD (Hard Disk Drive) or SSD (Solid State Drive), or a cloud on a network.
[0059] Also, the database 60 includes a personal database 60a and a visual recognition target database 60b. The personal database 60a is a database that stores the immersion degree determination threshold value for each individual of the brain activity during the blinking operation of the occupant. Also, the personal database 60a stores an immersion degree determination threshold value corresponding to the correlation between brain activity and the immersion degree for a specific individual such as the driver of the vehicle. This is because the correlation between the brain activity state such as brain potential and the immersion degree varies depending on the individual in the vehicle.
[0060] When identifying an individual, for example, an image captured by the visual recognition target detection unit SC or an ID number unique to a key for starting the power source (engine, motor) of the vehicle is used. Also, the personal database 60a corrects the stored immersion degree determination threshold value according to the determination result input from the immersion degree determination unit 40. The explanation regarding the correction according to the determination result will be described later.
[0061] The visual recognition target database 60b is a database that stores the immersion degree discrimination threshold for each visual recognition target of the brain activity during the blinking operation of the occupant. In addition, the visual recognition target database 60b stores, for each visual recognition target, the association between brain activity and the degree of immersion. This is because the correlation between the brain activity state such as brain potential and the degree of immersion is different when the occupant in the vehicle is watching an image such as a video or a navigation screen, and when the occupant is visually recognizing the outside of the vehicle (such as the surrounding environment of the vehicle).
[0062] The immersion degree discrimination threshold stored in the visual recognition target database 60b is the immersion degree discrimination threshold individually set and stored for each content displayed by each of the plurality of image display units DP. In the second embodiment, as in the first embodiment described above, the case where the plurality of visual recognition targets (image display units DP) are the three display screens of the navigation system display screen, the meter display screen, and the display screen provided on the rearview mirror will be described. Also, in the second embodiment, as in the first embodiment described above, the case where all of the plurality of image display units DP can display three-dimensional images will be described.
[0063] Therefore, the immersion degree discrimination threshold stored in the visual recognition target database 60b is the immersion degree discrimination threshold individually set and stored for each content displayed by the display screens of the navigation system, the meter display screen, and the display screen provided on the rearview mirror. The content displayed on the display screen of the navigation system is, for example, the positions of the host vehicle and surrounding vehicles, and a three-dimensional map including the surroundings of the host vehicle. The content displayed on the display screen of the meter is, for example, numbers and indicators of three-dimensional images. The content displayed on the display screen provided on the rearview mirror is, for example, a three-dimensional camera image.
[0064] In the second embodiment, as an example, the case where the magnitudes of the immersion degree discrimination thresholds set for each content are set in the magnitude relationship represented by the following formula (1) will be described. Contents displayed on the display screen of the navigation system > Contents displayed on the display screen provided on the room mirror > Contents displayed on the display screen of the meter … (1) In the second embodiment, as an example, the content displayed on the display screen of the navigation system is defined as "first content", and the content displayed on the display screen provided on the room mirror is defined as "second content". In addition, the content displayed on the display screen of the meter is defined as "third content".
[0065] <Degree of immersion determination unit> The degree of immersion determination unit 40 uses the degree of immersion included in the degree of immersion calculation information and the degree of immersion threshold based on the degree of immersion threshold stored in the database 60 to determine the height of the degree of immersion of the occupant in the three-dimensional image displayed on the object being viewed by the occupant. In addition, the degree of immersion determination unit 40 outputs the degree of immersion determination information, which is information including the determined height of the degree of immersion, to the display control unit 50. The height of the degree of immersion included in the degree of immersion determination information is any one of the determination results where the degree of immersion exceeds the degree of immersion threshold, the determination result where the degree of immersion is the same as the degree of immersion threshold, and the determination result where the degree of immersion is less than the degree of immersion threshold. In addition, as the height of the degree of immersion included in the degree of immersion determination information, the determination result where the degree of immersion exceeds the degree of immersion threshold includes the degree of deviation between the degree of immersion threshold and the degree of immersion. Similarly, as the height of the degree of immersion included in the degree of immersion determination information, the determination result where the degree of immersion is less than the degree of immersion threshold includes the degree of deviation between the degree of immersion threshold and the degree of immersion.
[0066] In addition, the degree of immersion determination unit 40 outputs the determination result to the database 60. The database 60 that has received the input of the determination result corrects the degree of immersion threshold stored in the personal database 60a. Specifically, when the database 60 receives an input of a discrimination result where the degree of immersion exceeds the immersion discrimination threshold, it corrects the immersion discrimination threshold stored in the personal database 60a to a higher value. Also, when the database 60 receives an input of a discrimination result where the degree of immersion is the same as the immersion discrimination threshold, it maintains the immersion discrimination threshold stored in the personal database 60a. Furthermore, when the database 60 receives an input of a discrimination result where the degree of immersion is less than the immersion discrimination threshold, it corrects the immersion discrimination threshold stored in the personal database 60a to a lower value.
[0067] (Operation) With reference to FIGS. 1 to 6 and using FIGS. 7 and 8, an example of the operation of the display control device 1 during vehicle travel will be described. For the same processes as those in the above-described first embodiment, the same step numbers are assigned. In step S1, the brain activity measurement unit 10a measures the brain waves of the occupant. In step S2, the visual recognition target grasping unit 20 measures whether the occupant is visually recognizing a plurality of visual recognition targets arranged in the vehicle interior.
[0068] In step S3, the visual recognition target grasping unit 20 determines whether the occupant is visually recognizing any one of the plurality of visual recognition targets arranged in the vehicle interior. If it is determined that the occupant is visually recognizing the visual recognition target (step S3: Yes), the process proceeds to step S4. On the other hand, if it is determined that the occupant is not visually recognizing the visual recognition target (step S3: No), the process returns to step S1. Thereby, in step S3, the visual recognition target grasping unit 20 grasps the target that the occupant is visually recognizing among the plurality of visual recognition targets arranged in the vehicle interior. In step S4, the immersion degree calculation unit 30 calculates the immersion degree of the occupant with respect to the visual recognition target grasped in step S3.
[0069] In step S20, the immersion degree determination unit 40 refers to the immersion degree determination threshold corresponding to the correlation between the brain activity and the immersion degree of the vehicle occupant, which is stored in the personal database 60a. In addition to this, the immersion degree determination unit 40 refers to the immersion degree determination threshold corresponding to the visual recognition target grasped in step S3 among the immersion degree determination thresholds stored in the visual recognition target database 60b. In step S30, the immersion degree determination unit 40 performs the selection process shown in FIG. 8. When the selection process starts, in step S31, it is determined whether the visual recognition target grasped in step S3 is the first content. That is, in step S31, it is determined whether the occupant is viewing the first content. If it is determined that the occupant is viewing the first content (step S31: Yes), the process proceeds to step S32. On the other hand, if it is determined that the occupant is not viewing the first content (step S31: No), the process proceeds to step S33.
[0070] In step S32, the immersion degree determination threshold used for determining the immersion degree is set to the immersion degree determination threshold corresponding to the first content, and then the selection process ends. That is, in step S32, the immersion degree determination threshold used for determining the immersion degree is set to the value corresponding to the first content, which is the first threshold that is the maximum value. In step S33, it is determined whether the visual recognition target grasped in step S3 is the second content. That is, in step S33, it is determined whether the occupant is viewing the second content. If it is determined that the occupant is viewing the second content (step S33: Yes), the process proceeds to step S34. On the other hand, if it is determined that the occupant is not viewing the second content (step S33: No), the process proceeds to step S35.
[0071] In step S34, the immersion degree determination threshold used for determining the immersion degree is set to the immersion degree determination threshold corresponding to the second content, and then the selection process ends. That is, in step S34, the immersion degree determination threshold used for determining the immersion degree is set to the value corresponding to the second content, which is the second threshold that is the intermediate value. In step S35, the immersion degree discrimination threshold value used for the discrimination of the immersion degree is set to the immersion degree discrimination threshold value corresponding to the third content, and then the selection process ends. That is, in step S35, the immersion degree discrimination threshold value used for the discrimination of the immersion degree is set to the value corresponding to the third content, which is the third threshold value that is the minimum value.
[0072] In step S12, the immersion degree discrimination unit 40 determines whether the immersion degree calculated in step S4 is the same as the immersion degree discrimination threshold value set in the selection process (step S30). If it is determined that the immersion degree calculated in step S4 is the same as the immersion degree discrimination threshold value (step S12: Yes), the process proceeds to step S13. On the other hand, if it is determined that the immersion degree calculated in step S4 is different from the immersion degree threshold value (step S12: No), the process proceeds to step S14. In step S13, the immersion degree discrimination unit 40 outputs the discrimination result that the immersion degree is the same as the immersion degree discrimination threshold value to the database 60.
[0073] In step S6, the display control unit 50 performs control not to change the three-dimensional depth of the image displayed on the image display unit DP, and then the process ends. Thereby, when the immersion degree of the occupant with respect to the three-dimensional image being visually recognized by the occupant is appropriate (the immersion degree is the same as the immersion degree discrimination threshold value), the three-dimensional depth of the three-dimensional image is not changed, and an appropriate three-dimensional depth for the occupant is maintained.
[0074] In step S14, the immersion degree discrimination unit 40 determines whether the immersion degree calculated in step S4 exceeds the immersion degree discrimination threshold value set in the selection process (step S30). If it is determined that the immersion degree calculated in step S4 exceeds the immersion degree discrimination threshold value (step S14: Yes), the process proceeds to step S8. On the other hand, if it is determined that the immersion degree calculated in step S4 is less than the immersion degree discrimination threshold value (step S14: No), the process proceeds to step S10.
[0075] In step S8, the immersion degree determination unit 40 determines that the immersion degree of the occupant with respect to the visual recognition target is high. In step S9, the display control unit 50 performs control to reduce the three-dimensional depth of the image being displayed on the image display unit DP (see FIGS. 2 and 3). Thereby, for the three-dimensional image being viewed by the occupant, when the immersion degree of the occupant is high, the three-dimensional depth of the three-dimensional image is reduced to control the three-dimensional depth to an appropriate depth for the occupant. In step S15, the immersion degree determination unit 40 outputs a determination result indicating that the immersion degree exceeds the immersion degree determination threshold to the database 60, and the process returns to step S1.
[0076] In step S10, the immersion degree determination unit 40 determines that the immersion degree of the occupant with respect to the visual recognition target is low. In step S11, the display control unit 50 performs control to increase the three-dimensional depth of the image being displayed on the image display unit DP (see FIGS. 2 and 4). Thereby, for the three-dimensional image being viewed by the occupant, when the immersion degree of the occupant is low, the three-dimensional depth of the three-dimensional image is increased to control the three-dimensional depth to an appropriate depth for the occupant. In step S16, the immersion degree determination unit 40 outputs a determination result indicating that the immersion degree is less than the immersion degree determination threshold to the database 60, and the process returns to step S1.
[0077] As described above, in the display control method using the display control device 1 of the second embodiment, the immersion degree determination threshold corresponding to the content of the three-dimensional image being viewed by the occupant is stored in the database 60. Then, the calculated immersion degree is compared with the immersion degree determination threshold stored in the database 60 to determine the height of the immersion degree. In addition to this, the immersion degree determination threshold stored in the database 60 is corrected for each individual according to the occupant viewing the three-dimensional image. Note that the above-described second embodiment is an example of the present invention, and the present invention is not limited to the above-described second embodiment. Various modifications can be made according to the design and the like without departing from the technical idea of the present invention as long as it is within a range not deviating from the technical idea of the present invention.
[0078] (Effects of the Second Embodiment) In the case of the display control method using the display control device 1 of the second embodiment, the following effects can be achieved. (1) The immersion degree discrimination threshold corresponding to the content of the three-dimensional image being viewed by the occupant is stored in the database 60, and the calculated immersion degree is compared with the immersion degree discrimination threshold stored in the database 60 to determine the height of the immersion degree. Therefore, by comparing the calculated immersion degree with the basic immersion degree discrimination threshold corresponding to the content of the three-dimensional image stored in the database 60 to determine the height of the immersion degree, it becomes possible to determine the immersion degree according to the content of the three-dimensional image.
[0079] As a result, it is possible to suppress variations in the accuracy of the process of calculating the immersion degree and the accuracy of the process of discriminating the immersion degree depending on the content of the three-dimensional image. That is, even when the measured values of the brain activities of the occupants are of the same level for three-dimensional images with different contents, the immersion degree for each occupant may be different. However, even in this case, it is possible to suppress variations in the accuracy of the process depending on the content of the three-dimensional image.
[0080] (2) The immersion degree discrimination threshold stored in the database 60 is corrected for each individual according to the occupant viewing the three-dimensional image. Therefore, by comparing the calculated immersion degree with the individual immersion degree discrimination threshold corrected with respect to the basic immersion degree discrimination threshold stored in the database 60 to determine the height of the immersion degree, it becomes possible to discriminate the immersion degree according to each individual occupant. As a result, it becomes possible to discriminate the immersion degree in consideration of individual differences according to each individual occupant.
[0081] (Other Embodiments) As described above, the embodiments of the present invention have been described. However, the discussions and drawings that form a part of this disclosure should not be understood as limiting the present invention. Various alternative embodiments, examples, and operation techniques will be apparent to those skilled in the art from this disclosure. In addition, the present invention includes configurations in which each configuration described in the above embodiments is arbitrarily applied, and various embodiments not described herein. Therefore, the technical scope of the present invention is defined only by the invention-specific matters according to the legitimate claims based on the above description.
Explanation of Signs
[0082] 1... display control device, 10... brain activity amount detection unit, 10a... brain activity measurement unit, 10b... blink detection unit, 20... visual recognition target grasping unit, 30... immersion degree calculation unit, 40... immersion degree determination unit, 50... display control unit, 60... database, 60a... personal database, 60b... visual recognition target database, SC... visual recognition target detection unit, DP... image display unit, DS... display screen, ER... right eye, EL... left eye, OBW... object recognized by the occupant with both eyes, OBR... object visually recognized by the occupant with the right eye, OBL... object visually recognized by the occupant with the left eye
Claims
1. Calculate the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit, Determine the height of the calculated degree of immersion, Control the three-dimensional depth of the three-dimensional image according to the height of the determined degree of immersion, where the three-dimensional depth is based on the amount of parallax between two images forming the three-dimensional image displayed on the image display unit, For a plurality of the image display units, using the line of sight of the occupant and a plurality of three-dimensional image coordinates which are spatial coordinates set for each of the plurality of image display units, identify one image display unit among the plurality of image display units that the occupant is viewing, A display control method for controlling the three-dimensional depth of the three-dimensional image displayed on the identified one image display unit.
2. The display control method according to claim 1, wherein the three-dimensional depth is controlled such that the higher the determined degree of immersion, the shallower the three-dimensional depth.
3. The display control method according to claim 1, wherein the three-dimensional depth is controlled such that the higher the determined degree of immersion, the deeper the three-dimensional depth.
4. The display control method according to any one of claims 1 to 3, wherein the degree of immersion is calculated by measuring the brain activity of the occupant using any one of the brain waves, brain magnetic field, and brain potential of the occupant.
5. Measure the brain activity of the occupant, The display control method according to any one of claims 1 to 4, wherein the degree of immersion is calculated based on the magnitude of the measured brain activity.
6. Calculate the degree of immersion of the occupant in the three-dimensional image displayed on the image display unit, Determine the height of the calculated degree of immersion, Control the three-dimensional depth of the three-dimensional image according to the height of the determined degree of immersion, where the three-dimensional depth is based on the amount of parallax between two images forming the three-dimensional image displayed on the image display unit, A display control method that stores in a database an immersion degree discrimination threshold corresponding to the content of the three-dimensional image being visually recognized by the occupant, collates the calculated immersion degree with the immersion degree discrimination threshold stored in the database, and discriminates the height of the immersion degree.
7. The display control method according to claim 6, wherein the immersion degree discrimination threshold stored in the database is corrected for each individual according to the occupant visually recognizing the three-dimensional image.
8. For the three-dimensional image being visually recognized by the occupant, when the calculated immersion degree is higher than a preset immersion degree threshold, the three-dimensional depth is controlled so that the three-dimensional depth becomes shallower, and when the calculated immersion degree is lower than the immersion degree threshold, the three-dimensional depth is controlled so that the three-dimensional depth becomes deeper. The display control method according to any one of claims 1, 2, and 4 to 7.
9. An immersion degree calculation unit that calculates the immersion degree of the occupant with respect to the three-dimensional image displayed on the image display unit, An immersion degree discrimination unit that discriminates the height of the immersion degree of the occupant with respect to the three-dimensional image, A display control unit that controls the three-dimensional depth of the three-dimensional image according to the amount of parallax with respect to two images forming the three-dimensional image displayed on the image display unit according to the discriminated height of the immersion degree, For a plurality of the image display units, using the line of sight of the occupant and a plurality of three-dimensional image coordinates that are spatial coordinates set for each of the plurality of image display units, a visual recognition target grasping unit that grasps one image display unit among the plurality of image display units that the occupant is visually recognizing, and The display control unit is a display control device that controls the three-dimensional depth of the three-dimensional image displayed on the grasped one image display unit.
10. An immersion degree calculation unit that calculates the immersion degree of the occupant with respect to the three-dimensional image displayed on the image display unit, and An immersion degree discrimination unit that discriminates the height of the immersion degree of the occupant with respect to the three-dimensional image, and A display control unit that controls the three-dimensional depth of a three-dimensional image according to the amount of parallax with respect to two images forming the three-dimensional image displayed on the image display unit according to the height of the determined immersion level; A database that stores an immersion level discrimination threshold according to the content of the three-dimensional image viewed by the occupant, and The immersion level discrimination unit is a display control device that collates the calculated immersion level with the immersion level discrimination threshold stored in the database to discriminate the height of the immersion level.
Citation Information
Patent Citations
[renzokushikikiyuusokutouketsusouchi[renzokushikikiyuusokutouketsusouchi]
JP1975030142A
Concentration degree evaluating apparatus and display device for vehicle equipped with the same
JP2008079737A
Video display device, video display control method, program for video display device, and computer-readable recording medium
JP2011234238A
Driver state determination device and driver support device
JP2011248535A
Viewing state determination device
JP2018143760A