Information processing apparatus, information processing method, and information processing system

Abstract

Provided is an information processing apparatus that performs a process for preventing or reducing the occurrence of motion sickness by an occupant in a movable object on which a display system is mounted. The information processing apparatus includes: a determination unit that determines motion sickness of an occupant in a movable object; and a processing unit that, on the basis of the determination result of the determination unit, performs a process for determining the transmittance of at least a partial region of a transmittance variable region in a display system mounted on the movable object, and displays the video in the transmittance variable region. The processing unit determines a transmittance of the video to be displayed in the transmittance variable region, and further determines a displacement amount of at least one of a display position or an angle of the video in the transmittance variable region.

Description

Technical Field

[0001] The technology disclosed in this specification (hereinafter, referred to as “the present disclosure”) relates to an information processing device, an information processing method, and a system that perform processing related to control of a display system mounted on a movable object. Background Art

[0002] There is a demand for watching videos on a large display in order to obtain a sense of immersion even in a vehicle. For example, in Level 4 (fully autonomous driving in specific conditions such as cities) and Level 5 (fully autonomous driving) of autonomous driving, the demand for occupants to watch videos increases. However, if the display occupies the field of view, the visual field information in front of the vehicle is lost, so it is difficult for the occupants to recognize the behavior of the car. There is a problem that it becomes difficult to match the body with the vehicle movement, and as a result, motion sickness, including motion sickness caused by the vehicle, etc., is prone to occur.

[0003] For example, a video display device has been proposed that can reduce the burden on passengers and reduce the occurrence of motion sickness by matching visual sensory information with vestibular information and somatosensory information based on vehicle motion while passengers are watching television or the like in a vehicle (see Patent Document 1). The video display device displays a video from a camera in front of the vehicle in a peripheral area outside the display area of ​​the display, and displays content in a central area, thereby reducing motion sickness, but the content display area is not used to identify the front.

[0004] In addition, an image processing device is proposed that predicts the displacement of a movable object after a predetermined time, crops an image obtained by imaging the outside of the movable object based on the predicted displacement, and outputs it as a display image, thereby providing a visually guided sense of self-movement so that it can be seen continuously together with the actual scenery to reduce motion sickness (see Patent Document 2). This image processing device determines the content display position and rotation angle from the prediction of the displacement of the movable object, but the content display area is not used to identify the front.

[0005] In addition, a display device is proposed that prevents or reduces the occurrence of motion sickness and alleviates the symptoms of motion sickness by deforming a predetermined graphic image in a deformation orientation corresponding to a direction opposite to the acceleration direction according to the inertial force and tilting an image display unit or a predetermined graphic image in a direction opposite to the acceleration direction according to the inertial force to display the predetermined graphic image (see Patent Document 3). The display device rotates the content and guides the user's posture, but the display image is not used to recognize the front.

[0006] Reference List

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2008-242251

[0009] Patent Document 2: Japanese Patent Application Publication No. 2012-19452

[0010] Patent Document 3: Japanese Patent Application Publication No. 2019-174523 Summary of the invention

[0011] Technical issues

[0012] An object of the present disclosure is to provide an information processing apparatus, an information processing method, and a system that perform processing for preventing or reducing the occurrence of motion sickness of an occupant in a movable object on which a display system is mounted.

[0013] Solution to the problem

[0014] The present disclosure is made in view of the above-mentioned problems, and a first aspect thereof is an information processing device, the information processing device comprising:

[0015] a determination unit that determines motion sickness of an occupant in the movable object; and

[0016] A processing unit that performs processing for determining the transmittance of at least a partial area of ​​the transmittance variable area in a display system that is mounted on the movable object and displays a video in the transmittance variable area based on the determination result of the determination unit.

[0017] The determination unit determines the motion sickness response level based on a combination of the motion sickness index of the occupant and the predicted displacement of the movable object. Then, the processing unit determines the transmittance of at least a portion of the transmittance variable region based on the motion sickness response level determined by the determination unit. Although the determination unit determines the motion sickness of the occupant based on the biometric information of the occupant, the processing unit may be adapted to determine the motion sickness of the occupant based on an accumulation factor and a recovery factor of the motion sickness.

[0018] While the determination unit determines the transmittance of the video to be displayed in the transmittance variable area, the processing unit may also determine the displacement amount of at least one of the display position or angle of the video in the transmittance variable area.

[0019] The display system includes a transparent screen with variable transmittance and a projector for projecting a video onto the transparent screen. Then, the processing unit determines the transmittance of the entire transparent screen or the transmittance of the video to be projected onto the transparent screen.

[0020] In addition, a second aspect of the present disclosure is an information processing method, the information processing method comprising:

[0021] a determining step of determining motion sickness of an occupant in the movable object; and

[0022] A processing step of performing a process for determining the transmittance of at least a partial area of ​​the variable transmittance area in a display system that is mounted on the movable object and displays a video in the variable transmittance area based on the determination result of the determination step.

[0023] In addition, a third aspect of the present disclosure is a system, comprising:

[0024] a display system mounted on the movable object and displaying a video in a variable transmittance region;

[0025] a determination unit that determines motion sickness of an occupant in the moving object; and

[0026] A processing unit that performs a process for determining the transmittance of at least a partial region of a variable transmittance region in the display system based on a determination result of the determination unit.

[0027] It should be noted that the "system" explained in this article refers to a logical collection of multiple devices (or functional modules that implement specific functions), and whether the corresponding devices or functional modules are located in a single housing is not particularly relevant. That is, a single device consisting of multiple components or functional modules and a collection of multiple devices are equivalent to a "system".

[0028] Advantageous Effects of the Invention

[0029] It should be noted that the effects described herein are merely examples, and the effects provided by the present disclosure are not limited thereto. In addition, in addition to the effects mentioned above, the present disclosure may also produce additional effects.

[0030] Other objects, features, and advantages of the present disclosure will become apparent through more detailed description based on embodiments and accompanying drawings to be described later. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a diagram showing a functional configuration example of the information processing system 100 .

[0032] Figure 2 is a diagram illustrating an example of a determination table.

[0033] Figure 3 1 is a flowchart showing a processing procedure for controlling display of content video according to an occupant's motion sickness index and a predicted displacement of a vehicle.

[0034] Figure 4 is a diagram showing a second configuration example of the information processing system 100 .

[0035] Figure 5 is a diagram showing a third configuration example of the information processing system 100 .

[0036] Figure 6 is a diagram showing a fourth configuration example of the information processing system 100 .

[0037] Figure 7 is a diagram showing a fifth configuration example of the information processing system 100 .

[0038] Figure 8 is a view showing a state in which a content video is displayed by a display system mounted on a vehicle.

[0039] Fig. 9 : is a view showing a state where a content video is displayed by a display system mounted on a vehicle (an example in which the transmittance is adjusted).

[0040] Fig.10 : is a view showing a state where a content video is displayed by a display system mounted on a vehicle (an example in which the transmittance is adjusted).

[0041] Fig.11 is a view showing a variation of the arrangement position of the transmittance variable region in the in-vehicle display system.

[0042] Fig.12 is a view showing the arrangement position of the projector corresponding to the transparent screen for RSE.

[0043] Fig.13 is a view showing an arrangement position of a projector corresponding to a transparent screen arranged on a front window.

[0044] Fig.14 is a view showing the arrangement position of the projector corresponding to the transparent screen arranged on the rear window.

[0045] Fig.15 is a view showing an arrangement position of a projector corresponding to a transparent screen arranged on a side window.

[0046] Fig.16 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent).

[0047] Fig.17 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent and rotating the video).

[0048] Fig.18 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent and moving the video).

[0049] Fig.19 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent and reducing a video size).

[0050] Fig. 20 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent, rotating a video, and moving a video).

[0051] Fig.21 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent, rotating a video, and reducing a video size).

[0052] Fig. 22 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent, moving the video, and reducing the size of the video).

[0053] Fig.23 is a view showing an operation example of a display system for reducing motion sickness (making a video transparent, rotating a video, moving a video, and reducing a video size). DETAILED DESCRIPTION

[0054] Hereinafter, the present disclosure will be described in the following order with reference to the accompanying drawings.

[0055] A. Overview of the display system

[0056] B. Reduce motion sickness

[0057] C. System Configuration Example (1)

[0058] D. System Configuration Example (2)

[0059] E. System Configuration Example (3)

[0060] F. System Configuration Example (4)

[0061] G. System Configuration Example (5)

[0062] A. Overview of the display system

[0063] There is a demand for watching videos on a large display to obtain a sense of immersion in the vehicle. For example, at Level 4 and Level 5 of automated driving, the demand for passengers to watch videos increases. In view of this, in the present disclosure, it is contemplated that a display system for displaying content videos in a variable transmittance region is installed on a vehicle.

[0064] Specifically, the display system that displays the content video in the variable transmittance area is composed of a combination of a transparent screen and a projector that projects the video onto the transparent screen. Here, the transparent screen is configured by laminating a film with an electrically variable transmittance on a transparent film such as a resin, for example. In addition, the display system that displays the content video in the variable transmittance area can be configured by a display device with a transparent flat panel display (FPD) such as a transparent organic light emitting diode (OLED) or a transparent liquid crystal display (LCD). Alternatively, the display system may be of a video see-through type that displays the scenery in front of the vehicle (or around the vehicle) by combining a display device of a non-see-through type rather than a see-through type with an on-board camera.

[0065] The variable transmittance region of the display system may be a transparent screen or a transparent FPD that flips down from the bottom surface of the cabin roof. Figure 8 The transparent screen 801 is flipped down from the bottom surface of the cabin ceiling and a content video 803 is projected from a projector 802 also installed on the bottom surface of the ceiling to the approximate center of the transparent screen 801. For example, the flip-down type transparent screen 801 is installed near the backrest of the first row of seats. Therefore, passengers sitting in the rear seats can watch the content video 803 projected to the transparent screen 801. In short, Figure 8 The display system shown in can be said to be a rear seat entertainment (RSE) system. It should be noted that it is assumed that the rear seats include the second row of seats for a 2-row seat car or the second and third rows of seats for a 3-row seat car.

[0066] A film having electrically variable transmittance is stacked on the transparent screen 801, and by electrically controlling the transmittance of the film, the transmittance of the entire transparent screen 801 or a portion thereof (for example, only a partial area in which the content video 803 is projected) can be adjusted. In addition, by adjusting the contrast of the content video 803 projected by the projector 802, the transmittance of the display area of ​​the content video 803 can be adjusted (increasing the illumination intensity to increase the contrast will reduce the transmittance, and conversely, reducing the illumination intensity to reduce the contrast will increase the transmittance).

[0067] It can be seen that when the transmittance of the entire transparent screen 801 or part thereof is increased, the occupants in the rear seats can easily recognize the situation in front of the vehicle and the behavior of the vehicle through its transparent area. Fig. 9 As shown in , when the transmittance of the entire transparent screen 801 decreases, the immersion of the content video 803 increases. Fig.10 As shown in , when the transmittance of the entire transparent screen 801 is reduced and the display size of the content video 803 is increased, the sense of immersion is further increased.

[0068] The same applies to display systems using transparent FPDs. By increasing the transmittance of the entire transparent FPD including the content video or increasing the transmittance of an area other than the display area of ​​the content video, passengers in the rear seats can easily recognize the situation in front of the vehicle and the behavior of the vehicle through the transparent area. In addition, by reducing the transmittance of the entire transparent FPD or increasing the display size of the content video, the sense of immersion is further increased.

[0069] It should be noted that the above-mentioned display system for RSE is an example, and the arrangement position of the transparent screen or transparent FPD is not limited to Figure 8 The arrangement position shown in . Fig.11 A variation of the arrangement position of a transmittance variable region such as a transparent screen or a transparent FPD in an in-vehicle display system is shown taking a 3-row seat car as an example.

[0070] exist Fig.11 , reference numeral 1101 indicates an arrangement position of a transparent screen or transparent FPD for RSE at the backrest of the first row of seats (or in front of the second row of seats). Reference numeral 1111 indicates an example of an arrangement position where the front window (windshield) is set as a transparent screen or transparent FPD. Reference numeral 1121 indicates an example of an arrangement position where the rear window is set as a transparent screen or transparent FPD. For example, in a case where the seats in the second or third row have been turned backward, it is sufficient to display a content video for an occupant sitting in a rear-facing seat on the rear window. Reference numerals 1131R, 1132R, and 1133R indicate examples of arrangement positions where the right side windows of the first, second, and third rows are respectively set as transparent screens or transparent FPDs. In addition, reference numerals 1131L, 1132L, and 1133L indicate examples of arrangement positions where the left side windows of the first, second, and third rows are respectively set as transparent screens or transparent FPDs.

[0071] It should be noted that in the case where a transparent screen or a transparent FPD is arranged on a vehicle window such as a front window, a rear window, or a side window, it can be used as a display and it can also be used as a transmittance-adjustable smoked glass.

[0072] In the case where a transparent screen is used as a transmittance variable area, it is necessary to install a projector that projects a content video onto the transparent screen together with the transparent screen in the vehicle. In the case of a display system using a combination of a transparent screen and a projector, a projector arrangement position for each arrangement position of a transparent screen in a vehicle will be described.

[0073] Fig.12 The arrangement position of the projector 1201 is illustrated in the case where the transparent screen 1200 for RSE is arranged at the backrest of the first row of seats. Fig.13The arrangement position of the projector 1301 in the case where the transparent screen 1300 is arranged on the front window is illustrated. Fig.14 The arrangement position of the projector 1401 is illustrated in the case where the transparent screen 1400 is arranged on the rear window. For example, in the case where the seats in the second or third row have been turned back, it is sufficient to display content videos for passengers sitting in the rear-facing seats on the rear window. Fig.15 The arrangement position of the projector 1501 in the case where the transparent screen 1500 is arranged on the side window is illustrated.

[0074] exist Fig.12 , Fig.14 and Fig.15 In any of the examples shown in FIG. 1 , projectors 1201, 1401, and 1501 are each arranged on the bottom surface of the top. Fig.13 In the example shown in , the projector 1301 is arranged near the center just below the dashboard or the front windshield. In any arrangement example, by arranging the projector as close as possible to the transparent screen on which the content video is to be projected, the video can be projected without being blocked by an object (e.g., an occupant) and the maximum brightness can be kept high.

[0075] B. Reduce motion sickness

[0076] For example, in Figure 8 In the case where the display system for RSE is installed as shown in , the front view of the occupant sitting in the rear seat is occupied by the display (transparent screen or transparent FPD), and it is difficult to grasp the situation in front of the vehicle. Therefore, there is a problem that it becomes difficult for the occupant to match the body with the movement of the vehicle, and as a result, motion sickness is easily caused.

[0077] In view of this, in the present disclosure, a display system characteristic that displays a content video in a variable transmittance region, in other words, a display system characteristic that is capable of adjusting the transmittance of a video to be displayed, is used to reduce motion sickness by controlling the transmittance of the variable transmittance region according to a response level for alleviating motion sickness while taking into account a motion sickness index and a predicted displacement. Specifically, as the response level for alleviating motion sickness increases, the amount of visual field information in front of the vehicle through the entire display is increased by increasing the transmittance of the transparent screen or transparent FPD. Therefore, the visibility of the content video decreases, but it becomes easy to recognize the situation in front of the vehicle, and, for example, by the occupant matching the body with the movement of the vehicle, it becomes possible to prevent the development of motion sickness, or to alleviate the symptoms. In addition, according to the present disclosure, motion sickness can also be reduced by changing the display position and angle of the content video according to the response level for alleviating motion sickness so that the occupant can easily match the posture with the displacement of the vehicle body.

[0078] A display system for RSE will be taken as an example, in other words, Figure 8 The display operation implemented by the present disclosure is described as an example of a display system in which a display (e.g., a transparent screen or a transparent FPD) is installed in front of a vehicle. It is envisioned that, for example, in a case where there is a sharp curve on the left side in front of the vehicle, the occupant wants to recognize the front, so that the occupant can easily match the displacement of the body with the vehicle body to reduce motion sickness. Figures 16 to 23 Each shows an operation example of a display system for reducing motion sickness in such a situation.

[0079] exist Fig.16 In the example shown in , the content video 803 displayed at the center of the transparent screen is made transparent. Figure 8 and Fig. 9 Compared to the display example shown in , the visibility of content video 803 to passengers sitting in the rear seats is lower, and the passengers can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, thereby reducing motion sickness.

[0080] exist Fig.17 In the example shown in , the content video 803 displayed at the center of the transparent screen is made transparent, and the content video rotates in the counterclockwise direction according to the sharp left turn of the vehicle body. Fig.17 In the display example shown in , the occupant sitting in the rear seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. In addition, the content video 803 is rotated according to the tilt angle of the body posture that follows the displacement of the vehicle body during a sharp left turn, so it is consistent with Fig.16 Compared to the display example shown in , the visibility of the content video 803 is further improved.

[0081] exist Fig.18 In the example shown in FIG. 8 , the content video 803 displayed at the center of the transparent screen is made transparent, and the content video moves according to the sharp left turn of the vehicle body. Fig.18 In the display example shown in , the occupant sitting in the rear seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. Since the display position of the content video 803 is moved to the left from the center of the transparent screen, the front view of the vehicle is further improved, and the occupant can more easily recognize the displacement of the vehicle body. In addition, the content video 803 is moved to the left to adapt to the position of the body leaning to the left, thereby withstanding the centrifugal force applied during a sharp left turn, so as to match Fig.16 Compared to the display example shown in , the visibility of the content video 803 is further improved.

[0082] exist Fig.19In the example shown in , the content video 803 displayed at the center of the transparent screen is made transparent, and the size of the content video is reduced. Fig.19 In the display example shown in , the occupant sitting in the rear seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. As the size of the content video 803 is reduced, the visibility of the content video 803 is further reduced, but the front field of view of the vehicle is further improved, and the occupant can more easily recognize the displacement of the vehicle body.

[0083] exist Figure 8 In the example shown in , the content video 803 displayed at the center of the transparent screen is made transparent, and the content video rotates in the counterclockwise direction and moves to the left according to the sharp left turn of the vehicle body. Figure 8 In the display example shown in , the occupant sitting in the rear seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. Since the display position of the content video 803 is moved to the left from the center of the transparent screen, the front view of the vehicle is further improved, and the occupant can more easily recognize the displacement of the vehicle body. In addition, the content video 803 is rotated according to the tilt angle of the body posture that follows the displacement of the vehicle body during a sharp left turn, so it is consistent with the vehicle body. Fig.16 Compared to the display example shown in , the visibility of the content video 803 is further improved.

[0084] exist Fig.21 In the example shown in , the content video 803 displayed at the center of the transparent screen is made transparent, and rotates in the counterclockwise direction and decreases in size according to the sharp left turn of the vehicle body. Fig.21 In the display example shown in , the occupant sitting in the rear seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. In addition, the content video 803 is rotated according to the tilt angle of the body posture that follows the displacement of the vehicle body during a sharp left turn, so it is consistent with Fig.16 Compared with the display example shown in , the visibility of the content video 803 is further improved. Since the size of the content video 803 is reduced, the visibility of the content video 803 is further reduced, but the front field of view of the vehicle is further improved, and the occupant can more easily recognize the displacement of the vehicle body.

[0085] exist Fig. 22 In the example shown in FIG. 8 , the content video 803 displayed at the center of the transparent screen is made transparent, and the content video moves to the left and decreases in size according to the sharp left turn of the vehicle body. Fig. 22In the display example shown in , an occupant sitting in a rear seat can easily identify the front of the vehicle and match the body's posture with the displacement of the vehicle body, so motion sickness can be reduced. Since the display position of content video 803 is moved to the left from the center of the transparent screen, the field of view in front of the vehicle is further improved, and the occupant can more easily identify the displacement of the vehicle body. As the size of content video 803 is reduced, the visibility of content video 803 is further reduced, but the field of view in front of the vehicle is further improved, and the occupant can more easily identify the displacement of the vehicle body. In addition, the visibility of content video 803 is improved by an amount corresponding to the left movement of content video 803 to accommodate the position of the body leaning to the left, thereby withstanding the centrifugal force applied during a sharp left turn.

[0086] exist Fig.23 In the example shown in , the content video 803 displayed at the center of the transparent screen is made transparent, and the content video rotates in the counterclockwise direction and moves to the left and decreases in size according to the left sharp turn of the vehicle body. Fig.23 In the display example shown in , an occupant sitting in a rear seat can easily recognize the front of the vehicle and match the body's posture with the displacement of the vehicle body, so motion sickness can be reduced. In addition, the visibility of content video 803 is improved by an amount corresponding to the rotation and movement of the body position and posture of content video 803 according to the leaning and moving to the left to follow the displacement of the vehicle body during a sharp left turn. As the size of content video 803 is reduced, the visibility of content video 803 is further reduced, but the vehicle front field is further improved, and the occupant can more easily recognize the displacement of the vehicle body.

[0087] Fig.17 , Fig.18 and Figure 20 to Figure 23 An example is shown in which a transparent content video on a display (e.g., a transparent screen or a transparent FPD) rotates left and moves left when the vehicle makes a sharp left turn. Although the illustration is omitted, the effect of alleviating motion sickness of the occupant can also be obtained in such a manner that the transparent content video on the display rotates right and moves right when the vehicle makes a sharp right turn.

[0088] In addition, the transparent content video can also be moved upward and downward (rather than left and right) when the vehicle passes a steep slope (rather than making a sharp turn) to reduce the motion sickness of the occupants. For example, when the vehicle goes up a steep slope, the content video only needs to move upward according to the upward movement of the occupant's line of sight. On the contrary, when the vehicle goes down a steep slope, the content video only needs to move downward according to the downward movement of the occupant's line of sight.

[0089] C. System Configuration Example (1)

[0090] Figure 1An example of a functional configuration of an information processing system 100 that performs processing for controlling the transmittance of a transparent screen and the display position and angle of a content video is shown. The information processing system 100 shown in the figure includes an occupant biometric information detection unit 101, a motion sickness index calculation unit 102, a speed detection unit 103, an acceleration detection unit 104, a global positioning system (GPS) information detection unit 105, a displacement prediction unit 106, a motion sickness reduction response level determination unit 107, a content video transmittance and displacement amount determination unit 108, a content input unit 109, an image processing unit 110, a projector 111, and a transparent screen 112. It should be noted that although the information processing system 100 may be configured as a physically single device with a single housing in which all of those functional blocks 101 to 112 are stored, each functional block may be configured as a corresponding individual device, or the functional blocks 101 to 112 may be classified into two or more groups and each group may be configured as a device. As an example, the functional blocks 106 to 110 may be configured as a physically single device (in Figure 1 , the functional blocks that can be configured as a single device are surrounded by dotted lines). In addition, as another example, the functional blocks 106 to 112 may be configured as a single device physically, or the projector 111 and the transparent screen 112 in the functional blocks 101 to 112 may be configured as peripheral devices externally connected to the information processing system 100. In addition, in the case where the information processing system 100 is a vehicle control system (or part of the vehicle control system) installed on a vehicle, the occupant biometric information detection unit 101, the speed detection unit 103, the acceleration detection unit 104, and the GPS information detection unit 105 may be vehicle-mounted sensors externally connected to the information processing system 100. Of course, the information processing system 100 may also include functional blocks other than the functional blocks 101 to 112 shown in the figure, and at least some of the functional blocks 101 to 112 may be removed or may be replaced by functional blocks (not shown) depending on the operation of the system, etc.

[0091] The occupant biometric information detection unit 101 detects biometric information such as heart rate and electroencephalogram of the occupant. The occupant biometric information detection unit 101 may set a person who watches a content video (see above) displayed by the display system as a detection target, and exclude an occupant who does not watch the content video from the target. The motion sickness index calculation unit 102 calculates the motion sickness index of the occupant based on the biometric information detected by the occupant biometric information detection unit 101.

[0092] The speed detection unit 103 detects the speed information of the vehicle, and the acceleration detection unit 104 detects the acceleration information of the vehicle. The speed detection unit 103 and the acceleration detection unit 104 are, for example, a speed sensor, an acceleration sensor, an angular velocity sensor (gyro sensor) installed on the vehicle, or an inertial measurement unit (IMU) integrating them. The GPS information detection unit 105 analyzes the GPS signal received from the GPS satellite, measures the current position of the vehicle, and further detects the map information of the planned travel route of the vehicle. The displacement prediction unit 106 calculates the predicted displacement of the vehicle, that is, the displacement amount of the vehicle after a certain time, based on the information detected by the corresponding detection units 103 to 105.

[0093] The motion sickness reduction response level determination unit 107 determines the response level of motion sickness reduction from a determination table determined in advance based on the corresponding information, the motion sickness index calculated by the motion sickness index calculation unit 102 , and the displacement amount predicted by the displacement prediction unit 106 .

[0094] The determination table set forth herein is a table showing the relationship between a combination of a motion sickness index and a predicted displacement amount, and a response level of motion sickness alleviation. Figure 2 An example of a determination table is shown. In this embodiment, the response level of motion sickness reduction is associated with the transmittance of the content video. For example, in the case where the motion sickness index is large and the predicted displacement amount is large, the response level of motion sickness reduction is 90% and the transmittance of the content video is set to 90%.

[0095] The content video transmittance and displacement amount determination unit 108 determines the transmittance τ and displacement amount (x, y, θ) of the content video projected by the projector 111 onto the transparent screen 112 based on the response level determined by the motion sickness reduction response level determination unit 107. In addition, the content video transmittance and displacement amount determination unit 108 may be further adapted to also determine the display size of the content video.

[0096] The video signal of the content projected by the projector 111 onto the transparent screen 112 is input from the content input unit 109 to the image processing unit 110. After the image processing unit 110 translates and rotates the content video according to the displacement amount (x, y, θ) determined by the content video transmittance and displacement amount determination unit 108 (after the size of the display size of the content video is further reduced as the case may be), the image processing unit 110 outputs the video from the projector 111 (i.e., projects the video onto the transparent screen 112).

[0097] The transparent screen 112 is configured by, for example, laminating a film having electrically variable transmittance on a transparent film made of resin, etc. The transparent screen 112 electrically controls the transmittance of the transparent film according to the transmittance τ determined by the content video transmittance and displacement amount determination unit 108.

[0098] The configuration of the projector 111 and the transparent screen 112 (or the arrangement position in the vehicle) in the case where the display system is installed in the vehicle has been described above in item A. In addition, the content video transmittance and displacement amount determination unit 108 determines the transmittance τ and displacement amount (x, y, θ) of the projected video on the transparent screen 112 and the display size according to the response level of motion sickness reduction. Adjusting the transmittance τ of the content video to be projected on the transparent screen 112 and the movement and rotation θ of the display position (x, y) and the display size helps to reduce motion sickness as described above with reference to Figures 16 to 23 As described in item B.

[0099] Figure 3 The processing procedure of the information processing system 100 for controlling the display of content video according to the motion sickness index of the occupant and the predicted displacement of the vehicle is shown as a flowchart.

[0100] First, the occupant biometric information detection unit 101 detects biometric information such as heart rate and electroencephalogram of the occupant (step S301). Then, the motion sickness index calculation unit 102 calculates the motion sickness index of the occupant based on the biometric information detected by the occupant biometric information detection unit 101 (step S302).

[0101] In addition, the speed detection unit 103 detects the speed information of the vehicle, the acceleration detection unit 104 detects the acceleration information of the vehicle, and the GPS information detection unit 105 analyzes the GPS signal received from the GPS satellite, measures the current position of the vehicle, and further detects the map information of the driving plan route of the vehicle (step S303). Then, the displacement prediction unit 106 calculates the predicted displacement of the vehicle, that is, the displacement amount of the vehicle after a certain time, based on the information detected by the corresponding detection units 103 to 105 (step S304). It should be noted that the calculation process of the motion sickness index of the occupant in step S302 and the displacement prediction process of the vehicle in step S304 can be performed in parallel at the same time, rather than in time sequence.

[0102] Subsequently, the motion sickness reduction response level determination unit 107 selects a vehicle displacement amount predicted by the displacement prediction unit 106 from a determination table (see Figure 2 ), determining a response level for alleviating motion sickness (step S305).

[0103] Subsequently, the content video transmittance and displacement amount determination unit 108 determines the transmittance and displacement amount of the content video projected by the projector 111 onto the transparent screen 112 based on the response level determined by the motion sickness reduction response level determination unit 107 (step S306). In step S306, in addition to the transmittance and displacement amount of the content video, the display size of the content video may also be determined.

[0104] Then, the transparent screen 112 changes the screen transmittance according to the transmittance τ determined by the content video transmittance and displacement amount determination unit 108 (step S307). In addition, the image processing unit 110 translates and rotates the content video according to the displacement amount (x, y, θ) and the display size determined by the content video transmittance and displacement amount determination unit 108 (after the display size of the content video is further reduced, as the case may be) (step S308), and projects the content video from the projector 111 onto the transparent screen 112 (step S309).

[0105] Figure 3 The processing procedure shown in may be adapted to be executed once by the information processing system 100 when display of the content video starts, or may be adapted to be repeatedly executed at predetermined time intervals during display of the content video (or while the vehicle is moving).

[0106] The information processing system 100 controls the transmittance of the content video to be projected onto the transparent screen 112 according to the motion sickness index of the occupant and the predicted displacement of the vehicle, so that the entire display can be used to identify the front. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the motion sickness symptoms of the occupant can be alleviated. The information processing system 100 can be adapted to control not only the transmittance of the area of ​​the transparent screen 112 on which the content video is projected, but also the transmittance of the entire transparent screen 112.

[0107] In addition, the information processing system 100 controls the display position and rotation of the content video projected by the projector 111 onto the transparent screen 112 and the display size according to the occupant's motion sickness index and the predicted displacement of the vehicle, so that visual sense information in front of the vehicle can be easily obtained through the content video. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated.

[0108] D. System Configuration Example (2)

[0109] Figure 4 2 shows a second configuration example of the information processing system 100. It should be noted that Figure 4 In, with Figure 1 The same components as those shown in FIG. 1 are denoted by the same names, and the same reference numerals and detailed descriptions thereof are omitted here.

[0110] The projector 111 is configured to project the content video onto Figure 1 On the transparent screen 112 in the information processing system 100 shown in FIG. On the other hand, the information processing system 100 is provided with a Figure 4 The transparent FPD 113 of the display device in FIG. 1 is the main difference.

[0111] After the image processing unit 110 translates and rotates the content video input from the content input unit 109 according to the displacement amount (x, y, θ) determined by the content video transmittance and displacement amount determination unit 108 (depending on the situation, after the display size of the content video is further reduced), the image processing unit 110 outputs it to the transparent FPD 113.

[0112] The transparent FPD 113 changes the transmittance of the entire transparent FPD 113 or the display area portion of the content video according to the transmittance τ determined by the content video transmittance and displacement amount determination unit 108. The transparent FPD 113 is composed of a transparent LCD, a transparent OLED, or another transparent display. The transparent display represented by the transparent LCD or the transparent OLED is well known in the related art, so its detailed description will be omitted in this specification.

[0113] Depend on Figure 4 The processing performed by the information processing system 100 shown in FIG. Figure 3 It should be noted that it is assumed that in step S307, the transparent FPD 113 changes the transmittance of the panel according to the transmittance τ determined by the content video transmittance and displacement amount determination unit 108, and in step S309, the transparent FPD 113 displays the video according to the displacement amount (x, y, θ) and the display size determined by the content video transmittance and displacement amount determination unit 108.

[0114] therefore, Figure 4 The information processing system 100 shown in controls the transmittance of the transparent FPD 113 according to the motion sickness index of the occupant and the predicted displacement of the vehicle, so that the entire display can be used to identify the front. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. In addition, the information processing system 100 controls the position and rotation to display the content video on the transparent FPD 113 according to the motion sickness index of the occupant and the predicted displacement of the vehicle, and also controls the display size. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. Adjusting the transmittance τ of the content video to be displayed on the transparent FPD 113 and the movement and rotation θ of the display position (x, y) as well as the display size helps to alleviate motion sickness as described in the above reference. Figures 16 to 23 As described in item B.

[0115] E. System Configuration Example (3)

[0116] Figure 5 1 shows a third configuration example of the information processing system 100. It should be noted that Figure 5 In, with Figure 1 The same components as those shown in FIG. 1 are denoted by the same names, and the same reference numerals and detailed descriptions thereof are omitted here.

[0117] Figure 5 The information processing system 100 shown in Figure 1 The main difference of the example shown in is that the information processing system 100 further includes a background video capturing unit 114 and is provided with a non-transparent FPD 115 as a display device.

[0118] The background video capturing unit 114 is constituted by, for example, an on-vehicle camera, and captures a video of the surroundings of the vehicle, for example, the scenery in front of the vehicle. The image processing unit 110 arranges the content video input from the content input unit 109 at the center, arranges the captured images received from the background video capturing unit 114 at the periphery, synthesizes them into a single video, and outputs it to the non-transparent FPD 115. Thus, the non-transparent FPD 115 displays an image obtained by superimposing the content video on the video see-through video.

[0119] Here, after the image processing unit 110 translates and rotates the content video input from the content input unit 109 according to the displacement amount (x, y, θ) determined by the content video transmittance and displacement amount determination unit 108 (after the size of the display size of the content video is further reduced as the case may be), the image processing unit 110 synthesizes it onto the background video input from the background video capture unit 114. At this time, the image processing unit 110 adjusts the mixing ratio of the content video and the background video according to the transmittance τ determined by the content video transmittance and displacement amount determination unit 108. Then, the non-transparent FPD 115 displays an image obtained by the image processing unit 110 synthesizing the content video onto the captured image of the background video capture unit 114 at the mixing ratio corresponding to the transmittance τ.

[0120] For example, a mixing ratio of 1:0 is equivalent to a transmittance of 0%, and the visibility of the content video is significantly high, but the field of view information in front of the vehicle is lost by an amount corresponding to the content video that completely covers the background video. In addition, a mixing ratio of 0:1 is equivalent to a transmittance of 100%, and no content video can be visually recognized, but the field of view information in front of the vehicle increases accordingly. In short, as the mixing ratio of the content video increases, the transmittance decreases and the visibility of the content video increases, but it becomes difficult to visually recognize the front of the vehicle. In addition, as the mixing ratio of the content video decreases, the transmittance increases and the visibility of the content video decreases, but it becomes easy to visually recognize the front of the vehicle.

[0121] Depend on Figure 5 The processing performed by the information processing system 100 shown in FIG. Figure 3 . It should be noted that it is assumed that in step S307, the mixing ratio of the content video is determined according to the transmittance τ determined by the content video transmittance and displacement amount determination unit 108. Furthermore, it is assumed that in step S308, the image processing unit 110 synthesizes the content video obtained by translating and rotating the video according to the displacement amount (x, y, θ) and the display size determined by the content video transmittance and displacement amount determination unit 108 (further reducing the size of the display size of the content video as the case may be) onto the background video captured by the background video capture unit 114 at the mixing ratio determined in step S308. Then, it is assumed that in step S309, the non-transparent FPD 115 displays the video perspective video synthesized by the image processing unit 110.

[0122] therefore, Figure 5 The information processing system 100 shown in controls the mixing ratio of the content video and the video perspective video according to the occupant's motion sickness index and the predicted displacement of the vehicle, so that the entire display can be used to identify the front. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. In addition, the information processing system 100 controls the position and rotation according to the occupant's motion sickness index and the predicted displacement of the vehicle as well as the display size to superimpose the content video on the video perspective video. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. Adjusting the transmittance τ of the content video displayed on the transparent FPD 115 and the movement and rotation θ of the display position (x, y) as well as the display size helps to alleviate motion sickness as described in the above reference. Figures 16 to 23 As described in item B.

[0123] F. System Configuration Example (4)

[0124] Figure 6 4 shows a fourth configuration example of the information processing system 100. It should be noted that Figure 6 In, with Figure 1 The same components as those shown in FIG. 1 are denoted by the same names, and the same reference numerals and detailed descriptions thereof are omitted here.

[0125] Figure 6 The information processing system 100 shown in FIG. 1 is provided with a content video transmittance, displacement amount, and contrast determination unit 116 instead of the content video transmittance and displacement amount determination unit 108. The content video transmittance, displacement amount, and contrast determination unit 116 determines the contrast of the content video in addition to determining the transmittance τ and displacement amount (x, y, θ) of the content video projected by the projector 111 onto the transparent screen 112 based on the response level determined by the motion sickness reduction response level determination unit 107.

[0126] After the image processing unit 110 translates and rotates the video according to the displacement amount (x, y, θ) determined by the content video transmittance, displacement amount and contrast determination unit 116 and further adjusts the contrast, the image processing unit 110 outputs the video from the projector 111 (i.e., projects the video onto the transparent screen 112).

[0127] The content video transmittance, displacement amount and contrast determination unit 116 may be adapted to adjust the contrast of the video output from the projector 111 according to the transmittance τ. Then, the image processing unit 110 increases the contrast of the content video when the transmittance τ is low, and reduces the contrast of the content video when the transmittance τ is high. For a projection video with a high contrast, visibility increases while the transmittance decreases. On the other hand, as a projection video with a low contrast, the transmittance increases by an amount corresponding to the decrease in visibility.

[0128] according to Figure 6 In the display system 100 shown in FIG. 1 , the transparent screen 112 electrically controls the transmittance of the transparent film, so that in addition to adjusting the transmittance τ of the content video, the visibility and field of view information of the content video in front of the vehicle can also be adjusted by controlling the contrast of the content video to be projected from the projector 111.

[0129] Depend on Figure 6 The processing performed by the information processing system 100 shown in FIG. Figure 3It should be noted that it is assumed that in step S308, the image processing unit 110 translates and rotates the content video according to the displacement amount (x, y, θ) and the display size determined by the content video transmittance, displacement amount and contrast determination unit 116, and also sets the contrast of the content video determined by the content video transmittance, displacement amount and contrast determination unit 116, and in step S309, the image processing unit 110 projects the content video having the contrast determined by the content video transmittance, displacement amount and contrast determination unit 116 from the projector 111 onto the transparent screen 112.

[0130] therefore, Figure 6 The information processing system 100 shown in the figure controls the transmittance and contrast of the content video according to the motion sickness index of the occupant and the predicted displacement of the vehicle, so that the entire display can be used to identify the front. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. In addition, the information processing system 100 controls the position and rotation to display the content video according to the motion sickness index of the occupant and the predicted displacement of the vehicle. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. Adjusting the transmittance τ of the content video to be displayed on the transparent screen 112 and the movement and rotation θ of the display position (x, y) as well as the display size helps to reduce motion sickness. This point should be seen from the reference Figures 16 to 23 The above description in item B is understood.

[0131] G. System Configuration Example (5)

[0132] Figure 7 1 shows a fifth configuration example of the information processing system 100. It should be noted that Figure 7 In, with Figure 1 The same components as those shown in FIG. 1 are denoted by the same names, and the same reference numerals and detailed descriptions thereof are omitted here.

[0133] Figure 7 The main feature of the information processing system 100 shown in the figure is that the information processing system 100 includes a head movement calculation unit 701, a motion sickness accumulation factor calculation unit 702, a motion sickness recovery factor calculation unit 703 and a motion sickness index calculation unit 704 to replace the occupant biometric information detection unit 101 and the motion sickness index calculation unit 102.

[0134] The head movement calculation unit 701 calculates the head movement of the occupant based on the corresponding data detected by the vehicle-mounted sensor. Basically, the head movement calculation unit 701 calculates the head movement of the occupant through simulation calculation based on the movement of the vehicle. Specifically, the head movement calculation unit 701 calculates the head movement of the occupant based on the vehicle acceleration (a) detected by the acceleration sensor installed on the rigid part of the vehicle.x , a y , a z ) and the occupant's attribute data (sit height (h) and weight (w) of the upper body) detected by the on-board monitoring camera and the body pressure sensor installed on the seat surface, the occupant's head acceleration (A) is calculated through simulation calculation using a simulation model of the human body (upper body) x , A y , A z ). It should be noted that the head movement calculation unit 701 may be adapted to detect actual head movement from captured occupant images, or to estimate head movement based on the vehicle's driving route and movement in camera video in addition to the above-mentioned simulation calculations.

[0135] The motion sickness accumulation factor calculation unit 702 calculates the head acceleration (A) calculated by the head motion calculation unit 701 according to the frequency. x , A y , A z ) performs weighting, detects the travel time of the vehicle, and calculates the occupant's motion sickness accumulation factor by time integration using the expression described in ISO 2631.

[0136] The motion sickness recovery factor calculation unit 703 calculates the motion sickness recovery factor of the occupant based on the detected attribute data (ditto) of the occupant and the detected travel time of the vehicle. In addition, the motion sickness recovery factor calculation unit 703 may also calculate the motion sickness recovery factor of the occupant by considering the position of the occupant in the vehicle and the posture of the occupant in addition to the detected attribute data (ditto) of the occupant and the detected travel time of the vehicle. Even in the same vehicle, the degree of motion sickness recovery changes depending on the seated position of the occupant. For example, in the case of a vehicle with three or more rows of seats installed, the forward field of view and the up, down, left and right movements are inconsistent for each seat position, and the head movement changes according to the seated position of the member. For example, based on an image captured by a vehicle-mounted surveillance camera, the position of the member in the vehicle and the posture of the occupant are acquired.

[0137] The motion sickness index calculation unit 704 combines the motion sickness accumulation factor calculated by the motion sickness accumulation factor calculation unit 702 and the motion sickness recovery factor calculated by the motion sickness recovery factor calculation unit 703 to calculate the motion sickness index of the occupant.

[0138] The motion sickness reduction response level determination unit 107 determines the response level of motion sickness reduction based on the corresponding information of the occupant's motion sickness calculated by the motion sickness index calculation unit 704 in consideration of the accumulation factor of motion sickness and the recovery factor of motion sickness and the displacement amount predicted by the displacement prediction unit 106.

[0139] The content video transmittance and displacement amount determination unit 108 determines the transmittance and displacement amount of the content video projected by the projector 111 onto the transparent screen 112 based on the response level determined by the motion sickness reduction response level determination unit 107 .

[0140] The video signal of the content projected by the projector 111 onto the transparent screen 112 is input from the content input unit 109 to the image processing unit 110. After the image processing unit 110 translates and rotates the video by the displacement amount determined by the content video transmittance and displacement amount determination unit 108, the image processing unit 110 outputs the video from the projector 111. In addition, the transparent screen 112 changes the screen transmittance by the transmittance determined by the content video transmittance and displacement amount determination unit 108.

[0141] Regarding motion sickness, ISO 2631 clearly describes that it can be calculated from the behavior (acceleration) of the occupant's head. The motion sickness dose value (MSDV) according to ISO 2631 is an indicator of motion sickness calculated by the time integration of the head movement, in other words, the accumulation factor for motion sickness.

[0142] Specifically, the motion sickness accumulation factor calculation unit 702 calculates the determination index of motion sickness (motion sickness dose value) by time integration using the following expression (1) described in ISO 2631.

[0143] [Formula 1]

[0144]

[0145] It should be noted that in the above expression (1), a w (t) is the weighted effective acceleration (weighted RMS acceleration) of the vehicle at time t, and is the acceleration obtained by weighting the vehicle acceleration A(t) depending on the frequency. The weighted effective acceleration a(t) can be obtained by converting the acceleration a(t) in the time domain to the frequency domain once, multiplying it by the transfer function H(s) of the filter (it should be noted that s=jω=j2πf) and then converting it back to the time domain. w (t). The correlation factor α between the motion sickness determination index MSDV and the simulator sickness questionnaire (SSQ) as a motion sickness tendency can be determined by experiment. The motion sickness cumulative factor calculation unit 702 calculates the cumulative factor α*MSDV of the occupant's motion sickness by using the correlation factor α.

[0146] However, it has been confirmed through experimental evaluation that even when the time integral value of the head movement is the same, the symptoms of motion sickness differ depending on how the vehicle being ridden is traveling. From this experimental evaluation, it can be considered that when the head movement during the vehicle riding time is less, the occupant tends to recover from motion sickness. In view of this, in Figure 7 In the information processing system 100 shown in FIG. 1 , the motion sickness recovery factor calculation unit 703 also calculates the motion sickness recovery factor R of the occupant based on the attribute data (ditto) of the occupant and the travel time of the vehicle. Then, the motion sickness index calculation unit 704 is configured to synthesize the motion sickness accumulation factor α*MSDV and the motion sickness recovery factor R to more accurately calculate the motion sickness index S (=α*MSDV-R).

[0147] In addition, Figure 7 In the information processing system 100 shown in FIG. 1 , considering that the method of directly detecting the head movement is difficult and the detection accuracy is also poor, the head movement of the occupant is calculated by simulation based on the movement of the vehicle. Using an on-board sensor such as an acceleration sensor, the behavior of the vehicle can be accurately detected. The head movement can be further calculated by simulation prediction based on the occupant's body information such as weight and seat height.

[0148] Depend on Figure 7 The processing performed by the information processing system 100 shown in FIG. Figure 3 It should be noted that it is assumed that in step S301, the head movement operation unit 701 calculates the head acceleration of the occupant by simulation calculation using a simulation model of the human body (upper body) based on the vehicle acceleration and the attribute data of the occupant (sitting height (h) and weight (w) of the upper body), and in step S302, the motion sickness accumulation factor calculation unit 702 performs integral calculation of the accumulation factor of the occupant's motion sickness based on the head movement of the occupant obtained by the simulation calculation, and the motion sickness recovery factor calculation unit 703 calculates the recovery factor of motion sickness, and the motion sickness index calculation unit 704 synthesizes the accumulation factor of motion sickness and the recovery factor to calculate the motion sickness index.

[0149] therefore, Figure 7The processing system 100 shown in the figure controls the display position and rotation and also the display size of the content video projected by the projector 111 onto the transparent screen 112 according to the motion sickness index of the occupant and the predicted displacement of the vehicle, so that the visual sense information in front of the vehicle can be easily obtained through the content video. In this way, the occurrence of motion sickness of the occupant can be prevented or reduced and the symptoms of motion sickness can be alleviated. In addition, the information processing system 100 more correctly calculates the motion sickness index of the member in consideration of the accumulation factor and the recovery factor of motion sickness, so when the occupant does not suffer from motion sickness, the transmittance of the projected video does not actually have to be reduced, and the visibility of the content video can be maintained.

[0150] It should be noted that if Figure 7 The calculation of motion sickness based on the simulated prediction of head movement (accumulation factor of motion sickness) and the calculation of the motion sickness index taking into account the accumulation factor and the recovery factor of motion sickness as shown in can also be applied to using Figure 1 and Figures 4 to 6 Another type of information processing system of a display system is shown in FIG.

[0151] Industrial Applicability

[0152] In the above, the present disclosure has been described in detail with reference to specific embodiments. However, it is obvious that those skilled in the art can modify and replace the embodiments without departing from the gist of the present disclosure.

[0153] Although the present description focuses on an embodiment in which the present disclosure is applied to reduce motion sickness when an occupant is in a vehicle, the subject matter of the present disclosure is not limited thereto. The present disclosure may also be applied to any of various vehicles (movable objects) including ships and airplanes to reduce motion sickness caused by motion when an occupant riding in the vehicle (movable object) watches a content video in the vehicle (movable object).

[0154] In short, the present disclosure has been described by way of example, and the present disclosure should not be construed as limiting the contents of the present disclosure. The scope of the claims should be considered to determine the gist of the present disclosure.

[0155] It should be noted that the present disclosure may also take the following configurations.

[0156] (1) An information processing device comprising:

[0157] a determination unit that determines motion sickness of an occupant in the movable object; and

[0158] A processing unit that performs processing for determining the transmittance of at least a partial area of ​​the transmittance variable area in a display system that is mounted on the movable object and displays a video in the transmittance variable area based on the determination result of the determination unit.

[0159] (2) The information processing apparatus according to (1), wherein the determination unit determines the motion sickness based on at least one of a motion sickness index of the occupant or a predicted displacement of the movable object.

[0160] (3) The information processing apparatus according to any one of (1) or (2), wherein the determination unit determines the motion sickness of the occupant based on biometric information of the occupant.

[0161] (4) The information processing apparatus according to any one of (1) to (3), wherein the determination unit determines the motion sickness of the occupant based on an accumulation factor and a recovery factor of the motion sickness.

[0162] (5) The information processing apparatus according to (4), wherein the determination unit calculates the accumulation factor of the motion sickness based on a time integral of a head movement of the occupant.

[0163] (6) The information processing device according to any one of (4) or (5), wherein the determination unit calculates the accumulation factor of motion sickness based on a time integral of a head movement of the occupant, the head movement of the occupant being predicted by a head movement simulation calculation based on the acceleration of the movable object and the body information of the occupant.

[0164] (7) The information processing apparatus according to any one of (4) to (6), wherein the determination unit calculates the recovery factor of the motion sickness based on a travel time of the movable object and body information of the occupant.

[0165] (8) The information processing apparatus according to any one of (1) to (7), wherein the determination unit predicts the displacement of the movable object based on at least one of velocity information, acceleration information, or position information of the movable object.

[0166] (9) The information processing device according to any one of (1) to (8), wherein:

[0167] The determination unit determines the motion sickness response level based on a combination of the occupant's motion sickness index and the predicted displacement of the movable object, and

[0168] The processing unit determines the transmittance of at least a partial region of the variable transmittance region based on the motion sickness response level determined by the determination unit.

[0169] (10) The information processing apparatus according to any one of (1) to (9), wherein the processing unit determines transmittance of a video to be displayed in the transmittance variable area.

[0170] (11) The information processing apparatus according to any one of (1) to (10), wherein the processing unit further determines a displacement amount of at least one of a display position or an angle of the video in the transmittance variable area.

[0171] (12) The information processing device according to any one of (1) to (11), wherein:

[0172] The display system includes a transparent screen with variable transmittance and a projector for projecting a video onto the transparent screen, and

[0173] The processing unit determines the transmittance of the entire transparent screen or the transmittance of a video to be projected onto the transparent screen.

[0174] (13) The information processing device according to any one of (1) to (11), wherein:

[0175] The display system includes a transparent flat panel display having variable transmittance, and

[0176] The processing unit determines the transmittance of the entire transparent flat panel display or the transmittance of the video display area on the transparent flat panel display.

[0177] (14) The information processing device according to any one of (1) to (11), wherein:

[0178] The display system includes an imaging unit for imaging the periphery of the movable object and a non-transparent flat panel display, and

[0179] The processing unit synthesizes the captured video of the imaging unit and the content video at a mixing ratio based on the determined transmittance, and displays the synthesized captured video and the content video on the non-transparent flat panel display.

[0180] (15) The information processing apparatus according to any one of (1) to (11), wherein the processing unit further determines a contrast of a video to be displayed in the transmittance variable area.

[0181] (16) An information processing method comprising:

[0182] a determining step of determining motion sickness of an occupant of the movable object; and

[0183] A processing step of performing a process for determining the transmittance of at least a partial area of ​​the transmittance variable area in a display system that is mounted on the movable object and displays a video in the transmittance variable area based on the determination result of the determination step.

[0184] (17) A system comprising:

[0185] a display system mounted on the movable object and displaying a video in a variable transmittance region;

[0186] a determination unit that determines motion sickness of an occupant in the moving object; and

[0187] A processing unit that performs a process for determining the transmittance of at least a partial region of a variable transmittance region in the display system based on a determination result of the determination unit.

[0188] Reference Symbols List

[0189] 100 Information Processing Systems

[0190] 101 Occupant biometric information detection unit

[0191] 102 Motion sickness index calculation unit

[0192] 103 Speed ​​detection unit

[0193] 104 Acceleration detection unit

[0194] 105 GPS information detection unit

[0195] 106 Displacement Prediction Unit

[0196] 107 Motion sickness reduction response level determination unit

[0197] 108 Content video transmittance and displacement determination unit

[0198] 109 Content input unit

[0199] 110 Image processing unit

[0200] 111 Projector

[0201] 112 Transparent Screen

[0202] 113 Transparent FPD

[0203] 114 Background video capture unit

[0204] 115 Non-transparent FPD

[0205] 116 Content video transmittance, displacement and contrast determination unit

[0206] 701 Head Movement Computation Unit

[0207] 702 Motion sickness cumulative factor calculation unit

[0208] 703 Motion sickness recovery factor calculation unit

[0209] 704 Motion sickness index calculation unit

Claims

1. An information processing device, comprising: a determination unit that determines motion sickness of an occupant in the movable object; and A processing unit that performs processing for determining the transmittance of at least a partial area of ​​the transmittance variable area in a display system mounted on the movable object and displaying a video in the transmittance variable area based on the determination result of the determination unit.

2. The information processing device according to claim 1, wherein: The determination unit determines the motion sickness based on at least one of a motion sickness index of the occupant or a predicted displacement of the movable object.

3. The information processing device according to claim 1, wherein: The determination unit determines motion sickness of the occupant based on biometric information of the occupant.

4. The information processing device according to claim 1, wherein: The determination unit determines the motion sickness of the occupant based on the accumulation factor and the recovery factor of the motion sickness.

5. The image processing apparatus according to claim 4, wherein: The determination unit calculates the accumulation factor of the motion sickness based on a time integration of the head movement of the occupant.

6. The information processing device according to claim 4, wherein: The determination unit calculates the accumulation factor of the motion sickness based on a time integration of a head motion of the occupant predicted by a head motion simulation calculation based on the acceleration of the movable object and body information of the occupant.

7. The information processing device according to claim 4, wherein: The determination unit calculates a recovery factor of the motion sickness based on a travel time of the movable object and body information of the occupant.

8. The information processing device according to claim 1, wherein: The determination unit predicts a displacement of the movable object based on at least one of velocity information, acceleration information, or position information of the movable object.

9. The information processing device according to claim 1, wherein: The determination unit determines the motion sickness response level based on a combination of the occupant's motion sickness index and the predicted displacement of the movable object, and The processing unit determines the transmittance of at least a partial region of the variable transmittance region based on the motion sickness response level determined by the determination unit.

10. The information processing device according to claim 1, wherein: The processing unit determines the transmittance of a video to be displayed in the transmittance variable area.

11. The information processing device according to claim 1, wherein: The processing unit also determines a displacement amount of at least one of a display position or an angle of the video in the variable transmittance region.

12. The information processing device according to claim 1, wherein: The display system includes a transparent screen with variable transmittance and a projector for projecting a video onto the transparent screen, and The processing unit determines the transmittance of the entire transparent screen or the transmittance of a video to be projected onto the transparent screen.

13. The information processing device according to claim 1, wherein: The display system includes a transparent flat panel display having variable transmittance, and The processing unit determines the transmittance of the entire transparent flat panel display or the transmittance of the video display area on the transparent flat panel display.

14. The information processing device according to claim 1, wherein: The display system includes an imaging unit for imaging the periphery of the movable object and a non-transparent flat panel display, and The processing unit synthesizes the captured video of the imaging unit and the content video at a mixing ratio based on the determined transmittance, and displays the synthesized captured video and the content video on the non-transparent flat panel display.

15. The information processing device according to claim 1, wherein: The processing unit also determines a contrast ratio of a video to be displayed in the variable transmittance region.

16. An information processing method, comprising: a determining step of determining motion sickness of an occupant in the movable object; and A processing step of performing a process for determining the transmittance of at least a partial area of ​​the variable transmittance area in a display system that is mounted on the movable object and displays a video in the variable transmittance area based on the determination result of the determination step.

17. A system comprising: a display system mounted on the movable object and displaying a video in a variable transmittance region; a determination unit that determines motion sickness of an occupant of the moving object; and A processing unit that performs a process for determining the transmittance of at least a partial region of a variable transmittance region in the display system based on the determination result of the determination unit.

Images