Information processing apparatus, information processing method, and system

Abstract

Provided is a device for processing information relating to motion sickness of an occupant in a moving body. The information processing apparatus includes: a motion sickness accumulation calculation unit that calculates an accumulation factor of motion sickness of an occupant in a moving body; a motion sickness recovery calculation unit that calculates a recovery factor of motion sickness of the occupant; and a motion sickness calculation unit that combines the accumulation factor and the recovery factor to calculate a motion sickness index of the occupant. The motion sickness accumulation calculation unit calculates the accumulation factor by using a head movement of the occupant predicted by a head movement simulation calculation based on acceleration of the moving body and body information of the occupant.

Description

Technical Field

[0001] The technology disclosed in this specification (hereinafter referred to as “the present disclosure”) relates to an information processing device, an information processing method, and a system for processing information related to motion sickness of an occupant of a moving object. Background Art

[0002] When in a vehicle such as a car or a ship, passengers may feel nauseous and show symptoms of motion sickness as the ride time passes, but it is difficult to determine whether the passengers are suffering from motion sickness. ISO 2631 clearly stipulates that the motion sickness identification index can be calculated based on the behavior (acceleration) of the passenger's head. However, ISO 2631 only records the calculation method based on time integration, in which motion sickness will occur after a certain period of time regardless of the behavior. In other words, the calculation method recorded in ISO 2631 takes into account even small movements that do not cause motion sickness for identification, which may cause inconvenience.

[0003] For example, a motion sickness estimation device has been proposed. The motion sickness estimation device detects the head behavior of an occupant as an occupant movement, and detects at least one of the sitting posture, restraint state, body pressure distribution, height, weight, or gender of the occupant. Then, when a time longer than a predetermined time has passed, the motion sickness estimation device predicts motion sickness based on driving data of a predetermined time by calculating a motion sickness dose value (MSDV) in accordance with ISO 2631 (see Patent Document 1).

[0004] In addition, a motion sickness prevention method has been proposed. The motion sickness prevention method predicts whether a passenger is likely to suffer from motion sickness when experiencing the motion of a moving body for a long time based on the three-directional acceleration components of the moving body (see Patent Document 2). This method uses a transfer function having a bandpass characteristic that can approximate the relationship between the acceleration of the motion and the degree to which the motion is likely to cause motion sickness in ordinary people to make a prediction, and also uses an integrator to determine the cumulative degree of motion sickness measured within a specific period of time.

[0005] A method for measuring train motion sickness evaluation index based on a combination of left and right acceleration, roll angle, and roll angular velocity measured by onboard sensors has also been proposed (see Patent Document 3). In this method, sampling is performed based on a sampling period of 100 Hz, and the sampled values ​​are integrated for 30 minutes for measurement.

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2007-236644

[0009] Patent Document 2: Japanese Patent Application Publication No. 2005-517568

[0010] Patent Document 3: Japanese Patent Application Publication No. 2004-286502 Summary of the invention

[0011] Technical issues

[0012] The present disclosure aims to provide an information processing device and an information processing method for calculating a motion sickness index of an occupant in a moving object, and a system for controlling the operation of a moving object or the like based on the calculated motion sickness index.

[0013] Solution to the problem

[0014] The present disclosure is made in view of the above problems, and a first aspect thereof is an information processing device, comprising:

[0015] A motion sickness accumulation calculation unit, which calculates a motion sickness accumulation factor of an occupant in the moving body;

[0016] a motion sickness recovery calculation unit, which calculates a motion sickness recovery factor of the occupant; and

[0017] A motion sickness calculation unit combines the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant.

[0018] The motion sickness accumulation calculation unit calculates the accumulation factor by using the head movement of the occupant predicted by head movement simulation calculation based on the acceleration of the moving body and the body information of the occupant. In addition, the motion sickness recovery calculation unit calculates the recovery factor based on the travel time of the moving body and the body information of the occupant.

[0019] The motion sickness recovery factor calculation unit may calculate the recovery factor by taking into account at least one of a difference in the motion of the moving object corresponding to the position of the occupant or a difference in the visual field information corresponding to the posture of the occupant. In addition, the motion sickness recovery factor calculation unit may calculate the recovery factor by further taking into account the moving mode of the moving object.

[0020] The information processing device according to the first aspect may further include a processing unit that performs processing corresponding to the motion sickness index of the occupant in the mobile body. For example, when the motion sickness of the occupant is predicted, the processing unit may perform at least one of the following operations: presentation of information indicating at least one of limiting the driving speed or changing the route of the mobile body in manual driving, driving control associated with limiting at least one of limiting the driving speed or changing the route of the mobile body in automatic driving, or operation control of a display system installed in the mobile body.

[0021] In addition, a second aspect of the present disclosure is an information processing method, comprising:

[0022] A motion sickness accumulation calculation step, calculating a motion sickness accumulation factor of an occupant in the moving body;

[0023] a motion sickness recovery calculation step, calculating a motion sickness recovery factor of the occupant; and

[0024] A motion sickness calculation step is to combine the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant.

[0025] In addition, the third aspect of the present disclosure is a system, comprising:

[0026] A motion sickness accumulation calculation unit, which calculates a motion sickness accumulation factor of an occupant in the moving body;

[0027] a motion sickness recovery calculation unit, for calculating a motion sickness recovery factor of the occupant;

[0028] a motion sickness calculation unit, combining the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant;

[0029] a display system mounted on the mobile body and displaying a video to be viewed by the occupant; and

[0030] The processing unit performs processing corresponding to the motion sickness index of the occupant on the display system.

[0031] It should be noted that the "system" mentioned here refers to a logical collection of multiple devices (or functional modules that implement specific functions), and it is not particularly important whether each device or functional module is in a single frame. In other words, a single device composed of multiple components or functional modules and a collection of multiple devices are equivalent to a "system".

[0032] Effects of the Invention

[0033] According to the present disclosure, it is possible to provide an information processing device and an information processing method for calculating a motion sickness index of an occupant in a moving object in consideration of a recovery factor from motion sickness, and a system for controlling the operation of a moving object or the like based on the calculated motion sickness index.

[0034] It should be noted that the effects described herein are merely illustrative, and the effects provided by the present disclosure are not limited thereto. In addition, in addition to the above-mentioned effects, the present disclosure may also produce additional effects.

[0035] Other objects, features, and advantages of the present disclosure will become apparent from more detailed description based on the embodiments described below and the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1is a diagram showing a functional configuration of an information processing system 100 that estimates motion sickness of an occupant in a vehicle.

[0037] Figure 2 1 is a flow chart showing the overall operation process performed on the information processing system 100 .

[0038] Figure 3 is a diagram showing an internal configuration example of the head movement calculation unit 101 .

[0039] Figure 4 To show Figure 3 Flowchart of a processing procedure for calculating the head movement of the occupant in the head movement calculation unit 101 shown.

[0040] Figure 5 is a diagram showing an internal configuration example of the motion sickness accumulation factor calculation unit 102.

[0041] Figure 6 To show Figure 5 Flowchart of a process for calculating the accumulation factor of motion sickness of the occupant in the motion sickness accumulation factor calculation unit 102 shown in FIG.

[0042] Figure 7 is a diagram showing an internal configuration example of the motion sickness recovery factor calculation unit 103 .

[0043] Figure 8 To show Figure 7 1 is a flowchart of a processing procedure for calculating a motion sickness recovery factor of an occupant in the motion sickness recovery factor calculation unit 103.

[0044] Fig. 9 FIG. 1 is a diagram that extracts and shows the motion sickness calculation unit 104 and its input / output parts.

[0045] Fig.10 To show Fig. 9 Flowchart of a process for calculating the motion sickness of an occupant in the motion sickness calculation unit 104 shown.

[0046] Fig.11 11 is a diagram showing a functional configuration of an information processing system 1100 that estimates motion sickness of an occupant in a vehicle.

[0047] Fig.12 11 is a flow chart showing the operation process performed in the information processing system 1100.

[0048] Fig.13 To illustrate the transformation of vehicle acceleration a(t) into weighted effective acceleration a w Plot of the filter transfer function H(s) for (t).

[0049] Fig.14 Graphs showing experimental results of MSDV and SSQ according to the traveling patterns of vehicles.

[0050] Fig.15 Graph showing the predictions of MSDV and SSQ according to the vehicle's travel pattern superimposed on the experimental results.

[0051] Fig.16 Schematically showing the correlation between MSDV and SSQ in each case of acceleration / deceleration driving and normal driving.

[0052] Fig.17 This is a diagram showing the distribution of MSDV and SSQ during driving to avoid motion sickness.

[0053] Fig.18 Graphs showing examples of experimental results of MSDV and SSQ total scores when vehicles perform the same travel.

[0054] Fig.19 It is a view showing a top view of the vehicle compartment of a 3-row seat vehicle.

[0055] Fig. 20 It is a view showing a state in which a content video is displayed by a display system installed in a vehicle.

[0056] Fig.21 It is a view showing a state where a content video is displayed by a display system installed in a vehicle (an example where the transmittance is adjusted).

[0057] Fig. 22 It is a view showing a state where a content video is displayed by a display system installed in a vehicle (an example where the transmittance is adjusted).

[0058] Fig.23 A diagram showing a modified example of the arrangement position of the transmittance variable region in the vehicle-mounted display system.

[0059] Fig.24 It is a view showing the arrangement position of the projector corresponding to the transparent screen for RSE.

[0060] Fig.25 It is a view showing the arrangement position of the projector corresponding to the transparent screen arranged on the front window.

[0061] Fig.26 It is a view showing the arrangement position of the projector corresponding to the transparent screen arranged on the rear window.

[0062] Fig. 27 It is a view showing the arrangement position of the projector corresponding to the transparent screen arranged on the side window.

[0063] Fig.28A diagram showing an operation example of a display system for reducing motion sickness (making a video transparent).

[0064] Fig.29 A diagram showing an operation example of a display system for reducing motion sickness (making a video transparent and rotating the video).

[0065] Fig.30 A view showing an operation example of a display system for reducing motion sickness (making a video transparent and moving the video).

[0066] Fig.31 A diagram showing an operation example of a display system for reducing motion sickness (making a video transparent and reducing the size of the video).

[0067] Fig.32 A view showing an operation example of a display system for reducing motion sickness (making a video transparent, rotating a video, and moving a video).

[0068] Fig.33 A view showing an operation example of a display system for reducing motion sickness (making a video transparent, rotating a video, and reducing the size of a video).

[0069] Fig.34 A view showing an operation example of a display system for reducing motion sickness (making a video transparent, moving a video, and reducing a video size).

[0070] Fig.35 A view showing an operation example of a display system for reducing motion sickness (making a video transparent, rotating a video, moving a video, and reducing the size of a video).

[0071] Reference numerals

[0072] 100: information processing system; 101: head movement calculation unit; 102: motion sickness accumulation factor calculation unit; 103: motion sickness recovery factor calculation unit; 104: motion sickness calculation unit; 105: response processing unit; 301: filtering processing unit; 302: first human body transfer function calculation unit; 501: transfer function calculation unit; 502: integration calculation unit; 701: occupant attribute calculation unit; 702: second human body transfer function calculation unit; 1100: information processing system; 1101: head movement calculation unit; 1102: motion sickness accumulation factor calculation unit; 1103: motion sickness recovery factor calculation unit; 1104: motion sickness calculation unit; 1105: response processing unit DETAILED DESCRIPTION

[0073] The present disclosure will be described below in the following order with reference to the accompanying drawings.

[0074] A. Summary

[0075] B. Calculation method of motion sickness index

[0076] C. Motion sickness recovery factor

[0077] C-1. When switching from urban driving to highway driving

[0078] C-2. Case of automatic driving of vehicles at ultra-low speeds

[0079] C-3. Changes in motion sickness recovery due to the orientation of the front passenger seat and the 2nd and 3rd row seats

[0080] C-4. Changes in motion sickness recovery caused by content display control

[0081] D. System Configuration and Operation

[0082] D-1. Simulation calculation of occupant's head movement

[0083] D-2. Calculation of the cumulative factor for motion sickness

[0084] D-3. Calculation of motion sickness recovery factor

[0085] D-4. Calculation of motion sickness

[0086] D.5. Changes in motion sickness recovery caused by the orientation of the front passenger seat and the 2nd and 3rd row seats

[0087] E. Display system and its control

[0088] E-1. Display system configuration

[0089] E-2. Relief of motion sickness

[0090] F. Summary

[0091] A. Summary

[0092] When in a vehicle such as a car, motion sickness symptoms may occur due to the influence of the vehicle's behavior. When motion sickness occurs, it is difficult for the occupant to continue riding the vehicle and the occupant is deeply disturbed. The present disclosure relates to prediction of motion sickness so as to predict the occupant's motion sickness level before the onset of motion sickness and relate it to response processing such as vehicle motion control (e.g., driving instructions) and notification to the occupant or driver.

[0093] As described in the background technology section, regarding motion sickness, a method of calculating a motion sickness index by integrating the head movement of the occupant over time has been used (see, for example, Patent Documents 1 and 3). However, it has been confirmed through actual experimental evaluation that even if the time integral value of the head movement is the same, the symptoms of motion sickness will vary depending on the mode of travel of the vehicle being ridden (i.e., sometimes motion sickness symptoms will occur, and sometimes motion sickness symptoms will not occur). Based on this experimental evaluation, it can be considered that when there is little head movement during the ride on the vehicle, the passenger tends to recover from motion sickness. The experimental formula can also generally explain the tendency to recover from motion sickness. Therefore, in the present disclosure, a technology for calculating a motion sickness index by taking into account the recovery factor of motion sickness is proposed.

[0094] In addition, when predicting motion sickness based on the head movement of the occupant, it is difficult to directly detect the movement of the head, and the detection accuracy is also poor. Therefore, in view of the difficulty of directly detecting the head movement, the present disclosure also proposes a technology for calculating the head movement of the occupant through simulation based on the vehicle movement. For example, the vehicle behavior can be accurately and easily detected based on the vehicle-mounted sensor such as the acceleration sensor, and the head movement can be calculated through simulation prediction based on the body information such as the weight and seat height of the occupant.

[0095] B. Calculation method of motion sickness index

[0096] As a motion sickness determination index, a calculation method of MSDV is described in ISO 2631. According to this description, the motion sickness determination index MSDV is calculated using the following expression (1).

[0097] [Formula 1]

[0098] …… (1)

[0099] In the above expression (1), a w (t) is the weighted effective acceleration (weighted root mean square acceleration) of the vehicle at time t. w (t) is the acceleration obtained by weighting the vehicle acceleration a(t) in accordance with the frequency. Weighted effective acceleration a w (t) can be obtained by temporarily transforming the acceleration a(t) in the time domain to the frequency domain, multiplying it by the filter transfer function H(s) (note that s = jω = j2πf), and then transforming it back to the time domain (see Fig.13 ). It should be noted that the transfer function H(s) of the filter depends on the motion (e.g. vehicle type). Therefore, in ISO 2631, the coefficient f is changed for each case. i (=ω i ) and Q i to change the filter characteristics.

[0100] In addition, as described above in Item A, in the present disclosure, in view of the difficulty in accurately detecting the head movement of the occupant, the head movement of the occupant is calculated by simulation calculation based on the movement of the vehicle. Specifically, a configuration is adopted in which sensors such as acceleration sensors are installed on the rigid body part of the vehicle body of a vehicle, etc. In addition, in order to detect the attribute data of the occupant (such as body information such as sitting height (h) and upper body weight (w)), a camera (on-board monitoring camera, etc.) and a body pressure sensor are installed on the vehicle. Then, the head acceleration of the occupant calculated by simulation calculation is weighted according to the frequency. The travel time of the vehicle is detected, and the above expression (1) recorded in ISO 2631 is used to integrate the motion sickness of the occupant (more strictly speaking, the cumulative factor of motion sickness).

[0101] It should be noted that, in addition to such simulation calculation, the head movement of the occupant can also be obtained by any of the following methods (1) and (2).

[0102] (1) Using occupant videos obtained by filming the occupants to detect actual head movements.

[0103] (2) Estimate head motion based on the vehicle’s route and the actual motion detected in the camera video.

[0104] In addition, during the travel of the vehicle, the motion sickness of the occupant will also recover over time. Based on the experimental results, the recovery of motion sickness is approximated as a linear function. In view of this, in the present disclosure, motion sickness is predicted based on the experimental results by considering both the accumulation factor and the recovery factor of motion sickness.

[0105] The MSDV described in ISO is a motion sickness index calculated by integrating the time of head movement, and can be said to be a cumulative factor of motion sickness. On the other hand, the Simulator Sickness Questionnaire (SSQ) is known as a subjective evaluation value of motion sickness tendency. SSQ is widely used as a questionnaire to determine the degree of motion sickness. Specifically, by weighting the scores of 16 questions answered on a 4-point scale of 0 to 3, four items, namely nausea, oculomotor, disorientation, and total score, are calculated and evaluated. ISO 2631 clearly states that there is a certain correlation between MSDV and the motion sickness tendency SSQ obtained through subjective evaluation. That is, assuming that the horizontal axis is MSDV and the vertical axis is SSQ, a fixed relationship holds, in which the higher the MSDV, the higher the SSQ, and the more susceptible people are to motion sickness.

[0106] Fig.14The experimental results of MSDV and SSQ are shown for the case where the vehicle is moving normally (smooth driving) and the case where the vehicle is moving with acceleration and deceleration (aggressive driving), that is, when the vehicle is moving in different ways. Even when the vehicle is moving normally (smooth driving), MSDV increases over time because it is obtained by integrating the head movement over time. In contrast, SSQ does not increase because motion sickness recovers over time during normal driving. Fig.14 The figure shows that when the vehicle is driving normally for 30 minutes, only the MSDV increases, but the SSQ does not change significantly. On the other hand, when the vehicle is accelerating or decelerating (aggressive driving), the MSDV calculated by the time integration of the head movement increases, and the SSQ also increases over time because the motion sickness does not recover. Fig.14 It shows that during acceleration and deceleration, MSDV and SSQ both increase after 5 minutes, and MSDV and SSQ further increase after 7 minutes. Fig.15 The predicted MSDV and SSQ according to the vehicle's travel pattern are shown in a superimposed manner. The predicted results are also as measured. During normal driving, the MSDV calculated by time integration increases, while the SSQ does not increase due to motion sickness recovery. On the other hand, during acceleration and deceleration driving, both the MSDV and SSQ increase over time.

[0107] Fig.16 Schematically showing the Fig.14 and Fig.15 The relationship between MSDV and SSQ in each case during acceleration / deceleration driving or normal driving is derived. During acceleration / deceleration driving (aggressive driving), motion sickness does not recover (or is not noticeable), so the relationship SSQ = α·MSDV holds (it should be noted that α represents the correlation coefficient between MSDV and SSQ). In addition, during normal driving (smooth driving), motion sickness recovers as time t passes (R·t), so the relationship SSQ = α·MSDV-R·t holds. Then, depending on the vehicle's travel mode, the relationship between MSDV and SSQ holds between SSQ = α·MSDV and SSQ = α·MSDV-R·t.

[0108] like Fig.17 As shown, considering that motion sickness will not occur as long as SSQ is not greater than a certain threshold (limit) 1701, the prediction of motion sickness can be dealt with. When driving to avoid motion sickness, MSDV and SSQ are roughly distributed in the range shown by reference numeral 1702. MSDV can be calculated based on the driving of the vehicle. Therefore, based on the MSDV calculated based on the data measured by the vehicle-mounted acceleration sensor, motion sickness can be predicted based on whether SSQ exceeds the threshold 1701.

[0109] In addition, when the relationship between the Motion Sickness Susceptibility Questionnaire (MSSQ) and SSQ was examined for each time period, a correlation between sensitivity and SSQ was confirmed for more than 10 minutes, but no correlation was confirmed for less than 10 minutes. Therefore, it can be said that in order to improve the accuracy of motion sickness prediction, measurement for more than 10 minutes is necessary or highly desirable.

[0110] Then, by simulating the occupant's head movement and calculating the MSDV, predicting the occupant's motion sickness while taking into account the restoration factor can assist in response processing such as controlling vehicle movement (e.g., driving instructions) and notifying the occupant or driver.

[0111] Methods for instructing a vehicle based on predicted motion sickness may include the following three examples.

[0112] (1) Manual driving

[0113] When SSQ approaches a threshold, the driver is informed that the occupant is likely to suffer from motion sickness. For example, guidance may be voice guidance such as "reduce speed change" or "reduce sudden steering" to reduce SSQ, or guidance may be notified by lighting up a display screen on the instrument panel. In addition, voice guidance or route changes associated with route information of a navigation system may be performed. In addition, the driver may be notified in an area that is easily viewed through a display UI such as a head-up display.

[0114] (2) Autonomous driving

[0115] When SSQ approaches a threshold, the car can reduce SSQ by linking autonomous driving with the prediction of motion sickness by limiting the travel speed or acceleration. It can also reduce SSQ by changing the route according to the situation (changing to a flat route with fewer curves). It can also predict motion sickness based on congestion conditions and feed it back into the current driving.

[0116] (3) Occupant’s field of vision control

[0117] If the occupants can easily see the outside world through the car windows, etc., the occupants can easily recognize the behavior of the car. In view of this, when the SSQ approaches the threshold, the field of view control of the occupants can be turned on. For example, a display system is installed, which displays a content video on a screen with adjustable transmittance in the car, and when the SSQ approaches the threshold while the occupants are watching the video, the transmittance of the screen is increased, or the size of the display of the content video is reduced, or the display of the content video is moved to the periphery of the screen, or the contrast is reduced to increase the transparency. Such field of view control reduces the visibility of the content, but the occupants can easily look around the outside of the car and can easily recognize the behavior of the car, thereby reducing the SSQ. It should be noted that the display system with a screen with adjustable transmittance can be, for example, a combination of a projector and a transparent screen, or a display device with a transparent flat panel display (FPD) such as a transparent organic light emitting diode (OLED) or a transparent liquid crystal display (LCD). The screen of the display system can be arranged on the front, rear, left, and right windows and walls of the car, or it can be a projection screen or display monitor pulled down from the ceiling of the car.

[0118] C. Motion sickness recovery factor

[0119] As described above, in the present disclosure, motion sickness is predicted in consideration of both the accumulation factor and the recovery factor of motion sickness. In this item C, a use case and a modification example will be described in which the recovery factor of motion sickness is considered important.

[0120] C-1. When switching from urban driving to highway driving

[0121] When driving in the city, the car often stops and starts at traffic lights, turns left and right at intersections, and often accelerates and decelerates and moves left and right. Then, when driving on the highway, the car switches to driving at a roughly constant speed and turns less often. When driving in the city, the head moves frequently, so motion sickness accumulates. On the other hand, when driving on the highway, the speed or route changes are small, so the head movement is less, so the occupants' motion sickness is reduced. In addition, when switching to automatic driving on the highway, the occupants can relax, so motion sickness is reduced.

[0122] In the existing method of calculating the motion sickness index by integrating the time of the head movement of the occupant, only the accumulation factor of motion sickness is considered, so even if the occupant is relaxed on the highway, it is predicted that the occupant suffers from motion sickness. As a result, the speed, acceleration, steering, etc. of the vehicle may be unnecessarily restricted, and an unnecessary route change may be made. In this regard, in the present disclosure, motion sickness is predicted by considering both the accumulation factor and the recovery factor of motion sickness, so that motion sickness can be predicted more accurately considering that the occupant may relax on the highway.

[0123] For example, by analyzing the GPS signals received from GPS satellites, measuring the current position of the vehicle, and then detecting the map information of the vehicle's planned route, it is possible to determine whether the vehicle is traveling in an urban area or on a highway. In addition, by performing image recognition or image analysis based on images taken by the vehicle's onboard camera, it is also possible to determine whether the vehicle is traveling in an urban area or on a highway.

[0124] C-2. Case of automatic driving of vehicles at ultra-low speeds

[0125] For example, in the case of an automatic driving vehicle at an ultra-low speed like a single-passenger compact vehicle, the vehicle is basically driven smoothly, so motion sickness is unlikely to occur. However, if the motion sickness index is calculated by integrating the head movement over time as in the existing method, motion sickness is always predicted after a certain time. In this regard, in the present disclosure, since motion sickness is predicted in consideration of the recovery factor, motion sickness can be predicted more accurately in consideration of the fact that the occupant may relax due to the smooth driving.

[0126] C-3. Changes in motion sickness recovery due to the orientation of the front passenger seat and the 2nd and 3rd row seats

[0127] Fig.19 The top view of the cabin of a three-row car is shown. Fig.19 In (A), all 3 rows of seats face forward. On the other hand, Fig.19 In (B), the 2nd row seats are turned to face the 3rd row seats. Fig.19 It can also be seen that the field of view in front of the vehicle varies depending on which row of seats the occupant is sitting in, that is, for each seat position. In addition, the up-down and left-right movement of the seat surface is not uniform during driving, and the head movement varies depending on the seat position of the occupant. Therefore, it can be said that even in the same vehicle, the degree of recovery from motion sickness varies depending on the seat position of the occupant.

[0128] For example, in the front passenger seat, the front view is wide, so the car's behavior can be easily recognized. Therefore, the motion sickness recovery effect is good. On the other hand, the rear seats have less visual field information, so it is not easy to recognize the car's behavior. Therefore, the motion sickness recovery effect is correspondingly poor. In addition, when the seat is turned to face backward, the visual field information in front of the vehicle is lost, so it is difficult to recognize the car's behavior. Therefore, the motion sickness recovery effect is correspondingly reduced.

[0129] In view of this, in the present disclosure, the position of the passenger is detected by using an onboard camera, a body pressure sensor, etc. to understand which row of seats the passenger is sitting in. Then, considering that the recovery effect of motion sickness is worse in the second and third rows of rear seats than in the first row, a weighted calculation of the recovery factor is performed according to the riding position, and the predicted motion sickness in the riding position is calculated. Fig.19As shown in (B), when passengers sit facing backwards in a face-to-face seat, they lose the visual field information in front of the vehicle and have difficulty recognizing the vehicle's behavior, making it difficult to recover from motion sickness. In view of this, in addition to the riding position, the passenger posture such as the seat orientation is also considered to calculate the recovery factor weightedly, so that motion sickness prediction is calculated more accurately.

[0130] C-4. Changes in motion sickness recovery caused by content display control

[0131] When a display system that displays a content video on a screen with adjustable transmittance is installed in a vehicle cabin and an occupant watches the video, the visual field information that can be obtained through the screen changes depending on the screen transmittance, the display size and display position of the content video, so the degree of motion sickness recovery changes. For example, when the screen transmittance is high, the size of the content video is small, or the content video is displayed at a position other than the center of the screen, the occupant has a wide field of view and can easily recognize the behavior of the car, so the motion sickness recovery effect is good.

[0132] In view of this, in the present disclosure, when the screen transmittance, display size and display position of the content video are obtained by querying the display system, the occupant's field of view information is grasped and the recovery factor is weighted based on the ease of identifying the car's behavior, and the predicted motion sickness corresponding to the display condition of the content video is calculated.

[0133] D. System Configuration and Operation

[0134] In this item D, a system configuration and operation in the case where the present disclosure is applied to a vehicle are explained.

[0135] Figure 1 The functional configuration of an information processing system 100 for estimating motion sickness of an occupant in a vehicle is schematically shown. The illustrated information processing system 100 includes a head motion calculation unit 101, a motion sickness accumulation factor calculation unit 102, a motion sickness recovery factor calculation unit 103, a motion sickness calculation unit 104, and a response processing unit 105. The information processing system 100 may be configured as a single device having a physically single frame storing all of these functional blocks 101 to 105. However, the head motion calculation unit 101, the motion sickness accumulation factor calculation unit 102, the motion sickness recovery factor calculation unit 103, the motion sickness calculation unit 104, and the response processing unit 105 may be configured as respective independent devices (in Figure 1, dotted lines surround functional blocks that can be configured as independent devices.) In addition, functional blocks 101 to 105 may be divided into two or more groups and each group may be configured as one device. Specifically, they may be configured as a single device that stores the head motion calculation unit 101, the motion sickness accumulation factor calculation unit 102, the motion sickness recovery factor calculation unit 103, and the motion sickness calculation unit 104 in a physically single frame. Alternatively, when the head motion calculation unit 101 and the response processing unit 105 are installed in a vehicle, the motion sickness accumulation factor calculation unit 102, the motion sickness recovery factor calculation unit 103, and the motion sickness calculation unit 104 may be configured as external devices of the vehicle.

[0136] Such an information processing system 100 can be constituted by, for example, a personal computer (PC). In addition, each component 101 to 104 of the information processing system 100 may be a dedicated hardware circuit, or may be implemented in the form of executing a predetermined software program on a PC. In addition, each component 101 to 104 may be installed on one PC, or may be distributed on two or more PCs.

[0137] The head movement calculation unit 101 calculates the head movement of the occupant based on the data detected by the vehicle-mounted sensors. Basically, the head movement calculation unit 101 calculates the head movement of the occupant through simulation calculation based on the movement of the vehicle. Specifically, the head movement calculation unit 101 calculates the head movement of the occupant based on the vehicle acceleration (a) detected by the acceleration sensor installed on the rigid body part of the vehicle. x , a y , a z ) and the occupant's attribute data (such as seat height (h) and upper body weight (w)) detected by the vehicle monitoring camera and the body pressure sensor installed on the seat surface, and the occupant's head acceleration (A) is calculated through simulation calculation. x , A y , A z ). It should be noted that, in addition to the above-mentioned simulation calculation, the head movement calculation unit 101 may also be adapted to detect actual head movement from the captured image of the occupant and estimate the head movement from the vehicle's travel route and the movement in the camera video.

[0138] The motion sickness accumulation factor calculation unit 102 calculates the head acceleration (A) calculated by the head motion calculation unit 101 according to the frequency. x , A y , A z ) is weighted, the travel time of the vehicle is detected, and the cumulative factor of the occupant's motion sickness is calculated by integrating the time integral of the above expression (1) described in ISO 2631.

[0139] The motion sickness recovery factor calculation unit 103 calculates the motion sickness recovery factor of the occupant based on the detected attribute data of the occupant (same as above) and the detected travel time of the vehicle.

[0140] The motion sickness calculation unit 104 combines the accumulation factor of motion sickness calculated by the motion sickness accumulation factor calculation unit 102 and the recovery factor of motion sickness calculated by the motion sickness recovery factor calculation unit 103 to calculate the motion sickness of the occupant.

[0141] The response processing unit 105 performs processing for recovering the occupant from motion sickness based on the result of the occupant's motion sickness calculated by the motion sickness calculation unit 104. Specifically, the response processing unit 105 performs response processing such as notification to the occupant or the driver in manual driving (e.g., instructing a driving operation or route change for reducing the occupant's SSQ), driving control in automatic driving (e.g., driving control or route change for limiting acceleration or deceleration or route change to reduce the occupant's SSQ), and occupant's field of view control (display control of content video in a display system installed in the vehicle).

[0142] It should be noted that the details of each component 101 to 104 will be described later.

[0143] Figure 2 The overall operation process performed on the information processing system 100 is shown as a flowchart.

[0144] When a person appears in the vehicle, i.e., an occupant is detected (step S201), the occupant's attribute data is first obtained (step S202). Specifically, by using vehicle-mounted sensors such as vehicle-mounted monitoring cameras and body pressure sensors installed on the seat surface, the occupant's body information such as seat height (h) and upper body weight (w) is obtained.

[0145] Then, when it is detected that the vehicle starts to move (step S203), the acceleration of the vehicle (a) is detected by using an acceleration sensor installed on the rigid body of the vehicle. x , a y , a z ) (Step S204).

[0146] Next, the head movement calculation unit 101 calculates the head acceleration (A) of the occupant through simulation calculation based on the vehicle acceleration information acquired in step S203 and the body information of the occupant such as the seat height (h) and upper body weight (w) acquired in step S202. x ,Ay,A z ) (step S205).

[0147] Next, the motion sickness accumulation factor calculation unit 102 calculates the head acceleration (A) calculated by the head motion calculation unit 101 according to the frequency.x , A y , A z ) is weighted, the travel time of the vehicle is detected, and the accumulation factor M of the occupant's motion sickness is integrally calculated by time integration using the above expression (1) described in ISO 2631 (step S206).

[0148] In addition, the motion sickness recovery factor calculation unit 103 reads the occupant's attribute data including body information such as the occupant's sitting height (h) and upper body weight (w) acquired in step S202 (step S207), and calculates the occupant's motion sickness recovery factor R based on the elapsed time (step S208).

[0149] Then, the motion sickness calculation unit 104 combines the motion sickness accumulation factor αM calculated by the motion sickness accumulation factor calculation unit 102 and the motion sickness recovery factor R calculated by the motion sickness recovery factor calculation unit 103 to calculate the motion sickness S (=αM−R) of the occupant (step S209 ).

[0150] The response processing unit 105 performs processing for recovering the occupant from motion sickness according to the result of the occupant's motion sickness calculated by the motion sickness calculation unit 104 (step S210). For example, the response processing unit 105 performs response processing such as notification to the occupant or driver in manual driving, driving control in automatic driving, and control of the occupant's field of view.

[0151] D-1. Simulation calculation of occupant's head movement

[0152] In this item D-1, details of simulation calculation of head movement performed by the head movement calculation unit 101 are described. The head movement calculation unit 101 is a functional block that predicts the head movement of the occupant by simulation calculation based on the detected data.

[0153] Figure 3 FIG. 1 shows an internal configuration example of the head motion calculation unit 101. In the example shown in the figure, the head motion calculation unit 101 includes a filter processing unit 301 and a first human body transfer function calculation unit 302.

[0154] The filtering processing unit 301 performs filtering on the vehicle acceleration (a) directly output from the acceleration sensor installed on the rigid body part of the vehicle. x , a y , a z ) and filtering to reduce the computational processing load.

[0155] The first human body transfer function calculation unit 302 inputs the filtered vehicle acceleration (a x , a y, a z ), and obtains body information such as seat height (h) and upper body weight (w) as attribute data of the occupant from the vehicle monitoring camera and the body pressure sensor installed on the seat surface. Then, the first human body transfer function calculation unit 302 uses the simulation model of the human body (upper body) based on the movement of the vehicle (the filtered vehicle acceleration (a x , a y , a z )) The occupant's head movement (head acceleration (A)) is calculated by simulation x , A y , A z )).

[0156] The simulation performed by the first human body transfer function calculation unit 302 is a dynamic calculation in which the vehicle and the occupant are approximated as mechanical elements such as springs, masses, and dampers, and the above three input parameters are used. It should be noted that the human body simulation model used is not particularly limited.

[0157] It should be noted that in addition to simulation, the method of calculating the occupant's head movement may also include a method using data based on previous experimental results and using a machine learning model that has previously learned detection results for actual vehicle acceleration data and head movement based on a camera.

[0158] Figure 4 Show Figure 3 The processing procedure of calculating the head movement of the occupant in the head movement calculation unit 101 is shown as a flowchart.

[0159] First, when the vehicle acceleration (a) directly output from the acceleration sensor installed on the rigid body of the vehicle is obtained x , a y , a z ) (step S401), the filtering processing unit 301 performs a filtering operation on the vehicle acceleration (a x , a y , a z ) and filtering processing for reducing the calculation processing load (step S402).

[0160] Next, the first human body transfer function calculation unit 302 obtains body information such as seat height (h) and upper body weight (w) as attribute data of the occupant from the vehicle-mounted monitoring camera and the body pressure sensor installed on the seat surface (steps S403 and S404), and calculates the body information based on the vehicle movement (filtered vehicle acceleration (a x , a y , a z ), using a simulation model of the human body (upper body) to calculate the head movement of the occupant through simulation (step S405), and calculating the head acceleration of the occupant (Ax , A y , A z ) (Step S406).

[0161] D-2. Calculation of the cumulative factor for motion sickness

[0162] In this item D-2, the calculation of the motion sickness accumulation factor by the motion sickness accumulation factor calculation unit 102 will be described in detail. The motion sickness accumulation factor calculation unit 102 is a functional block that calculates the motion sickness determination index MSDV by time integration defined in ISO 2631.

[0163] Figure 5 5 shows an internal configuration example of the motion sickness accumulation factor calculation unit 102. In the illustrated example, the motion sickness accumulation factor calculation unit 102 includes a transfer function calculation unit 501 and an integral calculation unit 502.

[0164] The transfer function calculation unit 501 inputs the travel time information t and the head acceleration (A) of the occupant calculated by the head movement calculation unit 101. x , A y , A z ), the head acceleration (A x , A y , A z ) is temporarily transformed from the time domain to the frequency domain, multiplied by the filter transfer function H(s), and then inversely transformed back to the time domain to calculate the weighted effective acceleration (see Fig.13 ). As described in item B above, by changing the coefficient f according to the sport (e.g. vehicle type), i (=ω i ) and Q i The obtained filter characteristics are used as the transfer function H(s).

[0165] Using the above expression (1), the integral calculation unit 502 squares the weighted effective acceleration calculated by the transfer function calculation unit 501 and integrates it over time to perform route calculation, thereby calculating one discrimination index MSDV for motion sickness defined in ISO 2631 as a cumulative factor for motion sickness.

[0166] Figure 6 Shown for Figure 5 The flow of processing for calculating the accumulation factor of motion sickness of the occupant in the motion sickness accumulation factor calculation unit 102 is shown as a flowchart.

[0167] First, the travel time information t is acquired (step S601), and the head acceleration (A) of the occupant calculated by the head movement calculation unit 101 is acquired. x , A y , Az ) (step S602).

[0168] The transfer function calculation unit 501 converts the head acceleration (A x , A y , A z ) is temporarily transformed from the time domain to the frequency domain, multiplied by the filter transfer function H(s), and then inversely transformed to the time domain to calculate the weighted effective acceleration (step S603).

[0169] Next, using the above expression (1), the integral calculation unit 502 performs route calculation by squaring the weighted effective acceleration calculated by the transfer function calculation unit 501 and integrating it over time (step S604), thereby calculating one discrimination index MSDV for motion sickness defined in ISO2631 as a cumulative factor for motion sickness (step S605).

[0170] D-3. Calculation of motion sickness recovery factor

[0171] In this item D-3, the details of the calculation of the motion sickness recovery factor performed by the motion sickness recovery factor calculation unit 103 will be described. The motion sickness recovery factor calculation unit 103 is a functional block that calculates the recovery effect of the occupant's motion sickness based on the occupant attribute data detected by the vehicle-mounted sensor, etc., the occupant's position and posture information in the vehicle, and the elapsed time. The motion sickness recovery factor calculation unit 103 calculates the occupant attribute parameter value to be used for motion sickness recovery calculation based on the occupant's attribute data that affects the recovery (for example, the occupant's seat height, weight, and the occupant's position and posture in the vehicle), and calculates the effect R of recovery from motion sickness based on the calculated occupant attribute parameter value and the elapsed time t. Regarding the calculation of the parameter value, the calculation accuracy can be improved by using a machine learning model that has learned the occupant's riding history in advance.

[0172] Figure 7 1 shows an internal configuration example of the motion sickness recovery factor calculation unit 103. In the example shown in the figure, the motion sickness recovery factor calculation unit 103 includes an occupant attribute calculation unit 701 and a second human body transfer function calculation unit 702.

[0173] The occupant attribute calculation unit 701 inputs the occupant's physical information such as the seat height and upper body weight detected by the vehicle-mounted monitoring camera and the body pressure sensor installed on the seat surface, as well as the state of the occupant's position and posture in the vehicle, and calculates the occupant attribute parameter value to be used for motion sickness recovery calculation. Specifically, the rate of change (slope) of the amount of recovery (or decline) of the SSQ total score over time when the input parameter changes is determined in advance through experiments. Then, based on the experimental results, the occupant attribute calculation unit 701 calculates the amount of motion sickness recovery over time corresponding to the input occupant attribute as the occupant attribute parameter value. Regarding the calculation of the parameter value, the calculation accuracy can be improved by using a machine learning model that has previously learned the occupant's riding history.

[0174] Second human body transfer function calculation section 702 calculates the amount of recovery R from motion sickness start from the start of travel by multiplying the amount of change over time in the SSQ total score determined by occupant attribute calculation section 701 by the actual travel time.

[0175] Figure 8 Shown for Figure 7 The process flow of calculating the recovery factor of the occupant's motion sickness in the motion sickness recovery factor calculation unit 103 is shown as a flowchart.

[0176] First, the occupant attribute calculation unit 701 obtains the occupant's weight information w from the body pressure sensor installed on the seat surface of the seat where the occupant sits (step S801), and obtains the occupant's seat height information h from the image captured by the vehicle-mounted monitoring camera (step S802). Furthermore, the occupant attribute calculation unit 701 reads the occupant's seat position (in which row of seats the occupant sits) and posture information in the vehicle from the image captured by the vehicle-mounted monitoring camera (step S803).

[0177] Then, the occupant attribute calculation unit 701 calculates the occupant attribute parameter value to be used for motion sickness recovery calculation (step S804). Specifically, the rate of change (slope) of the change amount of recovery (or decline) of the SSQ total score over time is determined in advance through experiments. Based on the experimental results, the occupant attribute calculation unit 701 calculates the change amount of motion sickness recovery over time corresponding to the input parameters acquired in the preceding steps S801 to S803 as the occupant attribute parameter value.

[0178] Next, information on the vehicle's travel time is acquired (step S805). Then, the second human body transfer function calculation unit 702 calculates the recovery amount R of motion sickness from the start of travel by multiplying the amount of change over time in the SSQ total score determined by the occupant attribute calculation unit 701 by the actual travel time (step S806) (step S807).

[0179] D-4. Calculation of motion sickness

[0180] In this item D-4, details of motion sickness calculation performed by the motion sickness calculation unit 104 will be described.

[0181] Fig. 9 Shown from Figure 1 The motion sickness calculation unit 104 and the input / output part of the motion sickness calculation unit 104 are extracted from the overall structure of the information processing system 100 shown in FIG. 1 . As described in the above item D-2, the motion sickness accumulation factor calculation unit 102 calculates the discrimination index MSDV based on the time integration of the head movement defined in ISO 2631 as the accumulation factor of motion sickness. In addition, as described in the above item D-3, the motion sickness recovery factor calculation unit 103 calculates the recovery effect of the occupant's motion sickness based on the physical information such as the seat height h and the upper body weight w of the occupant, the position and posture information of the occupant in the vehicle, and the elapsed time t. Then, the motion sickness calculation unit 104 combines the MSDV calculated by the motion sickness accumulation factor calculation unit 102 with the degree of recovery from motion sickness calculated by the motion sickness recovery factor calculation unit 103 to calculate the motion sickness of the occupant.

[0182] Here, assuming that the MSDV calculated by the motion sickness accumulation factor calculation unit 102 is the motion sickness accumulation factor M, and R represents the degree of recovery from motion sickness calculated by the motion sickness recovery factor calculation unit 103, the motion sickness calculation unit 104 subtracts the degree of recovery from motion sickness R from the motion sickness accumulation factor M to calculate the occupant's motion sickness S as shown in the following expression (2). It should be noted that in this expression (2), the coefficient α multiplied by the accumulation factor M is a correlation coefficient between MSDV and SSQ determined experimentally.

[0183] [Formula 2]

[0184] …… (2)

[0185] It should be noted that the correlation coefficient α between MSDV and SSQ varies depending on the vehicle's driving style. For example, the correlation coefficient α is different between acceleration and deceleration driving (aggressive driving) and normal driving (smooth driving), and is also different in urban driving and highway driving. Fig.18 The following is an example of the experimental results of MSDV and SSQ total score when the vehicle performs the same driving. In the experimental results shown in the figure, the coefficient of determination (square of the correlation coefficient) R 2 It is 0.6445.

[0186] Fig.10 Shown for Fig. 9 The process flow of calculating the motion sickness of the occupant in the motion sickness calculation unit 104 is shown as a flowchart.

[0187] First, the motion sickness calculation unit 104 obtains the discrimination index MSDV based on the time integration of the head movement calculated by the motion sickness accumulation factor calculation unit 102 (step S1001), and obtains the motion sickness recovery effect of the occupant calculated by the motion sickness recovery factor calculation unit 103 based on the occupant attribute information (step S1002). Fig.10 In the flowchart shown, step S1001 of calculating the cumulative factor of motion sickness and step S1002 of calculating the recovery factor of motion sickness are arranged in time series in the above order, but step S1001 and step S1002 can be executed in parallel or in the reverse order.

[0188] Next, the motion sickness calculation unit 104 combines the MSDV (M) calculated by the motion sickness accumulation factor calculation unit 102 and the degree of recovery from motion sickness (R) calculated by the motion sickness recovery factor calculation unit 103 according to the above expression (2) to calculate the motion sickness (S) of the occupant (step S1003 ).

[0189] Then, the motion sickness calculation unit 104 outputs the calculated motion sickness (S) of the occupant to the response processing unit 105 at the subsequent stage (step S1004 ), and the present process ends.

[0190] D.5. Changes in motion sickness recovery due to the orientation of the front passenger seat and the 2nd and 3rd row seats

[0191] Fig.11 The functional configuration of an information processing system 1100 for estimating motion sickness of an occupant is schematically shown. Fig.11 The information processing system 1100 is shown with Figure 1 The information processing system 100 shown is different in that the position of the occupant in the vehicle and the posture of the occupant are also considered to estimate motion sickness. The information processing system 1100 includes a head movement calculation unit 1101, a motion sickness accumulation factor calculation unit 1102, a motion sickness recovery factor calculation unit 1103, a motion sickness calculation unit 1104, and a response processing unit 1105.

[0192] Based on various data detected by the vehicle-mounted sensors, the head movement calculation unit 1101 calculates the head movement of the occupant through simulation calculation based on the movement of the vehicle.

[0193] The motion sickness accumulation factor calculation unit 1102 calculates the head acceleration (A) calculated by the head motion calculation unit 1101 according to the frequency. x , A y , A z ) is weighted, the travel time of the detection vehicle is detected, and the cumulative factor MSDV of the occupant's motion sickness is integrated and calculated by time integration using the above expression (1) described in ISO 2631.

[0194] In addition to the detected attribute data of the occupant (same as above) and the travel time of the vehicle, the motion sickness recovery factor calculation unit 1103 also calculates the motion sickness recovery factor of the occupant in consideration of the position of the occupant in the vehicle and the posture of the occupant. For example, based on the image captured by the vehicle-mounted monitoring camera, the position of the occupant in the vehicle and the posture of the occupant are acquired. In addition, as described in the above-mentioned item C-3, even in the same vehicle, the degree of recovery from motion sickness varies depending on the seat position of the occupant. This is because, for example, in the case of a vehicle with more than 3 rows of seats, the forward field of view and the up, down, left and right movements of each seat position are not uniform, and the head movement varies depending on the seat position of the occupant. Considering that the recovery effect of motion sickness is smaller in the rear seats such as the 2nd or 3rd row compared to the 1st row, and also considering the recovery effect corresponding to the posture (seat orientation) of the occupant, the motion sickness recovery factor calculation unit 1103 performs weighted calculation of the recovery factor according to the riding position and the occupant posture to calculate the predicted motion sickness at the riding position.

[0195] Specifically, the SSQ total score when the position and posture of the occupant are changed is determined in advance by experiments, and the score rate under each condition is calculated using "the state of the occupant in the second row sitting forward" as the reference position. Then, the motion sickness recovery factor calculation unit 1103 multiplies the determined score rate by the recovery calculation, and reflects the effect according to the position and posture of the occupant in the motion sickness recovery factor. Assuming that β represents the SSQ total score rate according to the position and posture of the occupant, as shown in the following expression (3), the value R' obtained by multiplying the motion sickness recovery factor R calculated based on the physical information such as the seat height h and the upper body weight w of the occupant and the elapsed time t by β is the motion sickness recovery factor reflecting the effect according to the position and posture of the occupant.

[0196] [Formula 3]

[0197] …… (3)

[0198] The motion sickness calculation unit 1104 combines the accumulation factor of motion sickness calculated by the motion sickness accumulation factor calculation unit 1102 and the recovery factor of motion sickness calculated by the motion sickness recovery factor calculation unit 103 to calculate the motion sickness of the occupant. That is, as shown in the following expression (4), the motion sickness calculation unit 1104 subtracts the motion sickness recovery factor R' reflecting the effect according to the position and posture of the occupant from the value αM obtained by multiplying the MSDV calculated by the motion sickness accumulation factor calculation unit 102 by the correlation coefficient α between the MSDV and the SSQ to calculate the motion sickness S of the occupant.

[0199] [Formula 4]

[0200] …… (4)

[0201] In addition, as described in the above-mentioned item D-4, the correlation coefficient α between MSDV and SSQ varies depending on the vehicle's driving mode. For example, the correlation coefficient α is different between acceleration and deceleration driving (aggressive driving) and normal driving (smooth driving), and the correlation coefficient is also different between urban driving and highway driving. The motion sickness calculation unit 1104 can be adapted to input the vehicle acceleration and determine the driving mode (acceleration and deceleration driving (aggressive driving) or normal driving (smooth driving)), or input GPS information and determine whether the vehicle is traveling in the urban area or on the highway, and use the appropriate correlation coefficient α based on the determination result to calculate the occupant's motion sickness S.

[0202] The response processing unit 1105 performs processing corresponding to the result of the motion sickness of the occupant calculated by the motion sickness calculation unit 1104. Specifically, the response processing unit 1105 performs response processing (same as above), such as notification to the occupant or the driver in manual driving (e.g., instructing a driving operation or route change for reducing the SSQ of the occupant), driving control in automatic driving (e.g., driving control or route change for limiting acceleration / deceleration or route change for reducing the SSQ of the occupant), and occupant's field of view control (display control of content video in a display system installed in the vehicle).

[0203] Fig.12 The operation procedure performed in the information processing system 1100 is shown as a flowchart.

[0204] When a person is detected in the vehicle, that is, an occupant is detected (step S1201), the attribute data of the occupant is first obtained (step S1202). Specifically, the occupant's physical information such as the seat height (h) and upper body weight (w) is obtained by using vehicle-mounted sensors such as a vehicle-mounted monitoring camera and a body pressure sensor installed on the seat surface.

[0205] Then, when it is detected that the vehicle has started to move (step S1203), the acceleration sensor installed on the rigid body of the vehicle is used to detect the vehicle acceleration (a x , a y , a z ) (step S1204).

[0206] Next, the head movement calculation unit 1101 calculates the head acceleration (A) of the occupant through simulation calculation based on the vehicle acceleration information acquired in step S1203 and the body information of the occupant such as the seat height (h) and upper body weight (w) acquired in step S1202. x , A y , A z ) (step S1205).

[0207] Next, the motion sickness accumulation factor calculation unit 1102 calculates the head acceleration (A) calculated by the head motion calculation unit 1101 according to the frequency. x , A y , A z ) is weighted, the travel time of the vehicle is detected, and the cumulative factor M of the occupant's motion sickness is integrally calculated by using the time integration of the above expression (1) described in ISO 2631 (step S1206).

[0208] In addition, the motion sickness recovery factor calculation unit 1103 reads the occupant's attribute data including the occupant's physical information such as the seat height (h) and upper body weight (w) acquired in step S1202 (step S1207), and reads the occupant's position and posture information (step S1208), and performs calculation processing of the motion sickness recovery factor R' reflecting the effect of the occupant's position and posture (step S1209).

[0209] Then, the motion sickness calculation unit 1104 combines the motion sickness accumulation factor αM calculated by the motion sickness accumulation factor calculation unit 1102 and the motion sickness recovery factor R′ calculated by the motion sickness recovery factor calculation unit 1103 to calculate the occupant's motion sickness S (=αM−R′) (step S1210 ).

[0210] The response processing unit 1105 performs response processing (step S1211) such as notification to the occupant or the driver, feedback on the automatic driving control, and control of the occupant's field of view (for example, display control of content in the in-vehicle display system) based on the result of the occupant's motion sickness calculated by the motion sickness calculation unit 1104.

[0211] E. Display system and its control

[0212] E-1. Display system configuration

[0213] In order to obtain an immersive feeling inside the vehicle, it is necessary to watch the video on a large display. For example, in Level 4 and Level 5 autonomous driving, the need for passengers to watch videos increases. In view of this, in the present disclosure, it is envisaged that a display system for displaying content videos on a transmittance variable region is installed on the vehicle. The display system is also one of the processing objects of the above-mentioned response processing unit 105 (or 1105).

[0214] Specifically, the display system is composed of a combination of a transparent screen and a projector, which projects a video onto the transparent screen and displays the content video in the variable transmittance area. Here, the transparent screen is formed by laminating a film having an electrically variable transmittance on a transparent film such as a resin. In addition, a display device having a transparent FPD such as a transparent OLED or a transparent LCD can also be used to form a display system that displays the content video in the variable transmittance area. Alternatively, the display system can also be a video see-through type, which displays the scenery in front of the vehicle (or around the vehicle) by using a non-see-through type instead of a see-through type display device in combination with a vehicle-mounted camera.

[0215] The variable transmittance region of the display system may be a transparent screen or a transparent FPD pulled down from the bottom surface of the vehicle ceiling. Fig. 20 The following state is shown: the transparent screen 2001 is pulled down from the bottom surface of the vehicle ceiling, and the content video 2003 is projected from the projector 2002 also installed on the bottom surface of the ceiling to the approximate center of the transparent screen 2001. The pull-down transparent screen 2001 is installed, for example, near the rear of the first row of seats. As a result, passengers sitting in the back seat can watch the content video 2003 projected on the transparent screen 2001. In short, Fig. 20 The display system shown may be referred to as a rear seat entertainment (RSE) system. Note that it is assumed that the rear seats include seats in the 2nd row of a 2-row seat vehicle, and seats in the 2nd and 3rd rows of a 3-row seat vehicle.

[0216] A film having an electrically variable transmittance is laminated on the transparent screen 2001. By electrically controlling the transmittance of the film, the transmittance of the entire or a portion of the transparent screen 2001 (for example, only a portion of the area where the content video 2003 is projected) can be adjusted. In addition, the transmittance of the display area of ​​the content video 2003 can be adjusted by adjusting the contrast of the content video 2003 projected by the projector 2002 (increasing the illumination intensity to enhance the contrast will reduce the transmittance, and conversely, reducing the illumination intensity to reduce the contrast will increase the transmittance).

[0217] It can be seen that when the transmittance of the entire or part of the transparent screen 2001 increases, the passengers in the rear seats can easily recognize the situation in front of the vehicle and the vehicle behavior through the transparent area. Fig.21 As shown in FIG. 2 , when the overall transmittance of the transparent screen 2001 decreases, the immersion of the content video 2003 increases. Fig. 22 As shown, when the transmittance of the entire transparent screen 2001 decreases and the display size of the content video 2003 increases, the immersive feeling is further increased.

[0218] The same applies to display systems using transparent FPDs. By increasing the transmittance of the entire transparent FPD including the content video or increasing the transmittance outside the display area of ​​the content video, rear seat passengers can easily recognize the situation in front of the vehicle and the vehicle behavior through the transparent area. In addition, by reducing the transmittance of the entire transparent FPD or increasing the display size of the content video, the sense of immersion is further increased.

[0219] It should be noted that the above-mentioned display system for RSE is an example, and the arrangement position of the transparent screen or transparent FPD is not limited to Fig. 20 shown. Fig.23 Taking a three-row seat car as an example, a variation of the arrangement position of the transmittance variable area such as a transparent screen or a transparent FPD in the vehicle display system is shown.

[0220] exist Fig.23 , reference numeral 2301 indicates the arrangement position of a transparent screen or transparent FPD for RSE behind the first row of seats (or in front of the second row of seats). Reference numeral 2311 indicates an example of setting the front window (windshield) as the arrangement position of the transparent screen or transparent FPD. Reference numeral 2321 indicates an example of setting the rear window as the arrangement position of the transparent screen or transparent FPD. For example, when the seats in the second or third row have been turned to face backward, it is sufficient to display the content video for the passengers sitting in the rear-facing seats on the rear window. Reference numerals 2331R, 2331R, and 2333R indicate examples of the arrangement positions where the right windows of the first row, the second row, and the third row are respectively set as transparent screens or transparent FPDs. In addition, reference numerals 2331L, 2331L, and 2333L indicate examples of the arrangement positions where the left windows of the first row, the second row, and the third row are respectively set as transparent screens or transparent FPDs.

[0221] It should be noted that when a transparent screen or a transparent FPD is arranged on a vehicle window such as a front window, a rear window, or a side window, it can be used as a display and can also be used as smoked glass with adjustable transmittance.

[0222] When a transparent screen is used as a transmittance variable area, a projector that projects content video onto the transparent screen needs to be installed in the car. The arrangement position of the projector for each arrangement position of the transparent screen in the car in the case of a display system using a combination of a transparent screen and a projector will be described.

[0223] Fig.24 The arrangement position of the projector 2401 is shown when a transparent screen 2400 for RSE is arranged behind the first row of seats. Fig.25 The arrangement position of the projector 2501 is shown when a transparent screen 2500 is arranged on the front window. Fig.26The arrangement position of the projector 2601 is shown in the case where a transparent screen 2600 is arranged on the rear window. For example, when the seats in the second or third row have been turned to face rearward, the content video for the passengers sitting in the rearward-facing seats can be displayed on the rear window. Fig. 27 The arrangement position of the projector 2701 is shown when a transparent screen 2700 is arranged on the side window.

[0224] exist Figure 24~Figure 27 In any of the examples shown in , each of the projectors 2401, 2501, 2601, and 2701 is arranged on the bottom surface of the ceiling. In addition, in any of the configuration examples, by arranging the projector as close as possible to the transparent screen on which the content video is to be projected, the video can be projected without being blocked by an object (for example, an occupant), and the maximum brightness can be maintained high.

[0225] E-2. Relief of motion sickness

[0226] For example, in Fig. 20 In the case where a display system for RSE is installed, the front view of the passengers sitting in the back seat is occupied by the display (transparent screen or transparent FPD), making it difficult for the passengers to understand the situation in front of the vehicle. Therefore, there is a problem that it is difficult for the passengers to match their bodies with the movement of the vehicle, resulting in motion sickness.

[0227] In view of this, in the present disclosure, a display system characteristic that displays a content video in a variable transmittance region, in other words, is capable of adjusting the transmittance of a video to be displayed, is used to reduce motion sickness by controlling the transmittance of the variable transmittance region according to a response level for reducing motion sickness that takes into account a motion sickness index and a predicted displacement. Specifically, as the response level for reducing motion sickness increases, the amount of visual field information in front of the vehicle that passes through the entire display is increased by increasing the transmittance of the transparent screen or transparent FPD. Accordingly, the visibility of the content video becomes lower, but it is easy to recognize the situation in front of the vehicle, for example, the onset of motion sickness can be prevented or the symptoms can be reduced by the occupants matching their bodies with the movement of the vehicle. In addition, according to the present disclosure, motion sickness can also be reduced by changing the display position and angle of the content video according to the response level for reducing motion sickness so that the occupants can easily match their posture with the displacement of the vehicle body.

[0228] As Fig. 20 The display operation realized by the present disclosure is described by taking a display system for RSE, in other words, a display (such as a transparent screen or a transparent FPD) installed in front of a vehicle as an example. For example, it is assumed that there is a sharp turn on the left side in front of the vehicle, and the occupant wants to recognize the front so that the occupant can easily match the displacement of the body with the vehicle body to reduce motion sickness. Figure 28 to Figure 35 Operation examples of the display system for alleviating motion sickness in such cases are respectively shown.

[0229] exist Fig.28 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent. Fig. 20 and Fig.21 Compared to the display example shown, the visibility of content video 2003 for passengers sitting in the back seat is lower, but the passengers can easily recognize the front of the vehicle and match their body posture with the displacement of the vehicle body, so motion sickness can be reduced.

[0230] exist Fig.29 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and rotated counterclockwise according to the sharp left turn of the vehicle body. Fig.29 In the example of display shown, the passenger sitting in the back seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. In addition, the content video 2003 is rotated according to the inclination angle of the body posture following the displacement of the vehicle body during the left sharp turn, so compared with Fig.28 In the display example shown, the visibility of the content video 2003 is further improved.

[0231] exist Fig.30 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and moves in accordance with the vehicle body turning sharply to the left. Fig.30 In the example of display shown, the passenger sitting in the back seat can easily identify the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. Since the display position of the content video 2003 is moved from the center of the transparent screen to the left, the front view of the vehicle is further improved, and the passenger can more easily identify the displacement of the vehicle body. In addition, the content video 2003 is moved to the left to adapt to the position of the body leaning to the left in order to withstand the centrifugal force applied during the left sharp turn, so compared with Fig.28 In the display example shown, the visibility of the content video 2003 is further improved.

[0232] exist Fig.31 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and reduced in size. Fig.31 In the display example shown, the passenger sitting in the back seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. As the size of the content video 2003 is reduced, the visibility of the content video 2003 is further reduced, but the field of view in front of the vehicle is further improved, and the passenger can more easily recognize the displacement of the vehicle body.

[0233] exist Fig.32 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and rotates counterclockwise and moves leftward according to the sharp left turn of the vehicle body. Fig.32In the display example shown, the passenger sitting in the back seat can easily identify the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. Since the display position of the content video 2003 is moved from the center of the transparent screen to the left, the field of view in front of the vehicle is further improved, and the passenger can more easily identify the displacement of the vehicle body. In addition, the content video 2003 is rotated according to the inclination angle of the body posture following the displacement of the vehicle body during a sharp left turn, so compared with Fig.28 In the display example shown, the visibility of the content video 2003 is further improved.

[0234] exist Fig.33 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and rotated counterclockwise and reduced in size as the vehicle body turns sharply to the left. Fig.33 In the example of display shown, the passenger sitting in the back seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. In addition, the content video 2003 is rotated according to the inclination angle of the body posture following the displacement of the vehicle body during the left sharp turn, so compared with Fig.28 In the display example shown, the visibility of the content video 2003 is further improved. Since the size of the content video 2003 is reduced, the visibility of the content video 2003 is further reduced, but the field of vision in front of the vehicle is further improved, and the occupants can more easily recognize the displacement of the vehicle body.

[0235] exist Fig.34 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and moves to the left and is reduced in size as the vehicle body turns sharply to the left. Fig.34 In the display example shown, the passenger sitting in the back seat can easily identify the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. The display position of content video 2003 is moved to the left from the center of the transparent screen, so the field of view in front of the vehicle is further improved, and the passenger can more easily identify the displacement of the vehicle body. As the size of content video 2003 is reduced, the visibility of content video 2003 is further reduced, but the field of view in front of the vehicle is further improved, and the passenger can more easily identify the displacement of the vehicle body. In addition, content video 2003 moves to the left to accommodate the position of the body leaning to the left in order to withstand the centrifugal force applied during a sharp left turn, and the visibility of content video 2003 is improved by a corresponding amount.

[0236] exist Fig.35 In the example shown, the content video 2003 displayed in the center of the transparent screen is made transparent and rotated counterclockwise and moved to the left and reduced in size according to the sharp left turn of the vehicle body. Fig.35In the display example shown, the passenger sitting in the back seat can easily recognize the front of the vehicle and match the body posture with the displacement of the vehicle body, so motion sickness can be reduced. In addition, the content video 2003 is rotated and moved according to the position and posture of the body that leans and moves to the left following the displacement of the vehicle body during a sharp left turn, and the visibility of the content video 2003 is improved by this amount. As the size of the content video 2003 is reduced, the visibility of the content video 2003 is further reduced, but the field of view in front of the vehicle is further improved, and the passenger can more easily recognize the displacement of the vehicle body.

[0237] Fig.29 , Fig.30 and Figure 32~Figure 35 An example is shown in which a transparent content video on a display (e.g., a transparent screen or a transparent FPD) is rotated and moved to the left when the vehicle turns sharply to the left. Although not shown in the figure, when the vehicle turns sharply to the right, the transparent content video on the display is rotated and moved to the right, which can also reduce the motion sickness of the occupants.

[0238] In addition, when the vehicle is not turning sharply but passing a steep slope, the transparent content video can be moved up and down instead of left and right, which can also reduce the motion sickness of the passengers. For example, when the vehicle is going up a steep slope, the content video can be moved upward in accordance with the upward movement of the passenger's line of sight. Conversely, when the vehicle is going down a steep slope, the content video can be moved downward in accordance with the downward movement of the passenger's line of sight.

[0239] The response processing unit 105 controls the transmittance of the transmittance variable area (or the content video displayed in the transmittance variable area) of the vehicle display system according to the result of the motion sickness of the occupant calculated by the motion sickness calculation unit 104, thereby reducing the motion sickness of the occupant. In addition, the response processing unit 105 changes the display size, inclination, and display position of the content video in addition to the transmittance of the transmittance variable area, thereby reducing the motion sickness of the occupant while maintaining the visibility of the content video.

[0240] F. Summary

[0241] Finally, the effects provided by the present disclosure are summarized. The following effects (1) and (2) are obtained in a vehicle such as an automobile to which the present disclosure is applied.

[0242] (1) According to the present disclosure, in addition to the accumulation factor of motion sickness, the recovery factor of motion sickness is further considered, so that more accurate motion sickness prediction can be achieved according to the way motion sickness occurs according to the travel time and travel mode of the vehicle.

[0243] (2) According to the present disclosure, when predicting motion sickness based on the head movement of the occupant, the head movement of the occupant is calculated by simulation based on the vehicle movement. Thus, it is not necessary to directly detect the head movement which is difficult to measure, but it is possible to obtain the data of the head movement and perform motion sickness prediction by only detecting the acceleration of the vehicle which can be easily measured using the vehicle-mounted sensor.

[0244] Industrial Applicability

[0245] The present disclosure has been described in detail with reference to specific embodiments. However, it is obvious that those skilled in the art can modify or replace the embodiments without departing from the spirit of the present disclosure.

[0246] Although this specification focuses on an embodiment in which the present disclosure is applied to motion sickness, the subject matter of the present disclosure is not limited thereto. The present disclosure can also be applied to motion sickness, such as seasickness, etc., caused by the movement of a vehicle (moving body) when a passenger is riding on various conventional vehicles (moving bodies).

[0247] In short, the present disclosure has been described by way of example, but should not be construed as limiting the content of the present disclosure. The scope of the claims should be considered to determine the gist of the present disclosure.

[0248] It should be noted that the present disclosure can also adopt the following configuration.

[0249] (1) An information processing device comprising:

[0250] A motion sickness accumulation calculation unit, which calculates a motion sickness accumulation factor of an occupant in the moving body;

[0251] a motion sickness recovery calculation unit, which calculates a motion sickness recovery factor of the occupant; and

[0252] A motion sickness calculation unit combines the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant.

[0253] (2) The information processing device according to (1) above, wherein:

[0254] The motion sickness accumulation calculation unit calculates the accumulation factor based on the head movement of the occupant and the travel time of the moving body.

[0255] (3) The information processing device according to (2) above, wherein:

[0256] The motion sickness accumulation calculation unit calculates the accumulation factor by using a head movement of the occupant, wherein the head movement is predicted by a head movement simulation calculation based on the acceleration of the moving body and body information of the occupant.

[0257] (3-1) The information processing device according to (3) above, wherein:

[0258] The physical information of the occupant includes the seat height and weight of the occupant.

[0259] (3-2) The information processing device according to (3) above, wherein:

[0260] The head simulation calculation is a dynamic calculation that approximates the moving body and the occupant as mechanical elements including a spring, a mass, and a damper and uses the acceleration of the moving body and the body information of the occupant.

[0261] (4) The information processing device according to any one of (1) to (3) above, wherein:

[0262] The motion sickness accumulation factor calculation unit calculates the accumulation factor based on a motion sickness dose value (MSDV) defined by ISO 2631.

[0263] (5) The information processing device according to any one of (1) to (4) above, wherein:

[0264] The motion sickness recovery factor calculation unit calculates the recovery factor based on the travel time of the moving body and the body information of the occupant.

[0265] (6) The information processing device according to (5) above, wherein:

[0266] The motion sickness recovery factor calculation unit calculates the recovery factor further in consideration of at least one of the position of the occupant in the moving body or the posture of the occupant.

[0267] (7) The information processing device according to (6) above, wherein:

[0268] The motion sickness recovery factor calculation unit calculates the recovery factor in consideration of at least one of a motion of the mobile object corresponding to a position of the occupant or visual field information corresponding to a posture of the occupant.

[0269] (8) The information processing device according to any one of (5) to (7) above, wherein:

[0270] The motion sickness recovery factor calculation unit calculates the recovery factor further in consideration of the traveling manner of the moving body.

[0271] (8-1) The information processing device according to (8) above, wherein:

[0272] Information on the traveling pattern of the moving object is acquired based on the head movement of the occupant or the position information of the moving object.

[0273] (8-2) The information processing device according to (8) above, wherein:

[0274] The moving mode of the mobile body includes at least one of whether the mobile body is performing manual driving or automatic driving, the moving speed of the mobile body in automatic driving, or where the mobile body is traveling in the urban area or on the highway.

[0275] (9) The information processing device according to any one of (1) to (8) above, wherein:

[0276] The motion sickness calculation unit calculates a motion sickness index based on calculation results for a predetermined period of time or more.

[0277] (10) The information processing device according to (9) above, wherein:

[0278] The predetermined time is a time when the correlation between the Motion Sickness Susceptibility Questionnaire (MSSQ) and the Simulator Sickness Questionnaire (SSQ) as a criterion for motion sickness tendency is sufficiently high.

[0279] (11) The information processing device according to any one of (1) to (10) above, further comprising:

[0280] The processing unit executes a process corresponding to the motion sickness index of the occupant in the moving object.

[0281] (12) The information processing device according to (11) above, wherein:

[0282] When motion sickness of the occupant is predicted, the processing unit performs at least one of information presentation, driving control, or operational control of a display system installed on the mobile body, wherein the information presentation indicates limiting at least one of the travel speed or route change of the mobile body in manual driving (or a driving operation for reducing the simulator sickness index of the occupant), and the driving control is associated with limiting at least one of the travel speed or route change of the mobile body in automatic driving (or associated with reducing the simulator sickness index of the occupant).

[0283] (13) The information processing device according to (12) above, wherein:

[0284] The processing unit adjusts the transmittance of at least a portion of the variable transmittance region of the display system that displays the video in the variable transmittance region according to the motion sickness index of the occupant.

[0285] (13-1) The system according to (13) above, wherein:

[0286] The display system comprises a screen having adjustable transmittance, and

[0287] The processing unit performs at least one of adjustments of the transmittance of the screen, or the size, display position, or contrast of a content video to be displayed on the screen according to the motion sickness index of the occupant.

[0288] (14) An information processing method comprising:

[0289] A motion sickness accumulation calculation step, calculating a motion sickness accumulation factor of an occupant in the moving body;

[0290] a motion sickness recovery calculation step, calculating a motion sickness recovery factor of the occupant; and

[0291] A motion sickness calculation step is to combine the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant.

[0292] (15) A system comprising:

[0293] A motion sickness accumulation calculation unit, which calculates a motion sickness accumulation factor of an occupant in the moving body;

[0294] a motion sickness recovery calculation unit, for calculating a motion sickness recovery factor of the occupant;

[0295] a motion sickness calculation unit, combining the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant;

[0296] a display system mounted on the mobile body and displaying a video to be viewed by the occupant; and

[0297] The processing unit performs processing corresponding to the motion sickness index of the occupant on the display system.

[0298] (15-1) The system according to (14) above, wherein:

[0299] The display system comprises a screen with adjustable transmittance,

[0300] The processing unit performs at least one of adjustments of the transmittance of the screen, or the size, display position, or contrast of a content video to be displayed on the screen according to the motion sickness index of the occupant.

Claims

1. An information processing device, comprising: A motion sickness accumulation calculation unit, which calculates a motion sickness accumulation factor of an occupant in the moving body; a motion sickness recovery calculation unit, for calculating a motion sickness recovery factor of the occupant; as well as A motion sickness calculation unit combines the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant.

2. The information processing device according to claim 1, wherein: The motion sickness accumulation calculation unit calculates the accumulation factor based on the head movement of the occupant and the travel time of the moving body.

3. The information processing device according to claim 2, wherein: The motion sickness accumulation calculation unit calculates the accumulation factor by using a head movement of the occupant, wherein the head movement is predicted by a head movement simulation calculation based on the acceleration of the moving body and body information of the occupant.

4. The information processing device according to claim 1, wherein: The motion sickness accumulation factor calculation unit calculates the accumulation factor based on a motion sickness dose value (MSDV) defined by ISO 2631.

5. The information processing device according to claim 1, wherein: The motion sickness recovery factor calculation unit calculates the recovery factor based on the travel time of the moving body and the body information of the occupant.

6. The information processing device according to claim 5, wherein: The motion sickness recovery factor calculation unit calculates the recovery factor further in consideration of at least one of the position of the occupant in the moving body or the posture of the occupant.

7. The information processing device according to claim 6, wherein: The motion sickness recovery factor calculation unit calculates the recovery factor in consideration of at least one of a motion of the mobile object corresponding to a position of the occupant or visual field information corresponding to a posture of the occupant.

8. The information processing device according to claim 5, wherein: The motion sickness recovery factor calculation unit calculates the recovery factor further in consideration of the traveling manner of the moving body.

9. The information processing device according to claim 1, wherein: The motion sickness calculation unit calculates a motion sickness index based on calculation results for a predetermined period of time or more.

10. The information processing device according to claim 9, wherein: The predetermined time is a time when the correlation between the Motion Sickness Susceptibility Questionnaire (MSSQ) and the Simulator Sickness Questionnaire (SSQ) as a criterion for motion sickness tendency is sufficiently high.

11. The information processing device according to claim 1, further comprising: The processing unit executes a process corresponding to the motion sickness index of the occupant in the moving object.

12. The information processing device according to claim 11, wherein: When motion sickness of the occupant is predicted, the processing unit performs at least one of information presentation, driving control, or operational control of a display system installed on the mobile body, wherein the information presentation indicates limiting at least one of the travel speed or route change of the mobile body in manual driving (or a driving operation for reducing the simulator sickness index of the occupant), and the driving control is associated with limiting at least one of the travel speed or route change of the mobile body in automatic driving (or associated with reducing the simulator sickness index of the occupant).

13. The information processing device according to claim 12, wherein: The processing unit adjusts the transmittance of at least a portion of the variable transmittance region of the display system that displays the video in the variable transmittance region according to the motion sickness index of the occupant.

14. An information processing method, comprising: A motion sickness accumulation calculation step, calculating a motion sickness accumulation factor of an occupant in the moving body; a motion sickness recovery calculation step, calculating a motion sickness recovery factor of the occupant; as well as A motion sickness calculation step is to combine the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant.

15. A system comprising: A motion sickness accumulation calculation unit, which calculates a motion sickness accumulation factor of an occupant in the moving body; a motion sickness recovery calculation unit, for calculating a motion sickness recovery factor of the occupant; a motion sickness calculation unit, combining the accumulation factor with the recovery factor to calculate a motion sickness index of the occupant; a display system mounted on the mobile body and displaying a video to be viewed by the occupant; as well as The processing unit performs processing corresponding to the motion sickness index of the occupant on the display system.

Images