System for alleviating motion sickness in a vehicle and information processing device

Abstract

The present disclosure provides a motion sickness alleviating system and an information processing apparatus that can provide appropriate treatment corresponding to the respective motion sickness conditions of multiple users. The motion sickness alleviating system includes a sensor apparatus that senses the ride states of multiple users riding a vehicle, multiple communication terminals respectively assigned to the multiple users, and an information processing apparatus that communicates with the multiple communication terminals. The multiple communication terminals store susceptibility data of the users to which the communication terminals are assigned. The information processing apparatus executes a motion sickness level estimation process in which the motion sickness levels of the multiple users are estimated using the susceptibility data and the ride states sensed by the sensor apparatus, and a motion sickness reduction treatment process in which motion sickness reduction treatments are respectively set for the multiple users based on the estimated motion sickness levels.

Description

Technical Field

[0001] This disclosure relates to systems and information processing devices for reducing motion sickness in vehicles. Background Technology

[0002] A method for reducing motion sickness by sensing the state of passengers inside a vehicle is known (see Japanese Patent Application Publication No. 2020-185378). In this method, sensing data is used to determine the state of passengers and the vehicle is controlled to reduce motion sickness. Summary of the Invention

[0003] The method described above uses data from all occupants to predict motion sickness. Therefore, the accuracy in assessing the individual conditions of multiple passengers needs improvement. Furthermore, because the same treatment is applied to all occupants, it cannot provide individualized interventions tailored to each passenger's specific situation.

[0004] One aspect of this disclosure preferably provides a system for alleviating motion sickness in vehicles, which is capable of providing appropriate treatment corresponding to the individual motion sickness conditions of multiple users.

[0005] One aspect of this disclosure relates to a system for alleviating motion sickness in vehicles, comprising: a sensor device configured to sense the riding status of multiple users riding in the vehicle; multiple communication terminals respectively assigned to the multiple users; and an information processing device disposed in the vehicle and configured to communicate with the multiple communication terminals.

[0006] Multiple communication terminals are configured to store motion sickness susceptibility data of users assigned to these terminals. An information processing device is configured to perform motion sickness level calculation and motion sickness reduction measures. Specifically, the information processing device performs motion sickness level calculation during vehicle movement. In this calculation, the device uses motion sickness susceptibility data stored in the multiple communication terminals and riding status sensed by sensor devices to calculate the motion sickness level of each user. In the motion sickness reduction measures, the device sets motion sickness reduction measures for each user based on the calculated motion sickness levels.

[0007] Based on the above structure, it is possible to estimate the individual motion sickness levels of multiple users traveling on a vehicle based on the motion sickness data of each user stored in the communication terminal. Therefore, it is possible to provide appropriate treatment corresponding to the individual motion sickness conditions of multiple users.

[0008] In one aspect of this disclosure, the information processing apparatus can be configured to, during motion sickness level estimation, send the riding status of each user corresponding to multiple communication terminals to multiple communication terminals respectively, and enable the multiple communication terminals to predict the motion sickness level of each user corresponding to the multiple communication terminals using motion sickness susceptibility data and riding status. According to this structure, the motion sickness level of each user can be estimated without providing the information processing apparatus with the user's personal information. Therefore, personal information stored in the communication terminals can be protected.

[0009] One aspect of this disclosure may further include a content providing device, configured to provide all content shared by multiple users within a vehicle. The information processing device may be configured to, as a motion sickness reduction measure, switch from a mode where the content providing device provides all content to multiple users to a mode where multiple communication terminals provide individual content to each user. According to this structure, it is possible to switch from a mode providing the same content to multiple users to a mode providing individual content to reduce motion sickness. Therefore, it is possible to combine the function of providing a content-sharing experience for multiple users with the function of reducing motion sickness.

[0010] In one aspect of this disclosure, the information processing device may be configured to further perform content determination processing, in which the information processing device determines the total content to be provided by the content providing device based on a predetermined travel route of the vehicle and motion sickness data stored in multiple communication terminals. According to this structure, the total content can be selected based on the shape of the predetermined travel route, the motion sickness of each user, etc. Therefore, it is possible to provide total content that is unlikely to induce motion sickness in multiple users through the content providing device.

[0011] In one embodiment of this disclosure, the information processing device can be configured to, as a motion sickness reduction measure, cause a communication terminal among multiple communication terminals corresponding to a user with a higher level of motion sickness to issue a reminder to the user. According to this configuration, it is possible to facilitate the recovery of users with higher levels of motion sickness.

[0012] Another aspect of this disclosure relates to an information processing device for alleviating motion sickness in vehicles, which is disposed in a vehicle and configured to communicate with multiple communication terminals respectively assigned to multiple users riding in the vehicle.

[0013] The information processing device is configured to perform motion sickness level calculation and motion sickness reduction processing. Specifically, the information processing device performs motion sickness level calculation during the movement of the vehicle. In the motion sickness level calculation, the information processing device uses motion sickness susceptibility data of users stored in multiple communication terminals and the riding status of multiple users sensed within the vehicle to calculate the motion sickness level of each user. In the motion sickness reduction processing, the information processing device sets motion sickness reduction measures for each user based on the calculated motion sickness level.

[0014] Based on the above structure, appropriate treatment can be provided corresponding to the motion sickness conditions of multiple users. Attached Figure Description

[0015] Figure 1 This is a schematic structural diagram illustrating the system for alleviating motion sickness in vehicles according to the embodiment.

[0016] Figure 2 It was applied Figure 1 A schematic diagram of a vehicle system designed to reduce motion sickness.

[0017] Figure 3 It is a general representation of the... Figure 1 The flowchart shows the process performed by the information processing device. Detailed Implementation

[0018] The embodiments of which this disclosure is applied will be described below with reference to the accompanying drawings.

[0019] [1. First Embodiment]

[0020] [1-1. Structure]

[0021] Figure 1 The system 1 shown for reducing motion sickness in vehicles is equipped on vehicle 100 (see reference). Figure 2 The vehicle 100 in this embodiment is a passenger vehicle capable of carrying multiple users, each of whom holds a communication terminal 200.

[0022] The system 1 for reducing motion sickness in vehicles includes: a sensor device 2, a content providing device 3, multiple seats 4, an information processing device 5, and multiple communication terminals 200.

[0023] <Sensor Device>

[0024] The sensor device 2 is configured to sense the riding status of multiple users riding in the vehicle 100. The "riding status" includes the acceleration experienced by the user and the user's posture.

[0025] Sensor device 2 has, for example Figure 2 The image shows an accelerometer 21 and multiple in-vehicle cameras 22. The accelerometer 21 is used to acquire the acceleration of the vehicle 100. The in-vehicle cameras 22 capture images of the postures of each user seated in the seat 4.

[0026] <Content providing device>

[0027] The content providing device 3 is configured to provide all content shared by multiple users within the vehicle 100.

[0028] As a content providing device 3, for example, a large screen or display can be used that can be visually viewed from all seats 4 inside the vehicle 100. The content providing device 3 plays all the content (e.g., movies, videos, and other moving images) determined by the information processing device 5.

[0029] <Seating>

[0030] Seat 4 is positioned in the space occupied by the user within the vehicle 100. The user of the vehicle 100 sits on any of the multiple seats 4.

[0031] Seat 4 has a control mechanism for controlling changes in posture (e.g., tilting), airflow, etc., as well as sensors such as pressure sensors and biometric data sensors. For example, the biometric data sensors acquire the user's heart rate.

[0032] Information processing device

[0033] The information processing device 5 is installed in the vehicle 100 and is configured to communicate with multiple communication terminals 200.

[0034] like Figure 1 As shown, the information processing device 5 includes an identification unit 51, a determination unit 52, a calculation unit 53, and a processing unit 54.

[0035] The information processing device 5 may be, for example, a computer equipped with a processor, storage media such as RAM and / or ROM, a communication unit, and an input / output unit. The information processing device 5 may be integrated into the ECU (Electronic Control Unit) of the vehicle 100. Furthermore, a portion of the information processing device 5 may also be installed as a server external to the vehicle 100 (i.e., ground equipment).

[0036] <Identification Department>

[0037] The identification unit 51 performs identification processing, in which it identifies the communication terminal 200 held by the user (i.e., assigned to the user) and confirms that the user holding the communication terminal 200 is riding in the vehicle 100.

[0038] Specifically, the identification unit 51 identifies the user's position (i.e., the seat 4 where the user is sitting) based on location information received from the communication terminal 200, images captured by the in-vehicle camera 22, and data acquired by the sensors of the seat 4. In addition to identifying the user's position while riding in the vehicle 100, the user's position is also identified at predetermined intervals during the movement of the vehicle 100.

[0039] <Determination Department>

[0040] The determination unit 52 performs content determination processing. In the content determination processing, based on the predetermined driving route of the vehicle 100 and the motion sickness data stored in multiple communication terminals 200, it determines the total content provided by the content providing device 3 from multiple playable contents.

[0041] Here, the vehicle 100 can be an autonomous vehicle that automatically travels along a predetermined route, or a manually driven vehicle driven by a driver along a predetermined route. In the case of an autonomous vehicle, there is no driver, so all passengers become the target of motion sickness reduction, thus easily achieving the effect of System 1 for reducing motion sickness in vehicles.

[0042] Specifically, the determining unit 52 predicts the magnitude of the swaying that will occur when driving along the predetermined driving route based on the historical acceleration records of previous driving along the predetermined driving route, wherein the historical acceleration records of previous driving along the predetermined driving route are stored in the database of the information processing device 5.

[0043] The determination unit 52 combines the predicted magnitude of the shaking with the following data to calculate the recommendation scores for each of the multiple content items. This data includes: each user's susceptibility to dizziness, the stimulation intensity of each of the multiple content items, and data based on each user's past viewing history. For example, the "stimulation intensity of the content" is calculated based on the amount of change, brightness, and type of structural elements (such as motion vectors) within the content.

[0044] The determining unit 52 determines the content with the highest recommended score among the multiple playable content as the entire content and instructs the content providing device 3 to play the entire content.

[0045] <Calculation Department>

[0046] The calculation unit 53 performs motion sickness level calculation processing during the movement of the vehicle 100. In the motion sickness level calculation processing, the calculation unit 53 uses motion sickness data stored in multiple communication terminals 200 and the riding status sensed by the sensor device 2 to calculate the motion sickness level of each of the multiple users.

[0047] "Susceptibility to motion sickness data" includes the user's age, gender, self-assessed level of susceptibility to motion sickness, and previous history of motion sickness. "Previous history of motion sickness" includes the riding conditions (specifically, vehicle acceleration and head acceleration) when motion sickness occurred and the predicted level of motion sickness at that time.

[0048] Specifically, in the motion sickness level calculation process, the calculation unit 53 first sends the riding status of the corresponding (i.e., the holder) user to each of the multiple communication terminals 200. The user's riding status includes, for example, vehicle acceleration, user's head acceleration, and user's posture.

[0049] The vehicle acceleration is acquired by the accelerometer 21. The user's head acceleration is calculated based on the image captured by the in-vehicle camera 22. The calculation unit 53 uses the cumulative values ​​of the power spectrum of the low-frequency region (e.g., above 0.2Hz and below 1Hz) of each of these accelerations over the past few minutes.

[0050] The user's posture is calculated based on images captured by the in-vehicle camera 22. The estimation unit 53 uses categorical variables for estimation, where the categorical variables are variables that represent the orientation of the user's face (i.e., the degree to which it is facing downwards) using several stages.

[0051] Next, the calculation unit 53 enables multiple communication terminals 200 to predict the motion sickness level of their respective users by using motion sickness data stored in the multiple communication terminals 200 and riding status data sent to the terminals 200.

[0052] That is, the calculation unit 53 sends calculation instructions to the multiple communication terminals 200, causing the multiple communication terminals 200 to input motion sickness data and riding status, and output motion sickness level. The calculation unit 53 obtains the motion sickness level predicted by each of the multiple communication terminals 200 as the calculation result of the motion sickness level of each user.

[0053] <Disposal Department>

[0054] The handling department 54 performs motion sickness reduction measures. In the motion sickness reduction measures, based on the motion sickness level calculated in the motion sickness level calculation process, motion sickness reduction measures are set separately for each of the multiple users.

[0055] Specifically, as a motion sickness reduction measure, the processing unit 54 switches from a mode where the content providing device 3 provides all content to multiple users to a mode where multiple communication terminals 200 provide individual content to multiple users respectively.

[0056] That is, if the motion sickness level of some users reaches or exceeds a predetermined threshold, the processing unit 54 instructs the content providing device 3 to stop playing all content. Furthermore, the processing unit 54 instructs multiple communication terminals 200 to play individual content.

[0057] In addition, as a motion sickness reduction measure, the processing unit 54 causes the communication terminal 200 of the plurality of communication terminals 200 corresponding to the user with a higher motion sickness level (i.e., the user whose motion sickness level is above the threshold) to perform a reminder to the user.

[0058] As a reminder to the user, for example, a display can be shown to urge the user to stop watching content and take a break. Additionally, individual content can be played and reminders can be given. As a reminder to the user, the communication terminal 200 can, for example, perform guidance control, including controls such as displaying directions that are less likely to cause motion sickness (e.g., upwards); and stopping the playback of individual content when the user faces a direction that is more likely to cause motion sickness (i.e., downwards).

[0059] The processing unit 54 or the communication terminal 200 determines the direction in which the user is prone to motion sickness based on the orientation of the communication terminal 200 detected by its gyroscope sensor and the direction of travel of the vehicle 100 detected by its accelerometer sensor. Then, the user's posture acquired by the in-vehicle camera 22 can be used to perform control for issuing reminders.

[0060] Furthermore, as a motion sickness reduction measure, the treatment unit 54 performs motion sickness mitigation control on the seat 4 occupied by the user with a higher level of motion sickness. Examples of motion sickness mitigation control include tilting the seat back backward or blowing air towards the user.

[0061] The handling department 54 does not perform the special handling measures such as reminders and motion sickness mitigation control as described above for users with low motion sickness levels (i.e., motion sickness levels that have not reached the threshold).

[0062] <Communication Terminal>

[0063] The communication terminal 200 is a portable computer equipped with storage media such as a processor, RAM and / or ROM, a communication unit, and an input / output unit.

[0064] The communication terminal 200 can be, for example, a smartphone, tablet computer, or laptop computer. Data is transmitted and received between the communication terminal 200 and the information processing device 5 via wireless communication. Examples of wireless communication methods include short-range wireless communication and wireless LAN.

[0065] The communication terminal 200 is equipped with a program (i.e., an application program) for using the system 1 for mitigating motion sickness. This program contains a judgment formula (i.e., a prediction model) for predicting the level of motion sickness. The communication terminal 200 uses the judgment formula and, based on the instructions of the information processing device 5, predicts the level of motion sickness.

[0066] A statistical formula for predicting motion sickness levels is pre-created, using the user's riding status and past motion sickness levels as explanatory variables (i.e., independent variables), and the user's current motion sickness level as a criterion variable. As mentioned above, the "user's riding status" used as an explanatory variable in the formula includes vehicle acceleration, the user's head acceleration, and the user's posture.

[0067] As a statistical method, multivariate analysis, supervised machine learning, or a combination of the above are used. In supervised machine learning, the user's motion sickness level is used as training data, and the aforementioned explanatory variables are used as input data for machine learning.

[0068] In the learning process, the machine learning circuit analyzes a large number of combinations of labeled explanatory variables (i.e., training data). The machine learning circuit learns features from the large amount of labeled data and constructs a judgment formula, whereby the features are used to classify combinations of explanatory variables into multiple labels (i.e., motion levels). Furthermore, the communication terminal 200 can be configured to receive updated judgment formulas in real time from a server not shown.

[0069] In addition, the communication terminal 200 stores motion sickness data of the assigned (i.e., the holder) user. When registering for use of the system 1 for alleviating motion sickness through the communication terminal 200 with the application installed, the user inputs the motion sickness data.

[0070] [1-2. Processing]

[0071] The following is for reference Figure 3 The flowchart illustrates an example of the processing performed by the information processing device 5.

[0072] In this process, the information processing device 5 first performs registration to confirm that the user has boarded the vehicle 100 (step S110). Registration is performed by identifying the communication terminal 200 held by the user who has previously registered (i.e., made a reservation).

[0073] After registration, the information processing device 5 initiates the movement of the vehicle 100 (step S120). If the vehicle 100 is in automatic driving mode, the information processing device 5 activates the driving control program. If the vehicle 100 is in manual driving mode, the information processing device 5 issues a driving instruction to the driver.

[0074] The information processing device 5 determines all the content provided by the content providing device 3 and plays it through the content providing device 3 (step S130). After the playback of all the content begins, the information processing device 5 works in conjunction with the communication terminals 200 of each user to calculate the motion sickness level of each user (step S140).

[0075] After calculating the motion sickness level, the information processing device 5 determines whether the motion sickness level of each user is above the threshold (step S150). When at least one user's motion sickness level is above the threshold (S150: Yes), the information processing device 5 performs motion sickness reduction measures corresponding to the user's motion sickness level (step S160). On the other hand, when there are no users whose motion sickness level is above the threshold (S150: No), the information processing device 5 does not perform motion sickness reduction measures.

[0076] After determining the motion sickness reduction measures, the information processing device 5 determines whether the vehicle 100 has reached its destination (step S170). When the vehicle 100 has reached its destination (S170: Yes), the information processing device 5 ends the processing. On the other hand, when the vehicle 100 has not reached its destination (S170: No), the information processing device 5 repeatedly executes the steps starting from calculating the motion sickness level (S140).

[0077] [1-3. Effects]

[0078] Based on the implementation methods detailed above, the following effects can be obtained.

[0079] (1a) It is possible to estimate the motion sickness level of multiple users riding in the vehicle 100 based on the motion sickness data of each user stored in the communication terminal 200. Therefore, it is possible to provide appropriate treatment corresponding to the motion sickness status of each user.

[0080] (1b) By predicting the level of motion sickness using motion sickness data in the communication terminal 200, the motion sickness level of each user can be estimated without providing the user's personal information to the information processing device 5. Therefore, personal information stored in the communication terminal 200 can be protected.

[0081] (1c) As a motion sickness reduction measure, the mode of providing all content is switched to a mode of providing individual content to multiple users, thereby switching from a mode of providing the same content to multiple users to a mode of providing individual content with reduced motion sickness. Therefore, it is possible to combine the function of providing a content sharing experience for multiple users with the function of reducing motion sickness.

[0082] (1d) The overall content is determined based on the predetermined driving route of the vehicle 100 and the motion sickness data. Thus, the overall content can be selected according to the shape of the predetermined driving route, the motion sickness of each user, etc. Therefore, the content providing device 3 can provide overall content that is less likely to cause motion sickness in multiple users.

[0083] (1e) As a motion sickness reduction measure, by having the communication terminal 200 remind the user, it is possible to promote the recovery of users with high motion sickness levels.

[0084] [2. Other Implementation Methods]

[0085] The embodiments of this disclosure have been described above. However, this disclosure is not limited to the above embodiments and can be implemented in various ways.

[0086] (2a) In the system for reducing motion sickness in vehicles described above, it is not necessary to predict the motion sickness level at the communication terminal. For example, the information processing device may receive motion sickness data from the communication terminal and use a judgment formula to calculate the motion sickness level.

[0087] (2b) In the system for reducing motion sickness in vehicles according to the above embodiments, the information processing device may also determine the total content provided by the content providing device without relying on the vehicle's predetermined driving route and motion sickness data.

[0088] Furthermore, the system for reducing motion sickness described in the above embodiments may also omit the content delivery device. That is, the motion sickness reduction system may be configured to provide content solely using individual communication terminals.

[0089] (2c) The system for reducing motion sickness in vehicles described above can also be applied to vehicles other than passenger cars, such as railway vehicles, ships, and aircraft.

[0090] (2d) The functions of one constituent element in the above embodiments can be shared by multiple constituent elements, or the functions of multiple constituent elements can be integrated into one constituent element. Furthermore, a portion of the structure of the above embodiments can be omitted. Additionally, at least a portion of the structure of the above embodiments can be added to the structure of other embodiments, or at least a portion of the structure of the above embodiments can be substituted with the structure of other embodiments. Furthermore, all embodiments of the technical concept defined by the statements in the claims are embodiments of this disclosure.

Claims

1. A system for alleviating motion sickness in vehicles, characterized in that, have: A sensor device configured to sense the riding status of multiple users riding in the vehicle within the vehicle; Multiple communication terminals, each of which is assigned to one of the multiple users; An information processing device is disposed in the vehicle and configured to communicate with the plurality of communication terminals; as well as A content providing device configured to provide all content shared by the plurality of users within the vehicle, and The sensor device includes an in-vehicle camera. The riding status includes the individual postures of the multiple users calculated based on images captured by the in-vehicle camera. The plurality of communication terminals are configured to store the dizziness susceptibility data of users assigned to the communication terminals. The information processing device is configured to perform motion sickness level calculation and motion sickness reduction procedures, wherein... The information processing device performs motion sickness level estimation processing during the movement of the vehicle. In the motion sickness level estimation processing, the information processing device uses the motion sickness data stored in the plurality of communication terminals and the riding status sensed by the sensor device to estimate the motion sickness level of each of the plurality of users. In the motion sickness reduction process, the information processing device sets motion sickness reduction measures for each of the multiple users based on the calculated motion sickness level. The information processing device is configured such that, in the motion sickness level calculation process, when it is calculated that the motion sickness level of a portion of users reaches or exceeds a predetermined threshold, the mode of providing all content to the multiple users by the content providing device is switched to a mode where the multiple communication terminals provide individual content to the multiple users respectively. For users whose motion sickness level reaches or exceeds the threshold, in the motion sickness reduction process, when the user's posture calculated from the image is used to determine that the user is facing a direction that is prone to causing motion sickness, the communication terminal corresponding to that user executes a reminder to that user as a motion sickness reduction measure for that user. The reminder includes: displaying a direction that is less likely to cause motion sickness to the user; or stopping the playback of the individual content to the communication terminal corresponding to the user when the user is facing the direction that is likely to cause motion sickness.

2. The system for reducing motion sickness in vehicles according to claim 1, characterized in that, The information processing device is configured to, in the motion sickness level prediction process, send the riding status of the user corresponding to each of the plurality of communication terminals to the plurality of communication terminals respectively, and enable the plurality of communication terminals to predict the motion sickness level of the user corresponding to each of the plurality of communication terminals using the motion sickness susceptibility data and the riding status.

3. The system for reducing motion sickness in vehicles according to claim 2, characterized in that, The information processing device is configured to further perform a content determination process, in which the information processing device determines the total content provided by the content providing device based on the vehicle's predetermined travel route and the motion sickness data stored in the plurality of communication terminals.

4. An information processing device for alleviating motion sickness in vehicles, characterized in that, The information processing device is installed in a vehicle, and is configured to communicate with multiple communication terminals respectively assigned to multiple users riding in the vehicle, and a content providing device configured to provide all content shared by the multiple users within the vehicle. The information processing device is configured to perform motion sickness level calculation and motion sickness reduction procedures, wherein... The information processing device performs the motion sickness level estimation process during the movement of the vehicle. In the motion sickness level estimation process, the information processing device uses the motion sickness data of the users stored in the plurality of communication terminals and the riding status of the plurality of users sensed in the vehicle to estimate the motion sickness level of each of the plurality of users. In the motion sickness reduction process, the information processing device sets motion sickness reduction measures for each of the multiple users based on the calculated motion sickness level. The riding state includes the individual postures of the multiple users calculated based on images taken in the vehicle. The information processing device is configured such that, in the motion sickness level calculation process, when it is calculated that the motion sickness level of a portion of users reaches or exceeds a predetermined threshold, the mode of providing all content to the multiple users by the content providing device is switched to a mode where the multiple communication terminals provide individual content to the multiple users respectively. For users whose motion sickness level reaches or exceeds the threshold, in the motion sickness reduction process, when the user's posture calculated from the image is used to determine that the user is facing a direction that is prone to causing motion sickness, the communication terminal corresponding to that user executes a reminder to that user as a motion sickness reduction measure for that user. The reminder includes: displaying a direction that is less likely to cause motion sickness to the user; or stopping the playback of the individual content to the communication terminal corresponding to the user when the user is facing the direction that is likely to cause motion sickness.

Images