Vehicle, system and method for reducing motion disease of occupants of a moting vehicle

Abstract

The present invention relates to a system for reducing motion sickness of a passenger of a moving vehicle, comprising: (i) an image providing device configured to provide a dynamic image characterized by a parameter to a projection device; (ii) means configured to provide a first signal to the evaluation unit; (iii) an evaluation unit configured to assign the first signal to a class in a predetermined class group; (iv) the image providing device is further configured to receive a second signal representing the assigned category from the evaluation unit; (v) the image providing device is further configured to adjust a parameter of the moving image according to the assigned category; (vi) a projection device configured to project the adjusted dynamic image to an interior surface of the vehicle, where the interior surface is located at least partially within a field of view of the passenger.

Description

Technical Field

[0001] The present invention relates to a vehicle, system and method, particularly a computer-implemented method, for reducing motion sickness of passengers of a moving vehicle. Background Art

[0002] Motion sickness (motion sickness) is a serious problem for many passengers. Motion sickness can be the result of a conflict or mismatch in the human perceptual system, where information from the vestibular system does not match information from the visual system. This occurs when a passenger's body is exposed to physical motion (e.g., changes in direction, speed, acceleration, vibration, etc.) but the passenger does not adequately observe any visual motion at the same time. Motion sickness can occur, in particular, for passengers in the rear seats who do not have a good view of the road and scenery moving in front of them. For these passengers, motion sickness can occur when they are reading a book or watching content on a display in front of them. In this case, the passenger's eyes are fixed on a static book or display, while their vestibular system perceives body motion (i.e., from motion associated with the vehicle's motion, such as forces generated by acceleration, deceleration, cornering, etc.). Other senses, such as touch, smell, and / or temperature, can also play a role in this effect.

[0003] In vehicles, there is a trend for displays in vehicles to become larger and better. This trend is driven by consumers’ desire for enhanced entertainment / information features and digital life integration. This is driven by advances in technologies such as displays, 5G, and processors, as well as factors such as technology maturity, automotive-grade readiness, and cost reduction.

[0004] However, larger displays may even further reduce the passenger's view of the road or scenery, which may increase motion sickness. On the other hand, motion sickness may prevent vehicle occupants from using large displays or enjoying activities or tasks such as reading, watching movies, or using smart devices (such as smartphones, tablets, or laptops) while the vehicle is in motion. Summary of the invention

[0005] The object of the present invention is to reduce motion sickness among passengers of a moving vehicle.

[0006] The solution to this problem is provided by the teaching of the independent claims. Various preferred embodiments of the invention are provided by the teaching of the dependent claims.

[0007] A first aspect of the present invention relates to a system for reducing motion sickness of passengers of a moving vehicle, comprising: (i) an image providing device, which is configured to provide a dynamic image characterized by parameters to a projection device; (ii) a device configured to provide a first signal to an evaluation unit; (iii) an evaluation unit, in particular an electronic unit including an evaluation algorithm, which is configured to assign the first signal to a category in a predetermined group of categories; (iv) the image providing device is also configured to receive a second signal representing the assigned category from the evaluation unit; (v) the image providing device is also configured to adjust the parameters of the dynamic image according to the assigned category; (vi) a projection device, in particular DLP, LCOS, LCD, microdisplay, laser-based projection device, LED, etc., which is configured to project the adjusted dynamic image onto an inner surface of the vehicle, wherein the inner surface is at least partially located in the field of view of the passenger.

[0008] When the word "comprises" or "comprising" is used in the present description and claims, it does not exclude other elements or steps. Where an indefinite or definite article is used when referring to a singular noun, for example "a", "an", "the", this includes a plural form of that noun unless otherwise stated.

[0009] In addition, unless expressly stated otherwise, "or" refers to an inclusive or, not an exclusive or. For example, condition A or B is satisfied by any of the following conditions: A is true (or exists) and B is false (or does not exist), A is false (or does not exist) and B is true (or exists), and both A and B are true (or exist).

[0010] As used herein, the terms "a" and "an" mean "one or more." The terms "another" and "another" and any other variations thereof should be understood to mean "at least another."

[0011] The word "plurality" as used herein should be understood to mean "two or more".

[0012] The terms "configured" or "set" to perform a certain function (and their respective variants) are to be understood in the sense of the present invention as meaning that the corresponding device is already present in a configuration or setting in which it can perform the function or at least is adjustable (i.e. configurable) to be able to perform the function after corresponding adjustments. In this case, the configuration can be performed, for example, by means of corresponding settings of parameters of a process sequence or switches etc., to enable or deactivate the function or setting. In particular, the device can have several predefined configurations or operating modes, so that the configuration can be performed by selecting one of these configurations or operating modes.

[0013] Therefore, the system of the first aspect can reduce or eliminate motion sickness or motion sickness symptoms by making the passenger's sensory system input better coordinated / consistent. This can be achieved by providing a dynamic image via a projection to the passenger, and wherein the dynamic image is adjusted according to the assigned category. This means that even if the passenger does not see the surrounding environment of the street, traffic or vehicle when the vehicle is moving, the passenger can still watch the dynamic image by projecting the dynamic image onto the inner surface of the vehicle. This is particularly effective because the projection device is configured to project an adjusted dynamic image. The dynamic image is adjusted according to the assigned category, wherein the category is assigned according to the first signal of the device. In this way, the mismatch in the human sensory system (wherein the information from the vestibular system does not match the information from the visual system) can be reduced, and possible motion sickness can be reduced. The motion sickness of the passenger can affect the driver and reduce driving safety, for example, by the passenger's explicit expression of discomfort, the expectation of emergency parking, the smell coming from, or the stench of vomit. By reducing the motion sickness of the passenger, driving safety can also be improved.

[0014] In the following, certain preferred embodiments of the method will be described, which embodiments may be arbitrarily combined with each other or with other aspects of the invention, unless such a combination is explicitly excluded or technically impossible.

[0015] In some embodiments, the device includes a display device, in particular an LCD or OLED-based screen, and the first signal includes graphic content that can be displayed by the display device. This enables the dynamic image to be adjusted according to a specified category of the graphic content. To this end, the graphic content to be displayed by the display device is evaluated by an evaluation unit. The category may include movies, freeze frames, visual games and / or text. Subcategories may even be action films or documentaries. Other categories may include physical properties of the displayed image, such as color or contrast. In the case where the graphic content provides a movie, the dynamic image may move at a faster rate than in the case where the graphic content provides a single freeze frame. As a result, the visual content received by the passenger through the display device is combined with the visual content received through the projection, which can further reduce or prevent motion sickness of the passenger.

[0016] In some embodiments, the device comprises a first sensor, in particular an acceleration sensor and / or a speed sensor, and the first signal comprises a third signal representing the movement of the vehicle, in particular a signal regarding speed, acceleration / deceleration and / or a change of direction, and wherein the third signal can be received by the first sensor. Different movement dynamics can represent different categories. The movement and type of movement of the vehicle can be perceived by the passenger, in particular by the vestibular system. By adjusting the dynamic image according to the movement of the vehicle, the mismatch in the human perception system (wherein the information from the vestibular system does not match the information from the visual system) can be further reduced, and motion sickness can be further reduced.

[0017] In some embodiments, the device includes a second sensor, in particular an electro-optical and / or electro-acoustic sensor, the first signal includes a fourth signal representing the surroundings of the vehicle, and wherein the fourth signal is received by the second sensor. Rapid changes in the surroundings of the vehicle can lead to different light conditions and different patterns visible through the windows, which can also cause motion sickness. Dynamic images adapted to the surroundings can reduce this effect. For example, if the vehicle is about to enter a tunnel and the vehicle has passed an area with trees before the tunnel, the adjusted dynamic image can include some bright lights, including dynamic images of the passing trees, thereby reducing the visual differences perceived by passengers when the vehicle enters the tunnel. This can further reduce motion sickness.

[0018] In some embodiments, the system comprises a third sensor, in particular an electro-optical and / or electro-acoustic sensor, configured to receive a fifth signal, the fifth signal representing at least a portion of the passenger's head, in particular at least a portion of the face, in particular the eyes and / or the mouth, wherein the evaluation unit is configured to determine the state of the head based on the received fifth signal, and wherein the evaluation unit is further configured to assign a category based on the determined head state. Image information representing the passenger's head can be received by a camera of the car. This information can be processed with known algorithms for facial recognition and / or for fatigue recognition to determine the head state. The determined state can then be assigned to a category. If the state is that the passenger is sleeping or busy on the phone, it may not be necessary to project a dynamic image. If the state is that the passenger's line of sight is towards the display device, the projection of the dynamic image can reduce motion sickness. If the state is that the head is bent downward at a certain angle, which indicates that the passenger is reading, different adjustments can be applied to the dynamic image compared to viewing graphic content on the display, thereby further reducing motion sickness.

[0019] In some embodiments, the projection device is arranged / aligned so that the projection is directed toward the display device so that the projection at least partially covers the surface of the display device displaying the graphical content or the frame of the surface. This can ensure that the passenger perceives the dynamic image and the content of the display device because both can be seen in the area of ​​the display device. This can also make the field of view required for the passenger to perceive both smaller, and the perception of the dynamic image is improved because the dynamic image is more centered in the field of view.

[0020] In some embodiments, the image providing device is configured to generate dynamic images by an algorithm. This can achieve more flexible adaptation of dynamic images, wherein dynamic images can be generated according to individual needs.

[0021] In some embodiments, the image providing device comprises a storage medium on which the dynamic image is stored, in particular a storage located on the vehicle or a storage accessible via a wireless network. This can achieve a solution that requires little computing power, since no dynamic image needs to be generated.

[0022] In some embodiments, the system includes a plurality of projection devices arranged so that the projections are projected in mutually different directions. This may allow a larger projection area to be covered. This may ensure that passengers can see the projected content even if they are looking in different directions. It may also be possible to project different dynamic images with each projection device so that the projections may provide a combined effect.

[0023] In some embodiments, the image providing device is configured to provide 3D dynamic images and / or virtual reality dynamic images and / or augmented reality dynamic images. Compared with 2D dynamic images, these types of dynamic images can be more realistic and can improve the reduction of motion sickness. For example, augmented reality (AR) images can be viewed with AR glasses, which display dynamic images within the user's overall field of view to reduce motion sickness, but not on a large display (or any display in the vehicle cabin). In addition, the AR position and orientation tracking system can enable the dynamic image to be positioned in a 3D virtual environment that is coordinated / consistent with the interior of the vehicle, for example, when the passenger moves away (changes the head / viewing orientation), the passenger can still perceive the dynamic image, and the physical cover of the display is correct in space.

[0024] In some embodiments, the system comprises a control unit configured to receive data representing the status and / or content of other display devices, in particular door compartments or other devices configured to display graphical content, wherein the control unit is further configured to coordinate so that the projection can be masked for the other display devices or the projection includes a portion of the other display devices. This can create a coordinated impression of the visual information perceived by the passenger, thereby reducing motion sickness.

[0025] In some embodiments, the image providing device is further configured to adjust parameters according to a stored user profile of the passenger. This can allow the adjusted dynamic images to be provided more efficiently. There may be passengers who are more susceptible to motion sickness than others. If the passenger does not have motion sickness, it may not be necessary to project dynamic images in this regard, which can save computing power and avoid the impact of the projected dynamic images on other passengers. If the passenger may be strongly affected by motion sickness, the adjustment of the dynamic images will be more closely related to the specific needs of the passenger. For example, if the passenger is particularly sensitive to changes in direction, projection can be enabled only when such changes in direction occur. This can reduce motion sickness more effectively and individually.

[0026] In some embodiments, the image providing device is further configured to adjust the parameters of the dynamic image and to provide the dynamic image to the projection device continuously in real time while the vehicle is in motion. This enables adjustments to be made according to the current first signal which may change over time. For example, the dynamic image can continuously adapt the display color of the display device at any time. In addition, the system can evaluate the video signal provided to the display or the video signal of the digital medium streamed to the evaluation unit. Performing real-time continuous adjustments can further reduce motion sickness, because the currently projected dynamic image is better adapted to the current situation than the adjusted signal related to the previous situation.

[0027] A second aspect of the invention relates to a vehicle comprising the system of the first aspect.

[0028] A third aspect of the present invention relates to a method, in particular a computer-implemented method, comprising the following steps: (i) providing a first signal by a device to an evaluation unit; (ii) assigning the first signal to a category in a predetermined category group by the evaluation unit; (iii) adjusting the provided dynamic image according to the assigned category; and (iv) projecting the adjusted dynamic image onto an interior surface of a vehicle, wherein the interior surface is at least partially within the field of view of a passenger.

[0029] The various embodiments and advantages described above in conjunction with the first aspect of the present invention are similarly applicable to the other aspects of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Other advantages, features and applications of the present invention are provided in the following detailed description and accompanying drawings, in which:

[0031] Figure 1 schematically illustrates a vehicle having an embodiment of the system of the present invention; and

[0032] Figure 2 A flow chart illustrating an exemplary method of the present invention is schematically shown.

[0033] In the drawings, the same reference numerals are used for identical or mutually corresponding elements of the present invention described herein. Specific embodiments

[0034] Figure 1 A vehicle 100 having an embodiment of the system of the present invention is schematically shown. In the interior of the vehicle 100, a display device 110 is arranged on the back of the front seats so that a passenger 195 sitting on the rear seat can view the content displayed on the display device 110, in particular the graphic content. The display device 110 is connected to an evaluation unit 120 via a cable connection and / or a wireless connection. The evaluation unit 120 can receive signals from the display device 110, and the signals can be evaluated at the evaluation unit 120. These signals include information about the graphic content. The evaluation process includes assigning a first signal (i.e., the graphic content) to a category in a predetermined group of categories. The category may include movies, freeze frames, visual games, and / or text. Subcategories may even be action films or documentaries. Other categories may include physical properties of the displayed image, such as color or contrast. In the case where the graphic content provides a movie, the dynamic image may move at a faster rate than in the case where the graphic content provides a single freeze frame. As a result, the visual content received by the passenger 195 through the display device 110 is combined with the visual content received through the projection, and motion sickness of the passenger 195 can be reduced or prevented.

[0035] The system further comprises an image providing device 130, which is connected to the evaluation unit 120 and the projection device 140 via a cable connection and / or a wireless connection, so that signals can be exchanged between the image providing device 130 and the evaluation unit 120 on the one hand and with the projection device 140 on the other hand. The image providing device 130 may comprise a computer with a storage medium 160 and a program or algorithm. The image providing device 130 is configured to provide dynamic images. The dynamic images can be stored in the storage medium 160 and / or the dynamic images can be generated by an algorithm. If the dynamic images are stored, the dynamic images can be selected and used according to the assigned categories. If the dynamic images are generated by the algorithm, the dynamic images are generated according to the assigned categories.

[0036] Once the dynamic image is adjusted by the image providing device 130 , the image providing device 130 provides the adjusted dynamic image to the projection device 140 .

[0037] The projection device 140 is configured to project the received adjusted dynamic image onto the interior surface 150 of the vehicle 100. The projection device 140 is arranged and / or oriented so that the dynamic image projected by the projection device 140 is at least partially within the field of view of the passenger 195 who is viewing the graphical content of the display device 110. Figure 1In the embodiment, the passenger 195 is located on the right rear seat and faces the display device 110 arranged on the back of the front seat. The field of view of the passenger 195 is represented by an angle α. However, in reality, the field of view may be larger depending on the individual. The projection device 140 projects the dynamic image toward the inner surface 150 on the left rear side, so that the passenger 195 who views the display device 150 in an inclined direction can also view the dynamic image. The system may also include a plurality of projection devices 140 (not shown here), which are arranged so as to project the projections in mutually different directions.

[0038] Furthermore, the system includes a first sensor 180 for receiving a signal representing the movement of the vehicle, and the dynamic image may be adjusted according to the movement of the vehicle.

[0039] The system also includes a second sensor 185 for receiving a signal representative of the vehicle's surroundings, and the dynamic image may be adjusted based on the vehicle's surroundings.

[0040] The system also includes a third sensor 190 configured to receive a signal representing at least a portion of the passenger's head, wherein the evaluation unit is configured to determine a state of the head based on the received fifth signal, and wherein the evaluation unit is further configured to assign a category based on the determined head state, and the dynamic image can be adjusted based on the head state.

[0041] The system may also not include any one or more of the first sensor 180 , the second sensor 185 , and the third sensor 190 .

[0042] The system may further include a control unit 170 configured to receive data representing a status and / or content of other display devices configured to display graphical content, wherein the control unit is further configured to coordinate such that the projection may be masked for the other display devices or the projection includes a portion of the other display devices.

[0043] At least two of the image providing device 130 , the evaluation unit 120 and the control unit 170 may be integrated into one device.

[0044] The system can reduce or eliminate motion sickness or motion sickness symptoms by better coordinating / aligning the sensory system inputs of the occupant 195. This means that even if the occupant 195 is not observing the street, traffic, or the surrounding environment of the vehicle 100 while the vehicle 100 is in motion, the occupant 195 is still provided with dynamic images by projecting the dynamic images onto the interior surfaces 150 of the vehicle 100.

[0045] Figure 2 A flow chart 200 is schematically shown, which illustrates an exemplary method for reducing motion sickness of an occupant 195 of a moving vehicle 100, comprising the following steps:

[0046] A first step 210 of the method comprises providing a first signal by the device 110 to the evaluation unit 120 .

[0047] A further step 220 of the method comprises assigning the first signal by the evaluation unit 120 to a class from a predetermined group of classes.

[0048] Another step 230 of the method comprises adjusting the provided dynamic image according to the assigned category;

[0049] Another step 240 of the method includes projecting the adjusted dynamic image onto an interior surface 150 of the vehicle 100 , wherein the interior surface 150 is at least partially within the field of view of the passenger.

[0050] Although at least one exemplary embodiment of the present invention has been described above, it must be noted that there are many variations thereto. In addition, it should be understood that the described exemplary embodiments only illustrate non-limiting examples of how to implement the present invention and are not intended to limit the scope, application, or configuration of the apparatus and methods described herein. On the contrary, the foregoing description will provide those skilled in the art with a configuration for implementing at least one exemplary embodiment of the present invention, wherein it must be understood that various changes may be made to the functionality and arrangement of elements of the exemplary embodiments without departing from the subject matter defined by the appended claims and their legal equivalents.

[0051] Reference numerals list

[0052] 100 vehicles

[0053] 110 Display device

[0054] 120 evaluation units

[0055] 130 Image providing device

[0056] 140 Projection Device

[0057] 150Inner surface

[0058] 160 Storage Media

[0059] 170 control unit

[0060] 180, 185, 190 1st, 2nd and 3rd sensors

[0061] 195 passengers

[0062] 200 is a flowchart showing an exemplary method of the present invention.

[0063] 210 provides the first signal

[0064] 220 Assigning the first signal to a category

[0065] 230 Adjust the dynamic image provided

[0066] 240 Projection of adjusted dynamic images

[0067] α Field of view

Claims

1. A system for reducing motion sickness of a passenger (195) of a moving vehicle (100), the system comprising: An image providing device (130) configured to provide a dynamic image characterized by parameters to a projection device (140); A device (110) configured to provide a first signal to an evaluation unit (120); An evaluation unit (120) configured to assign the first signal to a category of a predetermined group of categories; The image providing device is further configured to receive a second signal representing the assigned category from the evaluation unit (120); The image providing device (130) is further configured to adjust parameters of the dynamic image according to the assigned category; A projection device (140) is configured to project the adjusted dynamic image onto an interior surface (150) of the vehicle (100), wherein the interior surface (150) is at least partially located within the field of view of a passenger (195).

2. The system according to claim 1, wherein: The device comprises a display device (110), and the first signal comprises graphical content displayable by the display device (110).

3. The system according to claim 1 or 2, wherein: The device comprises a first sensor (180), and the first signal comprises a third signal representing the movement of the vehicle (100), and the third signal can be received by the first sensor (180).

4. The system according to any one of claims 1 to 3, wherein: The device (110) includes a second sensor (185), and the first signal includes a fourth signal representing the surroundings of the vehicle (100), and the fourth signal is received by the second sensor (185).

5. A system according to any of the preceding claims, comprising a third sensor (190) configured to receive a fifth signal representing at least a portion of a head of a passenger (195), and an evaluation unit (120) configured to determine a state of the head based on the received fifth signal, and the evaluation unit (120) is further configured to assign a category based on the determined state of the head.

6. A system according to any one of claims 2 to 5, wherein: The projection device is arranged such that the projection is directed toward the display device (110), so that the projection at least partially covers the surface of the display device (110) displaying the graphic content or a frame of the surface.

7. A system according to any one of the preceding claims, wherein: The image providing device (130) is configured to generate the dynamic image through an algorithm.

8. A system according to any one of the preceding claims, wherein: The image providing device (130) comprises a storage medium (160) on which the dynamic image is stored.

9. The system according to any of the preceding claims, comprising a plurality of projection devices (140) arranged such that the projections are projected in mutually different directions.

10. A system according to any one of the preceding claims, wherein: The image providing device (130) is configured to provide 3D dynamic images and / or virtual reality dynamic images and / or augmented reality dynamic images.

11. A system according to any of the preceding claims, the system comprising a control unit (170) configured to receive data representing the status and / or content of other display devices (110) configured to display graphical content, wherein the control unit is further configured to coordinate so that a projection can be masked for the other display device (110) or so that the projection includes a portion of the other display device (110).

12. A system according to any one of the preceding claims, wherein: The image providing device (130) is further configured to adjust the parameters according to a stored user profile of the passenger.

13. The system (100) according to any one of the preceding claims, wherein: The image providing device (130) is also configured to adjust the parameters of each dynamic image and to provide the dynamic image to the projection device (140) continuously and in real time when the vehicle (140) is moving.

14. A vehicle (100) comprising a system according to any one of the preceding claims.

15. A method for reducing motion sickness of a passenger of a moving vehicle (100), the method comprising the steps of: A device provides a first signal to an evaluation unit (120); Assigning the first signal to a class from a predetermined group of classes by an evaluation unit (120); adjusting the provided dynamic image according to the assigned category; The adjusted dynamic image is projected onto an interior surface (150) of the vehicle (100), wherein the interior surface (150) is at least partially within the field of view of a passenger (195).

Images