METHOD, DEVICE AND COMPUTER PROGRAM PRODUCT FOR THE RELIEF OF MOTION SICKNESS IN A USER VIEWING AN PICTURE ON A DISPLAY

By generating a virtual screen and dynamically adjusting the image position on display devices to align with user movement, the method addresses motion sickness caused by sensory conflicts, enhancing user comfort and safety.

DE112022006166T5Pending Publication Date: 2024-11-14SONY EUROPE BV +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
DE112022006166
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-12-23
Filing Date
2022-11-25
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Motion sickness occurs when there is a conflict between sensory information, such as the perceived motion from traveling and the visual content on a display device, leading to discomfort and potential safety hazards, especially in environments like vehicles.

Method used

A method and apparatus that generates a virtual screen at a greater distance from the user, dynamically adjusting the image position on the display device to align with the user's movement relative to this virtual screen, reducing the discrepancy between sensory inputs.

Benefits of technology

This approach reduces the feeling of motion sickness by aligning visual and sensory perceptions, allowing safer and more comfortable use of display devices in various environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The present disclosure provides a method for alleviating motion sickness in a user viewing an image on a display, the method comprising: displaying an image on a display device, the display device being located at a first distance from a user viewing the image on the display device; generating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, the distance of the second position from the user being greater than the first distance; detecting movement of the user and the display device to a new position relative to the virtual screen; determining a new image position by projecting a line from the position of the virtual screen to the new position of the user;and displaying an image on the display device at the new image position for at least a part of the image for which the new image position overlaps with the display device.
Need to check novelty before this filing date? Find Prior Art

Description

STATE OF THE ARTField of the disclosure

[0001] The present invention relates to a method, apparatus and computer program product for alleviating motion sickness in a user viewing an image on a display. Description of the state of the art

[0002] The "Background" description provided herein is intended to provide a general context for the disclosure. Work by the presently named inventors to the extent described in the Background section, as well as aspects of the description that could not otherwise be considered prior art at the time of filing, are not expressly or impliedly incorporated as prior art to the present invention.

[0003] Display devices are used in a variety of electronic devices to show information to the user. A display device can be found, for example, in electronic devices such as mobile phones, personal computers, laptops, tablet computers, and the like. The display device (e.g., a display screen) is used to show various types of images to the user. These images may correspond to specific information that is to be made available to the user (e.g., information containing certain messages or notifications). Alternatively, the images may also relate to digital content such as films, television programs, computer games, or the like. Since display devices are now required by a variety of electronic devices, the use of display devices has become increasingly common in various environments, such as when traveling.For example, a user may use a display device to view digital content while walking to a destination, traveling in a vehicle such as a car, flying in an airplane, or the like. However, using a display device in such environments may result in conflicting sensory information being delivered to the user, which may lead to a feeling of motion sickness. This is because there may be a conflict between the user's sense of movement while traveling and the visual content seen on the display device. In some cases, this motion sickness may even prevent the user from using the display device. Accordingly, important information, such as warnings or messages, may be missed by a user suffering from motion sickness.

[0004] These problems are further exacerbated in autonomous or semi-autonomous vehicles, such as an autonomous or semi-autonomous car. In this case, the occupants of the autonomous or semi-autonomous car may use a display device to view digital content while the car is driving in autonomous mode. However, because passengers have no control over the vehicle, they may experience motion sickness due to the disconnect between their own sense of movement and their attention (e.g., what they see and hear). Furthermore, such a vehicle may require a designated passenger to transition from being a passenger to being an active driver (e.g., when traffic, the environment, or the situation warrants). In such a case, the passenger who becomes the active driver may experience motion sickness at a time when they should be driving again.If the passenger suffers from motion sickness, it may be difficult for them to take control of the car. This can be dangerous for the car and other road users.

[0005] The purpose of the present disclosure is to solve these problems, although the disclosure may also solve other problems. SUMMARY:

[0006] A brief summary of the present disclosure is provided below to provide a basic understanding of certain aspects of the present disclosure.

[0007] In a first aspect of the present disclosure, a method for alleviating motion sickness in a user viewing an image on a display is provided, the method comprising: displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; generating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, the distance of the second position from the user being greater than the first distance; detecting movement of the user and the display device to a new position relative to the virtual screen; determining a new image position by projecting a line from the position of the virtual screen to the new position of the user;and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device;

[0008] In a second aspect of the present disclosure, an apparatus for alleviating motion sickness in a user viewing an image on a display is provided, the apparatus comprising circuitry configured to: display an image on a display device, the display device being at a first distance from a user viewing the image on the display device; generate a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, the distance of the second position from the user being greater than the first distance; detecting movement of the user and the display device to a new position relative to the virtual screen; determining a new image position by projecting a line from the position of the virtual screen to the new position of the user;and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device;

[0009] In a third aspect of the present disclosure, a computer program product is provided that includes instructions that, when implemented by a computer, cause the computer to perform a method for alleviating motion sickness in a user viewing an image on a display, the method comprising: displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; generating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, the distance of the second position from the user being greater than the first distance; detecting movement of the user and the display device to a new position relative to the virtual screen;Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device.

[0010] Further embodiments of the present disclosure are defined in the appended claims.

[0011] According to embodiments of the disclosure, a reduction in the conflict between the sensory information provided to a user when viewing an image on a display can be achieved, which reduces the user's sense of motion experience. This allows display devices to be used more safely in a variety of environments. The present disclosure is not limited to these advantageous technical effects. Other technical effects may become apparent to those skilled in the art upon reading the disclosure.

[0012] The foregoing paragraphs are provided as a general introduction and are not intended to limit the scope of the following claims. The described embodiments, as well as other advantages, can best be understood by reference to the following detailed description in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS:

[0013] A more complete understanding of the disclosure and many of the attendant advantages will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings, in which: Fig. 1 illustrates an example of a device consistent with the embodiments described in the disclosure; Fig. 2 illustrates an example of motion sickness in accordance with embodiments of the disclosure; Fig. 3 illustrates an example configuration of a device in accordance with embodiments of the disclosure; Fig. 4 illustrates an example of generating a virtual screen in accordance with embodiments of the disclosure; Fig. 5 illustrates an example of determining a new image position in accordance with embodiments of the disclosure; Fig. 6 illustrates an example of a situation in which embodiments of the disclosure may be applied; Fig. 7 illustrates an example of a situation in which embodiments of the disclosure may be applied; Fig. 8 illustrates an example of a situation in which embodiments of the disclosure may be applied; Fig. 9 illustrates an example method in accordance with embodiments of the present disclosure; Fig. 10 illustrates an example configuration of a device in accordance with embodiments of the disclosure; Fig. 11 illustrates an example of travel in accordance with embodiments of the disclosure; Fig. 12 illustrates an example timeline according to embodiments of the disclosure; Fig. 13 illustrates an example of content with different features according to embodiments of the disclosure; Fig. 14 illustrates an example timeline according to embodiments of the disclosure; Fig. 15 illustrates an example method in accordance with embodiments of the disclosure. DESCRIPTION OF THE EMBODIMENTS:

[0014] Reference is now made to the drawings, in which like reference numerals designate identical or corresponding parts throughout the several views.

[0015] In Fig. 1 illustrates a device 1000 according to embodiments of the disclosure. Typically, a device 1000 according to embodiments of the disclosure is a computing device, such as a personal computer or a terminal connected to a server. In certain cases, the device may also be a server. The device 1000 is controlled via a microprocessor or other processing circuit 1002. In some examples, the device 1000 may be a portable computing device, such as a mobile phone, a laptop, a tablet computer, or the like.

[0016] Processing circuitry 1002 may be a microprocessor that executes computer instructions or an application-specific integrated circuit. The computer instructions are stored on a storage medium 1004, which may be a magnetically readable medium, an optically readable medium, or a solid-state circuit. Storage medium 1004 may be integrated with device 1000 or separate from device 1000 and connected thereto via either a wired or wireless connection. The computer instructions may be embodied as computer software containing computer-readable code that, when loaded into processor circuitry 1002, configures processor circuitry 1002 to perform a method according to embodiments of the disclosure.

[0017] Additionally, an optional user input device 1006 is shown connected to processing circuitry 1002. User input device 1006 may be a touchscreen or a mouse- or pen-type input device. User input device 1006 may also be a keyboard or any combination of these devices.

[0018] A network connection 1008 may optionally be connected to the processor circuit 1002. The network connection 1008 may be a connection to a local area network or a wide area network such as the Internet or a virtual private network, or the like. The network connection 1008 may be connected to a server that allows the processor circuit 1002 to communicate with another device to obtain or provide relevant data. The network connection 1002 may be behind a firewall or other form of network security.

[0019] Additionally, a display device 1010 is connected to the processing circuit 1002. While the display device 1010 is integrated into the device 1000, it may also be separate from the device 1000 and may be a monitor or other type of device that allows the user to visualize the operation of the system. Furthermore, the display device 1010 may be a projector or other device that allows relevant information generated by the device 1000 to be viewed by the user or a third party. The display device may also be any type of display screen (e.g., an LED screen, OLED screen, or the like) or, alternatively, a headset, such as a virtual reality (VR) or augmented reality (AR) display device.A display device within the meaning of the present disclosure is therefore any device with which relevant images and information can be viewed by the user or by third parties.

[0020] As explained in the background, displays can now be found in a wide variety of electronic devices, which means that displays are being used in an increasing number of environments and situations. These environments and situations may include using the display while traveling (i.e., moving from one place to another). However, motion sickness (including, but not limited to, symptoms of nausea and / or balance problems) can occur in a user (i.e., any person) while traveling. Motion sickness often arises from a conflict of sensory impressions. That is, humans maintain their sense of balance using signals from many different sensory organs and body parts. These include signals from the person's eyes and inner ear. Conflicts between these feelings can occur while traveling.During a train journey, for example, a person's inner ears can perceive the train's movement, but their eyes are unable to see any signs of that movement (because the interior of the train remains fixed or immobile with respect to the passenger). Therefore, a person may experience motion sickness due to this conflict between their senses. In fact, viewing an image on a screen while traveling may increase the feeling of motion sickness. This is because further conflicts may arise between the images displayed on the screen and the person's other senses (e.g., the inner ear's sense of movement). In these environments and situations, it may be difficult to use display devices. However, the use of display devices is often desirable even while traveling. This may be for safety-critical information, navigation information, entertainment, or business purposes.Therefore, it is desirable to reduce or alleviate a person's motion sickness when using a display device - especially when using a display device while traveling.

[0021] In Fig. 2 of the present disclosure, an exemplary situation of motion sickness is presented.

[0022] The Tafel 2000 in Fig. Figure 2 illustrates a situation in which a user is playing a video game. The user is viewing the video game on a display device (e.g., a computer screen) and uses a controller to make inputs that trigger a specific action within the video game. The user's eyes are thus focused on the display device. If the user plays the video game in a static location (e.g., at home), they can play the video game without experiencing motion sickness. The panel, published in 2002, is in Fig. Figure 2, however, illustrates a situation in which a user is playing a video game while traveling in a vehicle, such as an airplane. In this case, the user views the display device in the same manner as described for Table 2002. However, because the user is traveling in an airplane, a feeling of motion sickness may occur. This is because the airplane is subject to motion such as vibrations, turbulence, changes in altitude, direction, and / or acceleration. This motion may be perceived by the inner ear of the user traveling in the airplane. However, the user's eyes, which are fixated on the display device, cannot detect any visual sign of this motion. The motion perceived by the user (e.g., in the video game) may even contradict the motion perceived by the user's inner ear.This discrepancy between the user's sensory perceptions may cause the user to experience motion sickness. As a result, the user may need to discontinue use of the display. While in this example, the user is using the display to play a video game, the display can also be used to provide the user with important information or warnings. If the user must spontaneously discontinue use of the display due to motion sickness, they may miss important information and / or warnings. This can be dangerous.

[0023] Motion sickness can also occur when using a display device, even when the user is not traveling in a vehicle. The 2004 and 2006 tables of the Fig. Figures 2 of the disclosure illustrate a situation in which a user uses a display device, e.g., a mobile phone display, while walking. Here, the user is focused on the mobile phone display. For example, the user is reading an important email from their employer.

[0024] For example, the user's eyes may not perceive movement because they are focused on the display. However, because the user is walking, their other senses may perceive movement. This can create a conflict between the user's senses, leading to a feeling of motion sickness. As a result, the user may have to stop using the display. If the user loses their sense of balance due to motion sickness, there is also a risk of falling or bumping into obstacles or other people while walking. This can be dangerous.

[0025] A third example situation is shown in Table 2006. Here, a user is traveling in an autonomous (or self-driving) car. The user can be a passenger, or they can be a passenger designated to be the car's driver (i.e., a passenger who becomes the active driver when necessary). In an autonomous or semi-autonomous car, the passenger can perform certain actions, such as watching a movie on a display device, while the car is in autonomous mode. However, the passenger may be required to take control of the car (e.g., as the active driver) in certain situations. If the passenger has been looking at a display device while the car is in autonomous mode, the passenger may experience motion sickness at the moment when they must become the active driver.This means that the signals from the passenger's eyes directed at the display device may conflict with the signals from the passenger's other senses, which correspond to the car's movement while moving along the road. The passenger may therefore have to stop observing the display device. Furthermore, if the passenger suddenly needs to take control of the car, the passenger may experience a feeling of motion sickness. This can be dangerous. <Erste Ausführungsform - Dynamische Anpassung>

[0026] In view of the above (and also the reasons described in the background of the disclosure), it is desirable to alleviate the sensation of motion sickness when viewing an image on a display device. Accordingly, an apparatus, method, and computer program product for alleviating motion sickness in a user viewing an image on a display are provided according to embodiments of the disclosure. <vorrichtung>

[0027] Fig. Figure 3 of the present disclosure shows an example configuration of a device consistent with embodiments of the disclosure. Device 3000 can be used to alleviate a user's motion sickness when viewing an image on a screen.

[0028] The device 3000 includes a display circuit 3002, a generation circuit 3004, a detection circuit 3006, and a determination circuit 3008.

[0029] The display circuit 3002 may be implemented as a processing circuit configured to display an image on a display device, the display device being at a first distance from a user viewing the image on the display device.

[0030] The generating circuit 3004 may be configured to generate a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance.

[0031] The detection circuit 3006 may be configured to detect movement of the user and the display device to a new position relative to the virtual screen.

[0032] The determination circuit 3008 may be configured to determine a new image position by projecting a line from the virtual screen position to a new user position.

[0033] Finally, the display circuit may also be configured to display an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps the display device.

[0034] In this way, the virtual screen generated by device 3000 emulates a physical screen (or other type of display device) located at a greater distance from the user than the actual display device. Furthermore, the movement of the user and the display device relative to this virtual screen is accounted for by a corresponding movement of the image on the display device. This can resolve the conflict between the image seen by the user's eye and the movement of the user and the display device, reducing the sensation of motion sickness.

[0035] Further details about the device 3000 will now be described with reference to the Fig. 4 to 8 of the present disclosure. <anzeigeschaltung>

[0036] As mentioned with reference to Fig. 3 of the present disclosure, an apparatus 3000 according to embodiments of the disclosure may include a display circuit 3002 configured to display an image on a display device, the display device being at a first distance from a user viewing the image on the display device.

[0037] In some examples, the display circuit 3002 is therefore a display controller that issues instructions that cause an image to be displayed on a display device. However, the display device itself does not have to be part of the device 3000. Rather, the display device may be external to the device 3000 (e.g., an external screen or monitor). This may be the case, for example, when the display device is installed as a fixed display in a vehicle (e.g., in a car). In other examples, however, the display device may also be located within the device 3000. This may be the case when the device 3000 is used as part of a user's personal electronic device (e.g., a mobile phone or a tablet computer).

[0038] Let us consider again the example situation which, with reference to Fig. 2 of the present disclosure, in which a person is traveling in an autonomous or semi-autonomous (hereinafter self-driving) car.

[0039] In this example, a passenger wishes to watch a movie on a display in the self-driving car. The display may be a screen built into the self-driving car. Accordingly, the person issues an instruction or command telling device 3000 that they wish to watch a movie on the screen. Upon receiving such an instruction or command, display circuitry 3002 may then instruct the screen built into the self-driving car to display the movie selected by the user. The user may then watch the movie on the screen.

[0040] Of course, the type of image that the display circuit can display on a display device is not particularly limited. That is, while a person may choose a movie as the image on the display screen, the image may also include a static image (e.g., a photograph), a video game, a television program, animated content, a video call, live-streamed video content, a user interface, a navigation system, a web page, or the like. The image may also include images consisting of text or containing at least a portion of text. For example, a person may read a message on the display device or part of a digital book (e-book). An image, as defined in the present disclosure, includes any type of visual content that can be displayed on a display device.

[0041] The display circuitry may update the image on the display device when another instruction or command is received from the user. Alternatively, the display circuitry may update the image on the display device when the digital content changes. For example, when video content is displayed on the display device, the display circuitry may update the display for each frame of the video content.

[0042] The distance between the user and the display device is defined in the present disclosure as the first distance. In some examples, this may be the distance between the user's observation position and the display device. Consider the example situation in Fig. 2 of the present disclosure, in which a person views an image on a display device in a self-driving car. The display device may have a fixed position in the self-driving car. This may be a fixed position on the car's dashboard or on the back of a seat (e.g., on the back of a headrest) or next to the windows, substantially perpendicular to the intended direction of travel, or as a head-up display, e.g., in the car's windshield. The distance between the person and the display device would remain constant in this case, since the person observes the fixed display device from a predetermined location in the self-driving car (e.g., from the car seat opposite the display device). However, in other examples, the display device may not have a fixed position. This may be the case when the display device is part of a portable electronic device (e.g.,a mobile phone). In this case, the person may be specified to view the display at a certain distance (e.g., at the person's arm's length) and / or the distance between the person and the display device may be measured (e.g., from a captured image of the user and / or the display device).

[0043] It is clear that this distance is often very close to the person viewing the display. Furthermore, the relative movement between the person and the display device is very small. That is, in the example where a person is traveling in a vehicle, both the person and the display device are on board the vehicle. Therefore, both the person and the display device travel with the vehicle. If the person views a display device while walking (as in the 2004 and 2006 tables of Fig. 2 of the present disclosure), the display device moves with the person because the person is holding (or carrying) the display device. Therefore, the relative movement between the person and the display device remains small, so that the first distance (i.e., the distance between the person and the display device) often remains the same during travel. However, any change in the relative position of the person and the display device can be measured (e.g., from a captured image of the user and / or the display device). Therefore, changes in the first distance can be accounted for by the device 3000 and / or the display circuitry 3002. <erzeugungsschaltung>

[0044] As mentioned with reference to Fig. 3 of the present disclosure, an apparatus 3000 according to embodiments of the disclosure may include a generating circuit configured to generate a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance.

[0045] The condition of motion sickness results from a discrepancy or contradiction between the various signals a person receives from their senses. Most often, conflicts arise between the inner ear's sense of balance and the person's vision. If the inner ear detects movement, but the image seen by the eyes shows no movement, motion sickness may occur. Viewing an image on a display device can worsen motion sickness because a person focused on the display device is unaware of any movement in their surroundings (e.g., the movement of a vehicle they are traveling in).

[0046] The inventors have recognized that the feeling of discomfort and motion sickness when viewing a display device can be alleviated by dynamically compensating the image position on the display screen in accordance with the movement of the person (the user) and the display device. For example, when the user and the display device are on board a vehicle, the feeling of motion sickness can be alleviated or reduced by dynamically compensating for the vehicle's movement. Dynamically compensating the image position on the display screen in accordance with the vehicle's movement reduces the discrepancy between the user's senses in this situation, because the image seen by the user then moves in accordance with the sense of motion detected in accordance with the user's other senses.This can solve the problem of motion sickness when viewing an image on a display device.

[0047] To enable this compensatory movement of the image position, the generation circuit of the present disclosure first generates a virtual screen. The virtual screen emulates a situation in which the area to be observed (i.e., the display device) is actually located at a much greater distance from the user than the display device. Furthermore, the virtual screen has a fixed position in a reference frame external to the vehicle, so that any relative movement between the vehicle and the virtual screen can be accounted for by changing the image position on the display device. In this way, the generation circuit generates a virtual screen that has a fixed location in a reference frame external to the vehicle and is located far away from the user. This reduces the risk of motion sickness and alleviates the user's suffering.

[0048] Let us now consider the example in Fig. 4 of the present disclosure. This illustrates an example of creating a virtual screen in accordance with embodiments of the disclosure. This may be the case, for example, when a user views a display device while traveling in a vehicle (e.g., a car, train, airplane, or boat).

[0049] In this example, a user 4000 and an on-board display device 4002 are depicted. The positions of the user 4000 and the on-board display device 4002 may be the positions of the user and / or the on-board display device 4002 at an initial time t0 (where t0 corresponds, for example, to a time when the user first views an image on the display device or when the user's journey in the vehicle begins).

[0050] In this example, the on-board display 4002 has a rectangular shape defined by points a, b, c, and d. However, the present disclosure is not particularly limited in this regard, and any shape or type of display may be used.

[0051] An image 4004 is displayed on this on-board display device. This is the image that the user 4000 sees at time t0.

[0052] The position of the user and the display device at time t0 may be predetermined (e.g., known from the position of the user and the display device at the start of the journey) or it may be determined by the detected device using information from one or more sensing devices. Further information on detecting the position and movement of the user and the display device is provided with reference to detection circuitry 3006 of device 3000.

[0053] To generate the virtual screen, the generation circuit 3004 projects a line from the user and the display device 4002 to a second position, where the distance of the second position from the user is greater than the first distance. In other words, the generation circuit draws a line from the initial position of the user 4000 to obtain, at the second distance, the rectangles A, B, C, D (which define the virtual screen) and the corresponding homothetic replication of the image 4004 as displayed on the display device in the vehicle on the virtual screen 4006. Each point on the virtual screen 4008 corresponds to the point on the display device 4004 projected to the second distance. For example, a line from the initial position of the user 4000 to point a on the display device 4004, extended or projected to the second distance, corresponds to point A on the virtual screen 4006.

[0054] Of course, projecting or extending a line from the user and the display device to the second position means that the generating circuit extrapolates the coordinates of the display device (relative to the user) to a second position to generate a virtual screen that is located at a greater distance from the user than the display device. In this way, a virtual screen can be generated at the second position by the generating circuit.

[0055] Therefore, in this particular example, the generating circuit 3004 projects a series of lines from the user's home position to the second position; that is, in this example, the generating unit projects four lines (one from each of the four corners of the display device a, b, c, and d) to the second position. However, the present disclosure is not limited to this example. In other examples, the generating circuit may project a single line from the user and the display device to the second position to generate the virtual screen. For example, the generating circuit may project a single line from the center of the display device to the center of the virtual screen to generate the virtual screen at the second distance.Therefore, the number of lines used by the generation unit to generate the virtual screen at the second position may be much larger or much smaller than the four lines shown as an example in . Fig. 4 of the present disclosure and is not particularly limited to this example.

[0056] The second distance (i.e., the distance of the virtual screen 4006 from the user 4000) should be a distance much greater than the distance between the user 4000 and the display device 4004. However, the exact distance of the virtual screen 4006 from the user 4000 is not particularly limited according to the present disclosure, as long as it is farther from the user 4000 than the display device 4002. In some examples, the virtual screen remains at a fixed second distance from the user 4000 even if the user moves toward the display screen. That is, in some examples, the virtual screen may have a fixed position in a frame of reference external to the vehicle in all dimensions except the direction of travel, along which the virtual screen has a fixed position relative to the user.In other examples, the virtual screen has a position fixed in a reference frame external to the vehicle, and the second distance may be such that the movement of the vehicle toward the virtual screen (in the direction of travel) is negligible compared to the second distance. However, the present disclosure is not limited to these specific example situations, and the second distance may be any distance much greater than the distance between the user 4000 and the display device 4004.

[0057] The manner in which the generating circuit 3004 projects a line from the user and the display device to a second position is not particularly limited according to the embodiments of the disclosure. For example, the generating circuit 3004 may extrapolate a line between the user and the display device to the second distance. However, other methods may also be used to project the line between the user and the display device to the second distance.

[0058] That is, the projection of the line (e.g., a line from the center of the display device) to the second position is understood as an extension of the line (e.g., extrapolation) of the line from the display device to the second position. Therefore, to project the line to the second position, the generating circuit may trace a line from the display device to the second position. However, the present disclosure is not specifically limited in this regard. The calculation for projecting the line from the display device to the second position may be performed by the generating circuit in any suitable manner, depending on the need and situation. Furthermore, the line is to be understood as a virtual line; it is not a physical line in space that would be visible to a user.Rather, the line is a virtual line used as a construct to allow the creation unit to create the virtual screen at the second position.

[0059] Furthermore, it is clear that the generated virtual screen is typically located at a fixed position in a reference frame outside the vehicle. Therefore, even if the vehicle moves, the virtual screen remains at the position generated by projecting the lines from the initial position of the user 4000 onto the display screen 4002 at the second distance.

[0060] The user views the virtual screen 4006 on the display device 4002. That is, the user looks at the display device 4002 to see an image or representation of the virtual screen. The display device 4002 is thus a tool for viewing the virtual screen 4006. If the user looks out of the vehicle toward the virtual screen without looking at the display device, the virtual screen cannot be seen. This is because the virtual screen is not a screen that exists in the real world, but rather a construct generated by the generation circuit 3004 in a virtual environment that can be used to dynamically compensate for the vehicle's movement and thus to alleviate motion sickness. This will be explained with reference to the Fig. explained in more detail in the present disclosure.

[0061] In this way, the generation circuit 3004 can emulate a situation in which the area to be monitored (i.e., the display device) is actually located at a much greater distance from the user than the display device and remains at a fixed position in a frame of reference external to the vehicle. <erkennungsschaltung>

[0062] As mentioned with reference to Fig. As explained in Figure 3 of the present disclosure, the device 3000 includes a detection circuit 3006 configured to detect movement of the user and the display device to a new position relative to the virtual screen. By detecting the movement of the user and the display device relative to the virtual screen, it is possible to dynamically compensate for the movement, thus reducing the sensation of motion sickness.

[0063] Let us now consider the Fig. 5 of the present disclosure. Fig. 5 shows an example of determining a new image position in accordance with embodiments of the disclosure.

[0064] This example corresponds to the example in Fig. 4 of the present disclosure. Fig. However, Figure 5 shows the situation at a time after t0, i.e., at a time when a movement of the user and the display device relative to the stationary virtual screen was detected. This means that at time t0, the user is at his or her initial position 4000. This can, for example, be the user's position at the beginning of a journey. At this time t0, the display device is also in its initial position 4002. As in Fig. 4 of the present disclosure, the generation circuit 3004 generates the fixed virtual screen 4006 at this time (t0) by projecting the lines from the user 4000 and the display device 4002 to a second distance.

[0065] However, at a later time t, the user and the display device have moved away from their initial position. In the example where the user and the display device are on board a vehicle, e.g., a car, this movement of the user and the display device from their initial position (i.e., their position at t0) may be caused by the movement of the vehicle during its travel.

[0066] Thus, at time t (which is after time t0) the user is at a new position 4010 and the display device is at a new position 4012.

[0067] This movement of the user and the display device is a movement relative to the stationary virtual screen 4006. That is, while the user and the display device have moved with the movement of the vehicle, the virtual screen remains fixed at the same position 4006. This is because the generation circuit 3004 generates the virtual screen based on the initial position of the user 4000 and the display device 4002 (ie, their positions at t0).

[0068] It goes without saying that this relative movement of the user and the display device relative to the virtual screen can be either a rotational and / or translational movement. However, a translational movement directly toward the screen does not necessarily affect the display of the image on the display device according to the embodiments of the disclosure (since the change in distance can be very small compared to the second distance).

[0069] The manner in which the detection circuit 3006 detects the movement of the user and the display device from their initial positions (i.e., their positions at t0) is not particularly limited according to the embodiments of the disclosure. Rather, it depends on the situation to which the embodiments of the disclosure are applied.

[0070] Consider the example situation that relates to the 2004 and 2006 tables in Fig. 2 of the present disclosure. In this example, a person is walking while viewing an image on their portable electronic device. Here, detection circuitry 3006 may detect the movement of the user and the display device relative to the virtual screen based on information from one or more sensors on the user and / or in their portable electronic device. These sensors may include one or more gyro sensors, accelerometers, or the like. Alternatively, detection circuitry 3006 may use a global navigation satellite system (GNSS), such as GPS signals from the user's device, to detect the movement of the user and the display device relative to the virtual screen.

[0071] It will be appreciated that in some examples, the sensors (such as the gyro sensor and / or the accelerometer) may be included as part of the device 3000. However, in other examples, the device 3000 may also receive information from external sensors (e.g., sensors in the user's wearable electronic device and / or wearable technology such as a smartwatch or the like).

[0072] Furthermore, detection circuitry 3006 may detect movements of the user and the display device based on an image of the user and / or the display device, or one of both. The movement of the user and / or the display device through an environment relative to the virtual screen may be determined by detection circuitry 3006 based on these captured images.

[0073] Let us now consider the example situation which, with reference to the 2006 table, is Fig. 2 of the present disclosure. In this example, a person is traveling in a self-driving car. While traveling, the person views an image on a display device in the car. Here, the detection circuitry 3006 of the device 3000 may detect the movement of the user and the display device relative to the virtual screen based on information from one or more sensors on the user and / or in the display device. Alternatively or additionally, however, the detection circuitry 3006 of the device 3000 may also detect the movement of the user and the display device relative to the virtual screen based on the movement of the car itself. Because the user and the display device are riding in the car, they move with the car as it continues its journey. Therefore, as the car moves relative to the virtual screen, the user and the display device also move relative to the virtual screen.This is a particularly efficient and reliable method for detecting movement relative to the virtual screen, as the sensors in the car (or any other vehicle the user is traveling in) can be used for motion detection. In this case, the distance between the user and the display remains the initial distance when the user and the display move to a new position relative to the virtual screen, since the user and the display have not moved relative to each other (the movement is determined by the movement of the car).

[0074] Using the sensors included in the car to detect user movement and the display device, the detection circuit 3006 can determine the car's movement using one or more gyro sensors, accelerometers, GPS signals, map information, and / or control signals to control the vehicle's movement. The map information can include a map of the route the car will travel during the trip. By correlating the GPS signals with the map information, the detection circuit can more accurately determine the vehicle's movement relative to the virtual screen. If the car is a self-driving car, control signals that control the car can be used by the detection circuit 3006 to determine the car's movement.For example, if a control signal for controlling the car indicates an instruction to turn left, this information about the turn can be used by the detection circuit to detect the movement of the car.

[0075] Even if it's not a self-driving car, control signals can be used to determine the car's movement. That is, a sensor that detects control signals, such as the driver turning the steering wheel, can be used by the detection circuit 3006 to determine the car's movement. This allows the detection circuit to respond directly to the car's controls when the movement is detected.

[0076] It should be understood that the present disclosure is not limited to the example situations described above. That is, the detection circuitry 3006 may use any suitable source or combination of information sources to detect the movement of the user and the display device relative to the virtual screen, depending on the situation to which the embodiments of the present disclosure are applied. <bestimmungsschaltung>

[0077] As mentioned with reference to Fig. 3 of the present disclosure, the device 3000 may further include a determination circuit 3008 configured to determine a new image position by projecting a line from the virtual screen position to a new user position.

[0078] The determination circuit 3008 of the device 3000 uses the information about the position of the user and the display device obtained from the detection circuit 3006 to determine a dynamic adjustment of the image displayed on the display device to account for the movement relative to the virtual screen.

[0079] Let us consider again the example situation that Fig. 5 of the present disclosure. An example of determining a new image position is illustrated here in accordance with embodiments of the disclosure.

[0080] In this example, the user and the display device are originally located at positions 4000 and 4002 (this is at time t0). The virtual screen generated by generation circuit 3004 is then located at 4006. At a time after t0, the user and the display device have moved to a new position 4010 and 4012, respectively. The movement of the user and the display device to this new position can be detected by detection circuit 3006.

[0081] To determine a new image position, the determination circuit 3008 can perform a backprojection from the virtual screen 4006 to the user's new position. This new image position emulates how the user's view of the virtual screen has changed due to the movement from 4000 to 4010.

[0082] Accordingly, in this example, the determination circuit 3008 may project a line from each position on the virtual screen to the user's position. This mapping allows the determination circuit 3008 to determine where each portion of the image displayed on the virtual screen should be rendered or displayed by the display device to account for the movement that has occurred relative to the virtual screen. For example, point A of the virtual screen (the upper left corner of the virtual screen) has a position created by projecting a line from the initial position of the user and the display screen to a second distance. To determine where this point should be displayed on the virtual screen (i.e.the new image position), the determination circuit 3008 then projects a line from the position of point A on the virtual screen to the new position of the user 4010 at time t. The new image position A' then lies on this line at the intersection of the display screen 4012.

[0083] Each point on the virtual screen 4006 can thus be mapped to the new position of the display screen 4012. In this way, a new image position 4014 can be determined by the determination circuit 3008. This new image position emulates the user's view of the virtual screen from the new position detected by the detection circuit 3006, thus providing dynamic compensation for the motion.

[0084] The manner in which the determination circuit 3008 performs the calculation to project the points from the virtual screen to the user's new position is not particularly limited in accordance with the embodiments of the disclosure. Any suitable method may be used to form a line connecting a point on the virtual screen to the user's new position.

[0085] Furthermore, the determination circuit 3008 may determine a new image position each time the detection circuit 3006 detects that the position of the user and the display screen has changed. Alternatively, the determination circuit 3008 may determine a new image position at regular intervals. For example, if a periodic basis is used, the determination circuit 3008 may determine a new image position several times per second. However, the periodic basis is not particularly limited in this regard, and the new image position could be determined in a much longer or much shorter period than this.

[0086] Once the new image position has been determined, the determination circuit 3008 of the device 3000 may provide information to the display circuit 3002 to cause the display circuit to display the image at the new image position. That is, at this stage, the display circuit 3002 may be configured to display an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps the display device.

[0087] In this way, display circuitry 3002 causes the display device to display the image at the new image position. When the user views an image, such as a photograph, on the display screen, it is the same image that was originally displayed on the display device when the display device was at the home position 4002 (i.e., images 4004, 4008, and 4014 are the same image in this example). However, when the user views a video as an image on the display device, the image displayed at the new image position may be a different video image than the video image displayed on the display device when the display device was at the original position.Thus, depending on the type of content viewed by the user, the image displayed at the new image position may or may not be the same image that was displayed on the display device when the display device was at the original position 4002.

[0088] By displaying the image at the new image position, the image the user sees on the display device will dynamically adjust its position according to the movement of the user and the display screen relative to the virtual screen. Accordingly, the impression of movement the user perceives based on sensory information, e.g., from the inner ear, is reflected in a corresponding movement in the image the user sees on the display screen. This means that the conflict between the user's different senses is reduced, which in turn alleviates motion sickness.

[0089] It goes without saying that the display circuit 3002 can only cause the display device to display the image at the new image position for the portion of the image where the new image position overlaps with the actual physical position of the display device. Therefore, if the new location of the user and the display device is very far from the original location of the user and the display device, a significant portion of the image may not be displayed (i.e., there is little overlap between the new image position and the actual physical position of the display device). Therefore, if the user and the display device move very far from their original positions, it may become difficult for the user to view content on the display device.If the movement from the starting position is very large, the user may experience greater motion sickness.

[0090] Thus, in some examples, device 3000 may be configured to adjust the display of the image on the display device when the movement of the user and the display device relative to the virtual screen is above a threshold, so that significant movements from the original position can be efficiently accounted for.

[0091] The threshold value that triggers the adjustment of the image display is not particularly limited. This threshold value may be a predetermined threshold. For example, it may be a value set in advance by the user according to their individual preferences. Alternatively, the value may be determined based on the context of the situation (e.g., the type of vehicle the user is traveling in). In some examples, the threshold value may correspond to a degree of movement at which no part of the new image position overlaps with the display device. In this case, if the movement of the user and the display device was such that there was no overlap between the actual new position of the display device and the new image position, the device 3000 would adjust the image for display.Such adjustment may involve adjusting the new image position so that at least a portion (e.g., 50%) of the new image position overlaps the display. When the new image position is adjusted in this manner, a visual indicator may appear on the screen to inform the user that the maximum movement of the image has been achieved. However, the present disclosure is not limited to this aspect.

[0092] Alternatively, in some examples, the threshold may be determined based on an amount of movement within a predetermined time (i.e., when the movement rate is above a threshold). That is, if the position of the user and the display device changes rapidly over time or follows a particular movement pattern, an adjustment of the display may be triggered. For example, this might correspond to significant turbulence when viewing an image on a display device while traveling in an airplane. Alternatively, it might correspond to a particularly bumpy or winding stretch of road when traveling by car.

[0093] In some examples, adjusting the display of the image on the display device may include displaying a predetermined image to replace the image on the display device. If the movement of the user and the display device is above the threshold, the user may be more likely to experience motion sickness when viewing the screen, even if the position of the image is dynamically adjusted. Accordingly, in this case, a predetermined image may be displayed to further reduce the user's feeling of motion sickness. This may be a blank image (so that the user stops looking at the display) or an image with a specific property. The image with a specific property may be an image that instructs the user to stop looking at the display (i.e.An image with a visual warning that the movement is very large) and / or an image with a property known to reduce the feeling of motion sickness. This means that, for example, if the user is watching video content such as an action movie, they may be more susceptible to motion sickness (as the conflict between the movement of the objects in the image content and the user's perception of motion may be amplified). Accordingly, in this case, the display can replace the image with an image that can reduce the user's feeling of motion sickness. This could, for example, be a relaxing photograph. Alternatively, it could be a relaxing image selected by the user in advance.

[0094] However, even if the image displayed to the user is adjusted by the device when the motion exceeds the threshold, the device 3000 can still generate sound associated with the image if the display of the image on the display device has been adjusted. That is, if the user is watching video content on the screen, the sound associated with that video can still be generated even if the display is adjusted (e.g., by a blank screen or a warning to stop watching the video content). Even if the user is unable to see the screen due to motion sickness, they can still hear the sound associated with the content. This allows the user to still enjoy the content even if they move significantly away from their original position.If the user is unable to see the display (due to motion sickness), the audio can be adjusted to provide the user with a verbal description of the video content. This allows the user to enjoy the content even if they are unable to view the display.

[0095] Moreover, in some examples, when audio is associated with the image displayed on the display device, device 3000 may be further configured to generate audio associated with the image when the image is displayed on the display device and to shift a source position of the audio according to the new image position when the image is displayed on the display device at the new image position. That is, the origin of the generated sound may be shifted according to the shift of the image on the display device (i.e., the new image position determined by determination circuit 3008). In some examples, this may be performed by device 3000 controlling an audio playback device (such as a speaker or the like) to control virtual sound localization.The present disclosure is not specifically limited to this specific manner of shifting the position of the audio in accordance with the newly determined image position. However, it is clear that shifting the starting point of the audio playback according to the newly determined image position can further reduce the conflict between the user's various sensory perceptions and the movement of the vehicle, thus further alleviating the feeling of motion sickness that occurs when viewing an image on the display device.

[0096] In some examples, a passenger may view A / V content on a display device in a vehicle. When viewing A / V content in a moving vehicle, the passenger may experience motion sickness because the motion perceived by the passenger may not match the motion the passenger sees when viewing the display device with their eyes. Therefore, in some examples, the A / V content viewed by the passenger may be overlaid on a live video representation of the horizon provided by a video camera (or other type of image capture device). Such a video camera (or other image capture device) may be mounted either inside or outside the vehicle. In either case, however, the video camera is mounted to the vehicle so that it moves with the vehicle.Therefore, the live video representation of the horizon captured by the video camera changes as the vehicle moves. Accordingly, the passenger can see the vehicle's movement (relative to the horizon) even when viewing the A / V content on a display device in the vehicle. This can further reduce the feeling of motion sickness in users. It should be understood that the determination circuit 3008 of the device 3000 can then determine a new image position at which the display circuit 3002 should display the image overlaid on the live video representation of the horizon based on the movement of the passenger and the display device relative to the virtual screen (which is, for example, located on the horizon).Thus, the A / V content superimposed over the live video of the horizon captured by the video camera is moved to a new display position based on the vehicle's movement, and the live video of the horizon captured by the video camera changes as the vehicle moves along the road. Therefore, the passenger watching the display sees the vehicle's movement fully reflected on the display, further reducing the feeling of motion sickness.

[0097] Furthermore, device 3000 can be configured to reduce the contrast of the live video representation of the horizon relative to the A / V content overlaid on that live video representation of the horizon. Such a contrast change can shift the user's attention to focus on either the A / V content or the live video representation of the horizon. Such a change in contrast can be made by device 3000 depending on the user's degree of motion sickness (either based on an observation of the user or, alternatively, based on a prediction of the degree of motion sickness depending on travel conditions).If the user experiences a low level of motion sickness, the contrast of the live video representation of the horizon relative to the A / V content can be reduced, making the live video representation of the horizon less noticeable to the user. This means that the user focuses primarily on the A / V content displayed by device 3000. However, if the user experiences a high level of motion sickness (despite the adaptive movement of the image position of the A / V content by device 3000), device 3000 can increase the contrast of the live video representation of the horizon relative to the A / V content, making the live video representation of the horizon more noticeable to the user. By focusing on the live video representation of the horizon, the user's feeling of motion sickness can be further reduced.Therefore, by adjusting the contrast of the live video representation of the horizon on the screen to the contrast of the A / V content superimposed over this live video representation based on the user's feeling of motion sickness, it is possible to further reduce the user's degree of motion sickness.

[0098] Additionally, in some examples, the brightness outside the vehicle may change during the journey. For example, the vehicle may set off during the day when it is bright outside. Then, it may become darker outside the vehicle when the vehicle is still en route later in the day (e.g., in the evening or at night). Alternatively, it may become darker outside the vehicle when the weather changes (e.g., when it is very cloudy). When a passenger is viewing a display device inside the vehicle, they may become accustomed to the brightness of the screen. When the passenger becomes the active driver (e.g., when they need to take control of the vehicle), they may not be able to see properly outside the vehicle when it has become dark outside and they have become accustomed to the brightness of the screen. This is because it takes time for eyesight to adjust to lower brightness.Accordingly, in some examples, device 3000 may monitor the brightness outside the vehicle using the video camera capturing a live video representation of the horizon (or any other suitable device for monitoring brightness outside the vehicle). Device 3000 may then adjust the brightness of the display device according to the brightness outside the vehicle. For example, as it gets darker outside, device 3000 may decrease the brightness of the display device. Therefore, by the time the passenger needs to take control of the vehicle, their eyesight will be more accustomed to the brightness outside the vehicle. This may further increase safety when the passenger is observing a display device in a vehicle for which they may require them to be the active driver.

[0099] In this way, the determination circuit 3008 of the device 3000 can determine a new image position at which the display circuit 3002 should display the image based on the movement of the user and the display device relative to the virtual screen. Accordingly, a user's feeling of motion sickness when viewing an image on a display device can be alleviated because the display of the image on the display screen is adjusted according to the movement of the user and the display device. <beispielsituationen>

[0100] An example of the application of the device 3000 of the present disclosure to an example situation according to the embodiments of the disclosure will now be described with reference to the Fig. 6, Fig. 7 and Fig. 8 of the present disclosure.

[0101] Fig. 6 illustrates an example situation in which embodiments of the disclosure are applied.

[0102] In this example, a user is watching a video while traveling in a car. The car may be a self-driving car (e.g., an autonomous or semi-autonomous car). Alternatively, the car may be a car manually controlled by a driver. In this case, the user may be a passenger being carried in the car by the driver.

[0103] The user begins the journey in the car on a road at position 6000A. At this time, the user can request that an image be displayed on a display in the vehicle 6000. This means that the initial position of the user and the display device in the car can be set to the time corresponding to the position of the car at 6000A. Thus, the image is centered on the display in the vehicle 6000, and the generation circuit 3004 of the device 3000 generates a virtual screen position 4006. The user thus sees the virtual screen 4006 via the display in the vehicle 6000.

[0104] Since the car is driving directly toward the position of the virtual screen, there is no relative movement between the user, the display device, and the virtual screen, so the image displayed on the display device remains centered on the display device.

[0105] After some time, the car reaches a slight curve at position 6002A. Accordingly, the car can move relative to the virtual screen (under the control of the driver or as part of the vehicle's autonomous driving). This is shown in Fig. 6 can be seen at position 6002A when the car starts to turn right.

[0106] At this stage, the user and the display device move relative to the virtual screen. The user's view of the virtual screen through the display device has therefore changed. Accordingly, detection circuit 3006 of device 3000 detects this movement. Determination circuit 3008 of device 3000 determines a new image position of the image on the display and causes display circuit 3002 of device 3000 to display the image at this new position. When the car turns right, the image the user sees on the display device in cab 6002 (corresponding to the position of the cab at 6002A) moves to the left.Thus, when the user perceives and experiences the car's movement to the right as it travels around the gentle curve, they can see that this movement is reflected in the position of the image displayed on the display device, as the image on the display device (which represents a view of the fixed virtual screen position through the display device) moves accordingly. The conflict between the user's senses is thus reduced, and the feeling of motion sickness the user experiences when viewing an image on the display device can be alleviated.

[0107] At position 4006, the car straightens and makes a slight left turn, again pointing directly at the virtual screen. Accordingly, device 3000 updates the image displayed on the display device so that the image is centered on the display device. This allows the user to continue enjoying the image on the display device during the journey.

[0108] If the car turns left instead, the image on the display can naturally move to the right, since the new image position (representing a view of the virtual screen through the display device) is on the right side of the display. This way, any movement of the user and the display device during the car's travel on the road relative to the fixed position of the virtual screen can be reflected by a corresponding movement of the image on the display.

[0109] While the image position in Fig. 6 of the present disclosure has been illustrated for only three positions of the car relative to the virtual screen (i.e., positions 6000A, 6002A, and 6004A), it is clear that the image position on the display can be continuously updated by device 3000 as the car travels along the road. That is, the user does not experience the image on the display jumping from one position to another. Rather, display circuitry 3002 can cause the image to slide from one image position to the next, essentially in real time, with the movement of the car relative to the virtual screen. This is possible because device 3000 efficiently determines the new image position depending on the movement of the user and the display relative to the virtual screen.

[0110] In Fig. Figure 7 illustrates an example of a situation in which embodiments of the present disclosure may be applied. In this example, a user is watching a video while traveling in a car, similar to the situation illustrated in Fig. 6 of the present disclosure. However, in this example, the car is traveling on a road and experiences a very sharp change in direction (e.g., in a very sharp curve).

[0111] The journey begins at position 7000A, and the user is shown an image on a display device in the car 7000. Since this is the start of the journey (i.e., the initial position of the user and the display device), the virtual screen is generated at position 4006 (i.e., directly in front of the car at position 7000A), and the image on the display device 7000 is centered accordingly on the display device.

[0112] As the car travels along the road, it reaches the curve at position 7002A and begins to turn (change direction), following the road around the curve. There is therefore a relative motion between the user and the on-board display device and the virtual screen created at position 4006. According to a method similar to that described in Fig. 6 of the disclosure, device 3000 updates the display so that the image presented on the display moves to the left. This allows the user to see a visual representation of the sensation of motion created as the car corners, reducing the sensation of motion sickness when viewing the image on the display device.

[0113] However, as the car continues to turn the curve, the relative movement between the user, the display device and the virtual screen becomes very large (position 7004A in Fig. 7). Thus, the new position of the image (determined by the determination circuit 3008 of the device 3000) may be above a threshold of the display device. That is, the movement of the image on the display device may occur such that a substantial portion of the image is not visible on the display device (e.g., the overlap between the display device and the new image position would be very small). In this example, the device 3000 may adjust the new image position once the threshold is reached so that a predetermined portion of the image remains displayed on the display device (e.g., 75% of the image). As the car corners, the image shown on the display is adjusted to reflect the car's movement relative to the virtual screen.However, once the movement exceeds the threshold, the movement of the image on the screen is adjusted so that a certain portion of the image remains on the screen. Therefore, the user can still enjoy the image on the screen even if the movement is large relative to the virtual screen. However, in this example, a warning indicator is provided (the red line on the display in the car 7004). The user can therefore understand from this warning that the risk of motion sickness is increased due to the strong movement of the car relative to the virtual screen. The user can therefore decide to stop viewing the image on the display device at this time.

[0114] As the car travels down the road, it completes the right turn and begins to turn left again (i.e., toward the virtual screen). At position 7006A, the relative movement of the user and the display device in the car from the virtual screen becomes less than the predetermined threshold. This stops the display adjustment performed by device 3000, so that the new image position again reflects the movement relative to the virtual screen. Thus, as the car moves toward the virtual screen again, the image on the display device moves back to the center of the display device.

[0115] In the example of Fig. 7, a user can therefore view an image on a display device with less feeling of motion sickness even if the movement is very large.

[0116] In Fig. Figure 8 of the present disclosure illustrates another example of a situation in which embodiments of the disclosure may be applied. In this example, a car is traveling along a road and makes a sharp right turn before continuing onto a new road perpendicular to the original road.

[0117] The journey begins at position 8000A. This may correspond to the time when a user traveling in the car requests the display of an image on the in-car display device. Accordingly, at this stage (i.e., when the car is at position 8000A), the generation circuit 3006 of the device 3000 generates the virtual screen at position 4006, and the display circuit 3002 displays the image on the in-car display device 8000, so that the image is displayed centrally on the display device (i.e., representing a view directly facing the generated virtual screen 4006).

[0118] As the car travels down the road, it travels directly toward the virtual screen 4006. This keeps the image displayed on the display device in the car centered on the display device.

[0119] Then, at position 8002A, the car begins to turn right. This may indicate that the driver of the car is turning to take a new road. Since there is relative movement between the virtual screen 4006 generated (based on the position of car 8000A, and thus the position of the user, and the display device at the beginning of the journey), the determination circuit 3008 of the device 3000 determines that the display circuit 3002 should display the image on the display device at a new image position. When the car turns right at position 8002A, the image on the display device in the car 8002 dynamically moves to the left to reflect the change in the view of the virtual screen as observed by the display device.

[0120] As the car continues to turn onto the new road, the movement or distance between the traveling direction and the virtual screen becomes very large. This may reach the predetermined threshold (if one exists), and the image position on the screen will reach its maximum displacement from the center of the screen. Even as the car continues to turn the corner, the image on the display screen will not move any further. Therefore, as the car continues to travel along the new road (in the new direction), the original position of the virtual screen may no longer be suitable, ensuring that the feeling of motion sickness a user experiences when viewing an image on a screen is reduced.

[0121] Therefore, in some examples of the present disclosure, device 3000 may be configured to determine whether the movement or distance between the direction in which the car (and thus the user and the display device) is facing and the virtual screen remains above the predetermined threshold for a predetermined period of time. If the movement of the user and the display device relative to the virtual screen remains above the threshold for a predetermined amount of time, device 3000 may be configured to move the virtual screen to a new virtual screen position corresponding to the position defined by projecting a line from the new position of the user and the display device to a third position, where the distance of the third position is the same as the second position.

[0122] In this example, when the car has traveled on the new road for a certain time and reached the new position 8006A, the device 3000 determines that the position of the virtual screen should be shifted (i.e., a new virtual screen should be generated) centered on the new direction of travel of the car. Therefore, at this time, the virtual screen 4006 is shifted to a new position 4006A corresponding to a position at the second distance determined by projecting a line from the new position of the user and the display device (i.e., its position at 8006A) to this second distance.In other words, the position of the virtual screen is reset so that a new initial position of the virtual screen is defined, which corresponds to the position of this virtual screen when based on the position of the car (and thus the user and the display device) at position 8006A.

[0123] Once the virtual screen position has been moved to the new virtual screen position, the user and the display device will move directly to this new virtual screen position, as shown in Fig. 8 of the present disclosure. Accordingly, at this time, the determination circuit 3008 of the device 3000 will determine that the display circuit 3002 should control the display device so that the image is displayed to the user centered on the display screen of the car 8006.

[0124] Any subsequent change in the car's direction relative to this new position of the virtual screen is reflected in the position of the image on the display in the same way as described for the original position of the virtual screen. The feeling of motion sickness when viewing an image on a display while traveling on this new road can thus be alleviated.

[0125] It will be appreciated that the predetermined period of time used to determine whether or not to move the virtual screen to a new position is not particularly limited according to the present disclosure. The length of time set as the predetermined period may depend on the situation to which the embodiments of the disclosure are applied. This may depend on the user's preferences, the context of the situation (e.g., vehicle type and driving speed), one or more additional information sources, or the like. An example of the one or more information sources may be map information. If this map information indicates that the car has turned onto a new road and will continue traveling in this new direction, the predetermined period for moving the position of the virtual screen may be shortened.Alternatively, in some examples, if the map information indicates that a series of significant directional changes will occur, the predetermined time period may be increased to provide a degree of hysteresis for the directional changes. This prevents sudden changes in the position of the image displayed on the screen, improving the user's viewing experience and reducing the sensation of motion sickness.

[0126] In some examples, the device 3000 may be configured to, after the predetermined period of time has elapsed and if the movement remains above the predetermined threshold, gradually move the virtual screen to the new virtual screen position over a second predetermined period of time. That is, the virtual screen may be gradually moved by the device 3000 from the original position 4006 to 4006A while the car travels along the new road. This means that the image shown to the user on the display device gradually moves back to the center of the screen as the virtual screen moves to its new position 4006A in the center in front of the car. Even if the virtual screen moves to its new position in front of the car, an unpleasant feeling for the user viewing the image on the display can be avoided.

[0127] If the user drives along the new road for a while and then changes direction, the virtual screen can be moved to a new position if necessary.

[0128] It goes without saying that, while an application of the device 3000 to a number of example situations with reference to the Fig. 6 to 8 of the present disclosure, the embodiments of the present disclosure are not particularly limited in this regard. That is, the embodiments of the present disclosure may be used to reduce or alleviate a user's feeling of motion sickness when viewing a display screen in many other types of situations. These may include situations where the car shown in the examples is traveling on a road that is very different from the example roads shown. These may also include situations where a vehicle other than a car is used.The embodiments of the disclosure may also be applied in situations where the display screen is not on board a vehicle, but moves due to the movement of a person carrying the display device (as in the example described with reference to panels 2004 and 2006 in FIG. Fig. 2 of the present disclosure). <Vorteilhafter technischer Effekt>

[0129] The device 3000, which is in accordance with the embodiments of the disclosure (as described with reference to Fig. 3 to 8 of the present disclosure) is configured to enable dynamic adjustment of the image displayed on a display device in accordance with detected movement of the user and the display device. This reduces or mitigates the feeling of motion sickness experienced by a user while viewing an image on the display device as the user and the display device move from one location to another.

[0130] It goes without saying that the advantageous technical effects of embodiments of the disclosure are not particularly limited in this regard. Further advantageous technical effects will become apparent to those skilled in the art upon reading the disclosure. <verfahren>

[0131] Fig. Figure 9 shows a method for alleviating motion sickness in a user viewing an image on a display. This method may be performed by a device such as device 1000 of the present disclosure. Furthermore, a computer program product may be provided that includes instructions that, when implemented by a computer, cause the computer to perform the Fig. 9 of the present disclosure.

[0132] The Fig. The method illustrated in Figure 9 begins with step S9000 and proceeds to step S9002. In some examples, the start of the method may be a time at which a command to display an image on a display device is received. However, the present disclosure is not particularly limited in this regard, and the start of the method may occur at any other time (e.g., even at the beginning of a journey in a vehicle).

[0133] In step S9002, the method includes displaying an image on a display device, wherein the display device is located at a first distance from a user viewing the image on the display device. The image may, for example, include a video being viewed by a user. After the image is displayed, the method proceeds to step S9004.

[0134] In step S9004, the method includes generating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance. This virtual screen emulates a display device viewed by a user who is stationary and far away from the user and the display device.

[0135] The process then continues with step S9006.

[0136] In step S9006, the method includes detecting a movement of the user and the display device to a new position relative to the virtual screen. The manner in which this movement is detected is not particularly limited. However, if the user is traveling in a vehicle, the movement may be detected, for example, by the corresponding movement of the vehicle.

[0137] The process then continues with step S9008.

[0138] In step S9008, the method includes determining a new image position by projecting a line from the position of the virtual screen to the new user position. By back-projecting the new image position from the position of the virtual screen in this way, the movement of the user and the display device relative to the virtual screen can be taken into account. The method then proceeds to step S9010.

[0139] In step S9010, the method includes displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device. The user can then see the movement of the image, which reflects the actual movement of the user and the display device. The user's sense of conflict between the senses can thus be alleviated, reducing the risk of motion sickness.

[0140] The method then proceeds to and ends with step S9012. In some examples, the method may continue with step S9012 when the user stops viewing an image on the display device. Alternatively, in some examples, the method may continue with step S9012 at the end of a trip. However, the present disclosure is not particularly limited in this regard.

[0141] It is to be understood that the method of the present disclosure is not limited to the specific arrangement of method steps described in the example of Fig. 9 of the present disclosure. If desired, further method steps may be included in this method. Furthermore, these method steps do not have to be in the Fig. 9; some of the process steps may be repeated and / or performed in parallel with one or more of the other steps in Fig. 9 described process steps are carried out. <Zweite Ausführungsform - Planung von Inhalten>

[0142] As in Fig. As described in Figure 2 of the present disclosure (and also in the background), there are a variety of situations in which a person viewing content on a screen, particularly while traveling (i.e., moving from one location to another), may experience motion sickness. Therefore, for at least these reasons, it is desirable to provide an apparatus, method, and computer program product capable of alleviating motion sickness experienced by a user.

[0143] In the first embodiment of the disclosure, an apparatus, method, and computer program product are provided that can perform dynamic motion compensation to adjust an image displayed on a display device. Therefore, the first embodiment of the disclosure provides a way to adjust the displayed image to compensate for motion as it occurs (i.e., in a substantially real-time environment). In other words, the apparatus 3000 of the first embodiment of the disclosure responds to motion as it is detected to reduce user motion sickness.

[0144] In this second embodiment of the disclosure, an apparatus, a method, and a computer program product for selecting content for display during a trip to alleviate motion sickness are provided. This second embodiment of the disclosure therefore enables the planning of content to be selected for an upcoming trip so that suitable content can be selected in advance that will reduce a user's motion sickness during the portions of the trip most likely to cause motion sickness. Advantageously, by planning content for display in this way, suitable content that can reduce the user's feeling of motion sickness can be determined and prepared in advance, thereby ensuring that this content can be displayed at the right time during the trip.This ensures that the feeling of motion sickness when viewing content on a display can be reduced or alleviated. <vorrichtung>

[0145] Fig. Figure 10 shows an example of a device consistent with the embodiments described in the disclosure. Device 10000 can be used to select content for display during travel to alleviate motion sickness.

[0146] The device 10000 comprises a receiving circuit 10002, a detection circuit 10004, an identification circuit 10006 and a selection circuit 10008.

[0147] The receiving circuit 10002 may be implemented as a processing circuit configured to receive information indicating a route for a trip.

[0148] The detection circuit 10004 may be configured to detect at least a first portion of the journey having a first predetermined feature. The detection circuit may detect the first portion of the journey having the first predetermined feature based on the route information received from the receiving circuit. Alternatively or additionally, the detection circuit may be configured to detect the first portion of the journey having the first predetermined feature using the route information and one or more additional information sources (e.g., map data indicating curves, predicted elevation changes, or the like). In this way, the detection circuit may detect a first portion of the journey having the first predetermined feature.

[0149] The identification circuit 10006 may be configured to identify a period of time corresponding to the first leg of the journey.

[0150] Finally, the selection circuit 10008 may be configured to select one or more content items having a second predetermined characteristic for display over the period of time.

[0151] In this way, the device 10000 may identify a portion of the journey that is most likely to trigger motion sickness in the user, for example, and may select content for that portion of the journey that has a feature that, for example, reduces or alleviates the feeling of motion sickness.

[0152] Further details about the device 10000 will now be described with reference to the Fig. 11 to 14 of the present disclosure. <empfangsschaltung>

[0153] As mentioned with reference to Fig. 10 of the present disclosure, the device 10000 may include a receiving circuit 10002 configured to receive information indicative of a route for a trip.

[0154] The receiving circuit 10002 can be configured as a network connection 1008, which allows the device 10000 to receive information about the route of a trip via a network. The information about the route can be received in any suitable manner (including via wired or wireless connections). Alternatively, the receiving circuit 10002 can also be configured as a user input device 1006, so that the information can be received directly from a user.

[0155] In some examples, the information indicating the route of a trip may include information about a start and an end point of the trip. In other examples, the trip route information may only provide information about an end point of the trip (i.e., a destination). Then, the information about the current position of the device 10000 may be used to determine the start point of the trip. Alternatively, the trip route information may describe the specific path taken during the trip from the start point to the end point. In other situations, however, the specific path taken during the trip may be determined once the start and end points have been specified. This may be determined in any suitable way, e.g., by determining a path from the start point to the end point that provides the shortest travel time.Therefore, the route information may indicate the actual route or contain certain information that can be used to determine the actual route.

[0156] Let us now consider the example from Fig. 11 of the present disclosure. In this example, a person is planning a trip from a starting point 11000 to an end point 11002. The person in this example is planning a car trip. During this trip, the person (or another passenger) wants to view an image on a display (e.g., a display on the person's mobile phone). For example, the person might plan to watch an action movie to entertain themselves during the car trip.

[0157] As mentioned earlier, watching an image on a screen while traveling can lead to motion sickness because there may be a conflict between the person's perception of motion (in this example, due to the movement of the car) and the image the person sees (because the image on the screen remains static or moves differently than the car). Therefore, watching the action movie the entire trip may not be appropriate and may lead to excessive motion sickness symptoms.

[0158] Accordingly, in this example, at the start of the trip (or when planning the content for the trip before the start of the trip), the receiving circuit 10002 of the device 10000 may receive information from the person indicating the route for the trip 11004. In this example, the route may describe the path the car will take on its journey from the starting point 11000 to the ending point 11002.

[0159] The receiving circuit 10002 can receive this information from the person through a user input or an instruction. That is, in the example of Fig. 11 of the present disclosure, the person may issue a voice command or instruction that informs the receiving circuit 10002 of the route to be taken in the upcoming trip (e.g., the person may inform the receiving circuit 10002 that they will travel from the starting point 11000 to the ending point 11002 via a particular road network).

[0160] Alternatively, the person may enter information regarding the intended destination (i.e., the end 11002) into another electronic device, such as a satellite navigation device, and the device 10000 may be configured to receive the information regarding the route for the journey from that other electronic device.

[0161] In this way, the receiving circuit 10002 of the device 10000 receives information indicating the route for the trip.

[0162] It goes without saying that the present disclosure does not apply to the Fig. 11 is limited. While the example in Fig. 11 of the present disclosure relates to a journey in a car, embodiments of the disclosure may also be applied to situations in which the person travels by other means (including, for example, situations in which the person travels by another type of vehicle, such as a train). In this example, although the receiving circuit 10002 receives the travel route information at the beginning of the journey (i.e., before the person begins the journey), it may also receive this information (or updates to this information (including, for example, a change in the travel route or direction)) after the person has already begun the journey from the starting point 11000 to the ending point 11002.

[0163] Once the route information has been received, the receiving circuit 11002 may forward this information to the detection circuit 10004. Alternatively, in some examples, the route may be stored in a memory circuit from which it may later be retrieved as needed by the detection circuit 10004 of the device 10000. <erkennungsschaltung>

[0164] As in Fig. 10 of the present disclosure, the device 10000 may further include a detection circuit 10004 configured to detect at least a first portion of the journey having a first predetermined feature.

[0165] Once the itinerary is available, detection circuitry 10004 can use this information to identify a portion of the journey that is likely to cause motion sickness in the person embarking on the journey. This can be done by detecting a portion of the journey with a predetermined characteristic likely to trigger motion sickness.

[0166] To return to the example in Fig. 11: A person drives a car from starting point 11000 to ending point 11002 while viewing an image on a display device. Based on the information received from receiving circuit 11002, detection circuit 11004 can know that the person will drive from starting point 11000 to ending point 11002. The distance traveled by the person in vehicle 11004 on the way from starting point 11000 to ending point 11002 can be known to detection circuit 11004.

[0167] In this example, detection circuitry 10004 can detect sections of the journey where the road is very winding. On a long and winding road, the person is more likely to experience motion sickness because there is a greater discrepancy between the person's perceived sensation of movement (e.g., based on signals from the inner ear) and the movement (or lack thereof) the person perceives when looking at a display device in the car. Based on this, detection circuitry 10004 of device 10000 can detect that sections 110012 and 11014 of the journey are sections of journey 11004 where the person is most likely to experience motion sickness.

[0168] On the other hand, if the car is at position 11006 of trip 11004, it is very unlikely that the person is suffering from motion sickness because the car is traveling on a particularly straight part of the road.

[0169] By analyzing the route the car will take, the detection circuit 10004 can identify the sections of the journey that are most likely to cause motion sickness in a person riding in the car.

[0170] In some examples where the trip information simply specifies a planned route (e.g., that the car should travel from starting point 11000 to ending point 11002 via a route with the shortest travel time), the detection circuit 10004 can identify the sections of the trip that have a predetermined characteristic (and thus are most likely to cause motion sickness) by comparing the trip with an additional information source, such as map information or the like. Route sections with a particular characteristic (e.g., very winding sections) can then be identified based on the map information.

[0171] The detection circuit is configured to detect the first leg of the journey based on the route information and / or one or more additional information sources (e.g., map information or the like).

[0172] It goes without saying that in the Fig. In the example described in Figure 11, the predetermined feature relates to how winding the road is, but the present disclosure is not particularly limited in this regard. That is, any feature of the journey that can be used to identify portions of the journey most likely to trigger motion sickness can be used in accordance with embodiments of the disclosure. This may vary depending on the context of the situation to which embodiments of the disclosure are applied.

[0173] For example, if the person is traveling by airplane, the detection circuit 10004 of the device 10000 may identify sections of the journey that are most likely to have significant turbulence as sections of the journey that are most likely to cause motion sickness in the person (i.e., a predisposition of this section of the journey to turbulence may be used as a first predetermined feature in accordance with embodiments of the disclosure). Information about the likelihood of turbulence during the journey may be determined based on the geographical location of the country over which the aircraft will fly (e.g., whether the aircraft will fly over warm waters or near mountains). Alternatively, such information about the likelihood of turbulence may also be determined based on a comparison of the travel route with a weather forecast (e.g.,a part of the journey that coincides with an area of ​​strong winds or atmospheric disturbances).

[0174] If the person is traveling by plane, a predetermined feature of the trip may also include portions of the journey related to takeoff or landing procedures. These sections of the journey may also lead to a higher degree of motion sickness in a user due to increased movement.

[0175] Predetermined characteristics of the trip may include sections of the trip with rapidly changing elevation changes (e.g., when traveling on a bumpy road), the type of road traveled during a particular segment of the trip (e.g., highways are often straighter and less likely to cause motion sickness than country roads), a segment of the route with higher accelerations (e.g., segments of road with frequent speed changes), a segment of the route with a particular sequence or pattern of motion (e.g., a segment of the route with a particular sequence of curves, as shown in segment 11014 of trip 11004), or the like. The predetermined characteristic of the trip segment may also relate to historical information about motion sickness experienced by the individual or by others who have traveled the same route.That is, if the historical data indicates that a particular section of the journey results in a high incidence of motion sickness, then that section of the journey can be detected by the detection circuit 10004.

[0176] The present disclosure is not limited to these examples of the predetermined feature. Depending on the type of trip, many other types of predetermined features may be used.

[0177] The detection circuit 10004 of the present disclosure may use any predetermined feature of the route in detecting travel segments, depending on the situation in which the embodiments of the disclosure are applied, as long as the predetermined feature can be used to detect travel segments that are most likely to cause motion sickness in the person traveling on the route. <identifizierungsschaltung>

[0178] As mentioned with reference to Fig. 10 of the present disclosure, the device 10000 may include an identification circuit 10006 configured to identify a time period corresponding to the first leg of the journey.

[0179] Once a particular section (or sections) of the journey have been identified as those sections of the journey which, if traveled through, are most likely to cause a person to experience motion sickness, that section (or sections) of the journey can be passed to the identification circuitry 10006 of the device 10000 so that the device 10000 can identify the actual time during the journey at which the section (or sections) are reached. By determining the actual time during the journey at which the section (or sections) are reached, the device 10000 is able to carefully select content to be displayed to the user at that time that takes into account the fact that the user may be more likely to experience motion sickness. In this way, the user's motion sickness can be reduced.

[0180] Let us now consider the Fig. 12 of the present disclosure. This example illustrates a timeline according to embodiments of the disclosure. That is, the timeline in Fig. Figure 12 of the present disclosure shows the total time that an example trip would take. The time axis begins at time t0 (corresponding to the start of the trip) and runs until t end (corresponds to the end of the journey). The time unit used for the time axis is not particularly limited and varies depending on the type of journey. For a typical car journey (as in Fig. However, (as shown in Figure 11 of the present disclosure) the time axis may be formed in a time unit such as hours and / or minutes. For example, a time axis in seconds may also be used.

[0181] The timeline for the journey (as in Fig. 12 of the present disclosure) may be created once the route for the trip has been received by the receiving circuitry. The timeline may be estimated or constructed, for example, based on information from one or more additional information sources (such as map information or the like). In some examples, the timeline for the trip may be estimated or constructed based on contextual information such as the time of day, the type of roads on which the trip takes place, and / or the current traffic volume on the route. An example trip (as shown in Fig. 11 of the present disclosure) may have a first timeline if it is made by a person in the afternoon, but the same trip may have a second, different timeline if the trip is made by the person at a very busy time (e.g., early in the morning when more people are traveling to work).

[0182] Additionally, the travel timeline can be updated throughout the journey. This means that the estimated travel time can be shortened or lengthened by the device 10000 depending on the person's journey. If the person makes an unplanned stop along the way or encounters unexpected traffic on the road, the travel timeline (and thus the estimated travel time) may be extended.

[0183] Once created, the timeline of the trip can be correlated with the route (e.g., using map information or the like) to determine at what point during the trip the person will reach the portions of the trip detected by detection circuit 10004.

[0184] In the example of Fig. 12 of the present disclosure, the period designated as 12000 may correspond to the portion of the journey 11012 described in Fig. 11 of the present disclosure is referred to as the first leg of the journey likely to cause motion sickness (i.e., exhibits the first predetermined characteristic). Furthermore, the period of time referred to as 12002 may correspond to the leg of the journey 11014 described in Fig. 11 of the present disclosure is referred to as the second leg of the journey likely to cause motion sickness (i.e., the second leg of the journey with the first predetermined characteristic). Thus, time 12002A may correspond to the time at which the car is estimated to reach position 11008, while time 12002B may correspond to the time at which the car is estimated to reach position 11010. The period 12002 between times 12002A and 12002B is therefore the amount of time that the car in the example of Fig. 11 of the present disclosure is estimated to be required for the journey between 11012 and 11014.

[0185] In this way, the identification circuit 10006 of the device 1000 can identify a time period corresponding to a portion of the journey having the first predetermined feature. The device 10000 then knows when the traveling person reaches the portion of the journey having the first predetermined feature, as well as how long that portion of the journey will take once reached. For example, the device 10000 can know that portion 11014 will be reached at 10:15 a.m. and that the person will need 20 minutes to travel from 11008 to 11010. Of course, these times are only an example and are not limiting to the present disclosure.

[0186] It will be appreciated that it is particularly advantageous to identify a period of time corresponding to a portion of the journey having the first predetermined characteristic in this manner. That is, by determining the time during the journey at which the portions of the journey most likely to cause motion sickness will occur, and by determining how long each of these portions will last, the device 10000 is able to create a plan in advance of the journey for the most appropriate content to be displayed on a display device in the vehicle at each stage of the journey, so that the motion sickness experienced by the user during the journey can be alleviated. This improves processing efficiency because the content for display can be obtained in advance.

[0187] Of course, as explained earlier, the schedule can be updated or modified during the journey (e.g., based on the car's current location information). However, such adjustments usually only require minor changes to the timeline and the corresponding content to be displayed (e.g., a small delay before reaching section 11014 of the journey (e.g., an unexpected stop) may delay the start of period 12002, but will not significantly increase the duration of period 12002 (i.e., the time to traverse section 11014 after reaching that section). Therefore, even if the timeline is updated or revised during the journey, the changes to the content selected for display can be relatively minor and implemented efficiently.

[0188] The identification circuit 10006 may identify the time period corresponding to the section or sections of the journey with the first predetermined feature in any suitable manner, depending on the situation. That is, in some examples, these time periods may be identified without creating a timeline for the entire journey. Using the example of Fig. 11 of the present disclosure, the detection circuit 10006 may detect that the trip segment identified as 11012 may last 15 minutes (or any other period of time) based solely on an analysis of that trip segment (e.g., the length of that road segment and the expected speed of the car while traveling on that section of the road). Then, when the car is determined to reach that road segment (based on the car's location information), the person may be presented with appropriate predetermined content with a duration of 15 minutes, preselected by the selection circuit 10008 of the device 10000—regardless of when during the trip (e.g., how long since the start of the trip) that segment of the trip is reached.Therefore, motion sickness can also be mitigated by identifying only the time periods corresponding to the section or sections of the journey that have the predetermined feature (as opposed to creating an entire timeline for the journey). <auswahlschaltung>

[0189] As mentioned with reference to Fig. 10 of the present disclosure, the device 10000 may include a selection circuit 10008 configured to select one or more content items having a second predetermined characteristic for display over the time period.

[0190] As mentioned in the background, a person is most likely to experience motion sickness when their various senses are inconsistent. Specifically, the discrepancy between the sensation of motion created by traveling in a car along a specific route (as perceived by a person's inner ear) and the motion (or lack thereof) perceived by the person's eyes can cause motion sickness in that person. The differences between these signals can be further amplified when the user is viewing certain types of content on a display device.

[0191] Let us now consider the example from Fig. 13 of the present disclosure. Fig. 13 illustrates an example of content with different features according to embodiments of the disclosure.

[0192] This example shows three pieces of content: Content 13000, Content 13002, and Content 13004. Each of these pieces of content represents a specific piece of video content. This means that while a single image is displayed for each piece of content, each piece of content can actually consist of a series of different images that can be displayed to the user in a video sequence.

[0193] In this example, the first piece of content 13000 represents an action film (or movie). This action film contains a large number of different computer-generated effects. In addition, between frames of the film or video sequence, a number of different objects can move relative to each other. Therefore, a person viewing the first piece of content 13000 will see many different visual indicators of movement with their eyes. If a person views this first piece of content during a journey, as in Fig. 11 of the present disclosure, the person is more likely to experience motion sickness (because the risk of conflict between the motion the person sees in the film and the sensation of motion the person experiences while traveling in the car increases).

[0194] Furthermore, the second content 13002 in this example is a video, e.g., a television program showing a motorsport. This television program shows several racing cars driving very fast around a racetrack, trying to reach the finish line first. Therefore, a person watching the second content 13002 will see many different visual indicators of movement with their eyes. If a person watches this second content during a journey such as the one in Fig. 11, the person is more likely to experience motion sickness (because the risk of conflict between the motion the person sees in the television program and the sensation of motion the person experiences during the journey in the car increases).

[0195] The third content 13004 in this example represents a video, e.g., a relaxing film with a sequence of images of a beach. In this video, there is very little sense of movement between the individual frames of the video. Furthermore, watching the video can give the user a feeling of relaxation. Therefore, a person viewing this third piece of content 13004 will perceive very few visual signs of movement with their eyes and experience a feeling of calm relaxation. If a person views this third content during a trip, as in Fig. 11, the person is less likely to experience motion sickness (because there is less risk of conflict between the movement the user sees in the video content and the sensation of movement the person feels during the journey).

[0196] The third content 13004 is therefore content having a second predetermined feature, where the second predetermined feature is any feature that indicates that a user viewing the content is less likely to experience a feeling of motion sickness. That is, in this example, the feature of being content with very few visual motion indicators is the second predetermined feature because content with very few visual motion indicators is less likely to cause a feeling of motion sickness in the user. However, this is only one type of second predetermined feature that may be used in accordance with embodiments of the disclosure.

[0197] Generally, the second predetermined characteristic is a characteristic of the content that indicates the likelihood that the content will cause motion sickness. In some examples, the content with the second characteristic is content that is less likely to cause and / or reduce or alleviate a feeling of motion sickness in a user. Although the degree of movement in the content may be determined with reference to Fig. 13 of the present disclosure as an example of the second characteristic of the content, the present disclosure is not particularly limited in this regard. The second predetermined characteristic may also include, for example, an indicator of the type of content (e.g., whether the user finds the content strenuous or relaxing), the number of scene changes in the content, a measure of the amount of text in the content, a historical indicator of whether the content is likely to cause motion sickness in the user, or the like.

[0198] It goes without saying that the present disclosure does not apply to the Fig. 13. Rather, there are many different types of content that may be used in accordance with embodiments of the disclosure, including various types of images, videos, text, video games, user interfaces, internet web pages, or the like. Indeed, any type of content that can be displayed on a display device may be used in accordance with the embodiments of the disclosure.

[0199] The various types of content may be stored locally on the device 10000. Alternatively, the various types of content may be stored external to the device 10000 (e.g., on a server or in a database) that the device 10000 accesses when needed.

[0200] In some examples, the device 10000 may be configured to perform processing steps on the content to enhance the second characteristic of the content (and thus make the content even more suitable for reducing or alleviating the user's feeling of motion sickness). The type of processing performed by the device 10000 to enhance the second characteristic of the content is not particularly limited and depends on the type of content and the second characteristic of that content itself. In the example of Fig. However, in accordance with Figure 13 of the present disclosure (where the second characteristic refers to the amount of motion within the video content), the device 10000 may enhance the second characteristic of a piece of content, such as content 13004, by processing the image frames of the video content to remove any objects within the content that move rapidly within the scene, processing the content to reduce the speed of transition between video frames, performing processing to skip a portion of the content that includes objects that move excessively quickly between frames of the video content, or the like. Of course, the processing performed to enhance the second characteristic of the content is not limited to these examples, and other types of processing may be performed as needed.

[0201] Let us now consider the Fig. 14 of the present disclosure. In this example, a timeline is shown according to embodiments of the disclosure. The timeline in Fig. 14 is similar to the timeline used in Fig. 12 of the present disclosure. The time axis in Fig. However, Figure 14 of the present disclosure corresponds to a journey in which only a single section was identified by the detection circuit as having a first predetermined feature.

[0202] The timeline in Fig. 14 of the present disclosure begins at t0 (in this example, the time at which the journey is initiated). The portion of the journey from t0 to t1 was not identified as a portion of the journey likely to cause motion sickness in the user. However, the period 14000 (from t1 to t2) was identified by the device 10000 as the portion of the journey most likely to cause motion sickness in a person viewing a screen during the journey. This may be due, for example, to the route traveled during this portion of the journey being particularly winding (with many turns and bends).

[0203] The part of the journey after time t2 has not been identified as a part of the journey that can cause motion sickness.

[0204] Based on this information, the selection circuit 10008 may therefore select one or more contents having a second predetermined characteristic for display over the time period 14004. The second predetermined characteristic used to select the one or more contents to be displayed is a characteristic of the content that indicates that the content is less likely to cause a feeling of motion sickness in a person and / or can be used to alleviate it. With reference to the Fig. 13 of the present disclosure, the second predetermined characteristic of the content may be a characteristic indicating the degree of movement within the content—wherein content with a lower degree of movement is less likely to trigger motion sickness in the individual. Accordingly, of the examples of content 13000, 13002, and 13004, content 13000 and 13002 may be identified as having a lot of movement within the content, while content 13004 may be identified as having little movement. Therefore, content 13004 is content having the second predetermined characteristic (e.g., less movement and less likely to cause motion sickness). The selection circuit 10008 may therefore select content 13004 as content suitable for display during the portion of the journey 14000 (between t1 and t2) because this is the portion of the journey most likely to trigger motion sickness in an individual.Indeed, by selecting this content for display during this period, device 10000 can plan appropriate content for the trip, so that a person's feeling of motion sickness can be reduced. Specifically, by displaying content 14004 during period 14000, the feeling of motion sickness during the portion of the trip most likely to cause motion sickness can be reduced or alleviated.

[0205] In the example of Fig. 14 of the present disclosure, the device 10000 may display any type of content for the period between t0 and t1 and the period after t2 (until the end of the trip).

[0206] The reason for this is that these parts of the journey are much less likely to trigger motion sickness. Therefore, content such as content 13000 from Fig. 13 of the present disclosure for display during these periods. In some examples, the content to be displayed during periods other than 14000 (i.e., periods not associated with portions of the journey that are likely to induce motion sickness) may be selected based on user preferences or user commands. Only when the portion of the journey corresponding to period 14000 (i.e., from t1 to t2) is displayed is content 14004 displayed to reduce the user's feeling of motion sickness.

[0207] In some examples of the disclosure, once the selection circuit 10008 of the device 10000 has selected the content suitable for display, the device 10000 may cause a display device to display that content at the predetermined time during the trip. That is, the device 10000 may issue a control command or the like instructing the display device to display the content selected by the selection circuit 10008 at the appropriate time during the trip. In some embodiments of the disclosure, the device 10000 may be configured to display the one or more content items having the second predetermined feature during the period corresponding to the first leg of the trip.

[0208] For example, a person traveling by car from starting point 11000 to ending point 11002 wants to watch an action movie during the journey. Accordingly, the in-car display may show this action movie while the car travels from starting point 11000 to ending point 11002. However, when the car reaches section 11012 or 11014, device 10000 may control the display to warn the user that they are entering a section of the journey that is likely to cause motion sickness. Furthermore, device 10000 may control the display to show specific content on the display (e.g., content 13004) to alleviate or reduce the user's feeling of motion sickness.Once the car leaves section 11012 or 11014 and thus travels on a section of road less likely to cause motion sickness, device 10000 can control the display to redisplay the action movie. This can reduce a person's feeling of motion sickness during a journey.

[0209] As previously mentioned, the selection circuit 10008 selects one or more pieces of content from internal or external storage for display during a period of time identified as corresponding to a portion of the journey particularly likely to induce or trigger motion sickness in the user. The content selected by the selection circuit 10008 is content having a second predetermined characteristic (a characteristic likely to alleviate or reduce motion sickness in the user). The selected content is content suitable for display during the period of time. However, it may be the case that the content available for selection by the selection circuit has a different temporal length (or duration) than the period of time for which the content is to be displayed.This means there may be a discrepancy between the time period for which the content is to be selected and the duration of the content that has the second predetermined characteristic and is available for selection. This can be particularly problematic if the content available for selection has a shorter duration than the time period. In this case, content that can reduce or alleviate the user's feelings of motion sickness may not be displayed for the entire duration of the identified journey.

[0210] Accordingly, in some examples, device 10000 may be configured to determine a difference between the length of the period and the duration of the one or more content items and to change the route for the trip to reduce the difference if the difference is above a predetermined threshold.

[0211] Let us consider again the example of Fig. 11 of the present disclosure. In this example, a portion of the journey 11014 has been identified as a portion of the journey likely to cause motion sickness in the person traveling in the car. Accordingly, a time period corresponding to this portion of the journey is determined; in this example, portion 11014 of the journey may last 20 minutes. Therefore, the selection circuit 10008 may select one or more pieces of content suitable for display during this time period. The content displayed during portion 11014 may last 20 minutes (so that it can be displayed throughout the entire time the car travels through portion 11014 of the journey) and may include a second predetermined feature (a feature suitable for reducing or alleviating the user's feelings of motion sickness).From the content available for selection, selection circuitry 10008 may identify that a portion of content 13004 has the second predetermined characteristic. However, this content 13004 may only be 19 minutes long. Accordingly, the difference between the time period and the duration of content 13004 is 1 minute. In this example, the predetermined threshold that triggers a change in the trip route may be a difference of 30 seconds or more. Because the difference between the time period and the duration of the content (i.e., 1 minute) is greater than this threshold (i.e., 30 seconds), selection circuitry 10008 of device 10000 may change the route for the trip to reduce the difference between the time period and the duration of the content. In this example, selection circuitry 10008 may determine that a slightly different route through portion 11014 of the trip is possible, having a slightly shorter time period than the originally selected route.This can be determined by comparing the route with map information or similar.

[0212] This slightly shorter route may have a duration of 19 minutes and 20 seconds. Accordingly, this alternative route can reduce the difference between the time period and the duration of the content, allowing content likely to reduce or alleviate the person's feelings of motion sickness to be displayed for a larger percentage of the time the car travels through section 11014. This ensures that the feeling of motion sickness can be reduced more effectively and efficiently during the journey.

[0213] Alternatively or additionally, the device 1000 may be configured to, if the difference between the length of the period and the duration of the one or more content items is above the predetermined threshold, modify the one or more content items to reduce the difference if the difference is above a predetermined threshold.

[0214] In the example given with reference to Fig. 11 of the present disclosure (where the difference between the time period and the duration of the content is 1 minute, but the predetermined threshold is 30 seconds), the device 10000 may change the content 13004 to decrease the difference between the duration of that content and the time period 11014. For example, the device 10000 may change the playback speed of the content so that the content has a duration equal to (or much closer to) the time period. Displaying the content 13004 at a playback speed of 0.95 (compared to the intended or original speed) means that the content 13004 will be played for 20 minutes. Therefore, the content 13004, which may reduce or alleviate a user's feeling of motion sickness, may be displayed the entire time the car is traveling through the section 11014.Furthermore, such a change in the playback speed of the content may be imperceptible to the person if the change in the playback speed of the content is within certain limits. By reducing the difference between the duration of the content and the period 11014, the feeling of motion sickness in a person during travel can be more effectively and efficiently reduced.

[0215] However, it should be understood that changing the one or more content items selected by selection circuit 10008 to reduce the difference between the time period and the content duration is not limited to changing the playback speed of the content. In some examples, if the difference between the content duration and the time period is greater than a predetermined threshold, device 10000 may be configured to generate an additional content item for display during the time period once the one or more selected content items have been displayed. That is, if no other suitable content is available for selection, device 10000 may generate additional content having the second predetermined feature that may be displayed during the remaining time the car travels through section 11014 once the selected content has been displayed.In the example given with reference to . Fig. 11 of the present disclosure, if the difference between the time period and the duration of content 13004 is 1 minute, device 10000 may generate additional content suitable for display while the car travels through portion 11014 of the journey, which has a duration of 1 minute. This may then be displayed after the selected content is displayed to ensure that content suitable for reducing or alleviating a person's feeling of motion sickness can be displayed throughout the time the car travels through portion 11014.

[0216] The additional content may be generated by device 10000 based on the content already present in the internal or external memory. For example, device 1000 may be configured to generate a short summary, highlight, or trailer related to an existing content item as an additional content item. Alternatively, device 10000 may generate an additional content item by selecting an image from a portion of the video content and generating new video content based on that image, such that the image is displayed to the user for the corresponding amount of time. Alternatively, the new content may also be computer-generated content or content generated through machine learning techniques or the like.In some examples, the additional content item generated by device 10000 may include an advertisement having the second predetermined characteristic (being capable of reducing or alleviating the user's feelings of motion sickness). This advertisement may be displayed for the remaining time after the selected content is displayed to the user while traveling through section 11014. Once the advertisement ends, the user may return to viewing any type of content (since they are no longer in a part of the journey likely to cause motion sickness).

[0217] It will be understood that the present disclosure is not limited to these examples, which are described with reference to the Fig. 11 of the present disclosure. Time differences that are much longer and much shorter than those described in this example may be used in accordance with the embodiments of the disclosure. Furthermore, different types of content, various modifications to the travel route, and / or various modifications to the selected content may be performed by the device 10000 as needed, depending on the situation to which the embodiments of the disclosure are applied.

[0218] It is now clear that the portions of the journey detected by detection circuit 10002 are the portions of the journey most likely to trigger motion sickness in the user. Generally, these are the portions of the journey that have the first predetermined feature. If a portion of the journey has this predetermined feature (e.g., if the portion of the journey involves a very winding section of road), device 10000 can select content suitable for display during that portion of the journey. Content is selected that, when viewed by a person on a display device, reduces or alleviates the user's feeling of motion sickness.

[0219] However, in some examples, certain sections of a journey may have a very high probability of causing motion sickness in a user (e.g., a probability of causing motion sickness that is higher than the value specified by the first predetermined feature). Let us consider again the Fig. 11 of the present disclosure. In this example, the portion 11014 of the journey consists of many sharp turns in quick succession. Therefore, the portion 11014 of the journey is very likely to cause a feeling of motion sickness in the user. If a portion of the journey has a third predetermined feature that indicates a very high probability of motion sickness (such as the rapid succession of turns in Fig. 11), the device 10000 and / or the selection circuit 10008 may make a different selection of content for that period. A very high probability of motion sickness may be a probability of motion sickness that is above a predetermined threshold. The predetermined threshold may be set based on the user, the trip, or the type of vehicle used for the trip. A portion of the content with the third predetermined characteristic (indicating a very high probability of motion sickness) may also relate to a portion of a trip with a second predetermined characteristic (indicating a probability of motion sickness).

[0220] In some examples, device 10000 may be configured to pause the display of content during a period of time related to a portion of the journey that has a very high probability of causing motion sickness in the individual. By pausing the display of content, the individual will then stop viewing content on the screen, which may further reduce or alleviate the feeling of motion sickness during the portions of the journey that have a high probability of causing motion sickness. In addition, additional content may be displayed, such as a warning message (e.g., "Warning, high probability of motion sickness") and / or instructions to the user on how to alleviate motion sickness (e.g.,"Stop looking at the display during the next section of the journey"), generated and displayed on the display while the original content was paused, to further encourage the person not to look at the display during the sections of the journey where motion sickness is most likely to occur.

[0221] Once the person has passed through these worst sections of the journey (i.e., the sections of the journey that have the third predetermined feature indicating that the likelihood of the user experiencing motion sickness during that section of the journey is above a predetermined threshold), the device 10000 can resume playback of content. This means that all content that was displayed before playback was interrupted can continue to be displayed even after the end of that section of the journey. Therefore, the selection of content for display during the journey can be made even in the sections of the journey that are most likely to cause motion sickness in the user (i.e., the sections with the third predetermined feature) in such a way that the user's feeling of motion sickness can be alleviated or reduced. For example, on certain sections of the journey, such as 11006 in Fig. 11, view any content on the display. Then, for sections of the journey that have a first predetermined characteristic, specific content to reduce or alleviate the user's feeling of motion sickness can be displayed. However, for journey sections with the third predetermined characteristic (i.e., journey sections where the probability of motion sickness occurring is above a predetermined threshold), the display of content on the display device can be paused so that the user no longer views the display during that time. The user's feeling of motion sickness during the journey can thus be effectively and efficiently reduced. <Vorteilhafte technische Effekte>

[0222] The device 10000, which is in accordance with embodiments of the disclosure (as described with reference to Fig. 10 to 14 of the present disclosure) is configured to select content for display during a trip to alleviate motion sickness. That is, if a portion of a trip has been identified as having a first predetermined characteristic (e.g., a portion of the trip likely to cause motion sickness), the device 10000 is capable of selecting content most suitable for that portion of the trip. Accordingly, content that alleviates the feeling of motion sickness may be displayed during the portions of the trip where the person is most likely to feel discomfort. Thus, motion sickness may be alleviated or reduced during the trip.

[0223] It goes without saying that the advantageous technical effects achieved by embodiments of the disclosure are not particularly limited in this regard. Further advantageous technical effects will become apparent to those skilled in the art upon reading the disclosure. <verfahren>

[0224] Fig. 15 illustrates an example of a method in accordance with embodiments of the disclosure. The method is a method for selecting content for display during travel to alleviate motion sickness. This method may be performed by a device such as device 1000 of the present disclosure. Furthermore, a computer program product may be provided that includes instructions that, when implemented by a computer, cause the computer to perform the Fig. 15 of the present disclosure.

[0225] The procedure in Fig. 15 begins at S15000 and proceeds to step S15002. In some examples, the start of the method may be a time prior to the start of the journey. However, the present disclosure is not particularly limited in this regard, and the start of the method may occur at any other time depending on the situation.

[0226] In step S15002, the method includes receiving information indicating a route for a trip. The route may, for example, be the route a vehicle, such as a car, takes when traveling from one point to another. Once the route information has been received, the method proceeds to step S15004.

[0227] In step S15004, the method includes detecting at least a first portion of the journey that has a first predetermined feature. The first portion of the journey may, in some examples, be a portion—such as portion 11014 of the example in Fig. 11 of the present disclosure—which is particularly likely to cause a feeling of motion sickness. The process then proceeds to step S15006.

[0228] In step S15006, the method includes identifying a time period corresponding to the first leg of the trip. The time period corresponding to the first leg of the trip may indicate a period during an anticipated timeline of the trip that corresponds to the first leg of the trip. Furthermore, the time period may indicate how long the first leg of the trip will take once it occurs (i.e., the duration of the first leg of the trip). The method then continues with step S15008.

[0229] In step S15008, the method includes selecting one or more content items with a second predetermined characteristic for display over the period of time. For example, the content may have a particular characteristic that can reduce a user's feelings of motion sickness. Therefore, content suitable for the first part of the journey (e.g., the part of the journey most likely to trigger motion sickness in the user) may be selected in advance.

[0230] The method then proceeds to step S15010 and ends there. However, in some examples, the Fig. 15 – or individual steps within this procedure – may be carried out repeatedly. This means that even if the content has been selected for the first part of the journey, the content may be updated or modified according to changes or delays during the journey. Furthermore, other procedural steps may also be included in this procedure, if necessary. These procedural steps do not have to be carried out in the manner described in Fig. 15 shown sequence, and a series of process steps of Fig. 15 can be used in parallel with one or more of the other Fig. 15 the process steps shown are carried out.

[0231] While several embodiments of the disclosure have been described with reference to the example of motion sickness associated with the movement of a car, it will be understood that the present disclosure is not particularly limited in this regard. Rather, embodiments of the present disclosure may be applied to alleviate the feeling of motion sickness experienced when viewing a display device in any situation. This may include viewing a display device while traveling in other types of vehicles, such as while traveling in another road vehicle (e.g., a bus) or while traveling in a vehicle such as an airplane or a boat. Furthermore, embodiments of the present disclosure may also be applied to situations where a user views a display device while traveling in a vehicle other than a vehicle (e.g., while walking).The beneficial technical effects of reducing the sensation of motion sickness can be achieved in all these situations.

[0232] Furthermore, it will be appreciated that the first embodiment of the disclosure and the second embodiment of the disclosure are not mutually exclusive. That is, elements of the first embodiment (related to dynamic motion compensation) and elements of the second embodiment of the disclosure (related to planning and selecting content for display during travel) may be combined to further reduce the feeling of motion sickness experienced by a user. For example, device 10000 may select content to be displayed during travel to reduce or alleviate the user's feeling of motion sickness. However, during travel, this selected content may be displayed by device 3000 such that the position of the image on a display device is dynamically adjusted according to the movement during the travel.This ensures that the feeling of motion sickness experienced by the user can be reduced as efficiently and effectively as possible.

[0233] Furthermore, embodiments of the present disclosure may be arranged in the manner defined by the following numbered sections: 1. A method for alleviating motion sickness in a user viewing an image on a display, the method comprising: Displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; Creating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance; Detecting a movement of the user and the display device to a new position relative to the virtual screen; Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device. 2. A method according to clause 1, wherein the user and the display device are on board a vehicle, and wherein the method comprises detecting movement of the user and the display device by detecting movement of the vehicle. 3. The method of clause 2, wherein the distance between the user and the display device remains the first distance when the user and the display device move to a new position relative to the virtual screen. 4. The method of clause 2, wherein the method comprises detecting the movement of the vehicle using one or more gyro sensors, accelerometers, GPS signals, map information and / or control signals to control the movement of the vehicle. 5. Method according to one of the preceding sections, wherein the movement of the user and the display device includes a rotational and / or translational movement. 6. The method of any preceding paragraph, wherein the image comprises a photograph, text content, and / or an image from a video. 7. The method of any preceding paragraph, wherein the method comprises generating audio associated with the image when the image is displayed on the display device, and shifting a source position of the audio in accordance with the new image position when the image is displayed on the display device at the new image position. 8. The method of any preceding paragraph, wherein the method comprises adjusting the display of the image on the display device when the movement of the user and the display device relative to the virtual screen is above a threshold. 9. The method of clause 8, wherein adjusting the display of the image on the display device includes displaying a predetermined image to replace the image on the display device. 10. The method of clause 9, wherein the predetermined image includes a blank image and / or an image having a predetermined property. 11. The method of clause 8, wherein the method comprises generating audio associated with the image when the display of the image on the display device has been adjusted. 12. The method of clause 8, wherein, if the movement of the user and the display device relative to the virtual screen remains above the threshold for a predetermined amount of time, the method comprises moving the virtual screen to a new position of the virtual screen corresponding to the position defined by projecting a line from the new position of the user and the display device to a third position, the distance of the third position being the same as the second position. 13. The method of clause 12, wherein the method comprises incrementally moving the virtual screen to the new virtual screen position over a second predetermined period of time. 14. The method of clause 8, wherein the threshold corresponds to a movement such that no part of the new image position overlaps with the display device. 15. The method of any preceding paragraph, wherein, if no portion of the new image position overlaps with the display device, the method comprises adjusting the new image position such that at least a predetermined portion of the image overlaps with the display device. 16. The method of clause 15, further comprising adjusting the image for display to indicate that the new image position has been adjusted. 17. A device for alleviating motion sickness in a user viewing an image on a display, the device comprising a circuit configured to: Displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; Creating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance; Detecting a movement of the user and the display device to a new position relative to the virtual screen; Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device. 18. A computer program product containing instructions which, when implemented by a computer, cause the computer to perform a method for alleviating motion sickness in a user viewing an image on a display, the method comprising: Displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; Creating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance; Detecting a movement of the user and the display device to a new position relative to the virtual screen; Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device.

[0234] While several embodiments of the disclosure have been described with reference to the example of motion sickness associated with the movement of a car, it will be understood that the present disclosure is not particularly limited in this regard. Rather, embodiments of the present disclosure may be applied to alleviate the feeling of motion sickness experienced when viewing a display device in any situation. This may include viewing a display device while traveling in other types of vehicles, such as while traveling in another road vehicle (e.g., a bus) or while traveling in a vehicle such as an airplane or a boat. Furthermore, embodiments of the present disclosure may also be applied to situations where a user views a display device while traveling in a vehicle other than a vehicle (e.g., while walking).The beneficial technical effects of reducing the sensation of motion sickness can be achieved in all these situations.

[0235] Furthermore, it will be appreciated that the first embodiment of the disclosure and the second embodiment of the disclosure are not mutually exclusive. That is, elements of the first embodiment (related to dynamic motion compensation) and elements of the second embodiment of the disclosure (related to planning and selecting content for display during travel) may be combined to further reduce the feeling of motion sickness experienced by a user.

[0236] Of course, numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore to be understood that, within the scope of the appended claims, the disclosure may be practiced other than as specifically described herein.

[0237] To the extent that embodiments of the disclosure have been described as being implemented at least in part by software-controlled data processing devices, it will be understood that a non-transitory machine-readable medium carrying such software, such as an optical disk, a magnetic disk, a semiconductor memory, or the like, is also considered an embodiment of the present disclosure.

[0238] It is understood that, for clarity, the foregoing description has described embodiments with reference to various functional units, circuits, and / or processors. However, it is understood that any suitable distribution of functionality between various functional units, circuits, and / or processors may be used without departing from the embodiments.

[0239] Described embodiments may be implemented in any suitable form, including hardware, software, firmware, or any combination thereof. Described embodiments may optionally be implemented at least in part as computer software executing on one or more data processors and / or digital signal processors. The elements and components of any embodiment may be physically, functionally, and logically implemented in any suitable manner. Indeed, the functionality may be implemented in a single unit, in multiple units, or as part of other functional units. As such, the disclosed embodiments may be implemented in a single unit, or they may be physically and functionally distributed among different units, circuits, and / or processors.

[0240] Although the present disclosure has been described in connection with some embodiments, it is not intended to be limited to the particular form set forth herein. Furthermore, although a feature may appear to be described in connection with particular embodiments, those skilled in the art would recognize that various features of the described embodiments may be combined in any suitable manner to implement the technique.< / verfahren> < / auswahlschaltung> < / identifizierungsschaltung> < / erkennungsschaltung> < / empfangsschaltung> < / vorrichtung> < / verfahren> < / beispielsituationen> < / bestimmungsschaltung> < / erkennungsschaltung> < / erzeugungsschaltung> < / anzeigeschaltung> < / vorrichtung>

Claims

[1] A method for alleviating motion sickness in a user viewing an image on a display, the method comprising: Displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; Creating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance; Detecting a movement of the user and the display device to a new position relative to the virtual screen; Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device. [2] The method of claim 1, wherein the user and the display device are on board a vehicle, and wherein the method comprises detecting movement of the user and the display device by detecting movement of the vehicle. [3] The method of claim 2, wherein the distance between the user and the display device remains the first distance when the user and the display device move to a new position relative to the virtual screen. [4] The method of claim 2, wherein the method comprises detecting the movement of the vehicle using one or more gyro sensors, acceleration sensors, GPS signals, map information and / or control signals for controlling the movement of the vehicle. [5] The method of claim 1, wherein the movement of the user and the display device includes a rotational and / or translational movement. [6] The method of claim 1, wherein the image comprises a photograph, text content and / or an image from a video. [7] The method of claim 1, wherein the method comprises generating audio associated with the image when the image is displayed on the display device, and shifting a source position of the audio in accordance with the new image position when the image is displayed on the display device at the new image position. [8] The method of claim 1, wherein the method comprises adjusting the display of the image on the display device when the movement of the user and the display device relative to the virtual screen is above a threshold. [9] The method of claim 8, wherein adjusting the display of the image on the display device includes displaying a predetermined image to replace the image on the display device. [10] The method of claim 9, wherein the predetermined image includes a blank image and / or an image having a predetermined property. [11] The method of claim 8, wherein the method comprises generating audio associated with the image when the display of the image on the display device has been adjusted. [12] The method of claim 8, wherein, if the movement of the user and the display device relative to the virtual screen remains above the threshold for a predetermined amount of time, the method comprises moving the virtual screen to a new position of the virtual screen corresponding to the position defined by projecting a line from the new position of the user and the display device to a third position, the distance of the third position being the same as the second position. [13] The method of claim 12, wherein the method comprises incrementally moving the virtual screen to the new virtual screen position over a second predetermined period of time. [14] The method of claim 8, wherein the threshold corresponds to a movement where no part of the new image position overlaps with the display device. [15] The method of claim 1, wherein, if no part of the new image position overlaps with the display device, the method comprises adjusting the new image position so that at least a predetermined part of the image overlaps with the display device. [16] The method of claim 15, further comprising adjusting the image for display to indicate that the new image position has been adjusted. [17] A device for alleviating motion sickness in a user viewing an image on a display, the device comprising a circuit configured to: Displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; Creating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance; Detecting a movement of the user and the display device to a new position relative to the virtual screen; Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device. [18] A computer program product containing instructions which, when implemented by a computer, cause the computer to perform a method for alleviating motion sickness in a user viewing an image on a display, the method comprising: Displaying an image on a display device, the display device being at a first distance from a user viewing the image on the display device; Creating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second position, wherein the distance of the second position from the user is greater than the first distance; Detecting a movement of the user and the display device to a new position relative to the virtual screen; Determining a new image position by projecting a line from the position of the virtual screen to the new position of the user; and displaying an image on the display device at the new image position for at least a portion of the image for which the new image position overlaps with the display device.

Citation Information

Cited By

  • Entertainment system that prevents motion sickness, and vehicle with such an entertainment system

    DE102025110267A1