Image display system and image display method for preventing motion sickness

Abstract

The present invention discloses an image display system and an image display method for preventing motion sickness. The image display method comprises the following steps: obtaining a user's field of view on a display; extracting an external image on the other side of the display relative to the user, the external image having a first area and a second area; calculating an image change rate of the first area and an image change rate of the second area; sensing the posture of a vehicle; and displaying at least one image on the display according to the field of view, the image change rate of the first area, the image change rate of the second area, and the posture of the vehicle.

Description

Technical Field

[0001] The present invention relates to an image display system and an image display method, and in particular to an image display system and an image display method for preventing motion sickness in a user in a vehicle. Background Art

[0002] The shaking of the vehicle when it is moving may cause the user of the vehicle (driver or passenger) to feel dizzy and uncomfortable, which is called "motion sickness". More specifically, when the user is riding in the vehicle and looking at the external scenery, the external scenery moves and changes rapidly relative to the vehicle, causing the user's vestibular perception of motion state and spatial position to conflict, causing the user's motion sickness.

[0003] In order to reduce motion sickness, the user can try to look at a constant scene in the distance, change the user's riding posture, improve the air quality in the vehicle, or take anti-sickness drugs. However, when the vehicle travels long distances and is in different fields or different road conditions, the above methods may not be able to effectively suppress motion sickness. Therefore, the relevant industries in this technical field are committed to more effective solutions to improve users' motion sickness. Summary of the invention

[0004] The technical solution disclosed in the present invention is to provide an image display system, including a display, a first information extraction device, a second information extraction device, a sensor and a processing device. The first information extraction device is used to obtain the user's field of view on the display. The second information extraction device is used to extract an external image of the display on the other side relative to the user, and the external image has a first area and a second area. The sensor is used to sense the posture of the vehicle. The processing device is used to generate at least one image, and display the at least one image on the display according to the field of view, the image change rate of the first area, the image change rate of the second area and the posture of the vehicle.

[0005] Another technical solution of the present disclosure provides an image display method, comprising the following steps: obtaining a user's field of view on a display; extracting an external image on the other side of the display relative to the user, the external image having a first area and a second area; calculating an image change rate of the first area and an image change rate of the second area; sensing a posture of a vehicle; and displaying at least one image on the display according to the field of view, the image change rate of the first area, the image change rate of the second area, and the posture of the vehicle.

[0006] Other aspects and advantages of the present invention will become apparent from a review of the following drawings, detailed description, and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 FIG. 4 is a block diagram of an image display system according to a first embodiment of the present disclosure.

[0008] Figure 2 and Figure 3 A schematic diagram of the display position of the disclosed image.

[0009] Figure 4 FIG. 4 is a schematic diagram of a method for determining an image change rate according to the first embodiment of the present disclosure.

[0010] Figure 5 Flow chart of a method for determining an image change rate according to the first embodiment of the present disclosure.

[0011] FIG. 6A to FIG. 6D A schematic diagram of a display position and / or display angle adjustment method of an image disclosed in the present invention.

[0012] FIG. 7A to FIG. 7B A schematic diagram of the type and / or color selection method of the image disclosed in the present invention.

[0013] Figure 8 The present invention is a flowchart of a method for selecting an image type and / or color.

[0014] Fig. 9 It is a schematic diagram of a method for determining an external image reference mark according to the present invention.

[0015] Fig.10 The present invention is a flowchart of a method for determining a reference mark of an external image.

[0016] Fig.11 is a flowchart of an image display method according to the first embodiment of the present disclosure.

[0017] Fig. 12A , 12B FIG. 4 is a flow chart of an image display method according to a second embodiment of the present disclosure.

[0018] Fig.13A , 13B is a flowchart of an image display method according to the third embodiment of the present disclosure.

[0019] Fig.14A is a flowchart of an image display method according to a fourth embodiment of the present disclosure.

[0020] Fig. 14B and Fig. 14C It is a schematic diagram of displaying an image in a single window manner or an annular cabin manner in the image display method of the fourth embodiment.

[0021] Fig.14D It is a schematic diagram of selectively masking an external image in an image display method according to a fourth embodiment of the present disclosure.

[0022] Fig.15A ,15B is a flowchart of an image display method according to a fifth embodiment of the present disclosure.

[0023] Fig.16A is a flowchart of an image display method according to a sixth embodiment of the present disclosure.

[0024] Fig. 16B A block diagram of an image display system for implementing the image display method of the sixth embodiment.

[0025] Fig. 16C FIG. 4 is a schematic diagram of displaying prompt information in the image display method of the sixth embodiment.

[0026]

Explanation of symbols

[0027] 100: Image display system

[0028] 102: Display

[0029] 104: First information extraction device

[0030] 106: Second information extraction device

[0031] 108: Sensor

[0032] 110: Processing device

[0033] 202: User

[0034] 302: User's head

[0035] 304: User's eyes

[0036] C1, C2: Image change rate

[0037] P: Posture

[0038] P_f: subsequent time posture

[0039] I1: First Area

[0040] I2: Second Area

[0041] V: Field of view

[0042] V1: Main visual field

[0043] V2: Secondary visual field area

[0044] G: Image

[0045] G_L: Left endpoint

[0046] G_R: right endpoint

[0047] Ht: Prompt information

[0048] IMG: External image

[0049] 402, 404, 410, 412: Block

[0050] 406, 408, 414, 416: Object

[0051] 418: Display information

[0052] 602: Vehicle

[0053] 902: Object

[0054] 1402: Vehicle

[0055] 1404: Car Window

[0056] 1408:Front windshield

[0057] 1410:Rear windshield

[0058] 502~520: Steps

[0059] 802~814: Steps

[0060] 1100, 1200, 1300, 1400, 1500, 1600: image display method 1002-1014: steps 1102-1116: steps 1202-1216: steps 1302-1316: steps 1402-1420: steps 1502-1516: steps 1602-1616: steps DETAILED DESCRIPTION

[0061] The technical terms in this specification refer to the customary terms in the technical field. If some terms are explained or defined in this specification, the interpretation of these terms shall be based on the explanation or definition in this specification. Each embodiment of the present disclosure has one or more technical features. Under the premise of possible implementation, those skilled in the art may selectively implement some or all of the technical features in any embodiment, or selectively combine some or all of the technical features in these embodiments.

[0062] Figure 1 is a block diagram of an image display system 100 according to a first embodiment of the present disclosure. Figure 2 and Figure 3 is a schematic diagram of the display position of the disclosed image G. First, please refer to Figure 1 The image display system 100 of the first embodiment of the present disclosure includes a display 102 , at least one first information extraction device 104 , at least one second information extraction device 106 , at least one sensor 108 and a processing device 110 .

[0063] Next, please also refer to Figures 1 to 3 The image display system 100 of the present disclosure can be applied to vehicles (such as vehicles, ships, etc.), and the display 102 of the image display system 100 can be set on the left and right windows or front and rear windshields of the vehicle. The user 202 is sitting inside the vehicle, and the setting position of the display 102 is used as a reference position. The user 202 is located on the inside of the display 102, and the external scene is located on the outside of the display 102. When the user 202 views the display 102, the user 202 has a field of view V on the display 102, and the first information extraction device 104 of the image display system 100 is used to obtain the field of view V of the user 202 on the display 102, and the second information extraction device 106 is used to extract the external image IMG of the display 102 relative to the other side of the user 202.

[0064] The external image IMG has a first region I1 and a second region I2, and the second information extraction device 106 is capable of calculating the image change rate C1 of the first region I1 and the image change rate C2 of the second region I2. In another example, the image change rate C1 of the first region I1 and the image change rate C2 of the second region I2 of the external image IMG can be calculated by the processing device 110.

[0065] When the vehicle is moving, the posture P of the vehicle may change, and the sensor 108 of the image display system 100 can be used to sense the posture P of the vehicle. The processing device 110 can generate an image G and display it on the display 102. The image G can be used as a constant reference mark for the user 202. In addition, according to the visual range V of the user 202 obtained by the first information extraction device 104, the image change rates C1 and C2 of the first area I1 and the second area I2 of the external image IMG calculated by the second information extraction device 106 or the processing device 110, and the posture P of the vehicle sensed by the sensor 108, the processing device 110 can adjust the display method of the image G on the display 102, such as adjusting the display position or display angle of the image G.

[0066] Due to the shaking of the vehicle, the change of posture or the rapid change of the external scene, the user 202 (such as the driver or passenger of the vehicle) may have a sensory conflict between the vestibular perception of the motion state and the spatial position, causing the user 202 to have motion sickness symptoms. The image display system 100 of the present disclosure can generate an image G and display it on the display 102, and the user 202 can watch the image G on the display 102 inside the vehicle. Compared with the rapidly changing external image IMG, the image G generated by the image display system 100 is in a relatively constant position and remains relatively constant. Therefore, the image G can be used as a constant reference mark for the user 202's vision, thereby reducing the sensory conflict of the user 202 and alleviating the motion sickness symptoms of the user 202. The above is an overview of the operation mode and technical effects of the image display system 100 of the present disclosure. The detailed operation mode of each device or element of the image display system 100 will be described below.

[0067] For more details, please also refer to Figures 1 to 3 The display 102 is, for example, a light-transmissive flat display, and the user 202 can see through the display 102 and view the external scene of the vehicle on the other side of the display 102. In one example, the display 102 can be set on the vehicle window. In another example, the display 102 can be a donut-shaped cabin type, and can be set on the front and rear windshields and left and right side windows of the vehicle in a manner that surrounds the vehicle cabin.

[0068] The first information extraction device 104 is, for example, a camera, a light sensing array, a low-power radar, or any other form of sensing device. The first information extraction device 104 may be disposed inside the vehicle to monitor and analyze the position and motion state of the head 302 or the eye 304 of the user 202. In one embodiment, the first information extraction device 104 monitors and analyzes the position and motion state of the head 302 or the eye 304 of the user 202 in real-time, and can immediately perform analysis and processing in response to the real-time dynamic changes of the head 302 or the eye 304 of the user 202. In one example, the image display system 100 may adopt edge computing to calculate the visual direction of the user 202 at that time by means of a processor (not shown in the figure) disposed in the first information extraction device 104, thereby obtaining the visual field V of the user 202 when viewing the display 102, and further divide the visual field V into a primary visual field area V1 and a secondary visual field area V2. The main visual field area V1 is the area where the user's line of sight is mainly concentrated, such as the upper half of the visual field V; the secondary visual field area V2 is the visual field of the user 202's peripheral vision, such as the lower half of the visual field V. In another example, the main visual field area V1 is, for example, the central position area of ​​the visual field V (which can be likened to the yolk area), and the secondary visual field area V2 is, for example, the peripheral area of ​​the visual field V (which can be likened to the egg white area). In other words, the main visual field area V1 can be the central position area where the user's 202 line of sight is mainly concentrated, and the secondary visual field area V2 can be the peripheral area of ​​the user's 202's peripheral vision. In another example, the image display system 100 can also adopt a central computing method, where the processing device 110 calculates the user's 202 line of sight direction at the time, obtains the user's 202 visual field V, and further divides the visual field V into the main visual field area V1 and the secondary visual field area V2.

[0069] After the visual range V of the user 202 at that time is calculated by the first information extraction device 104 or the processing device 110, the processing device 110 may display the image G within the visual range V. Furthermore, the main visual area V1 of the visual range V may be the area where the user 202's sight is mainly concentrated. In order not to obstruct the main sight of the user 202, in one embodiment, the image G may be displayed in an area outside the main visual area V1, for example, the image G may be displayed in the lower half area, the peripheral area or the edge of the visual range V of the user 202. In other words, the image G may be displayed within the secondary visual area V2, or the image G may be displayed on the edge line of the secondary visual area V2, and other display information may be displayed in the main visual area V1.

[0070] On the other hand, the second information extraction device 106 is, for example, a camera or any other form of image extraction device or image sensing device. The second information extraction device 106 can be disposed outside the vehicle to extract an image containing an external scene as an external image IMG. In one embodiment, the second information extraction device 106 can extract an image containing an external scene as an external image IMG in real time, so that the extracted external image IMG includes the external scene that the user 202 is viewing at the time. In addition, the second information extraction device 106 can also have a simple microprocessor to analyze and process the external image IMG. If the scene outside the vehicle changes rapidly relative to the vehicle, the external image IMG extracted by the second information extraction device 106 also changes rapidly, resulting in different degrees of similarity between multiple objects in the external image IMG. The second information extraction device 106 determines and calculates the image change rate of the external image IMG based on the similarity of the color, brightness and / or shape of the objects in the external image IMG. Please refer to Figure 3 In one example, the image display system 100 may use edge computing, for example, to divide the external image IMG into at least a first region I1 and a second region I2 by the second information extraction device 106, and respectively calculate the image change rate C1 of the first region I1 and the image change rate C2 of the second region I2 by the second information extraction device 106. In another example, the image display system 100 may also use central computing, for example, to calculate the image change rate C1 of the first region I1 and the image change rate C2 of the second region I2 by the processing device 110, so as to obtain a region with a higher image change rate: for example, it is obtained that the first region I1 has a higher image change rate C1, which is higher than the image change rate C2 of the second region I2. Then, the first region I1 with a higher image change rate C1 is selected by the second information extraction device 106 and / or the processing device 110, and the image G is displayed in the selected first region I1 by the processing device 110.

[0071] In summary, the image G is displayed at a suitable display position in the display 102. The suitable display position of the image G may roughly correspond to the inside of the secondary visual field area V2 of the visual field V of the user 202 or the edge line of the secondary visual field area V2, or to the first area I1 with a higher image change rate C1 of the external image IMG. In one example, the image G may be preferentially displayed in the secondary visual field area V2 of the visual field V of the user 202; if the secondary visual field area V2 also meets the condition of "having a higher image change rate", the image G is displayed in the secondary visual field area V2 and the secondary visual field area V2 may completely overlap or partially overlap with the first area I1 corresponding to the higher image change rate C1.

[0072] Next, the detailed operation of the second information extraction device 106 or the processing device 110 to determine and calculate the image change rate of the external image IMG is described below and in conjunction with Figure 4 's hint.

[0073] Figure 4 is a schematic diagram of a method for determining an image change rate according to the first embodiment of the present disclosure, Figure 5 Flow chart of the method for determining the image change rate according to the first embodiment of the present disclosure. Figure 4 and Figure 5 , the second information extraction device 106 or the processing device 110 can analyze the similarity of various attributes (e.g., color, brightness, and / or shape, etc.) of the image within the first area I1 of the external image IMG, and determine the image change rate C1 within the first area I1 accordingly. Similarly, the similarity of the above attributes of the image within the second area I2 can be analyzed and the image change rate C2 within the second area I2 can be determined accordingly. In this embodiment, the similarity of the above attributes of the image within the first area I1 (or the second area I2) is analyzed in a sampling manner. The sampling method is, for example, to sample and select one or more blocks 410, 412 (corresponding to step 502, step 504) in the external image IMG at a single time point. In an example, block 410 is a block with a larger range, block 412 is a block with a smaller range, and block 410 can roughly include block 412 (that is, block 412 can be completely included or partially included in block 410). In another example, block 410 may be adjacent to block 412 (i.e., block 412 may not be included in block 410). In addition, the second information extraction device 106 or the processing device 110 may further analyze various attributes (e.g., color, brightness, and / or shape, etc.) of objects 414 and 416 included in the range of block 410 and the above attributes of object 416 included in the range of block 412, and compare the similarity between the above attributes of block 410 and the above attributes of block 412 (corresponding to step 506).

[0074] In this embodiment, blocks 410 and 412 may be near-view areas that are relatively close to the user, and the relative movement speed of objects 414 and 416 relative to the user is fast. Object 414 in block 410 may be, for example, a building near the vehicle, and object 416 in block 412 may be, for example, a road or landform near the vehicle. If objects 414 and 416 have many visual elements in the user (for example, objects 414 and 416 include road signs, traffic lights, sidewalks, store signs, buildings, adjacent vehicles or pedestrians, etc.), objects 414 and 416 have high visual complexity in the user.

[0075] From the above, if the relative movement speed of objects 414 and 416 relative to the user is fast, or if the objects 414 and 416 are visually complex in the user, the similarity between the above attributes (color, brightness and / or shape) of block 410 and the above attributes (color, brightness and / or shape) of block 412 is low for the user's visual perception. In other words, if the objects 414 and 416 are visually chaotic in the user (relative movement speed is fast or complexity is high), the similarity between the above attributes of block 410 and the above attributes of block 412 is low. Accordingly, according to the similarity between the sampled blocks 410 and 412, the second information extraction device 106 or the processing device 110 can further determine the image change rate C1 of the first area I1 where the blocks 410 and 412 are located (corresponding to step 508).

[0076] On the other hand, the second information extraction device 106 or the processing device 110 may sample and select other one or more blocks 402, 404 in the external image IMG at the same time point (corresponding to step 510, step 512). Block 402 may be a block with a larger range, block 404 may be a block with a smaller range, and block 402 may substantially include block 404. Alternatively, block 402 may also be adjacent to block 404 (i.e., block 402 may not include block 404). Furthermore, the second information extraction device 106 or the processing device 110 may further analyze and compare the similarity between various attributes (e.g., color, brightness and / or shape, etc.) of the object 408 contained within the range of block 404 and the above attributes of the objects 406 and 408 contained within the range of block 402 (corresponding to step 514), and determine the image change rate C2 of the second area I2 where blocks 402 and 404 are located based on the similarity between the above attributes of block 404 and the above attributes of block 402 (corresponding to step 516).

[0077] In this embodiment, for example, blocks 402 and 404 may be distant view areas far from the user, and the relative movement speed of objects 406 and 408 relative to the user is relatively slow. Object 408 in block 404 is, for example, a mountain in the distance of the vehicle, and another object 406 in block 402 is, for example, a cloud in the distance of the vehicle. In addition, if objects 406 and 408 have fewer components in the user's vision and are relatively monotonous to the user's visual perception, the complexity of objects 406 and 408 in the user's vision is low. If the relative movement speed of objects 406 and 408 in blocks 402 and 404 is slow or the complexity is low, the chaos of blocks 402 and 404 in the user's visual perception is low, so the color, brightness and / or shape of block 404 is highly similar to block 402. Accordingly, the second information extraction device 106 or the processing device 110 can determine the image change rate C2 of the sampled blocks 402 and 404 (corresponding to step 516).

[0078] Next, the second information extraction device 106 or the processing device 110 compares the image change rate C1 of the first region I1 with the image change rate C2 of the second region I2 (corresponding to step 518). As mentioned above, in this embodiment, it can be compared that the image change rate C1 of the first region I1 is higher than the image change rate C2 of the second region I2.

[0079] A high image change rate C1 can easily lead to visual disharmony in the user and cause motion sickness. Therefore, the processing device 110 can display the image G in the first area I1 (corresponding to step 520) with a high image change rate C1 to serve as a constant reference mark for the user's vision. In addition to serving as a constant reference mark for the user, the image G can also have a larger size to cover the more complex scenes in the first area I1 with a high image change rate C1, thereby eliminating the visual complexity interference of the user. On the other hand, the second area I2 with a lower image change rate C2 can display other display information 418 (such as text).

[0080] In another comparative example, multiple images are extracted at multiple time points, and the image change rate is calculated based on the changes between different images. Different from the above comparative example, in the method for determining the image change rate of the first embodiment of the present disclosure, a single image (external image IMG1) is extracted at a single time point, and multiple blocks (such as blocks 402, 404, 410, 412) within the single image are analyzed to immediately determine the image change rate. In other words, the technical solution of the present disclosure can determine the image change rate in real time at a single time point, and can determine the display position of the image IMG in real time based on the real-time determination result, and has the technical effect of real-time processing.

[0081] The above-described implementation method determines the display position of the image G according to the image change rate of the external image IMG, but the technical solution of the present disclosure is not limited thereto. The processing device 110 may also adjust the display position and display angle of the image G according to the posture P of the vehicle. The sensor 108 of the image display system 100 is, for example, a gyroscope, a level or a six-axis sensor, which can be used to sense the posture P of the vehicle, for example, to sense the tilt or displacement of the vehicle in the front, back, left, and right directions. FIG. 6A to FIG. 6D This is a schematic diagram of the display position and / or display angle adjustment method of the disclosed image G. First, please refer to Fig. 6A , the sensor 108 senses that the posture P of the vehicle 602 is tilted forward, and senses the displacement caused by the forward tilt of the vehicle 602; accordingly, the processing device 110 changes according to the posture P of the vehicle 602 to execute a constant position algorithm, and displays the image G at a constant display position of the display 102, which can compensate for the displacement caused by the change in the posture of the vehicle 602.

[0082] In addition, in an optional embodiment, the processing device 110 may also adjust the display angle of the image G on the display 102 in response to the change in the posture P of the vehicle 602. For example, according to the user's habits, the display angle of the image may be adjusted to an angle complementary (opposite) to the posture P of the vehicle 602, so that the image G presented on the display 102 is constant for the user's vision, that is, the position does not change and the angle does not change. In one example, the image G is, for example, an image of the appearance of a post box. If the posture P of the vehicle 602 is leaning forward, the display angle of the post box is correspondingly adjusted to an upward-looking angle. See FIG. Figure 6B If the sensor 108 senses that the posture P of the vehicle 602 is in a normal posture and is not tilted, then the display angle of the mailbox is a frontal perspective. Figure 6C , if the sensor 108 senses that the posture P of the vehicle 602 is tilted backward, the display angle of the postbox is a downward angle. In another example, the display angle of the image G can also be adjusted to the same direction as the posture change of the vehicle 602 according to the different habits of the user. For example, if the posture P of the vehicle 602 is tilted forward, the display angle of the postbox is adjusted to a downward angle; if the posture P of the vehicle 602 is tilted backward, the display angle of the postbox is adjusted to an upward angle.

[0083] In another example of the present disclosure, the image G may also be a geometric figure. Fig.6D As shown, the image G is a long strip image, and the display angle of the long strip image G on the display 102 is complementary to the posture P of the vehicle 602. Fig.6D In the example of , the posture P of the vehicle 602 is tilted backward, and the display angle of the long strip image G is tilted forward, so the long strip image G viewed by the user in the vehicle 602 is still in the horizontal direction. Fig.6DIn the example of , the left end point G_L of the long strip image G can be aligned with the position where the front edge of the front door window of the vehicle 602 and the “A-pillar (the body pillar in front of the vehicle)” of the vehicle 602 intersect.

[0084] The image G is not limited to a single static pattern, but can be a dynamic pattern with three-axis dynamic display. The dynamic image can dynamically change the display position or display angle of the image G in real time in response to the posture change of the vehicle 602. For example, if it is sensed in real time that the vehicle 602 is tilted forward, the display angle of the image G can be dynamically changed to a top-down angle in real time.

[0085] In addition to determining the display position of the image G according to the image change rate of the external image IMG or adjusting the display angle of the image G according to the posture P of the vehicle, the processing device 110 may further select the type and / or color of the image G according to the field where the vehicle 602 is located. Fig. 7A and Figure 7B is a schematic diagram of the type and / or color selection method of the image G disclosed in the present invention, Figure 8 Flow chart of the method for selecting the type and / or color of an image G disclosed in the present invention.

[0086] Please also see Fig. 7A , 7B , 8, the image display system 100 may further include a positioning device (such as GPS) to locate and obtain the geographic coordinates of the user or the vehicle, and the processing device 110 of the image display system 100 may determine the location of the user or the vehicle based on the geographic coordinates (corresponding to steps 802, 804).

[0087] If the processing device 110 determines that the location is a street in a city (e.g. Fig. 7A ), the type of image G can be selected from common objects in urban streets, such as a post box, so that image G can be easily integrated into the external image IMG of the urban street scene (corresponding to step 806). In another example, the processing device 110 determines that the scene is a rural area (such as Figure 7B As shown), the type of image G can be selected from common objects in the countryside, such as trees, so that image G can be easily integrated into the external image IMG of the countryside (corresponding to step 806).

[0088] After the second information extraction device 104 obtains the external image IMG of the vehicle (corresponding to step 808), the processing device 110 can further analyze the color or hue of the external image IMG (corresponding to step 810) and adjust the color of the image G accordingly. Fig. 7A), the color of the image G can be adjusted to a gray complementary color or an opposite color to make the image G stand out from the external image IMG (corresponding to step 812). For example, the color of the image G can be adjusted to black (which is the opposite color of white). In another example, if the external image IMG is a grassland in the countryside and presents a green hue (such as Figure 7B As shown in FIG. 8 , the color of the image G can be adjusted to red (which is the complementary color of green) so that the image G stands out from the external image IMG (corresponding to step 812). Then, according to the type and color of the selected image G, an adjusted image G can be generated (corresponding to step 814).

[0089] In the above-mentioned examples, the image G is displayed in the display 102 to serve as a constant visual reference mark for the user. In other examples, if the external image IMG has a readily available reference mark, the image G may not be displayed in the display 102. Fig. 9 is a schematic diagram of a method for determining a reference mark of an external image IMG disclosed in the present invention, Fig.10 It is a flowchart of the method for determining the reference mark of the external image IMG disclosed in the present invention.

[0090] Please also see Fig. 9 , 10 , the second information extraction device 106 or the processing device 110 analyzes and processes the external image IMG to determine whether there is a ready-made reference mark in the external image IMG. First, determine whether the external image IMG is blurred or clear (corresponding to step 1002). For example, the sharpness of the edge of the object 902 in the external image IMG can be determined. If the edge of the object 902 is a discontinuous breakpoint, the object 902 is blurred and cannot be used as a reference mark (corresponding to step 1004). At this time, the processing device 110 can automatically generate an image G and display it on the display 102 (corresponding to step 1006).

[0091] In contrast, if the edge of the object 902 is a continuous contour line, the external image IMG is judged to be clear, and the clear object 902 with a sharp and continuous contour line may be used as a ready-made reference mark. At this time, the grayscale value of the external image IMG may be further analyzed to determine whether the external image IMG is low-brightness and in a dim state (corresponding to step 1008). If the external image IMG is high-brightness, the object 902 of the external image IMG has a sharp and clear contour line and high brightness, and this object 902 may be used as a ready-made reference mark.

[0092] At this time, the shape of the object 902 in the external image IMG can be further analyzed, and it can be determined whether the time for which the shape of the object 902 stays within the display range of the display 102 is greater than a critical value (corresponding to step 1010). If the time is greater than the critical value, it means that the object 902 is relatively in a constant position and is useful as a visual reference mark for the user (corresponding to step 1012). For example, the object 902 in the external image IMG is a distant mountain range, and the time for which the distant mountain range stays within the specific display range of the display 102 is greater than a critical value, which means that the distant mountain range is relatively in a constant position, and the contour of the distant mountain range is sharp and clear and has high brightness, so the distant mountain range can be used as a reference mark. At this time, the processing device 110 does not necessarily need to generate the image G, and the user can decide whether to generate the image G and display it on the display 102 (corresponding to step 1014). Among them, steps 1002, 1008, and 1010 may not have a sequential relationship and can be executed as needed.

[0093] The above describes the detailed implementation of each embodiment of the image display system 100 of the present disclosure. The following describes the image display method implemented in conjunction with the image display system 100 . Fig.11 For a flowchart of the image display method 1100 according to the first embodiment of the present disclosure, please refer to Fig.11 (See also FIGS. 1 to 4 .) First, in step 1102 , the user's head and / or eyes may be monitored by the first information extraction device 104 to obtain the user's line of sight direction, and the line of sight range V of the user 202 on the display 102 of the image display system 100 may be obtained by the first information extraction device 104 or the processing device 110 .

[0094] Next, in step 1104, the processing device 110 may display at least one image G in the visual range V on the display 102. More specifically, the image G is displayed in an area outside the user's main visual range, that is, the image G is displayed in a secondary visual range V2 of the user's peripheral vision. In step 1106, the external image IMG on the other side of the display 102 relative to the user 202 may be extracted by the second information extraction device 106.

[0095] Next, in step 1108, the image change rate C1 of the first area I1 of the external image IMG and the image change rate C2 of the second area I2 of the external image IMG may be calculated by the second information extraction device 106 or the processing device 110. More specifically, the similarity of various attributes (such as color, brightness and / or shape, etc.) in one or more blocks of the external image IMG may be analyzed, and the visual complexity of the objects in these blocks in the user's view may be analyzed to determine the image change rate of the area where these blocks of the external image IMG are located.

[0096] From step 1110 , the processing device 110 may display the image G in the first region I1 where the image change rate C1 of the external image IMG is relatively high, so that the image G serves as a constant visual reference mark for the user and reduces the motion sickness symptoms of the user.

[0097] Please refer to Figures 6A to 6D In step 1112, the posture P of the vehicle 602 may be sensed by the sensor 108, and the constant display position of the image G may be calculated according to the posture P of the vehicle 602. Next, in step 1114, the display position and / or display angle of the image G displayed on the display 102 may be adjusted according to the constant display position. Then, in step 1116, the image G may be displayed on the display 102 according to the adjusted display position and / or display angle.

[0098] Fig. 12A , 12B FIG. 1 is a flow chart of an image display method 1200 according to a second embodiment of the present disclosure. Steps 1202 to 1206 and steps 1212 to 1216 of the image display method 1200 are similar to Fig.11 The steps of the image display method 1100 are not repeated here. On the other hand, steps 1207 to 1210 of the image display method 1200 correspond to Fig. 7A , 7B , 8. The type and / or color selection of the image G of FIG. 8. In step 1207, the positioning device may be used to position the user or vehicle, obtain the geographic coordinates of the user or vehicle, and the processing device 110 may determine the location of the user or vehicle based on the geographic coordinates, such as a city or a village.

[0099] Next, in step 1208, the type of image G is selected according to the field where the vehicle is located, so that the image G can be easily integrated into the external image IMG of the field where the vehicle is located. In step 1209, the color or hue of the external image IMG can be analyzed by the processing device 110. Next, in step 1210, the color of the image G is adjusted to the opposite color or complementary color of the external image IMG by the processing device 110 according to the color or hue of the external image IMG.

[0100] Fig.13A , 13B is a flowchart of an image display method 1300 according to the third embodiment of the present disclosure. Steps 1302 to 1310 of the image display method 1300 are similar to Fig.11 Some steps of the image display method 1100 of FIG. 11 or some steps of the image display method 1200 of FIG. 12 will not be repeated here.

[0101] On the other hand, step 1312 and step 1313 of the image display method 1300 correspond to Fig. 9 ,10 Refer to the method for determining the reference mark of the external image IMG. Fig. 9 , 10 , 13A and 13B, in step 1312, the second information extraction device 106 or the processing device 110 can determine whether there is a ready-made reference mark in the external image IMG, for example, determining whether the distant mountains in the external image IMG can be used as a ready-made reference mark.

[0102] Then, in step 1313 , if the external image IMG has a ready-made reference mark, the processing device 110 does not necessarily need to generate the image G. In this case, the user can decide whether to generate the image G and display it on the display 102 .

[0103] If the user decides to use the existing reference mark, the processing device 110 does not generate the image G, and ends the image display method 1300 of this embodiment. However, if the user does not use the existing reference mark, the processing device 110 automatically generates and adjusts the image G as the reference mark in steps 1314 to 1316.

[0104] Fig.14A For a flowchart of an image display method 1400 according to the fourth embodiment of the present disclosure, see Fig.14A The image display method 1400 of the fourth embodiment is similar to the image display method 1100 of the first embodiment, except that the image display method 1400 of the fourth embodiment further includes step 1418 to select a single window mode or an annular cabin mode to display the image G, and can selectively adopt step 1420 to perform blurring or masking processing on the external image IMG.

[0105] Fig. 14B and Fig. 14C FIG. 1 is a schematic diagram of displaying the image G in a single window manner or an annular cabin manner in step 1418 of the image display method 1400. Fig. 14B If the image G is displayed in a single window, the image G can be displayed on a single window 1404 of the vehicle 1402. For example, the image G is in the form of a horizontally arranged long strip, and the image G can be displayed on the window 1404 of the rear door. The right end point G_R of the image G can be aligned with the intersection of the upper edge of the rear door and the "C-pillar (the body pillar at the rear of the vehicle)" (approximately above the door handle of the rear door). Please refer to Fig. 14C If the image G is displayed in a ring cabin manner, the image G can be displayed in a linked manner on all windows and windshields of the vehicle 1402. For example, the image G is displayed on the left front window 1406, the left rear window 1404, the right front window and rear window (not shown), the front windshield 1408, and the rear windshield 1410, so as to provide the user with a visual reference mark of full view.

[0106] Fig.14D FIG. 1 is a schematic diagram of selectively performing masking processing on the external image IMG in step 1420 of the image display method 1400, referring to FIG. Fig.14D For example, the size of image G is enlarged so that image G covers most of the display range of the display, so as to shield the scenery outside the car window and reduce the interference of the external scenery to the user, so as to achieve the effect of eliminating interference and more thoroughly reduce the user's motion sickness symptoms.

[0107] Fig.15A , 15B FIG. 1 is a flowchart of an image display method 1500 according to the fifth embodiment of the present disclosure. Fig.15A , 15B The image display method 1500 of the fifth embodiment is similar to the image display method 1300 of the third embodiment, except that the image display method 1500 of the fifth embodiment further includes step 1512 to determine whether the user has motion sickness. If the user has motion sickness, it is necessary to display image G to provide a constant visual reference for the user, and steps 1514 to 1516 are performed. Conversely, if the user does not have motion sickness, step 1513 is performed, and the user can further decide whether to generate and display image G.

[0108] Fig.16A FIG. 1 is a flowchart of an image display method 1600 according to a sixth embodiment of the present disclosure. Fig.16A Compared with the image display method 1100 of the first embodiment, the image display method 1600 of the sixth embodiment further includes steps 1611 and 1612 to pre-estimate the possible subsequent time posture P_f of the vehicle at a subsequent time (future time) and generate prompt information Ht accordingly. And, Fig. 16B A block diagram of an image display system 100B for implementing the image display method 1600 is shown below. Fig. 16C FIG. 1 is a schematic diagram of displaying prompt information Ht in the image display method 1600 .

[0109] See also Figures 16A to 16C, the sensor 108 of the image display system 100B may further include a sensing circuit (not shown) to sense feedback signals from the vehicle's steering wheel, brake, throttle, turn signal, etc. In step 1611, the sensor 108 may pre-estimate the possible posture change of the vehicle in the future (subsequent time) based on these feedback signals. For example, the sensor 108 may pre-estimate the possible change in the driving direction of the vehicle based on the feedback signal of the steering wheel or turn signal, or pre-estimate the possible deceleration of the vehicle based on the feedback signal of the brake. Accordingly, the sensor 108 pre-estimates and obtains the subsequent time posture P_f of the vehicle as: the vehicle turns or the vehicle decelerates. In another example, the sensor 108 may also sense the force condition of the vehicle seat (e.g., the pressure value borne by the seat) and sense the change in the body posture of the user 202, and thereby estimate the subsequent time posture P_f of the vehicle as, for example, the vehicle accelerates. In other examples, the sensor 108 may also include LiDAR or other image sensing devices to detect the road conditions in front of the vehicle, and estimate the subsequent time posture P_f of the vehicle, which may be: the vehicle turning, the vehicle accelerating / decelerating, or the vehicle reversing (for example, reversing into a garage), etc.

[0110] Next, in step 1612, the sensor 108 transmits the estimated posture P_f of the vehicle at a later time to the processing device 110, and the processing device 110 generates prompt information Ht accordingly and displays it on the display 102. The prompt information Ht is, for example, a graphic, text, or a combination of graphics and text. The user 202 can know in advance the posture change that may occur in the vehicle at a later time through the prompt information Ht; accordingly, the user 202 can be mentally prepared or change the body posture in advance to cope with the future posture change of the vehicle, thereby reducing the symptoms of motion sickness.

[0111] According to the above-mentioned embodiments and examples of various variations, one technical solution of the present disclosure can use a single window or an annular cabin to set a display 102 on a single window or all windows (including front and rear windshields) of a vehicle. The display 102 can be a light-transmitting form so that the user 202 can see through the display 102 and see the scenery outside the vehicle. The scenery outside the vehicle can be extracted as an external image IMG, and an image G is generated and displayed on the display 102. The image G provides a constant reference mark for the user 202 to reduce the motion sickness of the user 202. The display position of the image G can be determined according to the visual range V of the user 202 on the display 102 and the image change rate of the external image IMG, and the display position and display angle of the image G can be adjusted in real time according to the change of the posture P of the vehicle. It is further possible to select the type or color of the image G according to the type of the field where the user 202 or the vehicle is located and the background color tone, so as to optimize the effect of suppressing the motion sickness of the user 202. A technical solution disclosed in the present invention provides the user 202 with a more flexible option to decide by himself. The user 202 can decide whether to display the image G according to whether the user 202 has motion sickness symptoms or whether there is a ready-made reference mark in the external image IMG.

[0112] When judging the image change rate of an external image IMG, a technical solution disclosed herein can analyze a single external image IMG extracted at a single time point, and judge the image change rate according to the complexity and similarity of objects in different regions I1 and I2 of the single external image IMG. It is not necessary to analyze multiple images at multiple time points, thereby saving computing resources. A technical solution disclosed herein can judge the image change rate in real time at a single time point to determine the display position of the image G to achieve the effect of real-time judgment.

[0113] Although the present invention has been disclosed in detail with preferred embodiments and examples as above, it is to be understood that these examples are intended to be illustrative rather than restrictive. It is contemplated that a variety of modifications and combinations may be conceived by those skilled in the art, and the variety of modifications and combinations thereof fall within the spirit of the present invention and the scope of the claims.

Claims

1. An image display system for preventing motion sickness, comprising: monitor; At least one first information extraction device for obtaining the user's field of view on the display; At least one second information extraction device, used to extract an external image of the display on the other side relative to the user, the external image having a first area and a second area; At least one sensor for sensing the posture of the vehicle; as well as A processing device is used to generate at least one image and display the at least one image on the display based on the field of view, the image change rate of the first area, the image change rate of the second area and the posture of the vehicle, wherein the image change rate of the first area and the image change rate of the second area are calculated based on the similarity of the color, brightness and / or shape of the first area and the second area, and the similarity is evaluated based on the number of visual components of the objects in the first area and the second area.

2. The image display system according to claim 1, wherein: A low similarity corresponds to a high image change rate, the image change rate in the first area is higher than the image change rate in the second area, and the processing device displays the at least one image in the portion of the display corresponding to the first area.

3. The image display system according to claim 1, wherein: The processing device displays the at least one image within the visual field of the user.

4. The image display system according to claim 3, wherein: The visual field range includes a primary visual field area and a secondary visual field area, and the processing device displays the at least one image in an area outside the primary visual field area.

5. The image display system according to claim 1, wherein: The processing device adjusts the display position and / or display angle of the at least one image on the display according to the posture of the vehicle.

6. The image display system according to claim 1, wherein: The at least one sensor also pre-estimates the subsequent time posture of the vehicle, and the processing device generates prompt information according to the subsequent time posture and displays the prompt information on the display.

7. The image display system according to claim 1, further comprising: A positioning device for locating the geographical coordinates of the user or the vehicle; The processing device further determines the location of the user or the vehicle according to the geographic coordinates, and selects the type of the at least one image according to the location.

8. The image display system according to claim 1, wherein: The at least one second information extraction device or the processing device also determines whether the external image has at least one reference mark. If not, the processing device displays the at least one image on the display. If so, the user decides whether to display the at least one image on the display.

9. The image display system according to claim 8, wherein: The external image includes at least one object, and the at least one second information extraction device selects the at least one object as the at least one reference mark according to the clarity, brightness and residence time of the at least one object.

10. The image display system according to claim 1, wherein: The display is disposed in a single window form or an annular cabin form on at least one vehicle window and / or at least one windshield of the vehicle.

11. An image display method for preventing motion sickness, applied to an image display system, the image display method comprising: Acquire the visual field of the user on the display of the image display system; Extracting an external image of the other side of the display relative to the user, the external image having a first area and a second area; Calculating the image change rate of the first area and the image change rate of the second area respectively according to the similarity between the color, brightness and / or shape of the first area and the second area, wherein the similarity is evaluated according to the number of components of the objects in the first area and the second area in the user's vision; Sensing the vehicle’s posture; as well as At least one image is displayed on the display according to the visual field, the image change rate of the first area, the image change rate of the second area, and the posture of the vehicle.

12. The image display method according to claim 11, wherein: The low similarity corresponds to a high image change rate, the image change rate in the first area is higher than the image change rate in the second area, and the image display method further includes: displaying the at least one image in a portion of the display corresponding to the first area.

13. The image display method according to claim 11, wherein: The at least one image is displayed within the visual field of the user.

14. The image display method according to claim 13, wherein: The at least one image is displayed in an area outside a main viewing area of ​​the viewing range.

15. The image display method according to claim 11, wherein: The display position and / or display angle of the at least one image on the display is adjusted according to the posture of the vehicle.

16. The image display method according to claim 11, further comprising: Locating the geographical coordinates of the user or the vehicle; Determine the location of the user or the vehicle according to the geographic coordinates; as well as The type of the at least one image is selected according to the field.

17. The image display method according to claim 11, further comprising: determining whether the external image has at least one reference mark; If not, displaying the at least one image on the display; as well as If so, it is up to the user to decide whether to display the at least one image on the display.

18. The image display method according to claim 17, wherein: The external image includes at least one object, and the image display method further includes: analyzing the clarity, brightness, and dwell time of the at least one object; and The at least one object is selected as the at least one reference mark according to the clarity, brightness and residence time of the at least one object.

19. The image display method according to claim 11, wherein: The display is disposed in a single window form or an annular cabin form on at least one vehicle window and / or at least one windshield of the vehicle.

20. The image display method according to claim 11, further comprising: Pre-estimating the vehicle's subsequent temporal posture; generating prompt information according to the subsequent time posture; as well as The prompt information is displayed on the display.

Images