Transparent display screen control method and device, storage medium and electronic equipment

Abstract

This application relates to a control method, apparatus, storage medium, and electronic device for a transparent display screen. The method includes: acquiring physiological data of a target user in front of the transparent display screen; determining the fatigue level of the target user based on the physiological data; and controlling the transparent display screen to enter a display mode matching the fatigue level to alleviate visual fatigue for the target user. This application solves the technical problem that vehicles cannot effectively alleviate driving fatigue for users.

Description

Technical Field

[0001] This application relates to the field of display screen control, and more particularly to a control method, apparatus, storage medium, and electronic device for a transparent display screen. Background Technology

[0002] Over 20% of traffic accidents each year are caused by fatigued driving, with particularly high accident rates in industries such as long-distance freight and ride-hailing. When drivers stare at the road ahead for extended periods, the ciliary muscles in their eyes continuously contract to maintain focus, leading to a decline in visual accommodation ability (typically, reaction speed decreases by 40% after two hours of continuous driving), becoming a major contributing factor to accidents.

[0003] In response to the current situation where accidents are caused by driver fatigue, existing technologies typically use voice notifications to remind drivers to avoid driving while fatigued, but do not offer effective means to alleviate driver fatigue. Summary of the Invention

[0004] This application provides a control method, device, storage medium, and electronic device for a transparent display screen to solve the technical problem that vehicles cannot effectively alleviate driver fatigue.

[0005] In a first aspect, this application provides a control method for a transparent display screen, comprising: acquiring physiological data of a target user in front of the transparent display screen; determining the fatigue level of the target user based on the physiological data; and controlling the transparent display screen to enter a display mode matching the fatigue level, so as to alleviate visual fatigue for the target user.

[0006] Secondly, this application provides a control device for a transparent display screen, comprising: an acquisition module for acquiring physiological data of a target user in front of the transparent display screen; a determination module for determining the fatigue level of the target user based on the physiological data; and a control module for controlling the transparent display screen to enter a display mode matching the fatigue level, so as to alleviate visual fatigue for the target user.

[0007] Thirdly, this application provides an electronic device, comprising: at least one communication interface; at least one bus connected to the at least one communication interface; at least one processor connected to the at least one bus; and at least one memory connected to the at least one bus, wherein the memory stores a computer program, and the processor is configured to implement a control method for a transparent display screen as described above when executing the computer program.

[0008] Fourthly, this application also provides a computer storage medium storing computer-executable instructions for executing the control method of the transparent display screen according to any one of the above claims of this application.

[0009] Compared with the prior art, the above-mentioned technical solution provided in this application embodiment has the following advantages: The solution provided in this application embodiment determines the fatigue level of the target user based on the physiological parameters of the target user in front of the display screen, and controls the display mode of the transparent display screen according to the fatigue level. Thus, the change of the display mode of the transparent display screen can drive the target user's eyes to change from tension to relaxation or from prolonged stillness to forced stretching at the physiological level, thereby achieving the effect of massaging the user's eyes and further relieving the user's driving fatigue. Attached Figure Description

[0010] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0011] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0013] Figure 1 A flowchart illustrating a control method for a transparent display screen provided in an embodiment of this application; Figure 2 A flowchart illustrating another method for controlling a transparent display screen provided in this application embodiment; Figure 3 A flowchart illustrating another method for controlling a transparent display screen provided in this application embodiment; Figure 4 A flowchart illustrating another method for controlling a transparent display screen provided in this application embodiment; Figure 5 A flowchart illustrating another method for controlling a transparent display screen provided in this application embodiment; Figure 6 The framework design diagram provided for the embodiments of this application; Figure 7 This is a schematic diagram of the structure of a control device for a transparent display screen provided in an embodiment of this application; Figure 8 This is a schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0014] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0015] The following disclosure provides numerous different embodiments or examples for implementing various structures of the invention. To simplify the disclosure, specific examples of components and arrangements are described below. These are merely examples and are not intended to limit the scope of the invention. Furthermore, reference numerals and / or letters may be repeated in different examples. Such repetition is for simplification and clarity and does not in itself indicate a relationship between the various embodiments and / or arrangements discussed.

[0016] To address the technical problem that existing technologies cannot effectively alleviate driver fatigue, this application provides a control method for a transparent display screen that can effectively alleviate driver fatigue.

[0017] Figure 1 A flowchart illustrating a control method for a transparent display screen provided in an embodiment of this application. Figure 1 As shown, the control method for the above-mentioned transparent display screen includes: S102, Acquire physiological data of the target user in front of the transparent display screen; S104, based on physiological data, determines the fatigue level of the target user; S106 controls the transparent display screen to enter a display mode that matches the fatigue level, in order to alleviate visual fatigue for the target user.

[0018] This application can be applied to scenarios where adjusting the display mode of a transparent display screen can alleviate visual fatigue for target users in front of the screen. Specific application scenarios are varied, such as transparent displays in vehicles to help alleviate visual fatigue while driving, transparent displays in shopping malls to alleviate visual fatigue for customers browsing merchandise, and transparent displays in museum display cases to alleviate visual fatigue for visitors viewing artwork.

[0019] The technical solution of this application can be used in the aforementioned scenarios. The technical solution of this application can acquire the physiological data of the target user in front of the transparent display screen. The type of target user varies depending on the scenario. In a vehicle scenario, the target user can be the driver or a passenger; in a shopping mall scenario, the target user can be a customer in front of the transparent display screen; and in a museum scenario, the target user can be a visitor browsing artworks. In various scenarios, there may be multiple users; therefore, this application treats each user as a target user to alleviate visual fatigue. It can also provide solutions to alleviate visual fatigue for drivers, customers closest to the merchandise or artwork, and visitors.

[0020] Physiological data for target users can be diverse, with the core objective being to determine the user's fatigue level based on this data. Physiological data can include eye movement data, pupil data, and facial muscle data. Eye movement data includes blink frequency (the number of blinks per unit time), blink duration (the time from eyelid closure to full opening during a single blink), average eye-closing time (the percentage of time the eyes are closed for more than a certain percentage, such as 80%), ptosis (the proportion of the eyeball obscured by the eyelid), saccade speed and amplitude (the speed and distance of rapid eye movements, which usually decreases with fatigue), fixation stability (the minute tremors of the eyeball when focusing on a point), and eye rotation angle (whether the gaze is directed forward, indicating concentration). Pupil data includes pupil diameter (indicating concentration and distraction) and pupil diameter changes (indicating changes in attention). Facial muscle data can include the tension of the masticatory muscles and periorbital muscles (representing the user's state of tension and relaxation).

[0021] The above physiological data are examples of this application. This application may choose one or more combinations as physiological data to comprehensively determine the user's fatigue level.

[0022] When using physiological data to determine fatigue levels, artificial intelligence models can be employed. Physiological data can be converted into vectors and input into the AI ​​model, which then assesses the fatigue level of the target user.

[0023] For example, for physiological data such as eye movement data, pupil data, and facial muscle data, each type of data can be converted into a high-dimensional vector and concatenated to obtain a feature vector. The artificial intelligence model can then identify the feature vector to determine the fatigue level of the target user.

[0024] To further improve the accuracy of the model in identifying user fatigue levels, this application can also construct correlations based on various eye movement data, pupil data, and facial muscle data. For example, for the aforementioned eye movement data, pupil data, and facial muscle data, the greater the pupil change, the slower the blinking. A curve showing the change in pupil change and blink frequency is constructed, and the curves are macroscopically inversely proportional. This correlation is also converted into a vector, concatenated after the vectors of eye movement data and pupil data, and input into the artificial intelligence model. Here, the applicant constructs multiple correlations as auxiliary data for the aforementioned physiological data to assist the artificial intelligence model in outputting accurate fatigue levels. For example, the stiffer the facial muscles, the significantly lower the blinking frequency and the significantly higher the blink duration. A relationship curve between the data is constructed, generated as a vector, and concatenated after the vectors of eye movement data, pupil data, and facial muscle data.

[0025] After recognizing the input data, the AI ​​model outputs predicted probabilities for different fatigue levels. For example, if fatigue levels are divided into three levels: low fatigue, moderate fatigue, and severe fatigue, then after inputting the data, it can predict the probability that the target user has low fatigue, moderate fatigue, and severe fatigue, such as 5%, 10%, and 85% respectively. This indicates that the user is likely to have severe fatigue.

[0026] Depending on the user's fatigue level, the transparent display screen can be controlled to enter a display mode that matches the fatigue level. For example, by controlling the brightness, contrast, and sharpness of the pixels displayed on the transparent display screen, or by displaying different simulated scenes on the transparent display screen, or by switching or adjusting the distance of the displayed simulated scenes on the transparent display screen, the user's visual fatigue can be alleviated.

[0027] For example, in a driving scenario, virtual scenery can be displayed on a transparent screen. This virtual scenery is projected onto the user's eyes, guiding their eye muscles from tension to relaxation, thus massaging their eyes. During the display of the virtual scenery, the brightness, contrast, and sharpness of the display pixels can be adjusted to make the image softer. The distance of the virtual scenery can also be adjusted, allowing the user's eye muscles to switch between relaxation and tension, thereby relaxing the eyes and relieving visual fatigue.

[0028] For example, if an animation is displayed on a transparent screen and projected onto the user's eyes, the user will not only see the road conditions behind the transparent screen, but also the animation on the transparent screen. This creates different distances of scenery between the animation and the road outside the car, allowing the user's eyes to relax.

[0029] For example, a transparent display screen shows navigation images. By adjusting the brightness, contrast, and sharpness of the displayed pixels, the image becomes softer, or the distance of the navigation image is simulated to relax the user's eyes.

[0030] The solution provided in this application determines the fatigue level of the target user based on the physiological parameters of the target user in front of the display screen, and controls the display mode of the transparent display screen according to the fatigue level. In this way, the change of the display mode of the transparent display screen can drive the target user's eyes from tension to relaxation at the physiological level, thereby achieving the effect of massaging the user's eyes and further relieving the user's driving fatigue.

[0031] As an optional example, such as Figure 2 As shown, controlling the transparent display screen to enter a display mode that matches the fatigue level includes: S202 controls multiple zones of the transparent display screen to enter their respective display modes based on fatigue levels.

[0032] In this application, the transparent display screen can have multiple zones. These zones divide the transparent display screen into different parts. These zones are not physical divisions of the transparent display screen, but rather logically divided into multiple independent rectangular or irregular areas through logical control. Each zone can independently play different content without interference. For example, in a shopping mall window: the upper half of the screen (zone A) plays dynamic videos of models, the middle half (zone B) displays real-time scrolling promotional text, and the lower half (zone C) displays weather and time. In a car display: the left side of the windshield displays a navigation map, the right side displays multimedia information, and the middle area remains transparent for observing road conditions. Different zones can display different modes at a given fatigue level. For example, some zones can be controlled to change their display mode according to the fatigue level, while others can remain in their original mode. Alternatively, some zones can have more significant display mode changes, while others can have smaller changes, thus allowing for differentiated control of different zones without requiring a unified overall adjustment of the display mode.

[0033] In this application, by adjusting the display mode of the transparent display screen according to the fatigue level of the target user, different display modes are used for different zones of the transparent display screen, thereby improving the flexibility of display control for different zones. This ensures that the visual fatigue of the user is relieved by controlling some zones, while avoiding the impact on the display function of the transparent display screen by controlling all zones.

[0034] As an optional example, such as Figure 3 As shown, controlling the transparent display screen to enter a display mode that matches the fatigue level includes: S302, Determine the focal point of the target user's gaze on the transparent display screen; S304, Based on the location of the focal point, determine the first zone of the transparent display screen where the focal point is located; S306, determine the second partition whose distance from the first partition is less than the first distance threshold and the third partition whose distance from the first partition is greater than the second distance threshold; S308, a first display mode is used for the first partition, a second display mode is used for the second partition, and a third display mode is used for the third partition. The display precision or the content displayed in the first display mode, the second display mode, and the third display mode are different.

[0035] In this application, during the process of controlling different zones of a transparent display screen to display in different display modes, the display mode for each zone can be determined based on the focal point of the user's gaze on the transparent display screen. The focal point on the transparent display screen represents the user's gaze position and is designated as the primary focus for the first zone, while non-focal points that are far from the first zone can be treated as the edge of the third zone. The second zone, adjacent to the first zone, can be considered an associated zone of the first zone and given secondary focus.

[0036] In this application, the focus point of the target user's gaze on the transparent display screen can be a constant focus point, rather than a real-time focus point. Using a constant focus point better reflects the user's consistently observed area, rather than a temporarily changing partition.

[0037] One method for determining the persistent focal point is to collect the user's gaze on the transparent display screen at a certain frequency, and then cluster these focal points. The clustering results will divide the focal point into several cluster sets, resulting in multiple clustering results. The cluster with the most focal points and the most concentrated clustering is taken as the persistent focal area of ​​the user's gaze, and the center of the area can be considered the persistent focal point.

[0038] To determine the first, second, and third partitions, based on the focusing results described above, the partition containing the persistently focused area is designated as the first partition. The adjacent partitions of the first partition are designated as the second partition. The partitions furthest from the first partition are designated as the third partition.

[0039] In addition, the cluster set with the smallest difference from the cluster set with the most focal points and the most clustered cluster can be taken as the secondary cluster set, and the partition where the secondary cluster set is located can also be taken as the second partition.

[0040] Using the methods described above, the first, second, and third partitions are determined. These three partitions can be displayed using different display modes. The first partition, as the most important partition, can have higher display precision, followed by the second partition, and then the third partition. Furthermore, the content displayed in each partition can also differ. The color, brightness, and other parameters of the displayed content can also vary.

[0041] The first to third zones of the transparent display screen are determined by the above method, so that different types of zones adopt different display modes, which improves the accuracy of different zone display control when relieving user fatigue.

[0042] As an optional example, such as Figure 4 As shown, controlling the transparent display screen to enter a display mode matching the fatigue level includes: S402, determine the display image pair that matches the fatigue level; S404, control the transparent display screen to enter the display mode corresponding to the fatigue level. In the corresponding display mode, the transparent display screen projects the display image pair matching the fatigue level onto the eyes of the target user. The display image pairs matching different fatigue levels have different image sizes, sharpness, and parallax.

[0043] In this application, there are multiple ways to adjust the display mode of the transparent display screen. One approach is to use the content of the displayed virtual scenery to relax the user's eyes and alleviate visual fatigue. For example, different virtual scenery can be displayed in different display modes. Taking an in-vehicle virtual display screen as an example, this method involves controlling the transparent display screen to display different virtual scenery in different display modes, such as projecting scenery at different distances in front of the vehicle as virtual scenery and displaying it on the in-vehicle transparent display screen. Alternatively, the in-vehicle transparent display screen can display navigation data, virtual scenery of the road section in front of the vehicle, etc. For example, when the user has low fatigue, a virtual projection of scenery at close range can be displayed; for moderate fatigue, a virtual projection of scenery at medium range can be displayed; and for severe fatigue, a virtual projection of scenery at long range can be displayed, thereby appropriately relaxing the user's eyes.

[0044] Another approach involves displaying image pairs with different parallaxes at different fatigue levels, with the sharpness and image size controlled synchronously according to the fatigue level. By adjusting the image size and sharpness, and adjusting the parallax of the images in the displayed image pairs, the distance of the images can be simulated, thus providing the user with an eye-relaxing effect.

[0045] For example, a matching pair of display images is determined for each fatigue level. Each pair consists of two images that originate from the same source but are horizontally shifted (this can be understood as each eye seeing a roughly identical image when the left eye is open and the right eye is closed, versus when the right eye is open and the left eye is closed). One image in the pair is the left-eye image, projected onto the user's left eye, and the other is the right-eye image, projected onto the user's right eye. A parallax exists between the two images. By adjusting this parallax, the perceived distance of objects is simulated. The smaller the parallax between the two images, the farther away the simulated object appears to be.

[0046] By constructing this image pair, different distances of objects can be simulated under different fatigue levels of the user. These objects are displayed on a transparent screen and projected onto the user's eyes. They are observed by the user's eyes along with the objects behind the transparent screen that the user sees through the screen. Because the distance of the objects projected onto the transparent screen is different from the distance of the objects behind the screen, it massages the user's eyes, thereby relaxing them.

[0047] As an optional example, such as Figure 5 As shown, determining the display image pair that matches the fatigue level includes: S502, when the fatigue level is a first fatigue level, a first image pair is determined to constitute the display image pair, wherein the image size in the first image pair is a first size, the sharpness is a first sharpness, and the parallax is a first parallax; when the fatigue level is a second fatigue level, a second image pair and a third image pair are determined to constitute the display image pair, wherein the image size in the second image pair is a second size, the sharpness is a second sharpness, and the parallax is a second parallax, and the image size in the third image pair is a third size, the sharpness is a third sharpness, and the parallax is a third parallax; when the fatigue level is a third fatigue level, a fourth image pair is determined to constitute the display image pair, wherein the image size in the fourth image pair is a fourth size, the sharpness is a fourth sharpness, and the parallax is a fourth parallax.

[0048] In this embodiment, different display image pairs are provided to the user for different fatigue levels to adjust the user's eyes and provide a massage effect. In the solutions for the first to third fatigue levels described above, first to fourth image pairs are provided, each corresponding to different sizes, resolutions, and parallaxes. Specifically, the first size ≥ the second size > the third size ≥ the fourth size; the first resolution ≤ the second resolution < the third resolution ≤ the fourth resolution; and the first parallax ≥ the second parallax > the third parallax ≥ the fourth parallax.

[0049] This example divides fatigue levels into three levels: Level 1 (mild fatigue), Level 3 (severe fatigue), and Level 2 (moderate fatigue). The higher the fatigue level, the more severe the fatigue, resulting in smaller parallax, higher sharpness, and smaller image size in the corresponding displayed image. For detailed settings of parallax, sharpness, and size, different intervals can be set in this application. For example, three closed intervals can be set: 1-5, 5-15, and 15-20. If the interval represents the image size, then 1 represents the smallest image size, such as 200*300 pixels, and 20 represents the largest image size, such as 2000*3000 pixels. Therefore, the first size can be selected from the interval 15-20, the second and third sizes can be two sizes selected from the interval 5-15, with the second size being larger than the third. The fourth size can be selected from between 1 and 5. If the interval represents image sharpness, 1 can be set to the lowest sharpness, and 20 to the highest sharpness. Image sharpness can be achieved through the depth of field. A greater depth of field results in a sharper image for the user, while a smaller depth of field results in a blurrier image. Therefore, for the first level of sharpness, a value between 1 and 5 can be selected; for the second and third levels, a value between 5 and 15 can be selected; and for the fourth level, a value between 15 and 20 can be selected. If the intervals represent image parallax, then 1-20 can represent the user's comfortable parallax interval. 1 represents the minimum comfortable parallax, and 20 represents the maximum comfortable parallax. Thus, the first parallax can be selected from 15-20, the second and third parallax from 5-15, and the fourth parallax from 15-20.

[0050] For example, for the first fatigue level, two images with a size of 18, a sharpness of 3, and a parallax of 19 can be selected as the first image pair. This first image pair has large image sizes and shallow depth of field, resulting in low sharpness and high parallax. For the second fatigue level, an image with a size of 14, a sharpness of 6, and a parallax of 13 can be selected as the second image pair, and an image with a size of 6, a sharpness of 13, and a parallax of 6 can be selected as the third image pair. The second fatigue level corresponds to a second image pair with larger size, lower sharpness, and higher parallax, and a third image pair with smaller size, higher sharpness, and lower parallax. For the third fatigue level, an image with a size of 3, a sharpness of 18, and a parallax of 2 can be selected as the fourth image pair. The third fatigue level corresponds to a fourth image pair with smaller size, higher sharpness, and higher parallax.

[0051] By selecting different images to form display image pairs for different fatigue levels, users' eye fatigue can be relieved by projecting different display image pairs onto the user's eyes at different fatigue levels.

[0052] As an optional example, controlling the transparent display screen to enter a display mode corresponding to the fatigue level, wherein the transparent display screen projects a pair of display images matching the fatigue level onto the eyes of the target user, includes: locating the position of the target user's eyes; adjusting the display position of the pair of display images on the transparent display screen according to the position; and using a microlens array attached to the transparent display screen to project the left-eye image of the pair of display images onto the left eye of the target user, and to project the right-eye image of the pair of display images onto the right eye of the target user.

[0053] In this application, since display image pairs corresponding to each fatigue level are set, the images in the display image pairs can be projected onto the user's eyes. Therefore, for the display image pair of the first fatigue level, the left-eye image is projected onto the user's left eye, and the right-eye image is projected onto the user's right eye.

[0054] For the third fatigue level's image pair, the left-eye image is projected onto the user's left eye, and the right-eye image is projected onto the user's right eye during display. For the second fatigue level's image pair, since there are two pairs (second and third), one pair can be selected: the left-eye image is projected onto the user's left eye, and the right-eye image is projected onto the user's right eye; alternatively, the two pairs can be cycled through.

[0055] If two pairs of images are switched cyclically, this embodiment provides a solution: a projection switching operation is performed every preset time interval. The projection switching operation refers to changing the projection from the left-eye image of the second image pair to the target user's left eye, and from the right-eye image of the second image pair to the target user's right eye, and from the right-eye image of the third image pair to the target user's right eye; or the projection switching operation refers to changing the projection from the left-eye image of the third image pair to the target user's left eye, and from the right-eye image of the third image pair to the target user's right eye, and from the right-eye image of the second image pair to the target user's right eye.

[0056] During projection, a microlens array layer bonded to the transparent display screen is used to project the image displayed on the transparent display screen onto the user's eyes.

[0057] In the above scheme, every preset time interval, the second image pair is switched to the third image pair, or vice versa. In the example above, every preset time interval, the second image pair consisting of an image of size 14, resolution 6, and parallax 13 is switched to the third image pair consisting of an image of size 6, resolution 13, and parallax 6. Thus, the virtual scene seen by the user's left and right eyes is sometimes far away and sometimes near, which can make the user's eyes relax and tighten repeatedly, thus achieving the effect of massaging the user's eyes.

[0058] As an optional example, when controlling the transparent display screen to enter a display mode that matches the fatigue level, the method further includes: obtaining environmental parameters of the environment in which the transparent display screen is located; and adjusting the brightness of the pixels of the virtual scene on the transparent display screen according to the environmental parameters.

[0059] This application not only allows adjustment of the display mode of the transparent display screen, but also allows adjustment of the pixel brightness of the virtual objects on the transparent display screen according to the environmental parameters of the environment in which the transparent display screen is located. Brightness adjustment allows the brightness of the virtual objects displayed on the transparent display screen to adapt to the environment, such as lowering the brightness in dark scenes and raising the brightness in bright scenes, to avoid the virtual objects being too bright or too dark and causing eye strain.

[0060] The following explanation, using examples and accompanying diagrams of vehicle-mounted transparent displays, illustrates the process of adjusting the display mode of a transparent display screen according to the fatigue level of the target user. Figure 6 This is the architecture design diagram of this application. In this application, physiological data of the user is acquired through multiple sensors in the perception layer. A fatigue characteristic monitoring sensor group is deployed, using a pupil dynamic sensor to monitor changes in pupil diameter (range 2-8mm) and blink frequency (threshold: ≤5 times / minute for severe fatigue, 8-12 times / minute for mild fatigue); a facial electromyography sensor (optionally integrated): using a sensor built into the steering wheel grip, it monitors parameters such as facial masticatory muscles and periorbital muscle tension as physiological data. In addition, an infrared eye-tracking sensor can be deployed, with an operating temperature of -40℃~85℃, resistance to strong light interference (supports normal recognition under 100,000 lux strong light), and a response latency of ≤10ms. Deployed below the rearview mirror in the vehicle (in an unobstructed area), it is equipped with two infrared cameras (sampling rate 60Hz); it monitors the eye rotation angle, pupil position, and gaze area in real time (accuracy ±0.5°), identifying the driver's focal point on the windshield. An ambient light sensor can also be deployed at the upper left corner of the windshield, with a measurement range of 0-100,000 lux and an error of ≤±5%. This sensor can provide real-time feedback on ambient light intensity, providing a basis for adjusting the brightness and contrast of the display system and preventing glare from strong light or poor visibility in weak light.

[0061] For users' physiological data, data fusion can be performed to generate a 12-dimensional feature vector, which is then input into an artificial intelligence model to identify fatigue levels. Before data fusion, Kalman filtering can be used to remove sensor noise, and Z-score standardization can be used to unify data dimensions to ensure data accuracy.

[0062] The AI ​​model chip uses an ARM Cortex-A78 processor (2.4GHz) with an integrated Neural Processing Unit (NPU) to support real-time machine learning inference. It features 8GB of LPDDR5 memory and 64GB of eMMC storage to cache historical sensor data and algorithm model parameters. Supporting CAN FD and Ethernet / IP protocols, it can communicate with the vehicle control unit (ECU) and central control screen to transmit the user's fatigue level. Fatigue levels are divided into three categories: mild, moderate, and severe fatigue. The display mode is dynamically matched based on the fatigue level and the user's focal point on the windshield, with a decision delay of ≤0.3 seconds. Table 1 shows exemplary display modes for different fatigue levels.

[0063] Table 1

[0064] In driving scenarios, users spend long periods staring at the road ahead, resulting in their eyes being in a prolonged state of focusing on distant objects. Under mild fatigue, the first image pair uses a large, low-resolution image with significant parallax. This makes the virtual objects appear very close to the user, forcing the ciliary muscle to contract and the lens to convex in order to see them clearly. This relieves the eye muscles from prolonged staring at distant objects by forcing them to stretch. Under moderate fatigue, frequent switching between the second and third image groups causes the user's eyes to see virtual images that are sometimes near and sometimes far, resulting in alternating relaxation and tension in the eyes, providing a massage effect. For severe fatigue, a fourth image group is used, allowing the user to see virtual images that are as far away as possible, maximizing eye relaxation.

[0065] The design of the windshield in this application, from the outside to the inside, is as follows: 1. Outer protective glass (4mm tempered glass, impact resistance ≥500N); 2. Microlens array layer (thickness 0.5mm, lens diameter 50μm, spacing 100μm, achieving precise light deflection); 3. Organic Light-Emitting Diode (OLED) display layer (i.e., the transparent display screen of this application, with a thickness of 0.3mm, a light transmittance of ≥85%, a contrast ratio of 10000:1, and support for independent display of zones). 4. Inner bonding layer (0.2mm optical adhesive, refractive index 1.52, ensuring no light refraction loss); Integrated Process: Vacuum bonding technology is used to avoid air bubbles and optical distortion, ensuring seamless integration of the displayed content with the driver's field of vision. An AR anti-reflective film is applied to the outer glass, with a reflectivity of ≤0.5%, preventing glare under strong daylight. Night Mode: Automatically reduces display brightness (minimum 100 cd / m²) and uses a warm color tone to avoid glare irritating the eyes. Vision Compatibility: The display area only covers the driver's gaze area (approximately 30% of the windshield area), while the remaining area remains transparent, not affecting normal driving visibility.

[0066] If a command is received from the control unit, the transparent OLED layer is driven to display in zones, and the microlens array adjusts the direction of light to achieve different visual effects at different distances from various viewing angles. The display response time is ≤0.1 seconds, the number of zones is ≥16 (covering the main viewing area of ​​the windshield), and the brightness adjustment range is 100-1000 cd / m² (adaptive to ambient light).

[0067] This application supports human-machine collaborative operation. In automatic mode (default): the system automatically adjusts the display mode based on perception layer data, without user intervention; in manual mode: two operation methods are supported: central control screen touch adjustment: select display mode (near distance / far distance / automatic), adjust display brightness; voice control: supports commands such as "switch to far distance display", "reduce display brightness", "turn off fatigue relief function", with a response time of ≤0.5 seconds; status feedback: the central control screen displays the current fatigue level, display mode, and ambient light intensity in real time, allowing the driver to monitor the system status throughout the entire process.

[0068] Figure 7 This is a schematic diagram of the structure of a control device for a transparent display screen provided in an embodiment of this application. Figure 7 As shown, the control device for the aforementioned transparent display screen includes: Acquisition module 702 is used to acquire physiological data of the target user in front of the transparent display screen; The determination module 704 is used to determine the fatigue level of the target user based on physiological data; The control module 706 is used to control the transparent display screen to enter a display mode that matches the fatigue level, so as to relieve visual fatigue for the target user.

[0069] This application can be applied to scenarios where adjusting the display mode of a transparent display screen can alleviate visual fatigue for target users in front of the screen. Specific application scenarios are varied, such as transparent displays in vehicles to help alleviate visual fatigue while driving, transparent displays in shopping malls to alleviate visual fatigue for customers browsing merchandise, and transparent displays in museum display cases to alleviate visual fatigue for visitors viewing artwork.

[0070] The technical solution of this application can be used in the aforementioned scenarios. The technical solution of this application can acquire the physiological data of the target user in front of the transparent display screen. The type of target user varies depending on the scenario. In a vehicle scenario, the target user can be the driver or a passenger; in a shopping mall scenario, the target user can be a customer in front of the transparent display screen; and in a museum scenario, the target user can be a visitor browsing artworks. In various scenarios, there may be multiple users; therefore, this application treats each user as a target user to alleviate visual fatigue. It can also provide solutions to alleviate visual fatigue for drivers, customers closest to the merchandise or artwork, and visitors.

[0071] Physiological data for target users can be diverse, with the core objective being to determine the user's fatigue level based on this data. Physiological data can include eye movement data, pupil data, and facial muscle data. Eye movement data includes blink frequency (the number of blinks per unit time), blink duration (the time from eyelid closure to full opening during a single blink), average eye-closing time (the percentage of time the eyes are closed for more than a certain percentage, such as 80%), ptosis (the proportion of the eyeball obscured by the eyelid), saccade speed and amplitude (the speed and distance of rapid eye movements, which usually decreases with fatigue), fixation stability (the minute tremors of the eyeball when focusing on a point), and eye rotation angle (whether the gaze is directed forward, indicating concentration). Pupil data includes pupil diameter (indicating concentration and distraction) and pupil diameter changes (indicating changes in attention). Facial muscle data can include the tension of the masticatory muscles and periorbital muscles (representing the user's state of tension and relaxation).

[0072] The above physiological data are examples of this application. This application may choose one or more combinations as physiological data to comprehensively determine the user's fatigue level.

[0073] When using physiological data to determine fatigue levels, artificial intelligence models can be employed. Physiological data can be converted into vectors and input into the AI ​​model, which then assesses the fatigue level of the target user.

[0074] For example, for physiological data such as eye movement data, pupil data, and facial muscle data, each type of data can be converted into a high-dimensional vector and concatenated to obtain a feature vector. The artificial intelligence model can then identify the feature vector to determine the fatigue level of the target user.

[0075] To further improve the accuracy of the model in identifying user fatigue levels, this application can also construct correlations based on various eye movement data, pupil data, and facial muscle data. For example, for the aforementioned eye movement data, pupil data, and facial muscle data, the greater the pupil change, the slower the blinking. A curve showing the change in pupil change and blink frequency is constructed, and the curves are macroscopically inversely proportional. This correlation is also converted into a vector, concatenated after the vectors of eye movement data and pupil data, and input into the artificial intelligence model. Here, the applicant constructs multiple correlations as auxiliary data for the aforementioned physiological data to assist the artificial intelligence model in outputting accurate fatigue levels. For example, the stiffer the facial muscles, the significantly lower the blinking frequency and the significantly higher the blink duration. A relationship curve between the data is constructed, generated as a vector, and concatenated after the vectors of eye movement data, pupil data, and facial muscle data.

[0076] After recognizing the input data, the AI ​​model outputs predicted probabilities for different fatigue levels. For example, if fatigue levels are divided into three levels: low fatigue, moderate fatigue, and severe fatigue, then after inputting the data, it can predict the probability that the target user has low fatigue, moderate fatigue, and severe fatigue, such as 5%, 10%, and 85% respectively. This indicates that the user is likely to have severe fatigue.

[0077] Depending on the user's fatigue level, the transparent display screen can be controlled to enter a display mode that matches the fatigue level. For example, by controlling the brightness, contrast, and sharpness of the pixels displayed on the transparent display screen, or by displaying different simulated scenes on the transparent display screen, or by switching or adjusting the distance of the displayed simulated scenes on the transparent display screen, the user's visual fatigue can be alleviated.

[0078] For example, in a driving scenario, virtual scenery can be displayed on a transparent screen. This virtual scenery is projected onto the user's eyes, guiding their eye muscles from tension to relaxation, thus massaging their eyes. During the display of the virtual scenery, the brightness, contrast, and sharpness of the display pixels can be adjusted to make the image softer. The distance of the virtual scenery can also be adjusted, allowing the user's eye muscles to switch between relaxation and tension, thereby relaxing the eyes and relieving visual fatigue.

[0079] For example, if an animation is displayed on a transparent screen and projected onto the user's eyes, the user will not only see the road conditions behind the transparent screen, but also the animation on the transparent screen. This creates different distances of scenery between the animation and the road outside the car, allowing the user's eyes to relax.

[0080] For example, a transparent display screen shows navigation images. By adjusting the brightness, contrast, and sharpness of the displayed pixels, the image becomes softer, or the distance of the navigation image is simulated to relax the user's eyes.

[0081] The solution provided in this application determines the fatigue level of the target user based on the physiological parameters of the target user in front of the display screen, and controls the display mode of the transparent display screen according to the fatigue level. In this way, the change of the display mode of the transparent display screen can drive the target user's eyes from tension to relaxation at the physiological level, thereby achieving the effect of massaging the user's eyes and further relieving the user's driving fatigue.

[0082] For other examples of this embodiment, please refer to the examples above, which will not be repeated here.

[0083] like Figure 8 As shown in the figure, this application provides an electronic device, including a processor 111, a communication interface 112, a memory 113, and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114. Memory 113 is used to store computer programs; In one embodiment of this application, the processor 111, when executing the program stored in the memory 113, implements the control method of the transparent display screen provided in any of the foregoing method embodiments.

[0084] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the control method for the transparent display screen provided in any of the foregoing method embodiments.

[0085] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0086] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0087] It should be understood that the terminology used herein is for the purpose of describing particular exemplary embodiments only and is not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “described” as used herein may also include the plural forms. The terms “comprising,” “including,” “containing,” and “having” are inclusive and therefore indicate the presence of the stated features, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components, and / or combinations thereof. The method steps, processes, and operations described herein are not construed as requiring them to be performed in a particular order described or illustrated unless the order of performance is explicitly indicated. It should also be understood that additional or alternative steps may be used.

[0088] The above description is merely a specific embodiment of the present invention, enabling those skilled in the art to understand or implement the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A control method for a transparent display screen, characterized in that, include: Acquire the physiological data of the target user in front of the transparent display screen; Based on the physiological data, the fatigue level of the target user is determined; Based on the fatigue level, the transparent display screen is controlled to enter a display mode that matches the fatigue level, in order to alleviate visual fatigue for the target user.

2. The method according to claim 1, characterized in that, Controlling the transparent display screen to enter a display mode matching the fatigue level, based on the fatigue level, includes: Based on the fatigue level, the multiple zones of the transparent display screen are controlled to enter their respective display modes.

3. The method according to claim 2, characterized in that, Controlling the transparent display screen to enter a display mode matching the fatigue level, based on the fatigue level, includes: Determine the focal point of the target user's gaze on the transparent display screen; Based on the location of the focal point, determine the first zone of the transparent display screen where the focal point is located; Identify a second partition whose distance from the first partition is less than a first distance threshold and a third partition whose distance from the first partition is greater than a second distance threshold; A first display mode is used for the first partition, a second display mode is used for the second partition, and a third display mode is used for the third partition, wherein the display precision or the displayed content of the first display mode, the second display mode, and the third display mode are different.

4. The method according to claim 1, characterized in that, Controlling the transparent display screen to enter a display mode matching the fatigue level, based on the fatigue level, includes: Determine the display image pair that matches the fatigue level; The transparent display screen is controlled to enter a display mode corresponding to the fatigue level. In the corresponding display mode, the transparent display screen projects a pair of display images matching the fatigue level onto the eyes of the target user. The size, clarity and parallax of the images are different between the display image pairs matching different fatigue levels.

5. The method according to claim 4, characterized in that, Determining the display image pair that matches the fatigue level includes: When the fatigue level is the first fatigue level, a first image pair is determined to constitute the display image pair, wherein the size of the image in the first image pair is the first size, the sharpness is the first sharpness, and the parallax is the first parallax; When the fatigue level is the second fatigue level, the second image pair and the third image pair are determined to constitute the display image pair, wherein the size of the image in the second image pair is the second size, the sharpness is the second sharpness, and the parallax is the second parallax, and the size of the image in the third image pair is the third size, the sharpness is the third sharpness, and the parallax is the third parallax. When the fatigue level is the third fatigue level, a fourth image pair is determined to constitute the display image pair, wherein the size of the image in the fourth image pair is the fourth size, the sharpness is the fourth sharpness, and the parallax is the fourth parallax.

6. The method according to claim 5, characterized in that, Controlling the transparent display screen to enter a display mode corresponding to the fatigue level, and in the corresponding display mode, the transparent display screen projects a display image matching the fatigue level onto the eyes of the target user, including: Locate the position of the target user's eyes; Adjust the display position of the display image pair in the transparent display screen according to the position; A microlens array bonded to the transparent display screen is used to project the left-eye image of the displayed image pair onto the left eye of the target user, and the right-eye image of the displayed image pair onto the right eye of the target user.

7. The method according to claim 6, characterized in that, Projecting the left-eye image of the displayed image pair onto the left eye of the target user using a microlens array bonded to the transparent display screen, and projecting the right-eye image of the displayed image pair onto the right eye of the target user, includes: When the fatigue level is the second fatigue level, a projection switching operation is performed every preset time interval. The projection switching operation refers to changing the projection from the left-eye image in the second image pair to the left-eye image in the third image pair, and changing the projection from the right-eye image in the second image pair to the right-eye image in the third image pair; or the projection switching operation refers to changing the projection from the left-eye image in the third image pair to the left-eye image in the second image pair, and changing the projection from the right-eye image in the third image pair to the right-eye image in the second image pair.

8. A control device for a transparent display screen, characterized in that, include: The acquisition module is used to acquire the physiological data of the target user in front of the transparent display screen; The determination module is used to determine the fatigue level of the target user based on the physiological data; The control module is used to control the transparent display screen to enter a display mode that matches the fatigue level, so as to relieve visual fatigue for the target user.

9. An electronic device, characterized in that, include: At least one communication interface; At least one bus connected to the at least one communication interface; At least one processor connected to the at least one bus; At least one memory connected to the at least one bus, wherein the memory stores a computer program, and the processor executes the computer program to implement the control method of the transparent display screen as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The storage medium stores computer-executable instructions for executing the control method of the transparent display screen according to any one of claims 1 to 7 of this application.

Images