Display control method and device, electronic equipment, storage medium and program product

Abstract

The invention provides a display control method and device, electronic equipment, a storage medium and a program product, and the method comprises the steps: responding to the detection that at least one target object watches a display screen, determining a sight area of the at least one target object on the display screen, and improving the image quality of the sight area; when the sight line area changes, determining a change area according to the sight line area before and after the change, improving the image quality of the changed sight line area, and performing smooth transition processing on the change area; and carrying out image quality reduction processing on areas except the sight line area on the display screen.

Description

Technical Field

[0001] The present disclosure relates to the field of dynamic display technology, and in particular to a display control method, device, electronic device, storage medium, and program product. Background Art

[0002] With advancements in display technology, large-scale circular display systems have found applications in exhibitions, public spaces, and education and training. While these systems have matured from early projection splicing to OLED flexible screen splicing, the interactive experience still has much room for improvement.

[0003] In related technologies, traditional circular display systems usually use a fixed-viewing angle rendering method, which cannot dynamically adjust the display content according to the viewer's position and line of sight, resulting in inefficient use of resources and poor viewing experience for viewers.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] In view of this, the present disclosure proposes a display control method, device, electronic device, storage medium, and program product to solve or partially solve the above problems.

[0006] Based on the above objectives, in a first aspect, the present disclosure provides a display control method, comprising:

[0007] In response to detecting at least one target object viewing a display screen, determining a sight area of ​​the at least one target object on the display screen, and improving image quality of the sight area;

[0008] When the sight line area changes, the changed area is determined according to the sight line areas before and after the change, the image quality of the changed sight line area is improved, and a smooth transition process is performed on the changed area;

[0009] An image quality reduction process is performed on an area on the display screen except the sight area.

[0010] In some exemplary embodiments, before determining the sight area of ​​the at least one target object on the display screen, the method further includes:

[0011] Establishing a resource space for any target object, and independently calculating the sight area of ​​any target object through the resource space;

[0012] Resources of the resource space are allocated according to the number of the at least one target object and the position of the sight area.

[0013] In some exemplary embodiments, determining a sight area of ​​the at least one target object on the display screen includes:

[0014] In response to at least two visual area regions at least partially overlapping, performing a union process on the at least two visual area regions;

[0015] The image quality of the area after the union processing is determined according to the information of the at least two target objects corresponding to the at least two sight lines.

[0016] In some exemplary embodiments, after improving the image quality of the visual area, the method further includes:

[0017] Gaussian smoothing is performed on the boundary of the sight area.

[0018] In some exemplary embodiments, when the visual area changes, the step includes:

[0019] Tracking the sight area using a sight tracking algorithm;

[0020] Determine a change trajectory of the sight area, perform change prediction based on the change trajectory, and adjust resources based on the prediction result.

[0021] In some exemplary embodiments, performing smooth transition processing on the changed region includes:

[0022] The degree of change of the image quality in the changed area is controlled by a quaternion interpolation algorithm.

[0023] In some exemplary embodiments, the step of reducing the image quality of an area on the display screen other than the sight area includes:

[0024] determining a peripheral area and a background area in an area outside the visual area;

[0025] The image quality of the peripheral area is made smaller than that of the sight area, and the image quality of the background area is made smaller than that of the peripheral area.

[0026] Based on the same concept, in a second aspect, the present disclosure further provides a display control device, comprising:

[0027] A first module is configured to, in response to detecting at least one target object viewing a display screen, determine a sight area of ​​the at least one target object on the display screen, and improve image quality of the sight area;

[0028] The second module is configured to determine the changed area according to the visual area before and after the change when the visual area changes, improve the image quality of the changed visual area, and perform smooth transition processing on the changed area;

[0029] The third module is configured to reduce the image quality of an area on the display screen except the sight area.

[0030] Based on the same concept, in a third aspect, the present disclosure further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above methods when executing the computer program.

[0031] Based on the same concept, in a fourth aspect, the present disclosure further provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to implement any of the methods described above.

[0032] Based on the same concept, in a fifth aspect, the present disclosure further provides a computer program product, comprising computer program instructions, which, when executed on a computer, enable the computer to implement any of the methods described above.

[0033] As can be seen from the above, the present disclosure provides a display control method, apparatus, electronic device, storage medium, and program product. This disclosure captures a target object when using a large display screen, such as a cylindrical or circular screen. Each time a target object is detected, the visual field of the target object on the display screen is determined using techniques such as line-of-sight capture. Image quality enhancement is then performed on the visual field, or the core area of ​​the visual field, to improve the image quality of the target object's viewing area. The visual field can then be tracked and monitored at any time. When the visual field changes, the image quality enhancement area can be adjusted based on the visual field before and after the change. The image quality of the portion not falling within the visual field after the change can be gradually reduced using appropriate smoothing methods, making the change appear natural and even imperceptible. Finally, for areas outside the visual field on the display screen, image quality can be reduced to improve energy utilization. This optimizes computing resources, allowing resources to better serve the visual field and optimize allocation strategies. Ultimately, the above-described method improves resource allocation while enhancing the viewing experience of the target object, significantly improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 A schematic diagram of an exemplary application scenario provided for an embodiment of the present disclosure.

[0036] Figure 2 A schematic diagram of a local terminal device in a scenario provided by an embodiment of the present disclosure.

[0037] Figure 3 A schematic diagram of a local terminal device in another scenario provided by an embodiment of the present disclosure.

[0038] Figure 4 A flowchart of an exemplary method provided in accordance with an embodiment of the present disclosure.

[0039] Figure 5 A schematic diagram of the execution flow of the eye tracking algorithm provided in an embodiment of the present disclosure.

[0040] Figure 6 A schematic diagram of fusing two visual areas provided in an embodiment of the present disclosure.

[0041] Figure 7 A flowchart illustrating a specific application of the exemplary method provided in an embodiment of the present disclosure.

[0042] Figure 8 A schematic diagram of the structure of an exemplary device provided in an embodiment of the present disclosure.

[0043] Figure 9 A schematic diagram of the electronic device structure provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solutions and advantages of this specification more clear, this specification is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0045] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should have the usual meanings understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the embodiments of the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements, objects or method steps appearing before the word include the elements, objects or method steps listed after the word and their equivalents, without excluding other elements, objects or method steps. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0046] As mentioned in the background technology section, with the advancement of display technology, large-scale circular display systems have been applied in scenarios such as exhibitions, public spaces, and education and training. However, the interactive experience still has much room for improvement. This is mainly because circular screens display fixed content and lack interaction with users. Large screen sizes also consume a lot of power and cannot dynamically adjust content based on user usage. In related technologies, traditional circular display systems typically use a fixed viewing angle rendering method, which cannot dynamically adjust the displayed content based on the viewer's position and line of sight, resulting in a poor viewing experience, especially limited stereoscopic effects of 3D content.

[0047] In light of the above practical situation, an embodiment of the present disclosure provides a display control method. This disclosure captures a target object when using a large display screen, such as a cylindrical or circular screen. Whenever a target object is detected, the visual field of the target object on the display screen is determined using techniques such as line-of-sight capture. The image quality of the visual field or core area can then be enhanced to improve the image quality of the target object's viewing area. The visual field can then be tracked and monitored at any time. When the visual field changes, the image quality enhancement area can be adjusted based on the visual field before and after the change. The portion that does not fall within the visual field after the change can be gradually reduced in image quality using corresponding smoothing methods, making the change natural and even imperceptible. Finally, for areas outside the visual field on the display screen, the image quality of these areas can be reduced to improve energy utilization. This optimizes computing resources, allowing resources to better serve the visual field and optimize allocation strategies. Ultimately, the above method improves resource allocation while enhancing the viewing experience of the target object, significantly improving the user experience.

[0048] Further, Figure 1A schematic diagram of an exemplary application scenario of a display control method provided by an embodiment of the present disclosure is shown.

[0049] refer to Figure 1 In this application scenario, a local terminal device 101 and a server 102 may be included. The local terminal device 101 and the server 102 may be connected via a wired or wireless communication network to achieve data interaction.

[0050] The local terminal device 101 can be a terminal device with data transmission and multimedia input / output functions close to the user side. Figure 2 and Figure 3 As shown, the local terminal device 101 may have a large display area, and the user may not be able to directly view the entire display screen of the local terminal device 101, or the user may focus on viewing a portion of the display screen of the local terminal device 101, for example Figure 2 The cylindrical display shown or Figure 3 As shown in the circular screen display, the display screen of the local terminal device 101 can be a self-luminous display device that displays the image by itself, or a reflective display device through projection or other methods. Of course, in other application scenarios, it can also be other terminal devices that can realize the above functions.

[0051] Server 102 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0052] In some exemplary embodiments, the display control method may be executed on the local terminal device 101 or the server 102 .

[0053] When the display control method is run on the server 102, the server 102 is used to provide services to the user of the terminal device. The local terminal device 101 is installed with a client that communicates with the server 102. The local terminal device 101 can use the corresponding client to send data to the server 102 to determine whether display control is required or how to perform display control. In the process of providing services, the server 102, in response to detecting at least one target object viewing the display screen, determines the sight area of ​​the at least one target object on the display screen and improves the image quality of the sight area; when the sight area changes, determines the changed area based on the sight areas before and after the change, improves the image quality of the changed sight area, and performs smooth transition processing on the changed area; and reduces the image quality of the area on the display screen other than the sight area. The display screen can be a display screen device provided by the local terminal device 101.

[0054] In a specific implementation, when the display control method runs on the server 102, the method can be implemented and executed based on the cloud interaction system.

[0055] In the above embodiment, the display control method is described as running on the server 102 . However, the present disclosure is not limited thereto. In some exemplary embodiments, the display control method may also be run on the local terminal device 101 .

[0056] The local terminal device 101 may include a processor. A client or a thermal control related program may be installed in the local terminal device 101. The local terminal device 101 may use the client or program to monitor various relevant data of the terminal itself, and determine whether display control is required or how to perform display control, etc. During the execution of the corresponding process, the local terminal device 101, in response to detecting at least one target object viewing the display screen, determines the sight area of ​​the at least one target object on the display screen, and improves the image quality of the sight area; when the sight area changes, determines the changed area based on the sight areas before and after the change, improves the image quality of the changed sight area, and performs a smooth transition process on the changed area; and reduces the image quality of the area on the display screen except for the sight area. Among them, the display screen may be a display screen device provided by the local terminal device 101.

[0057] The following combination Figure 1 The display control method according to the exemplary embodiment of the present disclosure is described with reference to the application scenario. It should be noted that the above application scenario is only shown to facilitate understanding of the spirit and principles of the present disclosure, and the embodiments of the present disclosure are not limited in this respect. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario.

[0058] Figure 4 A schematic diagram of an exemplary flow chart of a display control method provided by an embodiment of the present disclosure is shown.

[0059] refer to Figure 4 , an embodiment of the present disclosure provides a display control method, the method specifically comprising the following steps:

[0060] Step 402 : In response to detecting at least one target object viewing a display screen, determining a sight area of ​​the at least one target object on the display screen, and improving image quality of the sight area.

[0061] In this step, if Figure 2 or Figure 3 As shown, in addition to the display screen for display, the local terminal device 101 can also be equipped with at least one image capture device, such as a camera. These image capture devices can monitor whether there is a target object entering a certain range. The target object here can be a person or a specific object set in other scenes. Figure 3 Taking the shown ring-shaped local terminal device 101 as an example, the middle area surrounded by the ring can be used as the target area, and the objects entering the target area can be captured and tracked by a camera or other device to determine whether there is an object and whether the object is watching the display screen of the local terminal device 101. If the above conditions are met, the object or these objects can be determined as target objects. After that, the line of sight tracking technology or eye tracking technology can be used to determine the display screen area covered by the target object's line of sight, or the display screen area where the line of sight is concentrated. These areas are used as line of sight areas, and one target object generally corresponds to one line of sight area. After determining the line of sight area, the image quality of the line of sight area can be prompted, such as improving the image resolution, refresh rate, saturation, etc. of the line of sight area.

[0062] In specific application scenarios, such as Figure 3 As shown, when a target person approaches the target area, the infrared sensor built into the local terminal device 101 is triggered, and the distributed camera array initiates a recognition process, capturing the visitor's facial features and creating a temporary identity profile. Subsequently, eye-tracking algorithms are used to accurately locate the coordinates of the area where the target person's gaze is focused, and the optimal viewing angle and distance are calculated, thus forming a visual field. High-quality 3D visual content is then rendered in real time to the visitor's current visual field, with computing resources prioritized to ensure enhanced resolution and refresh rate in that area, resulting in a richly detailed, layered 3D effect.

[0063] Next, we move on to eye tracking algorithms, a computer vision technology used to detect, track, and analyze eye movement patterns in real time, determining the user's gaze direction and fixation point. Eye tracking algorithms can be used to locate the user's pupil position and gaze direction, calculate the intersection of the gaze and the display (fixation point), filter noise and instability in eye movement data, predict gaze movement trends, and achieve low-latency rendering.

[0064] The specific algorithm process is as follows Figure 5 As shown, image acquisition preprocessing may include: capturing eye images using an infrared camera (wavelength 850-950nm), noise removal (Gaussian filtering / median filtering), adaptively adjusting image brightness and contrast, maintaining a frame rate above 60 FPS to ensure real-time performance, and scaling the image to a standard size (e.g., 640×480). Facial eye region detection may include: face detection using Haar cascade / HOG+SVM / CNN, eye location based on facial landmarks (e.g., dlib's 68-point model), extraction of left and right eye ROIs, application of AdaBoost or MTCNN to improve real-time detection accuracy, and addition of eye region tracking (KCF / MOSSE) to reduce computational overhead. Pupil and corneal reflector detection may include: extracting the pupil outline using adaptive threshold segmentation, obtaining the pupil center using an ellipse fitting algorithm, detecting corneal reflectors (Glint) based on grayscale peaks, calculating the pupil-corneal reflector vector (PCCR technology), and multi-reflector calibration to improve accuracy and robustness. Gaze vector calculation can include: constructing a 3D eyeball model (corneal curvature approximately 7.8mm), calculating the gaze vector based on the relative position of the pupil center and the corneal reflective point, applying a 3D-2D gaze mapping model, taking into account head pose compensation (using facial landmark estimation), and adjusting model parameters using personal calibration data. Gaze point mapping can include: calculating the intersection of the gaze vector with the screen plane, applying polynomial mapping or neural network model conversion, performing a 9-point / 16-point calibration procedure, establishing a personalized mapping matrix based on the calibration data, and compensating for deviations caused by head movement in real time. Data filtering and smoothing can include: applying Kalman filtering to eliminate jitter, implementing low-pass filtering to remove high-frequency noise, smoothing data using sliding window averaging or weighted averaging, identifying and filtering outliers (based on velocity thresholds), and compensating for missing data during blinks (interpolation techniques). Gaze behavior analysis can include: detecting gazes (gaze duration >200ms), performing saccade and smooth pursuit, calculating gaze point clusters to identify areas of interest, generating heat maps and gaze trajectory visualizations, analyzing blink frequency and pupil size changes, and extracting features of gaze scan paths and jump patterns.

[0065] In some embodiments, to further optimize resource allocation, a separate resource space can be established for each target object, enabling independent calculation and processing of the sight lines of multiple target objects using a parallel computing architecture. For example, a separate rendering channel and resource pool can be allocated for each target object. Furthermore, through behavior recognition algorithms, the identity characteristics and sight lines of different target objects can be accurately distinguished, maintaining stable tracking even in dense crowds. Image rendering resources can be intelligently allocated based on each visitor's visual focus, ensuring that each target object receives high-quality, personalized content within their focus area without interference from the viewing behavior of other target objects. In specific applications, image computing resources can be evenly allocated or allocated according to predefined requirements based on factors such as the number of target objects. Furthermore, in cases where sight lines may overlap, overlapping areas can be processed using a single resource pool to prevent duplicate processing of the same area. Specifically, in some embodiments, before determining the sight line area of ​​the at least one target object on the display screen, the method further includes: establishing a resource space for each target object, independently calculating the sight line area of ​​each target object using the resource space; and allocating resources within the resource space based on the number of the at least one target object and the location of the sight line area.

[0066] In some embodiments, since there may be multiple target objects, the sight lines of different target objects may overlap. Therefore, after determining the sight line area, if two or more sight lines overlap at least partially, these at least partially overlapping sight lines can be fused together to generate a new fused sight line area, which can be used as the basis for rendering. Figure 6 As shown in (a), there is an area where the sight lines of target object A and target object B overlap. Then, through union fusion, the following can be generated: Figure 6 (b) shows the fused visual field. Specifically, when multiple subjects view the same annular 3D display, the overlapping area of ​​different subjects' perspectives can be calculated based on eye tracking data to form a fused visual field region C. A special rendering strategy, i.e., C = A ∪ B, is then implemented for this region. This strategy aims to address the content rendering issue in areas where visual fields intersect or overlap when multiple subjects simultaneously use the annular 3D display system.

[0067] In the specific calculation process, the gaze mapping representation is first determined, and the gaze area of ​​user A is defined as set A, which is expressed as: A = {(x, y, pA) | (x, y)∈S, pA>τA}, where: (x, y) is the pixel coordinate point of the display screen, S is the coordinate space of the entire display screen, pA represents the probability value of user A's gaze at a certain point, and τA is the gaze threshold. When user A and user B watch the display screen at the same time, the calculation process of the fused gaze area C is as follows: (1) Initialize the union area: (Empty set). (2) Corner overlap detection: If there exists a point (x, y) such that (x, y, pA)∈A and (x, y, pB)∈B, then an overlapping region is confirmed. (3) Union region construction: C = {(x, y, pC) | (x, y, pA)∈A or (x, y, pB)∈B}, where the weight value pC can be obtained through the fusion function: pC = Ψ(pA, pB, wA, wB). The fusion function Ψ takes into account the user feature weights (wA, wB) and can be implemented as: pC = (pA·wA+pB·wB) / (wA+wB).

[0068] The above completes the determination of the overlapping sight area. After the determination of the overlapping sight area is completed, it can be directly used as a sight area for unified image quality improvement. In other embodiments, the image quality of the area can also be determined based on the information of the target object. In some scenes with higher requirements, the image quality corresponding to different target objects may be different, and then further confirmation can be made based on the information of the relevant target objects when processing the fused sight area. For example, the viewing priority of the overlapping target objects (calculated based on factors such as residence time, viewing distance and special needs) can be used to determine the weight of different target objects, and then comprehensively consider each target object to determine the image quality of the fused sight area. That is, in some embodiments, determining the sight area of ​​at least one target object on the display screen includes: in response to at least two sight areas at least partially overlapping, performing a union process on the at least two sight areas; and determining the image quality of the area after the union process based on the information of at least two target objects corresponding to the at least two sight areas.

[0069] In some embodiments, since the image quality of the line of sight area is improved, the line of sight area is different from other areas of the display screen. If edge processing is not performed, it may affect the user experience. Therefore, the boundaries of the line of sight area can be processed by means of Gaussian smoothing or Gaussian blurring to ensure a natural rendering transition and avoid hard boundaries. Specifically, for the line of sight area set A, A'=GaussianSmooth(A,σ), where A' is the processed line of sight area set and σ represents a dynamic adjustment parameter. That is, in some embodiments, after improving the image quality of the line of sight area, the method further includes: performing Gaussian smoothing on the boundaries of the line of sight area.

[0070] Step 404 : When the sight line area changes, the changed area is determined according to the sight line areas before and after the change, the image quality of the changed sight line area is improved, and a smooth transition process is performed on the changed area.

[0071] In this step, the aforementioned gaze tracking technology can be used to continuously track the gaze area. When the gaze area changes, the image quality of the changed gaze area also needs to be improved. Here, there may be overlapping areas between the gaze area before and after the change, and the image quality of these areas will not change. Some areas may be newly added areas. At the same time, during the change process, there may be some areas that change from the gaze area back to the non-sight area. Here, whether it is an area that is newly added to the gaze area or an area that changes to the non-sight area, it can be referred to as a changed area. For the changed area, if its image quality is directly improved to the level of the gaze area or reduced to the level of the non-sight area, a more obvious contrast may be formed, which may affect the viewing experience of the target object. In this way, the changed area can be smoothly transitioned. For example, the change process can be reflected and prolonged, such as the resolution gradually decreasing from 3840×2160 to 1920×1080 over a few seconds or even tens of seconds.

[0072] In some embodiments, when the target object moves freely or changes its sight focus within the target area, the changing trend of the eye movement trajectory can be continuously monitored by a real-time sight tracking algorithm. At this time, the trajectory prediction can be further performed with the help of the algorithm to summarize and predict the changing rules or change trajectories of the target object's sight area, and the new area that the target object is about to focus on can be predicted in advance, and rendering preparation can be started in advance. Once it is confirmed that the target object's gaze point has significantly shifted, the image rendering engine immediately reallocates resources. If it is a predicted new area, the image content of the new area can be quickly upgraded to a high-quality rendering state. Afterwards, the rendering quality of the old area is smoothly transitioned to ensure that the entire visual experience is coherent and natural, avoiding the discomfort caused by screen jumps. That is, in some embodiments, when the sight area changes, it includes: tracking the sight area using a sight tracking algorithm; determining the change trajectory of the sight area, predicting the change based on the change trajectory, and adjusting resources based on the prediction results.

[0073] In some embodiments, to further enhance the smooth transition of the area when the visual area changes, a quaternion interpolation algorithm can be used to control the change in image quality in the changing area to ensure a smooth transition. That is, in some embodiments, the smooth transition of the changing area includes controlling the degree of change in image quality in the changing area using a quaternion interpolation algorithm.

[0074] Step 406: Reduce the image quality of the area on the display screen except the sight area.

[0075] In this step, for the non-line-of-sight areas other than the line-of-sight area on the display screen, you can choose to reduce the image quality of the non-line-of-sight areas to save resources occupied by this part of the image, so that more resources are concentrated in the line-of-sight area, thereby achieving resource optimization while keeping the total amount of resources unchanged and improving the viewing experience of the target object.

[0076] Furthermore, in specific applications, the gaze situation of the entire display screen can be counted to form a gaze heat map. When it is detected that no target object is paying attention to a certain area for more than a set threshold time, the rendering priority of the area can be automatically reduced to the lowest to form a dormant area, thereby significantly reducing the rendering quality of the dormant area or completely suspending the content update calculation of the area. This attention-based dynamic resource allocation strategy enables GPU and CPU resources to be concentrated on the line of sight area that the target object actually pays attention to, which can improve overall operating efficiency and energy utilization. At the same time, low-intensity monitoring of the global environment of the display screen can be maintained. Once a target object turns its gaze to the dormant area, the full rendering capability of the area is restored to ensure the continuity of the experience and the immediacy of the response.

[0077] In some embodiments, in order to further divide the non-line-of-sight area and further optimize resource utilization, the non-line-of-sight area can be divided, wherein the non-line-of-sight area within a certain range of the line-of-sight area can be called the peripheral area, and the area further out can be called the background area. In this way, the entire display screen can be divided into three areas: the line-of-sight area, the peripheral area, and the background area. The image quality of these three areas can then be arranged as high, medium, and low, i.e., the line-of-sight area has high image quality, the peripheral area has medium image quality, and the background area has low image quality. For example, assuming the image quality of the line-of-sight area is 100%, the peripheral area can be 75%, and the background area can be 50%. While reducing the image quality of the non-line-of-sight area, the image quality drop in the peripheral area and the background area in the non-line-of-sight area is adjusted. This can optimize the overall image effect and adjust resource allocation so that the target object is less likely to notice changes in the peripheral area. At the same time, when the line of sight area changes, the image quality drop in the peripheral area is relatively low, so that the high image quality requirements of the line of sight area can be quickly met. That is, in some embodiments, the image quality reduction processing of the area other than the line of sight area on the display screen includes: determining the peripheral area and the background area in the area outside the line of sight area; making the image quality of the peripheral area smaller than that of the line of sight area, and making the image quality of the background area smaller than that of the peripheral area.

[0078] In specific application scenarios, combined with the Figure 7 , a specific implementation process of the display control method is described:

[0079] 1. Initialization phase: Hardware calibration: After startup, the system automatically performs calibration of camera internal and external parameters, display screen parameters, and coordinate system conversion matrix construction; Environmental scanning: The RGB-D camera scans the surrounding environment and establishes a spatial model; Internal self-test: Checks the rendering module, computing unit, and network connection status.

[0080] 2. Multi-user detection and recognition stage: Human detection: The RGB-D camera collects depth maps and color images in the environment, and uses the human detection algorithm to detect the human position in real time; Facial recognition: Through face recognition, facial feature vectors are extracted to locate the face position; Position tracking: Continuously track the changes in the user's spatial position and maintain the user's spatial distribution status.

[0081] 3. Data collection and processing stage: Camera selection: Based on the user's position and head orientation, the best combination of 2-4 infrared cameras is dynamically selected; Eye positioning: The eye area is located through the human eye tracking algorithm, and the key feature points of the eye are extracted; Multi-source data fusion: Weighted fusion of multi-camera data is performed, and filters are applied to filter out noise; Gaze point mapping: The line of sight vector is mapped to the coordinate system of the ring display screen to calculate the gaze point position.

[0082] 4. Dynamic allocation of rendering resources: Regional priority division: divide the display area into three levels of priority: high, medium, and low; rendering parameter configuration: configure differentiated rendering parameters for different priority areas; GPU task allocation: dynamically adjust the rendering area responsible for each GPU based on priority distribution; rendering task scheduling: monitor the GPU load status in real time and optimize the task allocation strategy.

[0083] 5. During the gaze area analysis phase, gaze heat map generation is performed: a heat map is generated based on user gaze point data to reflect attention distribution; multi-user data integration is performed: a comprehensive analysis of all users' gaze areas is performed to identify common areas of attention and individual differences; and content importance assessment is performed: the importance of content in each area is assessed based on content semantic information.

[0084] 6. Overlap detection and coordination stage: View overlap detection: detect the overlap of multiple users' visual areas and evaluate the degree of overlap; User priority evaluation: calculate the priority based on factors such as user interaction history and content relevance; Coordination strategy selection: select strategies such as content layered display and visual prompt guidance based on the overlap situation.

[0085] 7. Content-adaptive rendering stage: perspective-dependent content adjustment: real-time adjustment of the perspective and parallax parameters of 3D content based on the user's perspective; gaze point detail enhancement: detail enhancement processing is performed on the gaze area; perspective transition smoothing: quaternion interpolation algorithm is applied to ensure smooth transition when the perspective changes; personalized content rendering: personalized content is generated based on user identity and focus.

[0086] 8. Display output stage: content synthesis: synthesize the rendering results of each priority area into a complete picture; high-precision color correction: ensure the color consistency of each area of ​​the ring display; multi-view coordinated display: implement overlapping coordination strategy to ensure a harmonious viewing experience for multiple users; real-time picture update: maintain a high refresh rate for content updates to ensure smooth interaction.

[0087] The system continuously executes the above process in a closed-loop operation. Within each cycle, the system dynamically responds to changes in user gaze behavior, adjusting rendering strategies and display content in real time to ensure that all users receive the best interactive experience and visual effects, achieving a smooth and natural human-computer interaction experience.

[0088] As can be seen from the above embodiments, the present disclosure provides a display control method. This method captures a target object when using a large display screen, such as a cylindrical or circular screen. Each time a target object is detected, the visual field of the target object on the display screen is determined using techniques such as line-of-sight capture. Image quality enhancement is then performed on the visual field, or the core area of ​​the visual field, to improve the image quality of the target object's viewing area. The visual field can then be tracked and monitored at any time. When the visual field changes, the image quality enhancement area can be adjusted based on the visual field before and after the change. The image quality of the portion not falling within the visual field after the change can be gradually reduced using appropriate smoothing methods, making the change appear natural and even imperceptible. Finally, for areas outside the visual field on the display screen, image quality can be reduced to improve energy efficiency. This optimizes computing resources, allowing resources to better serve the visual field and optimizes allocation strategies. Ultimately, the above-described method improves resource allocation while enhancing the viewing experience of the target object, significantly improving the user experience.

[0089] It should be noted that the methods of the embodiments of the present disclosure can be performed by a single device, such as a computer or server. The methods of the embodiments of the present disclosure can also be applied in a distributed scenario, performed by multiple devices working together. In such a distributed scenario, one of the multiple devices may only perform one or more steps of the methods of the embodiments of the present disclosure, and the multiple devices will interact with each other to complete the described method.

[0090] It should be noted that the above description is of specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0091] Based on the same concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure further provides a display control device.

[0092] refer to Figure 8 , the display control device comprises:

[0093] The first module 810 is configured to, in response to detecting at least one target object viewing a display screen, determine a sight area of ​​the at least one target object on the display screen, and improve image quality of the sight area.

[0094] The second module 820 is configured to determine the changed area according to the visual area before and after the change when the visual area changes, improve the image quality of the visual area after the change, and perform smooth transition processing on the changed area.

[0095] The third module 830 is configured to reduce the image quality of the area on the display screen except the sight area.

[0096] In some exemplary embodiments, the first module 810 is further configured to:

[0097] Establishing a resource space for any target object, and independently calculating the sight area of ​​any target object through the resource space;

[0098] Resources of the resource space are allocated according to the number of the at least one target object and the position of the sight area.

[0099] In some exemplary embodiments, the first module 810 is further configured to:

[0100] In response to at least two visual area regions at least partially overlapping, performing a union process on the at least two visual area regions;

[0101] The image quality of the area after the union processing is determined according to the information of the at least two target objects corresponding to the at least two sight lines.

[0102] In some exemplary embodiments, the first module 810 is further configured to:

[0103] Gaussian smoothing is performed on the boundary of the sight area.

[0104] In some exemplary embodiments, the second module 820 is further configured to:

[0105] Tracking the sight area using a sight tracking algorithm;

[0106] Determine a change trajectory of the sight area, perform change prediction based on the change trajectory, and adjust resources based on the prediction result.

[0107] In some exemplary embodiments, the second module 820 is further configured to:

[0108] The degree of change of the image quality in the changed area is controlled by a quaternion interpolation algorithm.

[0109] In some exemplary embodiments, the third module 830 is further configured to:

[0110] determining a peripheral area and a background area in an area outside the visual area;

[0111] The image quality of the peripheral area is made smaller than that of the sight area, and the image quality of the background area is made smaller than that of the peripheral area.

[0112] For the convenience of description, the above devices are described as being functionally divided into various modules. Of course, when implementing the embodiments of the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0113] The apparatus of the above embodiment is used to implement the corresponding display control method in the above embodiment, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0114] Based on the same concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and runnable on the processor, wherein when the processor executes the computer program, the display control method as described in any of the above embodiments is implemented.

[0115] Figure 9 10 is a schematic diagram showing a more specific hardware structure of an electronic device provided in this embodiment. The device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are communicatively connected to each other within the device via the bus 1050.

[0116] The processor 1010 can be implemented using a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0117] The memory 1020 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage devices, dynamic storage devices, etc. The memory 1020 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 1020 and is called and executed by the processor 1010.

[0118] The input / output interface 1030 is used to connect an input / output module to implement information input and output. The input / output module can be configured as a component in the device (not shown in the figure) or can be externally connected to the device to provide corresponding functions. Input devices may include a keyboard, mouse, touch screen, microphone, various sensors, etc., and output devices may include a display, speaker, vibrator, indicator light, etc.

[0119] The communication interface 1040 is used to connect to a communication module (not shown) to enable communication between the device and other devices. The communication module can communicate via a wired method (such as USB, network cable, etc.) or a wireless method (such as mobile network, WiFi, Bluetooth, etc.).

[0120] The bus 1050 comprises a pathway for transmitting information between the various components of the device (eg, the processor 1010 , the memory 1020 , the input / output interface 1030 , and the communication interface 1040 ).

[0121] It should be noted that although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040, and the bus 1050, in a specific implementation, the device may also include other components necessary for normal operation. In addition, it will be understood by those skilled in the art that the above device may only include the components necessary to implement the embodiments of this specification, and does not necessarily include all the components shown in the figure.

[0122] The electronic device of the above embodiment is used to implement the corresponding display control method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0123] Based on the same concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the display control method described in any of the above embodiments.

[0124] The computer-readable media of this embodiment include permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0125] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the display control method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0126] Based on the same concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides a computer program product comprising computer program instructions. In some embodiments, the computer program instructions can be executed by one or more processors of a computer to cause the computer and / or the processor to perform the display control method. Corresponding to the execution subject corresponding to each step in each embodiment of the display control method, the processor executing the corresponding step can belong to the corresponding execution subject.

[0127] The computer program product of the above embodiment is used to enable the computer and / or the processor to execute the display control method described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0128] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Within the scope of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.

[0129] In addition, to simplify the description and discussion, and so as not to obscure the embodiments of the present disclosure, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, devices may be shown in the form of block diagrams to avoid obscuring the embodiments of the present disclosure, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure are to be implemented (i.e., these details should be fully within the purview of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it will be apparent to those skilled in the art that the embodiments of the present disclosure may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0130] Although the present disclosure has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those skilled in the art based on the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0131] The embodiments of the present disclosure are intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A display control method, characterized in that: include: In response to detecting at least one target object viewing a display screen, determining a sight area of ​​the at least one target object on the display screen, and improving image quality of the sight area; When the sight line area changes, the changed area is determined according to the sight line areas before and after the change, the image quality of the changed sight line area is improved, and a smooth transition process is performed on the changed area; An image quality reduction process is performed on an area on the display screen except the sight area.

2. The method according to claim 1, characterized in that Before determining the sight area of ​​the at least one target object on the display screen, the method further includes: Establishing a resource space for any target object, and independently calculating the sight area of ​​any target object through the resource space; Resources of the resource space are allocated according to the number of the at least one target object and the position of the sight area.

3. The method according to claim 1, characterized in that Determining the sight area of ​​the at least one target object on the display screen includes: In response to at least two visual area regions at least partially overlapping, performing a union process on the at least two visual area regions; The image quality of the area after the union processing is determined according to the information of the at least two target objects corresponding to the at least two sight lines.

4. The method according to claim 1, wherein After improving the image quality of the sight area, the method further includes: Gaussian smoothing is performed on the boundary of the sight area.

5. The method according to claim 1, wherein When the visual area changes, it includes: Tracking the sight area using a sight tracking algorithm; Determine a change trajectory of the sight area, perform change prediction based on the change trajectory, and adjust resources based on the prediction result.

6. The method according to claim 1, characterized in that The performing smooth transition processing on the changed area includes: The degree of change of the image quality in the changed area is controlled by a quaternion interpolation algorithm.

7. The method according to claim 1, characterized in that The performing of image quality reduction processing on the area on the display screen except the sight area includes: determining a peripheral area and a background area in an area outside the visual area; The image quality of the peripheral area is made smaller than that of the sight area, and the image quality of the background area is made smaller than that of the peripheral area.

8. A display control device, characterized in that: include: A first module is configured to, in response to detecting at least one target object viewing a display screen, determine a sight area of ​​the at least one target object on the display screen, and improve image quality of the sight area; The second module is configured to determine the changed area according to the visual area before and after the change when the visual area changes, improve the image quality of the changed visual area, and perform smooth transition processing on the changed area; The third module is configured to reduce the image quality of an area on the display screen except the sight area.

9. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 7 when executing the computer program.

10. A non-transitory computer-readable storage medium, characterized in that The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a computer to implement the method according to any one of claims 1 to 7.

11. A computer program product, characterized in that The method comprises computer program instructions, which, when executed on a computer, cause the computer to implement the method according to any one of claims 1 to 7.

Images