Display control method and device, electronic equipment and computer readable storage medium

Abstract

This application discloses a display control method, apparatus, electronic device, and computer-readable storage medium, relating to the field of terminal device technology. The method includes: the terminal device acquiring eye gaze information and eye distance information of a target user via a front-facing camera; calculating image cropping parameters based on the eye gaze information, eye distance information, and state parameters of the terminal device; cropping the rear image acquired by a rear-facing camera according to the image cropping parameters to obtain a target field-of-view image obscured by the terminal device itself; and outputting the target field-of-view image through the screen of the terminal device. This achieves the acquisition of the real rear view obscured by the terminal device itself and displays the target field-of-view image on the screen, thus stitching together the complete image visible from the user's perspective. It also reduces the cost of achieving unobstructed field of view.

Description

Technical Field

[0001] This application relates to the field of terminal equipment technology, specifically to a display control method, device, electronic device, and computer-readable storage medium. Background Technology

[0002] Current terminal devices have significant limitations in visual presentation. When users use terminal devices, the screen or the terminal device itself may obscure the real environment behind them, leading to security risks or efficiency issues.

[0003] Existing technologies attempt to simulate environmental displays using multi-camera stitching or AR (Augmented Reality) technology, but these methods have significant drawbacks. For example, multi-camera stitching solutions require additional cameras on the side or back of the terminal device, increasing the device's thickness and hardware costs. Furthermore, the stitched images are prone to edge distortion and color inconsistencies, and cannot match changes in the user's viewing angle in real time. On the other hand, AR-based environmental display solutions rely on external environment modeling and virtual scene overlay, requiring substantial computing power and prone to latency (typically ≥100ms). Moreover, the display effect deviates significantly from the real environment, especially in fast-moving scenarios, where image stuttering and misalignment are prominent issues.

[0004] Therefore, how to realize the display of the real environment at the back end and reduce hardware costs is an urgent problem to be solved. Summary of the Invention

[0005] This application provides a display control method, device, electronic device, and computer-readable storage medium, which can enable the display of the real environment behind the device to avoid the view being blocked by the terminal device, and can also reduce the implementation cost.

[0006] In a first aspect, embodiments of this application provide a display control method applied to a terminal device, the terminal device including a front-facing camera, a rear-facing camera, and a screen, the method comprising: The front-facing camera collects the target user's eye gaze information and eye distance information. The image cropping parameters are calculated based on the eye gaze information, the eye distance information, and the status parameters of the terminal device. The rear view captured by the rear camera is cropped according to the image cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device. The target field of view is output through the screen.

[0007] Secondly, embodiments of this application also provide a display control device applied to a terminal device, the terminal device including a front-facing camera, a rear-facing camera, and a screen, the device comprising: The acquisition module is used to acquire the eye gaze information of the target user and the eye distance information of the target user through the front-facing camera; The calculation module is used to calculate the image cropping parameters based on the eye gaze information, the eye distance information, and the status parameters of the terminal device; The cropping module is used to crop the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device. The output module is used to output the target field of view through the screen.

[0008] Optionally, in some embodiments of this application, the state parameters include screen size information, and the image cropping parameters include field of view information and image center point information; The calculation of image cropping parameters based on the eye gaze information, the eye distance information, and the state parameters of the terminal device includes: The field of view information is calculated using the screen size information and the eye distance information; The center point information of the image is determined based on the eye gaze information.

[0009] Optionally, in some embodiments of this application, the screen size information includes screen horizontal width information and screen vertical height information, and the field of view information includes horizontal angle information and vertical angle information; The calculation of the field of view information using the screen size information and the eye distance information includes: The horizontal angle information is calculated based on the screen horizontal width information and the eye distance information; The vertical angle information is calculated based on the screen vertical height information and the eye distance information.

[0010] Optionally, in some embodiments of this application, determining the center point information of the image based on the eye gaze information includes: Establish a screen coordinate system for the screen; The eye gaze information is mapped to the gaze position on the screen using the screen coordinate system; The center point information of the image is determined based on the gaze position.

[0011] Optionally, in some embodiments of this application, the state parameters may further include device attitude information; The device further includes: The field of view information is optimized based on the device attitude information to obtain optimized field of view information; The step of cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The rear image is cropped according to the optimized field of view information and the image center point information to obtain the target field of view image.

[0012] Optionally, in some embodiments of this application, the step of outputting the target field of view through the screen includes: The target view is displayed on the screen in a live wallpaper mode; The device further includes: The screen also displays at least one application icon; Determine the target screen color tone at the location of the application icon from the target viewpoint; Adjust the icon display color of the application icon according to the target screen color tone; The device further includes: In response to a touch operation on the application icon, the target application corresponding to the application icon is launched, and the capture of the rear view through the rear camera is paused.

[0013] Optionally, in some embodiments of this application, cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The ambient light intensity information is detected by the front-facing camera; The exposure parameters of the rear camera are adjusted based on the ambient light intensity information; The rear camera is controlled by the exposure parameters to capture the rear image. The target field of view is obtained by cropping the rear image according to the image cropping parameters.

[0014] Thirdly, embodiments of this application also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps in the above-described display control method.

[0015] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the above-described display control method.

[0016] Fifthly, embodiments of this application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in embodiments of this application.

[0017] In summary, the terminal device in this application embodiment collects the eye gaze information and eye distance information of the target user through the front-facing camera, calculates the image cropping parameters based on the eye gaze information, eye distance information and the state parameters of the terminal device, and crops the rear image collected by the rear-facing camera according to the image cropping parameters to obtain the target field of view image occluded by the main body of the terminal device, and outputs the target field of view image through the screen of the terminal device.

[0018] In this embodiment, the target field of view is obtained by calculating the image cropping parameters and cropping the rear image based on the image cropping parameters. This enables the acquisition of the real rear image that is blocked by the terminal device itself, and the display of the target field of view on the screen enables the stitching of the complete image that can be seen from the user's perspective.

[0019] Furthermore, the front-facing camera, rear-facing camera, and screen can all capture the real-world image from the front, eliminating the need for a camera on the side of the device or AR technology, thus reducing the cost of achieving unobstructed vision. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a schematic diagram of a scenario in which a terminal device, according to an embodiment of this application, executes the display control method; Figure 2 This is a flowchart illustrating the display control method provided in an embodiment of this application; Figure 3 This is a schematic diagram of the structure of the display control device provided in the embodiments of this application; Figure 4 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0022] Explanation of icon numbers: 101-Terminal device; 301-Acquisition module; 302-Calculation module; 303-Clipping module; 304-Output module; 401-Processor; 402-Memory; 403-Power supply; 404-Input unit. Detailed Implementation

[0023] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0024] In the description of the embodiments of this application, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention. Furthermore, the terms "first," "second," "third," and "fourth" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first," "second," "third," and "fourth" may explicitly or implicitly include one or more features. In the description of the present invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0025] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use the invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the invention can be made without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0026] This application provides a display control method, apparatus, electronic device, and computer-readable storage medium. Specifically, this application provides a display control apparatus suitable for electronic devices, including terminal devices, such as mobile phones, tablets, televisions, desktop computers, or vehicle-mounted devices equipped with front-facing cameras, rear-facing cameras, and screens.

[0027] For example, please see Figure 1 , Figure 1 This is a schematic diagram illustrating a scenario where a terminal device, according to an embodiment of this application, executes the display control method. Specifically, the execution process of the display control method by the terminal device is as follows: Terminal device 101 collects eye gaze information and eye distance information of the target user through the front-facing camera, calculates screen cropping parameters based on the eye gaze information, eye distance information and the status parameters of the terminal device, and crops the rear image collected by the rear-facing camera according to the screen cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device, and outputs the target field of view image through the screen of the terminal device.

[0028] For example, when a user browses a terminal device screen, their field of vision is traditionally obstructed by the screen, preventing them from seeing the real environment behind them. Furthermore, due to the larger field of view of the rear camera, the image seen through the screen overlaps with the actual space seen directly by the user's eyes, resulting in poor display quality and misleading information. Therefore, in this embodiment, the front camera collects the user's eye gaze information and distance from their eyes. Using this information, along with the terminal device's own state parameters, image cropping parameters are calculated. These parameters are then used to crop the image captured by the rear camera, obtaining the target field of view obstructed by the terminal device itself. This target field of view is then displayed on the screen, achieving a seamless stitching of the real scene visible to the user through the screen, making the terminal device appear "transparent."

[0029] In summary, this embodiment calculates image cropping parameters and crops the rear image based on these parameters to obtain the target field of view. This enables the capture of the real rear image obscured by the terminal device itself. By displaying the target field of view on the screen, a complete image visible from the user's perspective can be stitched together. Furthermore, the front camera, rear camera, and screen are sufficient to capture the real rear image, eliminating the need for a side-mounted camera or AR technology, thus reducing the cost of achieving unobstructed field of view.

[0030] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0031] Please see Figure 2 , Figure 2 This is a flowchart illustrating the display control method provided in this application embodiment. Although the flowchart shows a logical order, in some cases, the steps shown or described can be executed in a different order than that shown in the flowchart. Specifically, the execution subject of this display control method is a terminal device, which includes a front-facing camera, a rear-facing camera, and a screen. The specific flow of the display control method is as follows: S201. Collect the target user's eye gaze information and eye distance information for the target user through the front-facing camera.

[0032] The front-facing camera refers to a camera located on the front of a terminal device or whose shooting direction is forward, such as the front-facing camera of a mobile phone, which allows users to capture faces from the front when using the phone.

[0033] Among these, eye gaze information refers to the position of the eyes on the screen of the terminal device. The position of the eyes on the screen can be located through user eye tracking.

[0034] Among them, eye distance information refers to the distance between the terminal device (such as the screen of the terminal device or the front-facing camera) and the user's eyeball, which can be calculated from the focusing distance of the front-facing camera.

[0035] Here, the target user refers to the user currently using the terminal device. In this embodiment, the target user's eyes / face are located on the front of the screen, i.e., the shooting direction of the front-facing camera.

[0036] It's understandable that collecting eye gaze and eye distance information serves as a reference for cropping the rear image corresponding to the rear camera, improving the accuracy and effectiveness of image capture and helping the final display effect of the terminal device screen meet expectations. It's also understandable that obtaining reference information for controlling the cropping of the rear image through the front camera simplifies hardware costs.

[0037] S202. Calculate the image cropping parameters based on the eye gaze information, the eye distance information, and the status parameters of the terminal device.

[0038] It is understandable that the different eye gaze and eye distance information of the target user affects the image that the user can view. Therefore, calculating the image cropping parameters for cropping the rear image based on eye gaze and eye distance information helps to improve the accuracy and rationality of the image cropping parameters.

[0039] Furthermore, the status parameters of the terminal device also affect the obscured screen area. Therefore, by combining the status parameters of the terminal device to calculate the screen cropping parameters, the accuracy and rationality of the screen cropping parameters can be further improved.

[0040] Among them, the status parameters refer to the physical characteristics of the terminal device. For example, the status parameters include the screen size of the terminal device (generally the screen size is close to the size of the area of ​​the terminal device that has a blocking effect) or the orientation. The orientation includes vertical screen facing forward, vertical screen facing backward, horizontal screen facing left or horizontal screen facing right, etc. The orientation of the terminal device can be calculated by collecting the rotational angular velocity of the terminal device through the gyroscope.

[0041] Understandably, by calculating image cropping parameters that match the user's eye gaze information, eye distance information, and terminal device status parameters, the cropped image can be a true rear view that matches the user's perspective.

[0042] S203. The rear view captured by the rear camera is cropped according to the image cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device.

[0043] The rear view refers to the view captured by the rear camera when it is turned on.

[0044] For example, the rear view is first captured by the rear camera, and then the rear view is cropped using image cropping parameters to obtain the target view that is obscured by the terminal device in the user's view.

[0045] It should be noted that the target field of view is not the image with a wide field of view captured by the rear camera, but rather the part of the image that is obscured by the terminal device itself within the user's field of view.

[0046] For example, cropping the rear view using the rear camera can achieve hardware-based image cropping.

[0047] S204. Output the target field of view image through the screen.

[0048] For example, the target field of view is displayed on the screen. It is understood that the target field of view is only the obscured part, so there is no overlapping area between the target field of view and the part of the screen that is not obscured by the terminal device itself. By displaying the target field of view on the screen, the target field of view is visually stitched together with the part of the screen that is not obscured by the terminal device itself in the user's viewpoint, resulting in a complete picture without the terminal device in the user's viewpoint, which achieves the effect of the terminal device itself being "transparent".

[0049] In summary, this embodiment calculates image cropping parameters and crops the rear image based on these parameters to obtain the target field of view. This enables the capture of the real rear image obscured by the terminal device itself. By displaying the target field of view on the screen, a complete image visible from the user's perspective can be stitched together. Furthermore, the front camera, rear camera, and screen are sufficient to capture the real rear image, eliminating the need for a side-mounted camera or AR technology, thus reducing the cost of achieving unobstructed field of view.

[0050] In this embodiment, the rear image is cropped based on the field of view obstructed by the terminal device and the user's gaze position. Optionally, in some embodiments of this application, the image cropping parameters include field of view information and image center point information, and the status parameters include screen size information. The step "calculate the image cropping parameters based on the eye gaze information, the eye distance information, and the status parameters of the terminal device" includes: The field of view information is calculated using the screen size information and the eye distance information; The center point information of the image is determined based on the eye gaze information.

[0051] The screen size information includes the horizontal width and vertical height of the screen, and the field of view information includes the horizontal angle and the vertical angle.

[0052] The embodiments of this application calculate the horizontal angle using the horizontal width of the screen and eye distance information, and calculate the vertical angle using the vertical height of the screen and eye distance information.

[0053] That is, optionally, in some embodiments of this application, the screen size information includes screen horizontal width information and screen vertical height information, the field of view information includes horizontal angle information and vertical angle information, and the step "calculate the field of view information using the screen size information and the eye distance information" includes: The horizontal angle information is calculated based on the screen horizontal width information and the eye distance information; The vertical angle information is calculated based on the screen vertical height information and the eye distance information.

[0054] For example, the horizontal FOV (θx) is represented as θx = 2×arctan (W / (2D)). The vertical FOV (θy) is represented as θy = 2×arctan (H / (2D)). Where W is the horizontal width of the screen, H is the vertical height of the screen, and D is the eye distance.

[0055] In this embodiment of the application, the eye gaze information of the target user can be mapped onto the screen through coordinate transformation. That is, optionally, in some embodiments of this application, the step "determining the center point information of the screen based on the eye gaze information" includes: Establish a screen coordinate system for the screen; The eye gaze information is mapped to the gaze position on the screen using the screen coordinate system; The center point information of the image is determined based on the gaze position.

[0056] For example, a screen coordinate system is established with the top left corner of the screen as the origin, the X-axis along the horizontal direction of the screen, and the Y-axis along the vertical direction of the screen. The eye gaze information, i.e., the center point of the user's pupil (e.g., the average position of the two pupil positions), is mapped to the gaze position on the screen. Then, the gaze position is mapped to the center point information of the rear camera's image.

[0057] It is understandable that the gaze position (X1, Y1) is mapped to the center point (Xc, Yc) of the rear camera image to ensure that when the user gazes at a point on the screen, that point corresponds to the core area of ​​the rear scene.

[0058] In this embodiment, the field of view is further optimized based on the device's orientation to improve the accuracy of image cropping. That is, optionally, in some embodiments of this application, the method further includes: The field of view information is optimized based on the device attitude information to obtain optimized field of view information; The step of cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The rear image is cropped according to the optimized field of view information and the image center point information to obtain the target field of view image.

[0059] For example, if the terminal device is tilted (e.g., tilt angle α > 10°), the FOV clipping angle is corrected by the tilt angle obtained by the gravity sensor (e.g., when tilted by an angle α, the horizontal angle of the FOV increases by α × 0.8 to ensure that the image is unobstructed).

[0060] It is understandable that in practical applications, the position and posture of the terminal device, the user's head, and eyes can constantly change. Therefore, in this embodiment, a real-time target field of view is generated based on the terminal device's real-time posture, the user's eye gaze information, and eye distance information, and dynamically updated to the terminal device's screen. That is, optionally, in some embodiments of this application, the step "outputting the target field of view through the screen" includes: The target view is displayed on the screen in a live wallpaper mode.

[0061] In addition to displaying the target view based on the wallpaper, the method also includes displaying application icons on the screen. These application icons can also be adaptively adjusted according to the color tone of the target view. That is, the method further includes: The screen also displays at least one application icon; Determine the target screen color tone at the location of the application icon from the target viewpoint; Adjust the icon display color of the application icon according to the target screen color tone; The method further includes: In response to a touch operation on the application icon, the target application corresponding to the application icon is launched, and the capture of the rear view through the rear camera is paused.

[0062] For example, the color tone of the app icon can be adjusted to match the color tone of the target screen in the corresponding location, or the app icon can be adjusted to a color tone that provides a better display effect based on the color tone of the target screen, such as by increasing the contrast to improve the display effect of the app icon.

[0063] In this embodiment of the application, if the user starts the application and displays the application interface, the acquisition of the rear view and the cropping of the target field of view can be paused.

[0064] In this embodiment of the application, the specific physical object in the screen where the application icon is located can also be identified, and the application icon can be transformed according to the physical object. For example, if the location corresponds to a plant in a real scene, the application icon can be changed from a rectangle to a fruit shape, a bird or animal shape, etc. If the location corresponds to a mountain or building, the application icon can be changed from a rectangle to a grass or stone shape, etc., so that the screen interface formed by the target visual image is more visually appealing and has a more consistent overall feel, enhancing visual immersion and improving the user's visual experience.

[0065] It is understandable that in strong light environments (such as midday sunlight), the rear camera image is overexposed, affecting the transparent display effect. Therefore, in this embodiment, strong light adaptive adjustment is used to change the cropped target field of view. That is, optionally, in some embodiments of this application, the step "cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device" includes: The ambient light intensity information is detected by the front-facing camera; The exposure parameters of the rear camera are adjusted based on the ambient light intensity information; The rear camera is controlled by the exposure parameters to capture the rear image. The target field of view is obtained by cropping the rear image according to the image cropping parameters.

[0066] For example, the front-facing camera can detect the ambient light intensity and automatically adjust the exposure parameters of the rear camera (such as reducing ISO and shortening shutter speed) to ensure that the image brightness matches the environment.

[0067] It is understandable that there are scenarios where multiple people view the terminal device screen. Therefore, in cases involving multiple people, the center point of the gaze positions of multiple people can be used to determine the center point of the FOV clipping.

[0068] In summary, the embodiments of this application calculate the image cropping parameters and crop the rear image based on the image cropping parameters to obtain the target field of view image, thereby realizing the acquisition of the real image behind the terminal device body that is blocked by the terminal device body, and realizing the stitching of the complete image that can be seen from the user's perspective by displaying the target field of view image on the screen.

[0069] Furthermore, the front-facing camera, rear-facing camera, and screen can all capture the real-world image from the front, eliminating the need for a camera on the side of the device or AR technology, thus reducing the cost of achieving unobstructed vision.

[0070] By adjusting the color tone and shape of the application icons displayed on the screen according to the target field of view, the visual effect of the screen can be improved.

[0071] By controlling the image cropping based on ambient light intensity, the image is made consistent with the environment, thus enhancing the visual effect.

[0072] To facilitate better implementation of the display control method of this application, this application also provides a display control device based on the above-described display control method. The meanings of the terms used are the same as in the above-described display control method, and specific implementation details can be found in the descriptions of the method embodiments.

[0073] Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of a display control device provided in an embodiment of this application. The display control device is applied to a terminal device, which includes a front-facing camera, a rear-facing camera, and a screen. The display control device can specifically be as follows: The acquisition module 301 is used to acquire the eye gaze information of the target user and the eye distance information of the target user through the front-facing camera; The calculation module 302 is used to calculate the image cropping parameters based on the eye gaze information, the eye distance information, and the status parameters of the terminal device; The cropping module 303 is used to crop the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device. The output module 304 is used to output the target field of view through the screen.

[0074] Optionally, in some embodiments of this application, the state parameters include screen size information, and the image cropping parameters include field of view information and image center point information; The calculation of image cropping parameters based on the eye gaze information, the eye distance information, and the state parameters of the terminal device includes: The field of view information is calculated using the screen size information and the eye distance information; The center point information of the image is determined based on the eye gaze information.

[0075] Optionally, in some embodiments of this application, the screen size information includes screen horizontal width information and screen vertical height information, and the field of view information includes horizontal angle information and vertical angle information; The calculation of the field of view information using the screen size information and the eye distance information includes: The horizontal angle information is calculated based on the screen horizontal width information and the eye distance information; The vertical angle information is calculated based on the screen vertical height information and the eye distance information.

[0076] Optionally, in some embodiments of this application, determining the center point information of the image based on the eye gaze information includes: Establish a screen coordinate system for the screen; The eye gaze information is mapped to the gaze position on the screen using the screen coordinate system; The center point information of the image is determined based on the gaze position.

[0077] Optionally, in some embodiments of this application, the state parameters may further include device attitude information; The device further includes: The field of view information is optimized based on the device attitude information to obtain optimized field of view information; The step of cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The rear image is cropped according to the optimized field of view information and the image center point information to obtain the target field of view image.

[0078] Optionally, in some embodiments of this application, the step of outputting the target field of view through the screen includes: The target view is displayed on the screen in a live wallpaper mode; The device further includes: The screen also displays at least one application icon; Determine the target screen color tone at the location of the application icon from the target viewpoint; Adjust the icon display color of the application icon according to the target screen color tone; The device further includes: In response to a touch operation on the application icon, the target application corresponding to the application icon is launched, and the capture of the rear view through the rear camera is paused.

[0079] Optionally, in some embodiments of this application, cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The ambient light intensity information is detected by the front-facing camera; The exposure parameters of the rear camera are adjusted based on the ambient light intensity information; The rear camera is controlled by the exposure parameters to capture the rear image. The target field of view is obtained by cropping the rear image according to the image cropping parameters.

[0080] In this embodiment, the acquisition module 301 acquires the eye gaze information and eye distance information of the target user through the front-facing camera. The calculation module 302 calculates the image cropping parameters based on the eye gaze information, the eye distance information, and the state parameters of the terminal device. The cropping module 303 crops the rear image acquired by the rear-facing camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device. The output module 304 outputs the target field of view image through the screen.

[0081] In this embodiment, the target field of view is obtained by calculating the image cropping parameters and cropping the rear image based on the image cropping parameters. This enables the acquisition of the real rear image that is blocked by the terminal device itself, and the display of the target field of view on the screen enables the stitching of the complete image that can be seen from the user's perspective.

[0082] Furthermore, the front-facing camera, rear-facing camera, and screen can all capture the real-world image from the front, eliminating the need for a camera on the side of the device or AR technology, thus reducing the cost of achieving unobstructed vision.

[0083] In addition, this application also provides an electronic device, such as Figure 4 As shown, it illustrates a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Specifically: The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will understand that... Figure 4 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 401 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 402, and by calling data stored in the memory 402, it performs various functions and processes data, thereby providing overall monitoring of the electronic device. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 401.

[0084] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function, etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0085] The electronic device also includes a power supply 403 that supplies power to the various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 403 may also include one or more DC or AC power supplies, recharging systems, power equipment debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0086] The electronic device may also include an input unit 404, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0087] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 401 runs the applications stored in the memory 402, thereby implementing the steps in any of the display control methods provided in the embodiments of this application.

[0088] The terminal device in this application embodiment collects the eye gaze information of the target user and the eye distance information of the target user through the front-facing camera. Based on the eye gaze information, eye distance information and the state parameters of the terminal device, it calculates the screen cropping parameters and crops the rear screen captured by the rear-facing camera according to the screen cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device. The target field of view image is then output through the screen of the terminal device.

[0089] In this embodiment, the target field of view is obtained by calculating the image cropping parameters and cropping the rear image based on the image cropping parameters. This enables the acquisition of the real rear image that is blocked by the terminal device itself, and the display of the target field of view on the screen enables the stitching of the complete image that can be seen from the user's perspective.

[0090] Furthermore, the front-facing camera, rear-facing camera, and screen can all capture the real-world image from the front, eliminating the need for a camera on the side of the device or AR technology, thus reducing the cost of achieving unobstructed vision.

[0091] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0092] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0093] Therefore, this application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps of any of the display control methods provided in this application.

[0094] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0095] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0096] Since the instructions stored in the computer-readable storage medium can execute the steps of any of the display control methods provided in this application, the beneficial effects that any of the display control methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0097] The above provides a detailed description of a display control method, apparatus, electronic device, and computer-readable storage medium provided in this application. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

[0098] It is understood that in the specific embodiments of this application, data related to eye gaze information, eye distance information, state parameters, rear view, screen color tone, ambient light intensity information, etc. are involved. When the embodiments in this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

Claims

1. A display control method, characterized in that, Applied to a terminal device, the terminal device including a front-facing camera, a rear-facing camera, and a screen, the method includes: The front-facing camera collects the target user's eye gaze information and eye distance information. The image cropping parameters are calculated based on the eye gaze information, the eye distance information, and the status parameters of the terminal device. The rear view captured by the rear camera is cropped according to the image cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device. The target field of view is output through the screen.

2. The display control method according to claim 1, characterized in that, The status parameters include screen size information, and the image cropping parameters include field of view information and image center point information; The calculation of image cropping parameters based on the eye gaze information, the eye distance information, and the state parameters of the terminal device includes: The field of view information is calculated using the screen size information and the eye distance information; The center point information of the image is determined based on the eye gaze information.

3. The display control method according to claim 2, characterized in that, The screen size information includes screen horizontal width information and screen vertical height information, and the field of view information includes horizontal angle information and vertical angle information; The calculation of the field of view information using the screen size information and the eye distance information includes: The horizontal angle information is calculated based on the screen horizontal width information and the eye distance information; The vertical angle information is calculated based on the screen vertical height information and the eye distance information.

4. The display control method according to claim 2, characterized in that, Determining the center point information of the image based on the eye gaze information includes: Establish a screen coordinate system for the screen; The eye gaze information is mapped to the gaze position on the screen using the screen coordinate system; The center point information of the image is determined based on the gaze position.

5. The display control method according to claim 2, characterized in that, The status parameters also include device attitude information; The method further includes: The field of view information is optimized based on the device attitude information to obtain optimized field of view information; The step of cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The rear image is cropped according to the optimized field of view information and the image center point information to obtain the target field of view image.

6. The display control method according to claim 2, characterized in that, The step of outputting the target field of view through the screen includes: The target view is displayed on the screen in a live wallpaper mode; The method further includes: The screen also displays at least one application icon; Determine the target screen color tone at the location of the application icon from the target viewpoint; Adjust the icon display color of the application icon according to the target screen color tone; The method further includes: In response to a touch operation on the application icon, the target application corresponding to the application icon is launched, and the capture of the rear view through the rear camera is paused.

7. The display control method according to claim 1, characterized in that, The step of cropping the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image obscured by the main body of the terminal device includes: The ambient light intensity information is detected by the front-facing camera; The exposure parameters of the rear camera are adjusted based on the ambient light intensity information; The rear camera is controlled by the exposure parameters to capture the rear image. The target field of view is obtained by cropping the rear image according to the image cropping parameters.

8. A display control device, characterized in that, Applied to a terminal device, the terminal device including a front-facing camera, a rear-facing camera, and a screen, the device includes: The acquisition module is used to acquire the eye gaze information of the target user and the eye distance information of the target user through the front-facing camera; The calculation module is used to calculate the image cropping parameters based on the eye gaze information, the eye distance information, and the status parameters of the terminal device; The cropping module is used to crop the rear image captured by the rear camera according to the image cropping parameters to obtain the target field of view image that is obscured by the main body of the terminal device. The output module is used to output the target field of view through the screen.

9. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the display control method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the display control method as described in any one of claims 1-7.

Images