Image display methods, apparatus, terminal equipment, storage media and program products

Abstract

This application provides an image display method, apparatus, terminal device, storage medium, and program product, relating to the field of terminal technology, which can improve the image display effect of a virtual mirror. The method includes, in response to a first instruction input by a user, obtaining a first offset corresponding to a first display specification; displaying a first target image on the display screen according to the first display specification, wherein the first target image is cropped from a first original image according to the first display specification, the first offset being the offset between the center of the first target image and the center of the first original image, and the first original image being an image captured centered on a front-facing camera.

Description

Technical Field

[0001] This application belongs to the field of terminal technology, and in particular relates to image display methods, devices, terminal equipment, storage media and program products. Background Technology

[0002] Mirrors are necessities in daily life, and many users carry them with them for quick grooming. As mobile devices become increasingly feature-rich, they can now offer a virtual mirror. This virtual mirror uses a front-facing camera to capture the user's image and displays it on the device's screen, effectively functioning as a physical mirror. This allows users to use the device as a physical mirror without needing to carry a physical one. However, currently, the image display quality of virtual mirrors is often inferior to that of physical mirrors. Summary of the Invention

[0003] This application provides an image display method, apparatus, terminal device, and storage medium that can improve the image display effect of a virtual mirror.

[0004] In a first aspect, this application provides an image display method applied to a terminal device, the terminal device including a front-facing camera and a display screen, the method including: in response to a first instruction input by a user, obtaining a first offset corresponding to a first display specification; displaying a first target image on the display screen according to the first display specification, the first target image being cropped from a first original image according to the first display specification, the offset between the center of the first target image and the center of the first original image being the first offset, the first original image being an image captured with the front-facing camera as the center.

[0005] Based on the image display method provided in this application, taking a virtual mirror as an example, when the terminal device runs the virtual mirror, it can offset the center of the first target image according to a first offset corresponding to the first display specification, so that the center of the first target image cropped from the first original image is offset from the center of the first original image (i.e., the position of the front-facing camera) to the area of ​​the first original image opposite to the display screen. This makes the first target image displayed by the virtual mirror closer to the image reflected by a physical mirror, thereby improving the image display effect of the virtual mirror and enhancing the user experience.

[0006] Optionally, the first offset includes an offset component in a first direction and an offset component in a second direction, wherein the first direction and the second direction are perpendicular to each other.

[0007] Based on this optional method, by setting two offset components in mutually perpendicular directions, it can be ensured that the center of the first target image can be accurately offset, thereby improving the offset accuracy of the center of the first target image.

[0008] Optionally, the first offset includes the straight-line distance and the offset direction.

[0009] Based on this optional method, by setting the straight-line distance and offset direction, it can be ensured that the center of the first target image can be accurately offset, thereby improving the offset accuracy of the center of the first target image.

[0010] Optionally, before displaying the first target image on the display screen according to the first display specification, the method further includes: obtaining the tilt angle of the terminal device; correcting the first offset according to the tilt angle; then the offset between the center of the first target image and the center of the first original image is the corrected first offset.

[0011] Based on this optional method, when the user tilts the terminal device while using the virtual mirror, the offset is corrected by measuring the tilt angle of the terminal device during the user's use. This reduces the difference between the first target image displayed by the virtual mirror and the image illuminated by the physical mirror, further improving the image display effect of the virtual mirror and enhancing the user experience.

[0012] Optionally, the method further includes: responding to a second instruction input by a user, obtaining a second offset corresponding to a second display specification, the second instruction being used to instruct switching the first display specification to the second display specification; displaying a second target image on the display screen according to the second display specification, the second target image being cropped from a second original image according to the second display specification, the offset between the center of the second target image and the center of the second original image being a first offset, the second original image being an image captured with a front-facing camera as the center.

[0013] Based on this option, multiple display specifications can be set for the virtual mirror, each with a corresponding offset. Users can switch display specifications randomly, further improving the user experience.

[0014] Optionally, the first offset is obtained from the server.

[0015] Based on this optional method, the updated first offset can be obtained from the server at any time, ensuring the accuracy of the first offset.

[0016] Optionally, the first offset is obtained from preset camera parameters, which include at least one display specification and an offset corresponding to each display specification, wherein the first display specification is one of the at least one display specifications.

[0017] Based on this optional approach, multiple display specifications can be set for the virtual mirror. Each display specification is configured with a corresponding offset to ensure that the target image displayed in the display area of ​​each display specification is closer to the image reflected by the physical mirror, thereby improving the image display effect of the virtual mirror and enhancing the user experience.

[0018] Secondly, this application provides an image display device applied to a terminal device, the terminal device including a front-facing camera and a display screen, the image display device including:

[0019] The acquisition unit is used to respond to a first instruction input by the user and acquire a first offset corresponding to the first display specification;

[0020] The display unit is used to display a target image on the display screen according to a first display specification. The target image is cropped from the original image according to the first display specification. The offset between the center of the target image and the center of the original image is a first offset. The first original image is an image captured with a front-facing camera as the center.

[0021] Thirdly, this application provides a terminal device, including a front-facing camera, a display screen, a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it enables the terminal device to perform the following functions:

[0022] In response to a first instruction input by the user, a first offset corresponding to a first display specification is obtained; and a first target image is displayed on the display screen according to the first display specification. The first target image is obtained by cropping from a first original image according to the first display specification. The offset between the center of the first target image and the center of the first original image is the first offset. The first original image is an image taken with the front-facing camera as the center.

[0023] Optionally, when the processor executes the computer program, it enables the terminal device to also perform the following functions:

[0024] Before displaying the first target image on the display screen according to the first display specification, the tilt angle of the terminal device is obtained; the first offset is corrected according to the tilt angle; then the offset between the center of the first target image and the center of the first original image is the corrected first offset.

[0025] Optionally, when executing the computer program, the processor also performs the following functions: in response to a second instruction input by the user, it obtains a second offset corresponding to the second display specification, the second instruction being used to instruct the switching of the first display specification to the second display specification; it displays a second target image on the display screen according to the second display specification, the second target image being cropped from a second original image according to the second display specification, the offset between the center of the second target image and the center of the second original image being a first offset, and the second original image being an image captured with the front-facing camera as the center.

[0026] Based on the first to third aspects mentioned above, optionally, the first offset includes an offset component in the first direction and an offset component in the second direction, wherein the first direction and the second direction are perpendicular to each other.

[0027] Optionally, the first offset includes the straight-line distance and the offset direction.

[0028] Optionally, the first offset is obtained from the server.

[0029] Optionally, the first offset is obtained from preset camera parameters, which include at least one display specification and an offset corresponding to each display specification, wherein the first display specification is one of the at least one display specifications.

[0030] Fourthly, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the image display method as described in the first aspect or any alternative method of the first aspect.

[0031] Fifthly, embodiments of this application provide a computer program product that, when run on a terminal device, causes the terminal device to execute the image display method described in the first aspect or any optional method of the first aspect.

[0032] The technical effects of the second to fifth aspects provided in this application can be found in the technical effects of the first aspect or the various alternative methods of the first aspect, and will not be repeated here. Attached Figure Description

[0033] Figure 1 This is a schematic diagram of the display area of ​​a virtual mirror provided in an embodiment of this application;

[0034] Figure 2 This is a comparison diagram of the image display of a virtual mirror and a physical mirror provided in an embodiment of this application;

[0035] Figure 3 This is a schematic diagram of the imaging range of a virtual mirror provided in an embodiment of this application;

[0036] Figure 4 This is a schematic diagram illustrating the principle of target image acquisition in existing technologies;

[0037] Figure 5 This is a schematic diagram illustrating the observation perspectives of a virtual mirror and a physical mirror, provided in an embodiment of this application.

[0038] Figure 6 This is a schematic diagram illustrating an application scenario provided in an embodiment of this application;

[0039] Figure 7 This is a schematic diagram of the center of a display area provided in an embodiment of this application;

[0040] Figure 8 This is a schematic diagram of the direction of an offset provided in an embodiment of this application;

[0041] Figure 9 This is a schematic diagram illustrating an offset representation method provided in an embodiment of this application;

[0042] Figure 10 This is a schematic diagram illustrating another way of representing offsets provided in an embodiment of this application;

[0043] Figure 11 This is a schematic diagram illustrating the startup of a virtual mirror provided in an embodiment of this application;

[0044] Figure 12 This is a schematic diagram illustrating the startup of another virtual mirror provided in this application embodiment;

[0045] Figure 13 This is a flowchart of an image display method provided in an embodiment of this application;

[0046] Figure 14 This is a schematic diagram illustrating the principle of acquiring a target image according to an embodiment of this application;

[0047] Figure 15 This is a schematic diagram of offset correction provided in an embodiment of this application;

[0048] Figure 16 This is a flowchart of another image display method provided in the embodiments of this application;

[0049] Figure 17 This is a schematic diagram illustrating the display specification switching of a virtual mirror provided in an embodiment of this application;

[0050] Figure 18 This is a schematic diagram of the structure of an image display device provided in an embodiment of this application;

[0051] Figure 19 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0052] A virtual mirror provided by a terminal device is an application (app) that can simulate the function of a physical mirror. A virtual mirror uses the terminal device's front-facing camera to capture an image of the user and then displays that image on the device's screen, allowing the user to use the screen as a mirror. However, the image display effect of a virtual mirror is usually not entirely similar to that of a physical mirror. The image presented by the virtual mirror is often offset from the image presented by a physical mirror, resulting in a generally poorer image display effect and negatively impacting the user experience.

[0053] The following example compares the image display effects of a virtual mirror and a physical mirror with the same display area when a user applies lipstick. The display area of ​​a physical mirror refers to its mirror surface area. The display area of ​​a virtual mirror refers to the display area of ​​its image frame. For example, as shown... Figure 1 As shown in (a) above, when the virtual mirror is set to full-screen display, the display area of ​​the virtual mirror is the same as the area of ​​the display screen. Figure 1 As shown in (b), when the virtual mirror is set to a square display frame, the display area of ​​the virtual mirror is the same as the display area of ​​the square display frame. Figure 1 As shown in (c), when the virtual mirror is set to a circular display frame, the display area of ​​the virtual mirror is the same as the display area of ​​the circular display frame. In this example, it is assumed that the surface area of ​​the physical mirror is the same as the display screen area of ​​the terminal device, and the display area of ​​the virtual mirror is the display screen area.

[0054] For ease of description, we will construct a plane L as a reference plane to describe the relative positions of the physical mirror, the virtual mirror, the user's lips, and the lip image. It's important to understand that plane L is merely a reference plane and not an actual existing surface.

[0055] Assuming that, based on the mirror (including physical and virtual mirrors) and the user's lip's side-view direction, the relative position of the mirror and the lips is as follows: Figure 2 As shown in (a), both the mirror (i.e., the mirror surface of the physical mirror and the display screen of the terminal device) and the lip are perpendicular to plane L. Based on... Figure 2 The relative positions shown in (a) are used to describe the image of the lips displayed by the mirror of a physical mirror as shown in the figure. Figure 2 The lip image shown in (b) (i.e., the frontal view of the physical mirror) is used as an example, assuming the lip image displayed by the physical mirror is also located at plane L. For the virtual mirror, assuming the front-facing camera of the terminal device is close to the top edge of the terminal device and located at the upper left of the display screen, then, based on... Figure 1The virtual mirror displays the image as shown in the relative positions indicated. Figure 2 As shown in (c) (i.e., the viewing direction of the terminal device's display screen). The lip image displayed by the virtual mirror is offset from plane L and located in the lower right area of ​​the virtual mirror display area (i.e., the terminal device's display screen).

[0056] The reason for this difference lies in the fact that the imaging range of a physical mirror is the area that the mirror surface can reflect. The imaging range of a virtual mirror, on the other hand, is the area captured by the front-facing camera of the terminal device. For example, as... Figure 3 As shown, the imaging range of the virtual mirror is the area that the front-facing camera can capture, centered on its location. Since the front-facing camera of the terminal device is located at the upper left of the display screen, when the display screen of the terminal device is aligned with the user's lips on plane L, the original image captured by the front-facing camera is as follows: Figure 4 As shown in (a), the lip image is located in the lower right region of the original image. Then, the terminal device crops the original image based on its center, according to set display specifications (e.g., size and shape), to obtain the target image, and displays the target image on the screen. Because the lip image is located in the lower right region of the original image, therefore, as... Figure 4 As shown in (b), in the target image cropped from the center of the original image, the lip image is also located in the lower right region of the target image, deviating from the center of the target image (i.e., the center of the original image). Therefore, compared to the lip image displayed by the physical mirror, the lip image displayed by the virtual mirror is offset in the display area, resulting in a poorer composition and thus a worse display effect.

[0057] Furthermore, generally speaking, when users look in a mirror (such as a physical mirror or a virtual mirror), they usually align the mirror with the area they want to observe, and their gaze is also focused on the relative position on the mirror surface. For example, Figure 2 In a physical mirror, the user aligns the mirror with the lips, ensuring the mirror and lips are aligned on plane L. Simultaneously, the user's gaze is focused on the intersection of plane L and the mirror. Therefore, when using a physical mirror, the image of the lips reflected on the mirror overlaps with the user's line of sight, making it easier to observe. However, when using a virtual mirror, although the mirror (i.e., the display screen) is also aligned with the lips, the image of the lips displayed on the screen often deviates from plane L. For example, when the front-facing camera of the terminal device is close to the top edge of the device, located at the upper left of the display screen, as... Figure 2 As shown in (b), the image of lips displayed on the screen is offset to the lower right based on plane L. This forces the user to lower their gaze, increasing the viewing angle and resulting in a poor user experience. For example, as... Figure 5As shown, compared to the viewing angle a1 of the user's line of sight when using a physical mirror, the viewing angle a2 of the user's line of sight when using a virtual mirror is larger, which causes discomfort to the user's eyes and makes it difficult to observe.

[0058] In some cases, due to limitations in the display area and pixel count of the terminal device, as well as the relative position of the front-facing camera and the lips, a virtual mirror may display an incomplete image or even no image of the lips, even if a physical mirror can fully display the lip image. In such situations, the user needs to move the terminal device down so that the front-facing camera is aligned with the lips, thus displaying the lip image on the screen. This also requires the user to lower their gaze, resulting in a wider viewing angle and causing eye discomfort. Therefore, the user experience when using a virtual mirror is generally poor.

[0059] Similarly, if the front-facing camera of a terminal device is close to the bottom bezel of the device, located below the display screen (including the center, left, or right side of the bottom of the screen), then compared to a physical mirror, the user needs to shift their gaze upwards. In some situations, such as when a user uses a mirror to observe the upper part of their face (e.g., eyebrows, eyes, forehead), the viewing angle of a virtual mirror is often larger than that of a physical mirror, which can cause eye discomfort and make observation more difficult.

[0060] Therefore, this application provides an image display method that, based on a first offset corresponding to a first display specification, offsets the center of a first target image so that the center of the first target image, cropped from a first original image (an image captured centered on a front-facing camera), shifts from the position of the front-facing camera to the area of ​​the first original image opposite the display screen (equivalent to the area reflected by a physical mirror). This makes the first target image closer to an image reflected by a physical mirror, thereby improving the image display effect of the virtual mirror and enhancing the user experience.

[0061] The following specific embodiments illustrate the system architecture, application scenarios, and specific implementation methods to which the image display method provided in this application is applicable.

[0062] In one example, the image display method provided in this application can be applied to, for example... Figure 6 The system architecture is shown. See also... Figure 6 This application provides a schematic diagram of a virtual mirror system architecture, including server-side devices and client-side devices. The server-side devices include a server that provides the virtual mirror, and the server maintains camera parameters for different models of terminal devices. The client-side devices include terminal devices with the virtual mirror installed, and a maintenance terminal for administrators to maintain the virtual mirror.

[0063] The terminal device equipped with the virtual mirror can be any type of terminal device, including a front-facing camera, such as a mobile phone or tablet computer. The maintenance terminal can be a computer device such as a laptop, tablet computer, smartphone, or desktop computer. In this embodiment, the front-facing camera refers to a camera facing the user during the shooting process. The server can be any type of server capable of providing the virtual mirror, such as a cloud server. This application does not impose any restrictions on this.

[0064] Administrators manage camera parameters by logging into the server's webpage through a maintenance terminal. Specifically, they upload the terminal device model and camera parameters to the server for storage and maintenance. When a terminal device activates the virtual mirror, it can download the camera parameters corresponding to its model from the server. The image is then displayed based on these downloaded parameters, simulating the function of a physical mirror.

[0065] In another example, the image display method provided in this application can also be performed independently by the terminal device. The terminal device has preset camera parameters corresponding to its model, and the terminal device can directly display images based on the preset camera parameters to simulate the function of a physical mirror.

[0066] Camera parameters may include the offset of the front-facing camera of the terminal device relative to the display area of ​​the terminal device. Based on the offset, the center of the target image cropped from the original image captured by the front-facing camera can be offset from the position of the front-facing camera to the center of the display area, or offset to a position closer to the center of the display area than the front-facing camera. The specific position can be set according to actual needs, and this application does not limit it.

[0067] For example, the specific value of the offset can be determined based on the display specifications used by the virtual mirror. These display specifications can refer to the size, shape, and position of the display area on the screen. Each display specification can be set with a corresponding offset.

[0068] For example, consider the center of the display area. If the virtual mirror uses, as shown in the example... Figure 1 The display specification shown in (a) is full-screen display, and the center of the display area is as follows: Figure 7 As shown in (a) above, it is located at the center of the display screen. If the virtual mirror uses... Figure 1 The display specifications shown in (b) are a rectangular display frame with sides equal to the width of the screen, located within the screen near the front-facing camera. The center of the display area is as follows: Figure 7 As shown in (b) above, it is located in the center of the square display frame. If the virtual mirror uses... Figure 1 The display specification shown in (c) is a circular display frame with a diameter equal to the width of the screen, located within the screen near the front-facing camera. The center of the display area is as follows: Figure 7 As shown in (c), it is located at the center of the circular display frame.

[0069] The offset can include two mutually perpendicular components. For example, the offset can include an offset component in a second direction (let's say Y) and an offset component in the first direction (let's say X). The second direction and the first direction are mutually perpendicular. This can be understood as offsetting the front-facing camera's position by Y in the second direction and X in the first direction, thus shifting it to the center of the display area, or to a position closer to the center of the display area than the front-facing camera.

[0070] For example, such as Figure 8 As shown, with Figure 7 Taking the center of the display shown in (a) as an example, the second direction is parallel to the display surface and points towards the bottom edge of the terminal device, while the first direction can be parallel to the display surface and points towards the right edge of the terminal device. Therefore, the corresponding offset can be determined based on the size of various terminal device models, the center position of the display area, and the position of the front-facing camera. For example, based on... Figure 8 , Figure 9 The offset of the front-facing camera relative to the center of the display area is shown on several different models of terminal devices.

[0071] like Figure 9 As shown in (a), the front-facing camera of terminal device 1 is located above the display screen near the left edge. When the position of the front-facing camera is offset by 20 mm in the first direction and 55 mm in the second direction, it can be offset to the center of the display area. Therefore, the offset of the front-facing camera of terminal device 1 relative to the center of the display area includes "X = 20 mm, Y = 55 mm".

[0072] like Figure 9 As shown in (b), terminal device 2 is a full-screen device, and its front-facing camera is located in the middle of the upper area of ​​the display screen. When the position of the front-facing camera does not shift in the first direction, but shifts by 45mm in the second direction, it can be shifted to the center of the display area. Therefore, the offset of the front-facing camera of terminal device 2 relative to the center of the display area includes "X = 0mm, Y = 45mm".

[0073] like Figure 9As shown in (c), the front-facing camera of terminal device 3 is located below the display screen near the right edge. When the position of the front-facing camera is offset by 20mm in the opposite direction of the first direction and 55mm in the opposite direction of the second direction, it can be offset to the center of the display area. Therefore, the offset of the front-facing camera of terminal device 3 relative to the center of the display area includes "X = -20mm, Y = -55mm".

[0074] like Figure 9 As shown in (d), the front-facing camera of terminal device 4 is a pop-up camera. When the front-facing camera is activated, it rises and protrudes from the top edge of the display screen, near the left edge. The front-facing camera can be shifted to the center of the display area by offsetting its position by 30mm in a first direction and 65mm in a second direction. Therefore, the offset of the front-facing camera of terminal device 4 relative to the center of the display area includes "X = 30mm, Y = 65mm".

[0075] Optionally, the offset can also be represented by the offset direction and straight-line distance. For example, suppose the offset direction is represented by a rotation angle in a clockwise direction, using a straight line parallel to the top edge of the terminal device as a reference and the location of the front-facing camera as the center. Figure 10 As shown, the front-facing camera of terminal device 5 is located above the display screen near the left bezel. When the front-facing camera is moved 75mm in an offset direction with a rotation angle of 30° based on its position, it can be offset to the center of the display area. Therefore, the offset of the front-facing camera of terminal device 5 relative to the center of the display area includes "30°, 75mm".

[0076] Of course, in addition to the two representation methods mentioned above, the offset of the front-facing camera can also be represented in other ways, and this application does not impose any restrictions on this.

[0077] In this embodiment of the application, the virtual mirror can be a mirror app specifically designed to simulate the functions of a physical mirror. For example, such as... Figure 11 As shown, the main interface of the terminal device displays an icon for a mirror app. When the user clicks the mirror app icon, the terminal device can access the front-facing camera to display the virtual mirror's interface. Based on the image display method provided in this application, the device displays an image captured by the front-facing camera to simulate the function of a physical mirror. The virtual mirror's interface can also display brightness adjustment icons, zoom icons, etc.

[0078] Alternatively, a virtual mirror could be an application option included in other apps that provides the functionality to simulate a physical mirror. For example, such as... Figure 12As shown, the terminal device's display screen shows an icon for a photography app (e.g., a camera). When the user clicks the camera icon, the terminal device displays a camera shooting interface. For example, the camera shooting interface displays a mirror icon. When the terminal device detects that the user clicks the "mirror" icon, it uses the front-facing camera to display a virtual mirror interface and provides an image display method based on this application to display an image captured by the front-facing camera, simulating the function of a physical mirror.

[0079] The aforementioned mirror app that provides a simulated physical mirror function, as well as other apps that include application options that provide a simulated physical mirror function, may be pre-installed or downloaded by the user.

[0080] Understandably, the aforementioned virtual mirror technology is essentially about a terminal device using a front-facing camera to capture the user's image and display it on a screen.

[0081] The image display method provided in this application will be illustrated below with specific examples.

[0082] See Figure 13 This is a flowchart of an embodiment of an image display method provided in this application. The method includes:

[0083] S1301, in response to a first instruction input by the user, obtains a first offset corresponding to the first display specification.

[0084] The first instruction can be an instruction used to activate the virtual mirror function. For example, based on... Figure 11 The virtual mirror shown can receive its first command when the terminal device detects that the user has clicked the mirror app icon on the main interface. Alternatively, based on... Figure 12 The virtual mirror shown can receive the first instruction when the terminal device detects that the user clicks the mirror icon on the camera shooting interface.

[0085] In one possible implementation, after installing the virtual mirror, the terminal device can download the offset corresponding to its model from the server each time it detects the first instruction. Specifically, it sends a request message to the server requesting camera parameters. The server, based on the terminal device model carried in the request message, determines the camera parameters corresponding to that model and sends them to the terminal device. These camera parameters include the offset corresponding to the first display specification.

[0086] Alternatively, the terminal device can download the camera parameters corresponding to its model from the server and save them locally upon the first detection of the mirror's first command after installing the virtual mirror and each time the virtual mirror is updated. From the second time onwards, each time the first command is detected, the first offset corresponding to the first display specification can be obtained from the locally saved camera parameters.

[0087] Of course, the terminal device can also have pre-set camera parameters, eliminating the need to download them from the server. The terminal device can also directly obtain the first offset corresponding to the first display specification from the pre-set camera parameters.

[0088] For example, assuming the offset includes offset components X and Y, and the display specifications include circular display frame, square display frame, and full-screen display, the camera parameters can be shown in Table 1 below:

[0089] Table 1

[0090] Display Specifications X (unit: mm) Y (unit: mm) Circular display frame 30 60 Square display frame 30 60 Full screen 30 65

[0091] The first display specification can be the default display specification. This default display specification can be a fixed display specification. For example, if full-screen display is set as the default display specification, then whenever the first command is detected, the first display specification is determined to be full-screen display.

[0092] Alternatively, if the virtual mirror has multiple display specifications, the default display specification could be the one used during the last use of the virtual mirror before the first instruction was detected. For example, after the first instruction is detected, it can be determined that the most recent display specification used by the virtual mirror before detecting the first instruction was a circular display frame. Then, the terminal device can determine that the first display specification is a circular display frame.

[0093] S1302, Display a first target image on the display screen according to a first display specification. The first target image is cropped from a first original image according to the first display specification. The offset between the center of the first target image and the center of the first original image is a first offset. The first original image is an image captured with a front-facing camera as the center.

[0094] After the front-facing camera of the terminal device acquires the first original image, it can first determine the center of the first target image in the first original image according to the first display specifications and the first offset. Then, based on the center of the first target image and the first display specifications, the first target image is cropped from the first original image.

[0095] For example, as Figure 2 The relative position of the mirror to the user's lips is shown in (a) of the image. Figure 4 The original image shown in (a) and Figure 9 Taking terminal device 4 shown in (a) as an example, the first display specification is determined to be full-screen display, and the corresponding first offset is "X = 20mm, Y = 55mm". The front-facing camera acquires... Figure 4 After the first original image shown in (a) in the figure, as Figure 14 As shown, based on the offsets "X = 20mm, Y = 55mm", the center of the first target image is determined by offsetting 20mm in the first direction and 55mm in the second direction from the center of the first original image. Then, based on the center of the first target image, the first target image is cropped from the first original image according to the display specifications for full-screen display.

[0096] At this time, the center of the first target image is located at plane L, that is, the lip image in the first target image is located at the center of the first target image. After obtaining the first target image, the terminal device sends the first target image to the display screen and controls the display screen to display the first target image according to the full-screen display specification. Obviously, since the center of the first target image is opposite to the center of the display screen and is located at plane L, the lip image in the first target image displayed on the display screen is located at plane L. Therefore, after a first offset corresponding to the first display specification, the center of the first target image is offset, so that the center of the first target image moves from the center position of the first original image to a center position closer to the display area. Therefore, compared to Figure 4 The target image shown in (b) is closer to the first target image obtained by the image display method provided in this application than the target image shown in (b). Figure 2 The image of lips displayed by the physical mirror shown in (b) is an example. The composition of the first target image displayed by the virtual mirror was improved, thereby improving the display effect of the virtual mirror.

[0097] Optionally, in one possible scenario, a user might tilt the terminal device when using it to look in a mirror. Therefore, when running the virtual mirror, the terminal device can also measure the tilt angle during user use and correct the initial offset. This ensures that the final target image displayed by the terminal device is closer to the image displayed in a physical mirror, further improving the display effect of the virtual mirror.

[0098] For example, when a terminal device is running a virtual mirror, it acquires data from its built-in orientation sensors (such as gyroscopes, accelerometers, and magnetometers), and then performs calculations to obtain the tilt angle of the terminal device. For instance, the first offset might include an offset component X in the second direction and an offset component Y in the first direction. The terminal device can then convert the data acquired from the orientation sensors into tilt angles in the second and first directions. It can then use the tilt angle in the second direction to correct the offset component Y, and use the tilt angle in the first direction to correct the offset component X.

[0099] For example, with Figure 9 Taking terminal device 1 shown in (a) as an example, terminal device 1 has a certain tilt when held by the user, for example, as Figure 15 As shown, the tilt angle of the terminal device's display screen in the first direction is b1, and the tilt angle in the second direction is b2.

[0100] The terminal device uses b1 to correct X and b2 to correct Y. Assuming the corrected X is represented as X1, then X1 = X * cosine(b1). The corrected Y is represented as Y1, then Y1 = X * cosine(a2). After correction, the modified first offset includes both X1 and Y1.

[0101] After receiving the modified first offset, the terminal device can determine the center of the first target image based on the modified first offset. Then, based on the center of the target image and the first display specification, the target image is cropped from the original image and displayed on the screen. In this example, when the user tilts the terminal device while using the virtual mirror, the offset is corrected by measuring the tilt angle of the terminal device during user use. This reduces the difference between the target image displayed by the virtual mirror and the image reflected by the physical mirror, further improving the image display effect of the virtual mirror and enhancing the user experience.

[0102] In one embodiment, if the virtual mirror has multiple display specifications, the user can randomly switch between them when looking in the mirror using a terminal device. For example, based on... Figure 13 ,like Figure 16 As shown, after step S1302 above, the image display method provided in this application further includes:

[0103] S1303, in response to a second command input by the user, obtains a second offset corresponding to the second display specification.

[0104] The second instruction is used to instruct the switching of the first display specification to the second display specification.

[0105] For example, such as Figure 17 As shown, the virtual mirror's display interface features a display selection icon. Assume the user initially selects full-screen mode. When the user needs to switch display modes, they click the icon. The terminal device selects from the user's display mode options, including icons for a circular frame, a square frame, and full-screen mode. If the user clicks the circular frame icon, the terminal device detects a second instruction. In response to this second instruction, the terminal device determines the second display mode to be a circular frame, determines a second offset ("X = 30mm, Y = 60mm") from the camera parameters, and displays the circular frame on the virtual mirror's display interface.

[0106] S1304, Display a second target image on the display screen according to a second display specification. The second target image is cropped from a second original image according to the second display specification. The offset between the center of the second target image and the center of the second original image is a first offset. The second original image is an image captured with the front-facing camera as the center.

[0107] Understandably, after the virtual mirror is activated, the original image captured by the front-facing camera changes in real time. In response to the first instruction type, after the front-facing camera acquires the second original image, the terminal device can first determine the center of the second target image within the second original image based on the second display specifications and the second offset. Then, based on the center of the second target image and the second display specifications, the second target image is cropped from the second original image.

[0108] In this example, the virtual mirror can support switching between multiple display specifications, further improving the user experience.

[0109] It should be noted that in the above embodiments, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner. When ordinal numbers such as "first" or "second" are used, unless they explicitly indicate a sequence according to the context, they should be understood as merely for distinguishing purposes.

[0110] Unless otherwise stated, in this document, " / " generally indicates that the preceding and following objects are in an "or" relationship. For example, A / B can mean A or B. The term "and / or" is merely a description of the relationship between the related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, in the description of this application, "multiple" refers to two or more.

[0111] Corresponding to the image display method described in the above embodiments, Figure 18 A structural block diagram of an image display device provided in an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiments of this application are shown.

[0112] This image display device is used in a terminal device, for example, it can be a chip or processor in the terminal device, or a functional module in the processor. The terminal device includes a front-facing camera and a display screen. See also Figure 18 The image display device includes:

[0113] The acquisition unit 1801, in response to a first instruction input by the user, acquires a first offset corresponding to the first display specification.

[0114] Display unit 1802 displays a first target image on the display screen according to the first display specification. The first target image is cropped from a first original image according to the first display specification. The offset between the center of the first target image and the center of the first original image is the first offset. The first original image is an image taken with the front-facing camera as the center.

[0115] Optionally, the first offset includes an offset component in a first direction and an offset component in a second direction, wherein the first direction and the second direction are perpendicular to each other.

[0116] Optionally, the first offset includes a straight-line distance and an offset direction.

[0117] Optionally, the acquisition unit 1801 is further configured to acquire the tilt angle of the terminal device before the display unit 1802 displays the first target image on the display screen according to the first display specification; correct the first offset according to the tilt angle; then the offset between the center of the first target image displayed by the display unit 1802 and the center of the first original image is the corrected first offset.

[0118] Optionally, the acquisition unit 1801 is further configured to acquire a second offset corresponding to the second display specification in response to a second instruction input by the user, wherein the second instruction is used to indicate switching the first display specification to the second display specification.

[0119] The display unit 1802 is further configured to display a second target image on the display screen according to the second display specification. The second target image is cropped from a second original image according to the second display specification. The offset between the center of the second target image and the center of the second original image is the first offset. The second original image is an image taken with the front-facing camera as the center.

[0120] Optionally, the first offset is obtained from the server.

[0121] Optionally, the first offset is obtained from preset camera parameters, which include at least one display specification and an offset corresponding to each display specification, wherein the first display specification is one of the at least one display specification.

[0122] See Figure 19 This is a schematic diagram of a terminal device provided in this application. The terminal device can be equipped with a front-facing camera and a display screen, and can install a virtual mirror. Examples include mobile phones, tablets, and wearable devices. This application does not limit the specific type of terminal device.

[0123] like Figure 19 As shown, the terminal device includes components such as a processor 1901, a memory 1902, a communication module 1903, an input module 1904, a display screen 1905, a camera module 1906, and a sensor module 1907. Those skilled in the art will understand that... Figure 19 The terminal device structure shown does not constitute a limitation on the terminal device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0124] The processor 1901 may include at least one of the following types: a Central Processing Unit (CPU), which may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), graphics processing units (GPUs), image signal processors (ISPs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0125] The processor 1901 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 1901 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 1901, and thus improves the efficiency of the system.

[0126] The memory 1902 can be used to store software programs and modules. The processor 1901 executes various functional applications and data processing of the terminal device by running the software programs and modules stored in the memory 1902. The memory 1902 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as a virtual mirror), etc.; the data storage area may store data created according to the use of the terminal device (such as camera parameters, raw images, target images, etc.). In addition, the memory 1902 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0127] The communication module 1903, under the control of the processor 1901, is used to receive and transmit signals, such as receiving camera parameters sent by the server and sending request messages to the server. The communication module 1903 may include radio frequency (RF) circuitry. Typically, RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, an LNA (low-noise amplifier), and a duplexer. Furthermore, the RF circuitry can also communicate wirelessly with networks and other devices. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System for Mobile Communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), and short-range communication technologies (such as Wireless Fidelity (WiFi) communication).

[0128] The input module 1904 can be used to receive input numbers, characters, and voice information, as well as generate key signal inputs and voice signal inputs related to user settings and function control of the terminal device. Specifically, the input module 1904 may include a touch panel 1904a and other input devices 1904b. The touch panel 1904a, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel 1904a), and drive the corresponding connection devices according to a pre-set program. Optionally, the touch panel 1904a may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to the processor 1901, and can receive and execute commands from the processor 1901. Furthermore, the touch panel 1904a can be implemented using various types of sensors, including resistive, capacitive, infrared, and surface acoustic wave sensors. In addition to the touch panel 1904a, the input module 1904 may also include other input devices 1904b. Specifically, these other input devices 1904b may include, but are not limited to, one or more of the following: a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick.

[0129] Display screen 1905 can be used to display images, videos, etc. Display screen 1905 may include display panel 1905a, optionally configured as a Liquid Crystal Display (LCD), Organic Light-Emitting Diode (OLED), or similar display panel 1905a. Further, touch panel 1904a may cover display panel 1905a. When touch panel 1904a detects a touch operation on or near it, it transmits the information to processor 190 to determine the type of touch event. Subsequently, processor 1901 provides corresponding visual output on display panel 1905a based on the type of touch event. Although in Figure 19 In this embodiment, the touch panel 1904a and the display panel 1905a are two separate components to realize the input and output functions of the terminal device. However, in some embodiments, the touch panel 1904a and the display panel 1905a can be integrated to realize the input and output functions of the terminal device.

[0130] Camera module 1906 captures still images or videos. An object is projected onto a photosensitive element by an optical image generated through a lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to an ISP (Internet Service Provider) for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into image signals in standard formats such as RGB and YUV. In this embodiment, camera module 1906 includes a front-facing camera 1906a.

[0131] The sensor module 1907 may include a pressure sensor 1907a, a touch sensor 1907b, a gyroscope 1907c, a magnetic induction sensor 1907d, an acceleration sensor 1907e, etc.

[0132] The pressure sensor 1907a is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 1907a can be disposed on the display screen 1905. There are many types of pressure sensors 1907a, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to the pressure sensor 1907a, the capacitance between the electrodes changes. The terminal device determines the pressure intensity based on the change in capacitance. When a touch operation is applied to the display screen 1905, the terminal device detects the intensity of the touch operation based on the pressure sensor 1907a. The terminal device can also calculate the touch location based on the detection signal from the pressure sensor 1907a, determining the icon clicked by the user, etc.

[0133] Touch sensor 1907b, also known as a "touch device," can be disposed on display screen 1905. The touch sensor 1907b and display screen 1905 together form a touchscreen, also known as a "touchscreen." Touch sensor 1907b is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 1905. In other embodiments, touch sensor 1907b may also be disposed on the surface of the terminal device, in a different location than display screen 1905.

[0134] The gyroscope sensor 1907c can be used to determine the motion posture of a terminal device. In some embodiments, the angular velocity of the terminal device about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 1907c. The tilt angle of the terminal device, etc., can be determined from the angular velocity.

[0135] A magnetic induction sensor 1907d is used to determine the magnetic field information of the terminal device. In some embodiments, the tilt angle of the terminal device can be determined by the magnetic field information measured by the magnetic induction sensor 1907d.

[0136] An accelerometer 1907e is used to measure the acceleration of the terminal device. In some embodiments, the tilt angle of the terminal device can be determined by the acceleration measured by the accelerometer 1907e.

[0137] In addition, although not shown, the terminal device may also include a power module, audio circuitry, etc., which will not be described in detail here.

[0138] This application also provides a computer-readable storage medium. The methods described in the above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted on a computer-readable medium. A computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any available medium accessible by a computer.

[0139] As an optional design, a computer-readable medium may include read-only memory (ROM) or other types of static storage devices capable of storing static information and instructions, random access memory (RAM) or other types of dynamic storage devices capable of storing information and instructions, electrically erasable programmable-only memory (EEPROM) or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store the required program code in the form of instructions or data structures, and that is accessible to a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs (CDs), laser discs, optical discs, digital versatile optical discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs reproduce data optically using lasers. Combinations of these should also be included within the scope of computer-readable media.

[0140] This application also provides a computer program product. The methods described in the above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. If implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the above method embodiments are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device.

[0141] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0142] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0143] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An image display method applied to a terminal device, the terminal device including a front-facing camera and a display screen, characterized in that, The method includes: In response to a first command input by the user, a first offset corresponding to a first display specification is obtained; the specific value of the first offset is determined based on the first display specification adopted. The first target image is displayed on the display screen according to the first display specification. The first target image is cropped from the first original image according to the first display specification. The offset between the center of the first target image and the center of the first original image is the first offset. The first original image is an image taken with the front camera as the center. Displaying the first target image on the display screen according to the first display specification includes: The center of the first target image is determined in the first original image according to the first display specification and the first offset. The first target image is cropped from the first original image based on the center of the first target image and the first display specification. The center of the first target image is moved from the position of the front camera to the center of the display screen, or the center of the first target image is moved to a first position. The distance between the first position and the center of the display screen is less than the distance between the center of the display screen and the front camera.

2. The method according to claim 1, characterized in that, The first offset includes an offset component in a first direction and an offset component in a second direction, wherein the first direction and the second direction are perpendicular to each other.

3. The method according to claim 1, characterized in that, The first offset includes the straight-line distance and the offset direction.

4. The method according to claim 1, characterized in that, Before displaying the first target image on the display screen according to the first display specification, the method further includes: Obtain the tilt angle of the terminal device; The first offset is corrected according to the tilt angle; The offset between the center of the first target image and the center of the first original image is the corrected first offset.

5. The method according to claim 1, characterized in that, The method further includes: In response to a second command input by the user, a second offset corresponding to the second display specification is obtained, the second command being used to instruct the first display specification to be switched to the second display specification; The second target image is displayed on the display screen according to the second display specifications. The second target image is cropped from the second original image according to the second display specifications. The offset between the center of the second target image and the center of the second original image is the first offset. The second original image is an image taken with the front-facing camera as the center.

6. The method according to any one of claims 1-5, characterized in that, The first offset was obtained from the server.

7. The method according to any one of claims 1-5, characterized in that, The first offset is obtained from preset camera parameters, which include at least one display specification and an offset corresponding to each display specification, wherein the first display specification is one of the at least one display specification.

8. An image display device, applied to a terminal device, the terminal device including a front-facing camera and a display screen, characterized in that, The image display device includes: The acquisition unit is used to respond to a first instruction input by the user and acquire a first offset corresponding to a first display specification; the specific value of the first offset is determined based on the first display specification adopted. The display unit is configured to display a target image on the display screen according to the first display specification. The target image is cropped from a first original image according to the first display specification. The offset between the center of the target image and the center of the first original image is the first offset. The first original image is an image captured with the front-facing camera as the center. The display unit is further configured to: determine the center of a first target image in a first original image according to a first display specification and a first offset; crop the first target image from the first original image based on the center of the first target image and the first display specification; move the center of the first target image from the position of the front-facing camera to the center of the display screen, or move the center of the first target image to a first position; the distance between the first position and the center of the display screen is less than the distance between the center of the display screen and the front-facing camera.

9. A terminal device, characterized in that, The device includes a front-facing camera, a display screen, a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it enables the terminal device to perform the following functions: In response to a first command input by the user, a first offset corresponding to a first display specification is obtained; the specific value of the first offset is determined based on the first display specification adopted; and a first target image is displayed on the display screen according to the first display specification, the first target image being cropped from a first original image according to the first display specification, the offset between the center of the first target image and the center of the first original image being the first offset, and the first original image being an image captured with the front-facing camera as the center; Displaying the first target image on the display screen according to the first display specification includes: The center of the first target image is determined in the first original image according to the first display specification and the first offset. The first target image is cropped from the first original image based on the center of the first target image and the first display specification. The center of the first target image is moved from the position of the front camera to the center of the display screen, or the center of the first target image is moved to a first position. The distance between the first position and the center of the display screen is less than the distance between the center of the display screen and the front camera.

10. The terminal device according to claim 9, characterized in that, The first offset includes an offset component in a first direction and an offset component in a second direction, wherein the first direction and the second direction are perpendicular to each other.

11. The terminal device according to claim 9, characterized in that, The first offset includes the straight-line distance and the offset direction.

12. The terminal device according to claim 9, characterized in that, When executing the computer program, the processor also performs the following functions: Before displaying the first target image on the display screen according to the first display specification, the tilt angle of the terminal device is obtained; the first offset is corrected according to the tilt angle; The offset between the center of the first target image and the center of the first original image is the corrected first offset.

13. The terminal device according to claim 9, characterized in that, When the processor executes the computer program, the terminal device also performs the following functions: In response to a second command input by the user, a second offset corresponding to the second display specification is obtained, the second command being used to instruct the first display specification to be switched to the second display specification; The second target image is displayed on the display screen according to the second display specifications. The second target image is cropped from the second original image according to the second display specifications. The offset between the center of the second target image and the center of the second original image is the first offset. The second original image is an image taken with the front-facing camera as the center.

14. The terminal device according to any one of claims 9-13, characterized in that, The first offset was obtained from the server.

15. The terminal device according to any one of claims 9-13, characterized in that, The first offset is obtained from preset camera parameters, which include at least one display specification and an offset corresponding to each display specification, wherein the first display specification is one of the at least one display specification.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a terminal device, implements the image display method as described in any one of claims 1 to 7.

17. A computer program product, characterized in that, When the computer program product is run on a terminal device, the terminal device implements the image display method as described in any one of claims 1 to 7.

Images