Display effect adjustment method and device

Abstract

This application discloses a display effect adjustment method and apparatus, relating to the field of image processing technology. The specific technical solution is as follows: An electronic device can receive a first input while displaying a first image; and in response to the first input, perform a first operation on the first image based on the pose change information of the electronic device to obtain a second image; wherein the first operation includes at least one of the following: color transformation and viewing angle transformation.

Description

Technical Field

[0001] This application belongs to the field of image processing technology, specifically relating to a method and apparatus for adjusting display effects. Background Technology

[0002] Typically, when a user is viewing pictures in the photo album of an electronic device, if they want to adjust the display effect of the picture (such as color style and / or display perspective), they can first click on the editing controls in the photo album to make the electronic device display multiple effect adjustment controls, and then perform multiple operations on different effect adjustment controls to trigger the electronic device to adjust the color style and / or display perspective of the picture, and then display the adjusted picture in the photo album.

[0003] However, since users need to perform multiple operations to trigger the electronic device to adjust the color style and / or display perspective of an image, the user's operation is relatively cumbersome and time-consuming during the process of adjusting the color style and / or display perspective of an image. As a result, the efficiency of electronic devices in adjusting the display effect of images is low. Summary of the Invention

[0004] The purpose of this application is to provide a display effect adjustment method and apparatus, which can improve the efficiency of adjusting the display effect of images by electronic devices.

[0005] In a first aspect, embodiments of this application provide a method for adjusting display effects. The method includes: an electronic device receiving a first input while displaying a first image; and responding to the first input, performing a first operation on the first image based on pose change information of the electronic device to obtain a second image; wherein the first operation includes at least one of the following: color transformation and viewing angle transformation.

[0006] Secondly, embodiments of this application provide a display effect adjustment device, which includes: a receiving module, configured to receive a first input when the display effect adjustment device displays a first image; and an execution module, configured to, in response to the first input received by the receiving module, perform a first operation on the first image according to the pose change information of the display effect adjustment device to obtain a second image; wherein the first operation includes at least one of the following: color transformation and viewing angle transformation.

[0007] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions implementing the steps of the method as described in the first aspect when executed by the processor.

[0008] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method as described in the first aspect.

[0009] Fifthly, embodiments of this application provide a chip including a processor and a communication interface coupled to the processor, the processor being used to run programs or instructions to implement the steps of the method as described in the first aspect.

[0010] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the method as described in the first aspect.

[0011] In this embodiment, the electronic device can receive a first input while displaying a first image; and in response to the first input, perform a first operation on the first image based on the pose change information of the electronic device to obtain a second image; wherein the first operation includes at least one of the following: color transformation and viewing angle transformation. Since when the electronic device displays the first image, a single input from the user (i.e., the first input) can trigger the electronic device to perform the first operation (i.e., color transformation and / or viewing angle transformation) on the first image based on the pose change information of the electronic device, thereby adjusting the color style and / or display viewing angle of the first image, without requiring the user to perform multiple operations on different controls, the user's operation during the adjustment of the color style and / or display viewing angle of the first image can be simplified and the time consumption reduced. Thus, the efficiency of the electronic device in adjusting the display effect of the image can be improved. Attached Figure Description

[0012] Figure 1 This is one of the flowcharts illustrating the display effect adjustment method provided in the embodiments of this application;

[0013] Figure 2 This is a second schematic flowchart of the display effect adjustment method provided in the embodiments of this application;

[0014] Figure 3 This is a schematic diagram of the interface of a mobile phone provided in an embodiment of this application;

[0015] Figure 4 This is the third flowchart illustrating the display effect adjustment method provided in the embodiments of this application;

[0016] Figure 5 This is the fourth flowchart illustrating the display effect adjustment method provided in the embodiments of this application;

[0017] Figure 6 This is the fifth flowchart illustrating the display effect adjustment method provided in the embodiments of this application;

[0018] Figure 7 This is the sixth flowchart illustrating the display effect adjustment method provided in this application embodiment;

[0019] Figure 8 This is the seventh flowchart illustrating the display effect adjustment method provided in the embodiments of this application;

[0020] Figure 9 This is a schematic diagram of the display effect adjustment device provided in the embodiments of this application;

[0021] Figure 10 This is one of the hardware structure diagrams of the electronic device provided in the embodiments of this application;

[0022] Figure 11 This is the second schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0024] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0025] The terms "at least one," "at least one of," etc., used in the specification and claims of this application refer to any one, any two, or a combination of two or more of the included items. For example, at least one of a, b, and c can mean: "a," "b," "c," "a and b," "a and c," "b and c," and "a, b, and c," where a, b, and c can be single or multiple. Similarly, "at least two" refers to two or more items, and its meaning is similar to that of "at least one."

[0026] Typically, when users are viewing photos in their electronic device's photo album and want to adjust the color style of the images, they can do so using the following methods:

[0027] 1. Filter presets: The album offers several preset filters (such as nostalgic, black and white, vivid, etc.), and users can switch the color style of the picture by clicking the filter icon;

[0028] 2. Control Adjustment Scheme: Users can click and input on the editing controls in the album to make the electronic device display multiple effect adjustment controls (such as Hue adjustment slider, Saturation adjustment slider, Brightness adjustment slider, etc.). Users can then perform multiple operations on different effect adjustment controls to trigger the electronic device to adjust the color style of the image.

[0029] 3. Artificial Intelligence (AI) One-Click Beautification Solution: Automatically enhances the colors of images using deep learning models.

[0030] It is understandable that users can adjust the color style of images using the three methods mentioned above, so that after the user saves the adjusted image, the electronic device can display the adjusted image in the photo album.

[0031] However, all three of the above methods suffer from the drawback of being cumbersome and time-consuming for users to adjust the color style of images, resulting in low efficiency for electronic devices in adjusting the color style of images.

[0032] Furthermore, when a user is viewing pictures in the photo album of an electronic device, if they want to adjust the display perspective of the picture, they can trigger the electronic device to open a picture editing application and open the picture in that application. The user can then perform multiple operations in the picture editing application to trigger the electronic device to adjust the display perspective of the picture. After the user saves the adjusted picture, the electronic device can display the adjusted picture in the photo album.

[0033] However, the above-mentioned methods for adjusting the display perspective of images also have the drawbacks of being cumbersome and time-consuming for users during the process, resulting in low efficiency for electronic devices in adjusting the display perspective of images.

[0034] In summary, the related technologies suffer from the drawback of low efficiency in adjusting the display effect of images by electronic devices.

[0035] To address the aforementioned problems, this application provides a method and apparatus for adjusting display effects. The following detailed description, in conjunction with the accompanying drawings, of specific embodiments and application scenarios provides the method and apparatus for adjusting display effects provided in this application.

[0036] It should be noted that the display effect adjustment method provided in this application can be executed by electronic devices such as mobile phones, tablets, laptops, PDAs, and in-vehicle electronic devices. Some embodiments of this application use electronic devices as the executing entity to illustrate the display effect adjustment method provided in this application.

[0037] The display effect adjustment method provided in this application embodiment can be applied to scenarios where users adjust the display effect of images using electronic devices.

[0038] One specific application scenario is when a user adjusts the display effect of a picture in the photo album of an electronic device, and another specific application scenario is when a user adjusts the display effect of a picture in a picture editing application on an electronic device.

[0039] Figure 1 A flowchart illustrating the display effect adjustment method provided in an embodiment of this application is shown. Figure 1 As shown, the display effect adjustment method provided in this application embodiment may include the following steps 101 and 102.

[0040] Step 101: When the electronic device displays the first image, the electronic device receives the first input.

[0041] In some embodiments of this application, a user can trigger an electronic device to open a first application and make multiple inputs in the first application, so that the electronic device displays a first image in the interface of the first application, thereby allowing the user to make the first input.

[0042] In some examples, the first application mentioned above may include, but is not limited to, any of the following: photo album, image editing application, web application.

[0043] In some examples, where the first application is a photo album, the electronic device can display the identifiers (e.g., thumbnails) of multiple images in the interface of the first application, so that the user can click on the identifier of the first image among the multiple image identifiers to make the electronic device display the first image in the interface of the first application.

[0044] In this embodiment of the application, the first input is used to select the operation parameters required by the user.

[0045] The operation parameters may include, but are not limited to, at least one of the following: the color required by the user, and the viewing angle change parameters required by the user.

[0046] In some embodiments of this application, the aforementioned first input includes, but is not limited to: touch input by the user to the display screen of the electronic device via a touch device such as a finger or stylus, or voice commands input by the user, or specific gestures input by the user, or other feasible inputs. The specific input can be determined according to actual usage needs, and this application does not limit it. The specific gestures in this application embodiment can be any one of a single-click gesture, a swipe gesture, a drag gesture, a pressure-recognition gesture, a long-press gesture, an area-change gesture, a double-press gesture, or a double-tap gesture; the click input in this application embodiment can be a single-click input, a double-tap input, or any number of clicks, and can also be a long-press input or a short-press input.

[0047] For example, the first input mentioned above can be: the user's movement input to the electronic device.

[0048] It should be noted that the above-mentioned user input to the electronic device can be understood as: the input of the user holding the electronic device to move and / or rotate.

[0049] Step 102: The electronic device responds to the first input and performs a first operation on the first image based on the pose change information of the electronic device to obtain a second image.

[0050] In this embodiment of the application, the first operation mentioned above includes at least one of the following: color transformation and viewing angle transformation.

[0051] In some embodiments of this application, the pose change information is used to indicate changes in the position and attitude of the electronic device. The pose change information may include, but is not limited to, at least one of the following: angular velocity change information, acceleration change information, position change information, rotation Euler angle change information, rotation matrix change information, etc.

[0052] In some embodiments of this application, the electronic device, in response to the first input, can first determine the pose change information, and then perform a first operation on the first image based on the pose change information.

[0053] In some examples, the electronic device can acquire the first pose information of the electronic device when displaying the first image, and acquire the second pose information of the electronic device when receiving the first input. Thus, the electronic device can determine the pose change information based on the second pose information and the first pose information.

[0054] Optionally, the electronic device can obtain the first pose information and / or the second pose information by detecting the inertial measurement unit (IMU).

[0055] For example, when a user opens an image in the first application mentioned above, the electronic device can record the first pose information Pose_ref through the IMU, and the electronic device can collect the pose information of the electronic device through the IMU at a fixed frequency (e.g., 100 Hz). Thus, when the first input is received, the electronic device can collect IMU data through the IMU, and integrate the IMU data through complementary filtering or EKF to obtain the second pose information Pose_cur, where Pose_cur can mainly use the two degrees of freedom of pitch and roll.

[0056] In some embodiments of this application, the above color transformation can be understood as: modifying the color parameters of at least some pixels in the first image, and / or modifying the color parameters of each Gaussian unit set in the three-dimensional scene model of the scene corresponding to the first image.

[0057] In some embodiments of this application, when the first operation includes color transformation, the electronic device can first determine the first object based on pose change information, and then perform color transformation on the first image based on the first object. The first object may include, but is not limited to, at least one of the following: a filter, a full color gamut, certain style color gamuts, or a color.

[0058] In some embodiments of this application, the above-mentioned perspective transformation can be understood as: changing the pose of the virtual camera of the first image.

[0059] In some embodiments of this application, when the first operation includes a viewpoint change, the electronic device can first determine the viewpoint change parameters based on the pose change information. The viewpoint change parameters are used to indicate the pose change of the virtual camera, and the device can render the scene based on the viewpoint change parameters and the three-dimensional scene model of the scene corresponding to the first image.

[0060] In some embodiments of this application, after obtaining the second image, the electronic device can update the first image to the second image and store the second image upon receiving confirmation input from the user in the interface of the first application (e.g., a click on the "confirm" control).

[0061] In some embodiments of this application, if the user is still not satisfied with the display effect of the second image after obtaining the second image, the first input can be performed again so that the electronic device can execute the above steps 101 and 102 again until the obtained image meets the user's requirements.

[0062] This application provides a method for adjusting display effects. When an electronic device displays a first image, it receives a first input and, in response to the first input, performs a first operation on the first image based on the pose change information of the electronic device to obtain a second image. The first operation includes at least one of the following: color transformation and viewing angle transformation. Since when the electronic device displays the first image, a single input from the user (i.e., the first input) triggers the electronic device to perform the first operation (i.e., color transformation and / or viewing angle transformation) on the first image based on the pose change information of the electronic device, thereby adjusting the color style and / or display viewing angle of the first image, without requiring the user to perform multiple operations on different controls, the user's operation during the adjustment of the color style and / or display viewing angle of the first image can be simplified and the time consumption reduced. This improves the efficiency of the electronic device in adjusting the display effect of the image.

[0063] The specific solutions of the embodiments of this application will be illustrated below with concrete examples.

[0064] In some embodiments of this application, the first operation described above includes color transformation. In some examples, it is combined with... Figure 1 ,like Figure 2 As shown, before step 102 above, the display effect adjustment method provided in this application embodiment may further include step 201 below, and step 102 above can be specifically implemented through steps 102a and 102b below.

[0065] Step 201: The electronic device displays N color areas and selection controls.

[0066] In this embodiment of the application, each of the above N color regions is used to indicate a color, where N is a positive integer greater than 1.

[0067] In some examples, the above N colors can be obtained by dividing the color space into HSV or custom color spaces.

[0068] In some examples, the above N color areas can be arranged in a circular shape.

[0069] In some examples, the selection control described above is used to select the color desired by the user. Specifically, the selection control can be a trackball control, which can be located at the center of N color areas.

[0070] In some examples, where the electronic device displays the first image in the interface of the first application, the electronic device may also display N color areas and selection controls in the interface of the first application.

[0071] For example, an electronic device may display a first image in a first area of ​​the interface of a first application, and display N color areas and selection controls in a second area of ​​the interface of the first application. The first and second areas may be adjacent display areas.

[0072] It should be noted that the above-mentioned adjacent display areas can be understood as: the distance between two display areas is less than or equal to the distance threshold.

[0073] Optionally, when the electronic device is in 3D color palette mode, the electronic device can simultaneously display a first image, N color areas, and selection controls in the interface of the first application.

[0074] For example, taking a mobile phone as an electronic device, Figure 3 A schematic diagram of the phone's interface is shown. The phone has its 3D color palette mode enabled, as shown below. Figure 3 As shown, the mobile phone can display the first image 12 in the first area 11 of the interface 10 of the first application, and display N color areas 14 and selection control 15 in the second area 13 of the interface 10. The N color areas 14 are in a circular shape, and the selection control 15 can be located at the center of the N color areas 14.

[0075] Step 102a: The electronic device responds to the first input and controls the selection control to move according to the pose change information.

[0076] In some examples, the electronic device can determine the corresponding movement parameters based on pose change information and control the movement of the selection control according to the movement parameters. These movement parameters may include, but are not limited to, at least one of the following: movement direction, movement speed, and movement distance.

[0077] In some examples, combined Figure 2 ,like Figure 4 As shown, step 102a can be implemented through steps 102a1 and 102a2 as described below.

[0078] Step 102a1: The electronic device determines the movement parameters corresponding to the pose change information.

[0079] Optionally, the electronic device can determine the movement parameters corresponding to the pose change information based on the first correspondence between the change information and the movement parameters.

[0080] The aforementioned first correspondence can be a preset correspondence in the electronic device, a correspondence determined based on user input, or a correspondence sent to the electronic device by other devices.

[0081] In this process, the electronic device can first determine a change information that matches the pose change information from the first correspondence, and then determine the movement parameter corresponding to the change information as the movement parameter corresponding to the pose change information.

[0082] It should be noted that the above matching can be understood as: identical, or the difference between the two is less than or equal to the difference threshold.

[0083] Step 102a2: The electronic device moves the selection control according to the movement parameters.

[0084] Alternatively, the electronic device can use a rolling dynamics model (with damping and boundary constraints) to update the position of the selection control on N color areas to control the movement of the selection control.

[0085] Therefore, since the electronic device can determine the movement parameters corresponding to the pose change information, it can accurately control the movement of the selection control according to the movement parameters. Thus, the accuracy of controlling the movement of the selection control can be improved, thereby improving the accuracy of the selection operation.

[0086] Step 102b: The electronic device performs color transformation on the first image according to the color indicated by the first color area to obtain the second image.

[0087] In this embodiment of the application, the first color region is the color region where the selection control is located after moving among the N color regions.

[0088] In some examples, the number of colors indicated by the first color area can be at least one. It is understood that, since the selection control may be located in two or more color areas after being moved, the number of colors indicated by the first color area can be two or more, meaning the number of colors indicated by the first color area can be at least one.

[0089] Optionally, if the number of colors indicated by the first color area is at least two, the electronic device may first determine the target color based on the at least two colors, and then perform color transformation on the first image based on the target color to obtain the second image.

[0090] The electronic device can perform a weighted average calculation on at least two colors to obtain the target color. The weight of each color can be positively correlated with the overlap area between the selection control and the color region corresponding to that color.

[0091] In some examples, an electronic device can use a color mapping function to process a first image and the colors indicated by a first color region to obtain a second image.

[0092] The color mapping function may include, but is not limited to, at least one of the following: hue shift, ColorGrading LUT generation, weighted overlay of the original image's HSV channels, etc.

[0093] Optionally, if the first operation is a color transformation, the electronic device can use a color mapping function to process the first image and the colors indicated by the first color region to obtain a second image.

[0094] In some other examples, prior to step 102b above, the display effect adjustment method provided in this application embodiment may also include steps 301 and 302 below, and step 102b above can be specifically implemented through step 102b1 below.

[0095] Step 301: The electronic device acquires the first depth image corresponding to the first image.

[0096] Optionally, if the first operation is a color transformation, the electronic device can acquire the first depth image corresponding to the first image and perform the following steps 302 and 102b1.

[0097] Alternatively, the electronic device can input the first image into a monocular depth estimation network (e.g., a lightweight MiDaS / DPT), and the monocular depth estimation network can perform inference based on the first image to obtain a first depth image.

[0098] In the case where the electronic device displays the first image in the interface of the first application, the electronic device can input the first image into the monocular depth estimation network.

[0099] In this process, the electronic device uses a monocular depth estimation network to infer from the first image to obtain a second depth image. In this way, the electronic device can directly or through the monocular depth estimation network normalize the depth values ​​of each pixel in the second depth image to [0,1] to obtain the first depth image.

[0100] Optionally, after acquiring the first depth image, the electronic device can store the first depth image for later use. It is understood that the first depth image only needs to be calculated once and does not need to be calculated again subsequently, thus ensuring real-time responsiveness in subsequent color interactions.

[0101] Step 302: The electronic device determines at least two layered masks based on the first depth image and at least one depth value range.

[0102] In this embodiment of the application, each of the above at least two layered masks is used to identify a region in the first image, and the depth values ​​corresponding to each pixel in each region are within the same depth value range.

[0103] Optionally, any two depth value ranges in at least one of the above depth value ranges do not overlap.

[0104] Optionally, the electronic device may first acquire at least one preset threshold, and determine at least one depth value range based on the at least one preset threshold, and then determine at least two layered masks based on the first depth image and the at least one depth value range.

[0105] Where at least one preset threshold is a preset threshold, the electronic device can use 0 and the preset threshold as two critical values ​​to determine a depth value range. Alternatively, the electronic device can use 0 and the preset threshold as two critical values ​​to determine a depth value range, and use the preset threshold and 1 as two critical values ​​to determine another depth value range.

[0106] Where at least one preset threshold is at least two preset thresholds, the electronic device can use 0 and the smallest preset threshold among the at least one preset threshold as two critical values ​​to determine a depth value range, and then use the second smallest preset threshold and the third smallest preset threshold as two critical values ​​to determine another depth value range, and so on, until the first largest preset threshold and 1 are used as two critical values ​​to determine the last depth value range, thus obtaining the above at least one depth value range.

[0107] Optionally, the electronic device sets the pixel value of a pixel in the first depth image that is within a certain depth value range to 1, and sets the pixel value of a pixel in the first depth image that is not within that depth value range to 0, to obtain a layered mask. Then, it sets the pixel value of a pixel in the first depth image that is within another depth value range to 1, and sets the pixel value of a pixel in the first depth image that is not within that other depth value range to 0, to obtain another layered mask, and so on, to obtain at least two layered masks.

[0108] It is understandable that the pixel value of each pixel in the area identified by each layer mask is 1.

[0109] Step 102b1: The electronic device performs a color transformation on the first image based on at least two layered masks, at least two color weights corresponding to the at least two layered masks, and the color indicated by the first color region, to obtain the second image.

[0110] Optionally, each depth value range can correspond to a color weight, and the layer mask corresponding to each depth value range can correspond to the color weight corresponding to each depth value range.

[0111] The aforementioned color weights can decrease (or increase) in order of depth values ​​from largest to smallest (or smallest to largest) within the corresponding depth value range, or the color weights can be configured by the user.

[0112] For example, color weights can decrease in descending order of depth value within the corresponding depth range. In other words, the greater the depth value within the depth range, the greater the color weight. This means that the foreground in the first image has a smaller color weight, while the background has a larger color weight. Therefore, in the second image, the foreground can retain its original color tone and only increase its saturation, while the background will more strongly migrate towards the color indicated by the first color area, simulating an "ambient light" effect. This allows for professional-grade color styles such as "distant scene colorization and close-up fidelity," lowering the professional barrier for users.

[0113] Thus, since the electronic device can acquire the first depth image corresponding to the first image, and determine at least two layer masks through the first depth image and at least one depth value range, so as to know the regions of different spatial levels in the first image through the at least two layer masks, the electronic device can perform different color transformations on the regions of different spatial levels of the first image according to the at least two layer masks, the at least two color weights corresponding to the at least two layer masks, and the color indicated by the first color region. Therefore, the colors of different spatial levels of the second image are different, thereby making the color adjustment effect of the electronic device have a sense of spatial hierarchy and improving the adjustment effect of the display effect of the electronic device.

[0114] Optionally, step 102b1 can be implemented through steps 102b1a and 102b1b as described below.

[0115] Step 102b1a: The electronic device performs color transformation on the first image according to each layer mask, the color weight corresponding to each layer mask, and the color indicated by the first color region, to obtain a third image.

[0116] For example, an electronic device may employ a first algorithm to perform color transformation on a first image based on each layer mask, the color weight corresponding to each layer mask, and the color indicated by a first color region, to obtain a third image, wherein the first algorithm is:

[0117] I i '=M_i(x,y) ·f(I(x,y), C_target, w_i);

[0118] Among them, I i' is the i-th third image, I(x,y) is the first image, M_i(x,y) is the i-th layer mask, w_i is the i-th color weight corresponding to the i-th layer mask, C_target is the color indicated by the first color region, f(·) is the color mapping function, and i is a positive integer.

[0119] It is understandable that the electronic device can first use a color mapping function to calculate the first image, the color indicated by the first color region, and the i-th color weight to obtain an image. Then, this image is multiplied by the i-th layer mask. The pixel value of the pixels in the region identified by the i-th layer mask is 1, and the pixel value of the pixels in the other regions is 0. Thus, the i-th third image obtained by multiplication only includes the region identified by the i-th layer mask.

[0120] Step 102b1b: The electronic device combines at least two third images into a second image.

[0121] For example, the electronic device may employ a second algorithm to combine at least two third images into a second image. This second algorithm may be:

[0122] I'= ;

[0123] Where I' is the second image, Z is the number of at least two third images, and Z is a positive integer greater than 1.

[0124] It is understandable that the electronic device can use the following algorithm to calculate and obtain the second image based on each layer mask, the color weight corresponding to each layer mask, and the color indicated by the first color region:

[0125] I'= ;

[0126] Among them, I i Let ' be the i-th third image, I(x,y) be the first image, M_i(x,y) be the i-th layer mask, w_i be the i-th color weight corresponding to the i-th layer mask, C_target be the color indicated by the first color region, f(·) be the color mapping function, i be a positive integer, I' be the second image, and Z be the number of at least two third images, where Z is a positive integer greater than 1.

[0127] Thus, it can be seen that since the electronic device can perform color transformation on the first image according to each layer mask, the color weight corresponding to each layer mask, and the color indicated by the first color region to obtain a third image, in order to obtain an image with different colors in different spatial layers, after the electronic device combines at least two third images into a second image, the colors of the second image in different spatial layers are also different, thereby making the color adjustment effect of the electronic device have a sense of spatial layering and improving the adjustment effect of the display effect of the electronic device.

[0128] In some examples, step 102b above can be specifically implemented through step 102b2 below.

[0129] Step 102b2: The electronic device performs color transformation on the first image based on the color indicated by the first color area and the three-dimensional scene model of the scene corresponding to the first image, to obtain the second image.

[0130] Optionally, if the first operation includes color transformation and perspective transformation, the electronic device can perform color transformation on the first image based on the color indicated by the first color area and the three-dimensional scene model of the scene corresponding to the first image to obtain the second image.

[0131] Optionally, the electronic device may first acquire a 3D scene model of the scene corresponding to the first image, and then perform color transformation on the first image according to the color indicated by the first color area and the 3D scene model of the scene corresponding to the first image to obtain the second image.

[0132] In this process, the electronic device can input the first image into the feedforward 3DGS generation network, so that the 3DGS generation network can perform inference based on the first image and output a 3D scene model of the scene corresponding to the first image.

[0133] The 3D scene model may include at least one of the following: at least one Gaussian unit, a mesh, or other suitable 3D model representation. Each Gaussian unit includes: position, covariance, color, opacity, etc.

[0134] It is understandable that the above-mentioned 3D scene model can be used for color transformation.

[0135] Optionally, the electronic device can apply the color indicated by the first color region to the color attribute of the 3D scene model, or perform color transformation after Splatting rasterization to obtain a second image.

[0136] Thus, since the electronic device can accurately perform color transformation on the first image based on the color indicated by the first color area and the three-dimensional scene model of the scene corresponding to the first image, it can ensure that the color style of the second image meets the user's needs. Therefore, the accuracy of adjusting the display effect of the electronic device can be improved.

[0137] As can be seen from the above, since the electronic device can display N color areas and selection controls, the user can accurately trigger the electronic device to control the selection controls to move based on the positions of the N color areas and the selection controls, so as to accurately select the color the user needs. This allows the electronic device to perform color transformation on the first image according to the color the user needs (i.e., the color indicated by the first color area), avoiding the user having to repeatedly input information because the electronic device performs color transformation on the first image according to the color the user does not need. Therefore, the user's operation in adjusting the color style of the first image can be simplified and the time consumption can be reduced. In this way, the efficiency of the electronic device in adjusting the display effect of the image can be improved.

[0138] Furthermore, in this embodiment, the posture of the electronic device and color selection can be decoupled and bound, replacing touch screen dragging with motion-sensing interaction, thereby enhancing the fun and immersion of color adjustment. This avoids the use of planar 2D touch interaction in related technologies, increasing user engagement; moreover, this embodiment can prevent users from obscuring part of the screen with their fingers during adjustment, improving the preview experience.

[0139] In some embodiments of this application, the first operation described above includes a viewpoint transformation. In some examples, it is combined with... Figure 1 ,like Figure 5 As shown, before step 102 above, the display effect adjustment method provided in this application embodiment may further include step 401 below, and step 102 above can be specifically implemented by steps 102c and 102d below.

[0140] Step 401: The electronic device acquires the 3D scene model of the scene corresponding to the first image.

[0141] In some examples, when an electronic device displays a first image in the interface of a first application, the electronic device can obtain a 3D scene model of the scene corresponding to the first image.

[0142] In some examples, step 401 above can be specifically implemented by step 401a below.

[0143] Step 401a: The electronic device inputs the first image into the first model, and performs 3D reconstruction based on the first image through the first model to output a 3D scene model.

[0144] Optionally, the first model described above may include, but is not limited to, a feedforward 3DGS generation network.

[0145] It is understandable that electronic devices can input the first image into a feedforward 3DGS generation network, so that the 3DGS generation network can perform inference based on the first image and output a 3D scene model of the scene corresponding to the first image.

[0146] The 3D scene model may include at least one of the following: at least one Gaussian unit, a mesh, or other suitable 3D model representation. Each Gaussian unit includes: position, covariance, color, opacity, etc.

[0147] It is understandable that the aforementioned 3D scene model can also be used for perspective transformation.

[0148] Thus, since the electronic device can also perform 3D reconstruction based on the first image using the first model, the accuracy of the output 3D scene model can be improved. Therefore, in subsequent steps, the electronic device can accurately perform perspective transformation on the first image, thereby improving the adjustment effect of the electronic device's display effect.

[0149] Step 102c: The electronic device determines the viewpoint change parameters corresponding to the pose change information.

[0150] In some examples, the electronic device can determine the viewpoint change parameters corresponding to the pose change information based on a second correspondence between the bit information and the change parameters.

[0151] Optionally, the aforementioned second correspondence may be a preset correspondence in the electronic device, a correspondence determined according to user input, or a correspondence sent to the electronic device by other devices.

[0152] In some examples, the aforementioned viewpoint variation parameters are used to determine the pose of the virtual camera of the aforementioned 3D scene model, and based on this pose, the 3D scene model is rendered into a 2D second image. These viewpoint variation parameters may include, but are not limited to, at least one of the following: the rotation matrix of the virtual camera, the translation vector of the virtual camera, the 3D coordinates of the virtual camera's center in the world coordinate system, and the virtual camera's gaze direction vector, etc. It is understood that the viewpoint of the second image is different from that of the first image.

[0153] In some examples, the electronic device can first determine a change information that matches the pose change information from the second correspondence, and then determine the change parameter corresponding to the change information as the viewpoint change parameter.

[0154] It should be noted that the above matching can be understood as: identical, or the difference between the two is less than or equal to the difference threshold.

[0155] Step 102d: The electronic device generates a second image based on the viewpoint change parameters and the 3D scene model.

[0156] In some examples, electronic devices can use perspective change parameters as virtual camera parameters to perform splatting rendering on a 3D scene model to obtain a second image.

[0157] It should be noted that for an explanation of Splatting rendering, please refer to the specific descriptions in related technologies, which will not be repeated here in the embodiments of this application.

[0158] Thus, since the electronic device can acquire the 3D scene model of the scene corresponding to the first image and determine the viewpoint change parameters corresponding to the pose change information, the electronic device can accurately execute viewpoint changes based on the viewpoint change parameters and the 3D scene model. Therefore, it can obtain a second image with a different viewpoint that meets the user's requirements, thereby improving the adjustment effect of the electronic device's display effect.

[0159] Furthermore, compared to related technologies, the embodiments of this application can avoid the fact that the pictures in the album of related technologies are always presented from a fixed two-dimensional (2D) perspective, and users cannot appreciate the content of the picture from different perspectives. The viewing experience is static and monotonous. Instead, the static 2D album can be upgraded to an interactive 3D scene browsing experience, and users can appreciate the photos from different perspectives simply by shaking their mobile phones.

[0160] Furthermore, when the first operation includes color transformation and viewpoint transformation, the viewpoint transformation and color transformation can share the same data source (such as the pose change information in the above embodiment), thereby achieving a unified and natural haptic interaction.

[0161] The following will use three different examples to illustrate the overall process of the display effect adjustment method provided in the embodiments of this application.

[0162] Example 1: Color adjustment of 2D images based on IMU virtual trackball.

[0163] System Architecture: The screen of the electronic device is divided into upper and lower display areas (i.e., the first area and the second area in the above embodiment). The upper part is the image display area, used to present the 2D image to be color-corrected (i.e., the first image in the above embodiment); the lower part is the 3D color palette area (i.e., the N color areas in the above embodiment), in which a hemispherical / disc-shaped color palette is rendered, and the surface of the color palette is distributed with continuous color blocks according to the HSV space or a custom color space. A virtual trackball (i.e., the selection control in the above embodiment) is placed in the center or on the surface of the color palette.

[0164] like Figure 6 As shown, Example 1 may include the following steps:

[0165] S1.1: Open the image, enter the 3D color palette mode, and record the first pose information Pose_ref.

[0166] Specifically, when a user opens a picture in the album, the system enters the 3D color palette mode; the positions of the virtual color palette and virtual trackball are initialized, and the current IMU pose is recorded as the reference pose Pose_ref.

[0167] S1.2: Acquire IMU accelerometer / gyroscope data at 100Hz.

[0168] S1.3: Complementary filtering / EKF solves the second pose information Pose_cur.

[0169] S1.4: △Pose is converted into trackball roll displacement.

[0170] Specifically, the aforementioned △Pose can be the pose change information in the above embodiments, and the electronic device can control the trackball to roll according to the pose change information.

[0171] S1.5: Sample the target color C_target in the 3D color palette area based on the position of the trackball after it has been moved.

[0172] Specifically, the target color C_target is the color indicated by the first color region.

[0173] S1.6: Color Transformation.

[0174] Specifically, the electronic device can perform color transformation on the first image based on the color indicated by the first color area.

[0175] S1.7: Real-time refresh.

[0176] Specifically, the electronic device can update the first image to the second image.

[0177] S1.8: Gesture confirmation to hold / exit mode.

[0178] Specifically, users can confirm and save the current color scheme or exit the mode by double-tapping the screen or using a specific gesture.

[0179] As can be seen from the above, Example 1 can replace the traditional touch screen dragging with IMU-driven motion-sensing interaction, making the color adjustment process more fun and immersive; it can be implemented using existing hardware in electronic devices without the need for additional equipment.

[0180] Example 2: Layered color adjustment combined with monocular depth estimation.

[0181] Building upon Example 1, monocular depth estimation is introduced, so that color adjustment no longer has a uniform effect on the entire image, but is differentiated according to depth level.

[0182] like Figure 7 As shown, Example 2 may include the following steps:

[0183] S2.1: Open the image, and the monocular depth estimation network infers the depth image.

[0184] Specifically, the depth image in S2.1 can be the first depth image in the above embodiment.

[0185] S2.2: Normalize the depth image and determine at least two layered masks according to at least one depth value range.

[0186] S2.3: Complementary filtering / EKF solves the second pose information Pose_cur.

[0187] S2.4: △Pose is converted into trackball roll displacement.

[0188] Specifically, the aforementioned △Pose can be the pose change information in the above embodiments, and the electronic device can control the trackball to roll according to the pose change information.

[0189] S2.5: Sample the target color C_target in the 3D color palette area based on the position of the trackball after it has been moved.

[0190] Specifically, the target color C_target is the color indicated by the first color region.

[0191] S2.6: Perform color transformation based on at least two layered masks and the target color C_target.

[0192] S2.7: Real-time refresh.

[0193] Specifically, the electronic device can update the first image to the second image.

[0194] S2.8: Gesture confirmation to hold / exit mode.

[0195] Specifically, users can confirm and save the current color scheme or exit the mode by double-tapping the screen or using a specific gesture.

[0196] As can be seen from the above, Example 2 can combine color adjustment with image semantics (depth structure), making the color adjustment effect more spatially layered; it can achieve professional-grade color styles such as "distant scene colorization and close-up scene fidelity", lowering the professional threshold for users; the depth image only needs to be calculated once, and subsequent color interactions still maintain real-time response.

[0197] Example 3: Combining the perspective-color dual linkage of feedforward 3DGS.

[0198] Building upon Example 2, a feedforward 3D Gaussian Splatting generative network is further introduced, enabling the images in the album to be upgraded into 3D scenes that can be driven by IMU poses, while also accepting color adjustments from a trackball.

[0199] like Figure 8 As shown, Example 3 may include the following steps:

[0200] S3.1: Open the image, and the feedforward 3DGS generator network outputs a 3D scene model.

[0201] Specifically, the 3D scene model can be a model of the scene corresponding to the first image.

[0202] S3.2: Determine △Pose.

[0203] S3.3: △Pose dual-channel splitting.

[0204] Specifically, the electronic device generates two channels, such as channel A and channel B:

[0205] Channel A: Maps △Pose to the virtual camera's viewpoint transformation T_view in the 3DGS scene (e.g., a small orbital movement around the scene center), where T_view can be the viewpoint transformation parameter in the above embodiment.

[0206] Channel B: Maps △Pose to the roll displacement (i.e., displacement parameter) of the virtual trackball on the palette.

[0207] The two mapping paths can use different scaling factors, or the dominant channel can be switched by user gestures (e.g., press and hold the screen with one finger → only view-based linkage, release → both linkage).

[0208] S3.4: Sample the target color C_target in the 3D color palette area based on the position of the trackball after it has been moved.

[0209] Specifically, the target color C_target is the color indicated by the first color region.

[0210] S3.5: Determine the new virtual camera position based on T_view and the 3D scene model.

[0211] S3.6: Perform color transformation on the color attributes of the 3D scene model based on the target color C_target, and render and generate a second image based on the virtual camera position and the color-transformed 3D scene model.

[0212] S3.7: Real-time refresh.

[0213] Specifically, the electronic device can update the first image to the second image.

[0214] S3.8: Gesture confirmation to hold / exit mode.

[0215] Specifically, users can confirm and save the current color scheme by double-tapping the screen or using a specific gesture, or exit the mode.

[0216] As shown above, Example 3 can upgrade a static 2D photo album into an interactive 3D scene browsing experience, allowing users to enjoy photos from different perspectives simply by shaking their phones; perspective changes and color adjustments share the same IMU data source, achieving unified and natural haptic interaction; and it integrates feedforward 3DGS, monocular depth (implied in the 3DGS structure), IMU pose, and color interaction end-to-end, constructing a brand-new paradigm for photo album image browsing and editing.

[0217] In summary, the three examples above can decouple the posture of electronic devices from color selection, replace touch screen dragging with haptic interaction to enhance the fun and immersion of color adjustment; combine monocular depth estimation to achieve differentiated color adjustment according to depth level; and combine feedforward 3DGS generation and IMU pose estimation to achieve a new image browsing method with dual linkage of "color + perspective".

[0218] The main improvements in this application's embodiments are as follows:

[0219] 1. Introduce a virtual 3D color palette and a virtual trackball in the album image viewing interface. The scrolling of the trackball is driven by the pose calculated by the phone's IMU, and the color blocks covered by the trackball on the color palette determine the target color applied to the image.

[0220] 2. Based on 2D color adjustment, monocular depth estimation is introduced to weight the color adjustment intensity / hue according to the depth layer.

[0221] 3. Further, feedforward 3DGS reconstruction is introduced, which enables the image to simultaneously respond to the IMU pose for new perspective synthesis, and trackball color adjustment is superimposed to form "viewpoint-color" linkage.

[0222] It should be noted that each of the above method embodiments, or various possible implementations of each method embodiment, can be executed individually or in combination of any two or more. The specific implementation can be determined according to actual usage requirements, and this application embodiment does not impose any restrictions on this.

[0223] The display effect adjustment method provided in this application can be executed by a display effect adjustment device. This application uses an example of a display effect adjustment device executing the display effect adjustment method to illustrate the display effect adjustment device provided in this application.

[0224] Figure 9This is a schematic diagram of a display effect adjustment device provided in an embodiment of this application. Figure 9 As shown, the display effect adjustment device 500 may include a receiving module 501 and an execution module 502.

[0225] The receiving module 501 is used to receive a first input when the display effect adjustment device 500 displays a first image. The execution module 502 is used to respond to the first input received by the receiving module 501 and perform a first operation on the first image according to the pose change information of the display effect adjustment device 500 to obtain a second image; wherein the first operation includes at least one of the following: color transformation and viewing angle transformation.

[0226] This application provides a display effect adjustment device. When the display effect adjustment device displays a first image, a single input (i.e., the first input) from the user to the display effect adjustment device triggers the device to perform a first operation (i.e., color transformation and / or viewing angle transformation) on the first image based on the device's pose change information, thereby adjusting the color style and / or viewing angle of the first image. This eliminates the need for the user to perform multiple operations on different controls. Therefore, the user's operation during the adjustment of the color style and / or viewing angle of the first image is simplified, and the time consumption is reduced. This improves the efficiency of the display effect adjustment device in adjusting the display effect of the image.

[0227] In some embodiments of this application, the first operation described above includes a viewpoint transformation. The display effect adjustment device 500 provided in this application embodiment may further include: an acquisition module, configured to acquire a three-dimensional scene model of the scene corresponding to the first image before the execution module 502 performs the first operation on the first image based on the pose change information of the display effect adjustment device 500. Specifically, the execution module 502 is configured to determine viewpoint change parameters corresponding to the pose change information; and generate a second image based on the viewpoint change parameters and the three-dimensional scene model acquired by the acquisition module.

[0228] In some embodiments of this application, the acquisition module is specifically used to input the first image into the first model, perform three-dimensional reconstruction based on the first image through the first model, and output a three-dimensional scene model.

[0229] In some embodiments of this application, the first operation mentioned above includes color transformation. The display effect adjustment device 500 provided in this application embodiment may further include: a display module, used to display N color regions and a selection control before the execution module 502 performs the first operation on the first image based on the pose change information of the display effect adjustment device 500, where each color region indicates a color, and N is a positive integer greater than 1. The execution module 502 is specifically used to control the selection control displayed by the display module to move according to the pose change information; and to perform color transformation on the first image according to the color indicated by the first color region to obtain a second image; wherein the first color region is the color region where the selection control is located after moving among the N color regions.

[0230] In some embodiments of this application, the execution module 502 is specifically used to determine the movement parameters corresponding to the pose change information; and to control the selection control to move according to the movement parameters.

[0231] In some embodiments of this application, the execution module 502 is specifically used to perform color transformation on the first image according to the color indicated by the first color region and the three-dimensional scene model of the scene corresponding to the first image, so as to obtain the second image.

[0232] In some embodiments of this application, the display effect adjustment device 500 provided in this application may further include: an acquisition module, configured to acquire a first depth image corresponding to the first image before the execution module 502 performs color transformation on the first image according to the color indicated by the first color region. The execution module 502 is further configured to determine at least two layered masks based on the first depth image acquired by the acquisition module and at least one depth value range, each layered mask being used to identify a region in the first image, and the depth values ​​corresponding to each pixel in each region being within the same depth value range. Specifically, the execution module 502 is configured to perform color transformation on the first image according to the at least two layered masks, at least two color weights corresponding to the at least two layered masks, and the color indicated by the first color region, to obtain a second image.

[0233] In some embodiments of this application, the execution module 502 is specifically used to perform color transformation on the first image according to each layer mask, the color weight corresponding to each layer mask, and the color indicated by the first color region, to obtain a third image; and to combine at least two third images into a second image.

[0234] The display effect adjustment device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the specific device.

[0235] The display effect adjustment device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0236] The display effect adjustment device provided in this application embodiment can achieve... Figures 1 to 8 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0237] In some embodiments of this application, such as Figure 10 As shown, this application embodiment also provides an electronic device 600, including a processor 601 and a memory 602. The memory 602 stores a program or instructions that can run on the processor 601. When the program or instructions are executed by the processor 601, they implement the various steps of the above-described display effect adjustment method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0238] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0239] Figure 11 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0240] The electronic device 700 includes, but is not limited to, components such as: radio frequency unit 701, network module 702, audio output unit 703, input unit 704, sensor 705, display unit 706, user input unit 707, interface unit 708, memory 709, and processor 710.

[0241] Those skilled in the art will understand that the electronic device 700 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 710 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 11 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0242] The user input unit 707 is used to receive the first input when the electronic device displays the first image.

[0243] The processor 710 is configured to respond to a first input received by the user input unit 707, and perform a first operation on the first image based on the pose change information of the electronic device to obtain a second image; wherein the first operation includes at least one of the following: color transformation and viewpoint transformation.

[0244] This application provides an electronic device in which, when the electronic device displays a first image, a single input (i.e., the first input) by the user triggers the electronic device to perform a first operation (i.e., color transformation and / or viewing angle transformation) on the first image based on the pose change information of the electronic device, thereby adjusting the color style and / or display viewing angle of the first image without requiring the user to perform multiple operations on different controls. Therefore, the user's operation in adjusting the color style and / or display viewing angle of the first image can be simplified and the time consumption reduced, thus improving the efficiency of the electronic device in adjusting the display effect of the image.

[0245] In some embodiments of this application, the first operation described above includes a change in viewpoint.

[0246] The processor 710 is also used to obtain a 3D scene model of the scene corresponding to the first image before performing the first operation on the first image based on the pose change information of the electronic device.

[0247] The processor 710 is specifically used to determine the viewpoint change parameters corresponding to the pose change information; and to generate a second image based on the viewpoint change parameters and the 3D scene model acquired by the acquisition module.

[0248] In some embodiments of this application, the processor 710 is specifically used to input the first image into the first model, perform three-dimensional reconstruction based on the first image through the first model, and output a three-dimensional scene model.

[0249] In some embodiments of this application, the first operation described above includes color transformation.

[0250] Display unit 706 is used to display N color areas and selection controls before processor 710 performs a first operation on the first image based on the pose change information of the electronic device. Each color area is used to indicate a color, and N is a positive integer greater than 1.

[0251] The processor 710 is specifically used to control the selection control displayed by the display module to move according to the pose change information; and to perform color transformation on the first image according to the color indicated by the first color area to obtain the second image; wherein the first color area is the color area where the selection control is located after moving among N color areas.

[0252] In some embodiments of this application, the processor 710 is specifically used to determine the movement parameters corresponding to the pose change information; and to control the selection control to move according to the movement parameters.

[0253] In some embodiments of this application, the processor 710 is specifically configured to perform color transformation on the first image based on the color indicated by the first color region and the three-dimensional scene model of the scene corresponding to the first image, to obtain a second image.

[0254] In some embodiments of this application, the processor 710 is further configured to acquire a first depth image corresponding to the first image before performing a color transformation on the first image according to the color indicated by the first color region.

[0255] The processor 710 is further configured to determine at least two layered masks based on a first depth image and at least one depth value range, each layered mask being used to identify a region in the first image, wherein the depth values ​​corresponding to each pixel in each region are within the same depth value range.

[0256] The processor 710 is specifically used to perform a color transformation on the first image based on at least two layered masks, at least two color weights corresponding to the at least two layered masks, and the color indicated by the first color region, to obtain a second image.

[0257] In some embodiments of this application, the processor 710 is specifically configured to perform color transformation on the first image according to each layer mask, the color weight corresponding to each layer mask, and the color indicated by the first color region, to obtain a third image; and to combine at least two third images into a second image.

[0258] It should be understood that, in this embodiment, the input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042. The GPU 7041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 706 may include a display panel 7061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

[0259] The memory 709 can be used to store software programs and various data. The memory 709 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 709 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 709 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0260] Processor 710 may include one or more processing units; optionally, processor 710 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 710.

[0261] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described display effect adjustment method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0262] The processor mentioned above is the processor in the electronic device described in the above embodiments. The readable storage medium mentioned above includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0263] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described display effect adjustment method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0264] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0265] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described display effect adjustment method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0266] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0267] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0268] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for adjusting display effects, characterized in that, include: When the electronic device displays the first image, receive the first input; In response to the first input, based on the pose change information of the electronic device, a first operation is performed on the first image to obtain a second image; The first operation includes at least one of the following: color transformation and perspective transformation.

2. The method according to claim 1, characterized in that, The first operation includes the viewpoint transformation; Before performing the first operation on the first image based on the pose change information of the electronic device, the method further includes: Obtain a 3D scene model of the scene corresponding to the first image; The step of performing a first operation on the first image based on the pose change information of the electronic device to obtain a second image includes: Determine the viewpoint change parameters corresponding to the pose change information; The second image is generated based on the perspective change parameters and the 3D scene model.

3. The method according to claim 1 or 2, characterized in that, The first operation includes the color transformation; Before performing the first operation on the first image based on the pose change information of the electronic device, the method further includes: Display N color areas and selection controls, each color area is used to indicate a color, and N is a positive integer greater than 1; The step of performing a first operation on the first image based on the pose change information of the electronic device to obtain a second image includes: Based on the pose change information, control the selection control to move; Based on the color indicated by the first color region, the color transformation is performed on the first image to obtain the second image; Wherein, the first color region is the region where the selection control is located after moving among the N color regions.

4. The method according to claim 3, characterized in that, The step of performing the color transformation on the first image according to the color indicated by the first color region to obtain the second image includes: Based on the color indicated by the first color region and the three-dimensional scene model of the scene corresponding to the first image, the color transformation is performed on the first image to obtain the second image.

5. The method according to claim 3, characterized in that, Before performing the color transformation on the first image according to the color indicated by the first color region, the method further includes: Obtain the first depth image corresponding to the first image; Based on the first depth image and at least one depth value range, at least two layered masks are determined, each layered mask being used to identify a region in the first image, and the depth values ​​corresponding to each pixel in each region being within the same depth value range; The step of performing the color transformation on the first image according to the color indicated by the first color region to obtain the second image includes: The color transformation is performed on the first image based on at least two layered masks, at least two color weights corresponding to the at least two layered masks, and the color indicated by the first color region, to obtain the second image.

6. A display effect adjustment device, characterized in that, include: The receiving module is configured to receive a first input when the display effect adjustment device displays a first image; An execution module is configured to respond to the first input received by the receiving module, perform a first operation on the first image according to the pose change information of the display effect adjustment device, and obtain a second image; The first operation includes at least one of the following: color transformation and perspective transformation.

7. The apparatus according to claim 6, characterized in that, The first operation includes the viewpoint transformation; The display effect adjustment device further includes: The acquisition module is used to acquire a three-dimensional scene model of the scene corresponding to the first image before the execution module performs the first operation on the first image based on the pose change information of the display effect adjustment device. The execution module is specifically used to determine the viewpoint change parameters corresponding to the pose change information; and to generate the second image based on the viewpoint change parameters and the three-dimensional scene model obtained by the acquisition module.

8. The apparatus according to claim 6 or 7, characterized in that, The first operation includes the color transformation; The display effect adjustment device further includes: The display module is used to display N color areas and a selection control before the execution module performs the first operation on the first image according to the pose change information of the display effect adjustment device. Each color area is used to indicate a color, and N is a positive integer greater than 1. The execution module is specifically used to control the selection control displayed by the display module to move according to the pose change information; and to perform the color transformation on the first image according to the color indicated by the first color area to obtain the second image; Wherein, the first color region is the region where the selection control is located after moving among the N color regions.

9. The apparatus according to claim 8, characterized in that, The execution module is specifically used to perform the color transformation on the first image according to the color indicated by the first color area and the three-dimensional scene model of the scene corresponding to the first image, so as to obtain the second image.

10. The apparatus according to claim 8, characterized in that, The display effect adjustment device further includes: The acquisition module is configured to acquire a first depth image corresponding to the first image before the execution module performs the color transformation on the first image according to the color indicated by the first color region; The execution module is further configured to determine at least two layered masks based on the first depth image and at least one depth value range obtained by the acquisition module, wherein each layered mask is used to identify a region in the first image, and the depth values ​​corresponding to each pixel in each region are within the same depth value range. The execution module is specifically used to perform the color transformation on the first image based on at least two layered masks, at least two color weights corresponding to the at least two layered masks, and the color indicated by the first color region, to obtain the second image.

Images