Picture processing method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides a picture processing method and device, electronic equipment, a storage medium and a computer program product, and relates to the technical field of Internet of Things. The operation convenience on the display interface can be improved. The method comprises the following steps: displaying a picture display area on a display interface of target equipment; the picture display area is used for displaying pictures from acquisition equipment; in response to an adjustment operation for the picture display area, if the area proportion of the picture display area meets an adjustment condition, adjusting the area proportion, and keeping the picture display proportion of the picture unchanged; the area proportion is used for indicating the proportion of the picture display area in the display interface; the picture display scale is used for indicating the display scale of the picture.

Description

Technical Field

[0001] The present application relates to the field of Internet of Things technology, and in particular to a picture processing method, device, electronic device, storage medium and computer program product. Background Art

[0002] When using an electronic device, a user usually needs to view images or videos on a display interface of an application and process the viewed images or videos.

[0003] In current screen display technology, the screen display area for displaying images or videos has a fixed proportion in the display interface. This approach limits operations on the display interface by the inherent proportion of the screen display area, resulting in inconvenient operations. Summary of the Invention

[0004] Based on this, it is necessary to provide a picture processing method, device, electronic device, storage medium and computer program product to address the above technical problems.

[0005] In a first aspect, the present application provides a method for image processing. The method comprises:

[0006] Displaying a picture display area on the display interface of the target device; the picture display area is used to display the picture from the acquisition device;

[0007] In response to the adjustment operation on the screen display area, if the area ratio of the screen display area meets the adjustment conditions, the area ratio is adjusted and the screen display ratio of the screen is kept unchanged; the area ratio is used to indicate the ratio of the screen display area in the display interface; the screen display ratio is used to indicate the display ratio of the screen itself.

[0008] In a second aspect, the present application further provides a picture processing device. The device comprises:

[0009] A display module is used to display a picture display area on the display interface of the target device; the picture display area is used to display the picture from the acquisition device;

[0010] An adjustment module is used to respond to an adjustment operation on the screen display area. If the area ratio of the screen display area meets the adjustment conditions, the area ratio is adjusted and the screen display ratio of the screen is kept unchanged; the area ratio is used to indicate the ratio of the screen display area in the display interface; the screen display ratio is used to indicate the display ratio of the screen itself.

[0011] In a third aspect, the present application further provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0012] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which implements the steps of the above method when executed by a processor.

[0013] In a fifth aspect, the present application further provides a computer program product, which includes a computer program that implements the steps of the above method when executed by a processor.

[0014] In the above-mentioned image processing method, device, electronic device, storage medium and computer program product, the image display area is displayed on the display interface of the target device; the image display area is used to display the image from the acquisition device; in response to the adjustment operation on the image display area, if the area ratio of the image display area meets the adjustment condition, the area ratio is adjusted and the image display ratio of the image is kept unchanged; the area ratio is used to indicate the ratio of the image display area in the display interface; the image display ratio is used to indicate the display ratio of the image itself. In the method provided by the embodiment of the present application, the area ratio of the image display area in the display interface can be flexibly adjusted as needed on the display interface of the target device, so that the user's operation on the display interface is not restricted by the inherent ratio of the image display area. By changing the area ratio of the image display area in the display interface, it is convenient to view and operate the image in the image display area, and it is also convenient to operate other areas of the display interface, thereby improving the convenience of operation on the display interface. At the same time, it will not destroy the display ratio of the image itself in the image display area, and will not cause the image to be stretched and deformed. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 A diagram illustrating an application environment of a picture processing method provided in an embodiment of the present application;

[0017] Figure 2 A flowchart of a method for processing an image provided in an embodiment of the present application;

[0018] Figure 3A schematic diagram of a display interface provided in an embodiment of the present application;

[0019] Figure 4 A schematic diagram of an operation interface corresponding to a real-time mode button provided in an embodiment of the present application;

[0020] Figure 5 A schematic diagram of an operation interface corresponding to a playback mode button provided in an embodiment of the present application;

[0021] Figure 6a A schematic diagram of a trigger adjustment operation provided in an embodiment of the present application;

[0022] Figure 6b A schematic diagram of another trigger adjustment operation provided in an embodiment of the present application;

[0023] Figure 7 A schematic diagram of a flow chart for determining whether the area ratio of a screen display area meets adjustment conditions provided in an embodiment of the present application;

[0024] Figure 8a A schematic diagram of performing a first adjustment operation provided in an embodiment of the present application;

[0025] Figure 8b A schematic diagram of another embodiment of the present application for performing a first adjustment operation;

[0026] Figure 9 A schematic diagram of performing a first return operation provided in an embodiment of the present application;

[0027] Figure 10 A flowchart of another image processing method provided in an embodiment of the present application;

[0028] Figure 11 A schematic diagram of the structure of the image processing device provided in an embodiment of the present application;

[0029] Figure 12 This is a diagram of the internal structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0031] The image processing method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown, this application environment may include cloud / cloud servers, routers, gateways, user terminals (such as mobile phones and tablets), and sub-devices (such as sensors and switches). In this image processing system, sub-devices can connect to the gateway via ZigBee / Bluetooth protocols, and the gateway and user terminals can connect to the router via wireless local area network (WiFi). User terminals can also establish a network connection with the cloud / cloud server via second-generation mobile communication technology (2G), third-generation mobile communication technology (3G), fourth-generation mobile communication technology (4G), fifth-generation mobile communication technology (5G), WiFi, etc., thereby obtaining data sent by the cloud / cloud server.

[0032] The user terminal may be installed with an application (APP), which includes an add interface where users can add at least one gateway. Users can also add sub-devices, such as sensors, switches, and cameras, by clicking the Add Sub-Device button on the add interface. Furthermore, users can select the gateway to which the sub-device should connect on the add interface, adding the sub-device to the ZIGBEE network corresponding to the gateway. This sub-device, along with the other added sub-devices and gateway, forms a ZIGBEE local area network. When the APP, router, and gateway are in the same local area network, the APP can interact with the gateway and sub-devices connected to the gateway via the local area network (LAN) path. When the APP, router, and gateway are not in the same local area network, the APP interacts with the gateway and sub-devices connected to the gateway via the wide area network (WAN) path.

[0033] Sub-devices in the space, such as sensors, switches, and cameras, can capture images or videos of the corresponding space in real time and send the captured images or videos to the user terminal, i.e., the target device;

[0034] The user terminal can display a screen display area on the display interface of the application, and the screen display area is used to display the screen from the sub-device (i.e., the acquisition device, such as a camera); the user can trigger an adjustment operation for the screen display area on the display interface, and the user terminal can respond to the adjustment operation for the screen display area, and can determine whether the area ratio of the screen display area meets the adjustment conditions. If the area ratio meets the adjustment conditions, the area ratio of the screen display area is adjusted, and the screen display ratio of the screen is kept unchanged; the area ratio is used to indicate the ratio of the screen display area in the display interface; the screen display ratio is used to indicate the display ratio of the screen itself.

[0035] User terminals include, but are not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices include smart speakers, smart TVs, smart air conditioners, smart car devices, and projectors. Portable wearable devices include smart watches, smart bracelets, and head-mounted devices. Head-mounted devices can include virtual reality (VR) devices, augmented reality (AR) devices, and smart glasses. Cloud / cloud servers can be independent physical servers, server clusters or distributed systems composed of multiple physical servers, or cloud servers providing cloud computing services.

[0036] In an exemplary embodiment, Figure 2 As shown, a method for image processing is provided. This embodiment uses the method applied to a user terminal as an example for illustration. It is understandable that the method can also be applied to a server, or to a system including a terminal and a server, and implemented through interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0037] Step 202: Display the image display area on the display interface of the target device. The image display area is used to display the image from the acquisition device.

[0038] The target device may be a user terminal, such as a mobile phone, tablet computer, etc. An application may be installed on the target device, such as a monitoring APP. The user may register a user account to log in to the application on the target device. Furthermore, the user may trigger a login request on the target device. The user terminal may respond to the login request by displaying a login interface for the application. The user terminal may enter a user name and password on the login interface to log in. If the user logs in successfully, the display interface of the application may be displayed on the target device. Figure 3As shown, the display interface can display a screen display area. This screen display area can be used to display images from a capture device (e.g., a camera). The screen can display images and / or videos captured by the camera in real time, such as a view of a living room in a space. The screen display area can include a video function bar. This video function bar can include at least one video function button. This at least one video function button can include inherent camera functions of the capture device (e.g., a camera), such as privacy, screenshot, record, call, and pause / play. In addition, the application's display interface can also display a functional area. The sum of the screen display area's proportion in the display interface (i.e., the screen display area's area proportion) and the functional area proportion of the functional area remains unchanged. This functional area proportion indicates the proportion of the functional area in the display interface. The functional area can include a function bar. This function bar can include at least one function implementation button. This at least one function implementation button can include commonly used functions of the application, such as a live mode button (Live), a playback mode button (History), a message button (Message), and a service button (Service). The real-time mode button may include at least one real-time operation function button, such as a smart reply button Smart Responses, an album button Albums, a time-lapse video button Time-Lapse Video, an associated device button associated device, a facial recognition button Facial recognition, a parcel recognition button parcel, and a pet recognition button cat and dog, etc. The at least one real-time operation function button may be used to adjust the acquisition operation of the acquisition device, and may also be used to adjust and process the image displayed in the image display area. Figure 4 As shown, triggering the real-time mode button can display the at least one real-time operation function button in the function area of the display interface, and can display the real-time shooting picture of the acquisition device (such as a camera) in the picture display area of the display interface. Figure 5 As shown, by triggering the playback mode button History, the spatial state information of the target space during the historical time period can be displayed in the function area in the form of a timeline, such as human activity information (a baby crying was detected at 23:30:00, human activity was detected in the living room at 21:41:00, etc.), and the shooting images of the acquisition device during the historical time period can be displayed in the image display area.

[0039] In step 204, in response to the adjustment operation on the screen display area, if the area ratio of the screen display area meets the adjustment conditions, the area ratio is adjusted while maintaining the screen display ratio of the screen unchanged. The area ratio indicates the ratio of the screen display area in the display interface; the screen display ratio indicates the display ratio of the screen itself.

[0040] In this step, the user can trigger an adjustment operation for the screen display area on the display page of the application. The adjustment operation is used to instruct the user terminal (i.e., the target device) to adjust the area ratio of the screen display area on the display interface; the area ratio is used to indicate the ratio of the screen display area in the display interface. In response to the adjustment operation for the screen display area, the target device can obtain the current area ratio of the screen display area and determine whether the current area ratio meets the adjustment conditions. If the area ratio of the screen display area meets the adjustment conditions, the area ratio of the screen display area is adjusted. In the process of adjusting the area ratio of the screen display area, the relative ratio of the screen and the screen display area will also change, but the screen display ratio of the screen itself will remain unchanged. The screen display ratio is used to indicate the display ratio of the screen itself, for example, it can be the width-to-height ratio of the screen itself.

[0041] Regarding the operation mode of the user triggering the adjustment operation on the screen display area on the display interface, in a possible implementation mode, as shown in FIG. Figure 6a and Figure 6b As shown, the user can adjust the area ratio of the screen display area by sliding the video function bar on the display interface. The sliding can be in the up and down direction or in the left and right direction. Upward sliding and / or left sliding can be set to reduce the area ratio of the screen display area. Conversely, downward sliding and / or right sliding can be set to increase the area ratio of the screen display area. Among them, when reducing the area ratio of the screen display area, if the total area size of the display interface does not change, the functional area ratio of the functional area of the display interface increases accordingly. When increasing the area ratio of the screen display area, if the total area size of the display interface does not change, the functional area ratio of the functional area of the display interface can be reduced accordingly. The adjustment condition can be used to determine whether the current area ratio of the screen display area can be adjusted. If the area ratio of the screen display area meets the adjustment condition, the area ratio of the screen display area is adjusted, and the screen display ratio of the screen and the integrity of the screen are maintained unchanged. The screen display ratio can be determined according to the display ratio of the acquisition device that acquires the screen. The display ratios of different acquisition devices may be different. As an example, the display ratio may include 16:9, 4:3, 1:1, etc. Correspondingly, the screen display ratio may include 16:9, 4:3, 1:1, etc. For example, if the inherent display ratio of the screen captured by the acquisition device is 4:3, then when the acquisition device sends the captured screen to the target device for display, the screen display ratio of the screen displayed on the display interface of the target device is also 4:3, and when the area ratio of the screen display area is adjusted, the screen display ratio of the screen is maintained unchanged at 4:3.

[0042] In the method of this embodiment, a picture display area is displayed on the display interface of the target device; the picture display area is used to display the picture from the acquisition device; in response to the adjustment operation on the picture display area, if the area ratio of the picture display area meets the adjustment conditions, the area ratio is adjusted, and the picture display ratio of the picture is kept unchanged; the area ratio is used to indicate the ratio of the picture display area in the display interface; the picture display ratio is used to indicate the display ratio of the picture itself. In the method provided by the embodiment of the present application, the area ratio of the picture display area in the display interface can be flexibly adjusted as needed on the display interface of the target device, so that the user's operation on the display interface is not restricted by the inherent ratio of the picture display area. By changing the area ratio of the picture display area in the display interface, it is convenient to view and operate the picture in the picture display area, and it is also convenient to operate other areas of the display interface, thereby improving the convenience of operation on the display interface. At the same time, it will not destroy the display ratio of the picture itself in the picture display area, and will not cause the picture to be stretched and deformed.

[0043] In an exemplary embodiment, Figure 7 As shown, if the area ratio of the screen display area meets the adjustment condition in step 204, steps 702 to 704 may be further included before adjusting the area ratio.

[0044] Step 702 : In response to the adjustment operation on the screen display area, obtain the current area ratio of the screen display area.

[0045] In response to the adjustment operation on the screen display area, the target device may obtain the current area ratio of the screen display area.

[0046] Step 704: If the current area ratio is the original area ratio and is different from the target area ratio, or if the current area ratio is the adjusted area ratio, it is determined that the current area ratio meets the adjustment condition.

[0047] The original area ratio is the area ratio of the screen display area in its original state without adjustment. The target area ratio may be the area ratio of the screen display area when a screen with a specific screen display ratio fills the screen display area. The specific screen display ratio may be 16:9.

[0048] In one possible implementation, if the original area ratio of the screen display area is the same as the target area ratio, it indicates that the current area ratio of the screen display area does not meet the adjustment condition. In this case, the current area ratio of the screen display area can be maintained. If the original area ratio of the screen display area is different from the target area ratio, it indicates that the current area ratio of the screen display area meets the adjustment condition. In this case, the current area ratio of the screen display area can be adjusted. In another possible implementation, if the current area ratio of the screen display area is the adjusted area ratio, it indicates that the current area ratio of the screen display area meets the adjustment condition. In this case, the current area ratio of the screen display area can be adjusted. For example, if the target area ratio is the area ratio that can cover a screen with a 16:9 aspect ratio, and the current area ratio of the screen display area is the original area ratio (the original area ratio can be, for example, the area ratio that can cover a screen with a 4:3 aspect ratio or the area ratio that can cover a screen with a 1:1 aspect ratio), then in response to an adjustment operation on the screen display area, the current area ratio of the screen display area can be adjusted to the target area ratio. If the current area ratio of the screen display area is the adjusted area ratio, the current area ratio of the screen display area may also be adjusted to the original area ratio.

[0049] In the method of this embodiment, a specific screen display ratio can be pre-set and the target area ratio can be set according to the specific screen display ratio. The original area ratio and the target area ratio of the screen display area can be used to determine whether the current area ratio of the screen display area meets the adjustment conditions. Then, the area ratio can be adjusted accordingly, which can improve the flexibility and simplicity of the area ratio adjustment.

[0050] In an exemplary embodiment, after obtaining the current area ratio of the screen display area in step 702, the following steps may also be included:

[0051] If the current regional proportion is the original regional proportion and is the same as the target regional proportion, it is determined that the current regional proportion does not meet the adjustment condition.

[0052] Among them, if the original area ratio of the screen display area is the same as the target area ratio, it indicates that the current area ratio of the screen display area does not meet the adjustment condition. In this case, the current area ratio of the screen display area can be maintained. For example, if the original area ratio of the screen display area is the area ratio of the screen that is fully covered with a 16:9 screen display ratio, and the target area ratio is also the area ratio of the screen that is fully covered with a 16:9 screen display ratio, the current area ratio of the screen display area can be maintained as the original area ratio.

[0053] Among them, we can discuss them according to different situations. If the original area ratio of the screen display area is the same as the target area ratio, there is no need to adjust the current area ratio of the screen display area, which can improve the diversity, flexibility and simplicity of area ratio adjustment.

[0054] In an exemplary embodiment, in response to the adjustment operation on the screen display area in step 204, if the area ratio of the screen display area meets the adjustment condition, adjusting the area ratio may include:

[0055] The adjustment operation includes a first adjustment operation for reducing the area ratio. In response to the first adjustment operation, if the current area ratio is greater than the target area ratio, the current area ratio is reduced to the target area ratio. Alternatively, the adjustment operation includes a second adjustment operation for increasing the area ratio. In response to the second adjustment operation, if the current area ratio is the target area ratio, the current area ratio is increased to the original area ratio.

[0056] The first adjustment operation can be that the user slides up on the video function bar; the first adjustment operation can be used to reduce the current area ratio of the screen display area, and correspondingly, the second adjustment operation can increase the current area ratio of the screen display area. Figure 8a and Figure 8b As shown, the current area ratio of the screen display area can be, for example, the area ratio of a screen covering a 4:3 screen display ratio, or the area ratio of a screen covering a 1:1 screen display ratio. The current area ratio can also be the original area ratio of the screen display area, and the target area ratio can be the area ratio of a screen covering a 16:9 screen display ratio. At this time, the current area ratio is greater than the target area ratio, and the current area ratio can be reduced to the target area ratio. During the sliding process, the current area ratio of the screen display area continues to shrink until it reaches the target area ratio. If the user stops sliding, the current area ratio of the screen display area can be automatically converted to the target area ratio. In this process, the non-screen area in the screen display area can be filled with background, such as filling color, and the color can be black. The non-screen area is the area other than the screen in the screen display area.

[0057] The second adjustment operation may be that the user slides down on the video function bar, and the second adjustment operation may be used to increase the area ratio of the screen display area. For example, the current area ratio is the target area ratio (the area ratio of the screen that covers a 16:9 screen display ratio), and the current area ratio may be the adjusted area ratio, for example, it may be adjusted from the area ratio of the screen that covers a 4:3 screen display ratio (which may be the original area ratio) to the target area ratio. At this time, the user slides down on the video function bar to increase the current area ratio of the screen display area to its original area ratio. In this process, the current area ratio of the screen display area is continuously increasing and can be increased to the original area ratio of the screen display area.

[0058] In the method of this embodiment, the area ratio of the screen display area can be flexibly adjusted on the display interface of the target device, which can improve the flexibility and simplicity of screen adjustment.

[0059] In an exemplary embodiment, after adjusting the area ratio as described above, the following steps may also be performed:

[0060] In response to a first return operation or a second return operation on the screen display area, the area ratio of the screen display area is restored to the original area ratio, or the area ratio is restored to the target area ratio. The first return operation is the inverse operation of the first adjustment operation, and the second return operation is the inverse operation of the second adjustment operation.

[0061] Among them, the first return operation is the reverse operation of the first adjustment operation, and the second return operation is the reverse operation of the second adjustment operation. The first return operation and the second return operation can be used to restore the area ratio of the screen display area to the original area ratio and restore the area ratio of the screen display area to the target area ratio. In response to the first return operation on the screen display area, the first return operation can be the user sliding down and / or right on the video function bar; the first return operation can be used to increase the area ratio of the screen display area. For example, it can be as follows Figure 9 As shown, the current area ratio of the screen display area may be the area ratio of a screen with a full screen display ratio of 16:9 (target area ratio). In this case, the area ratio of the screen display area may be restored from the target area ratio to the original area ratio (e.g., the area ratio of a screen with a full screen display ratio of 4:3). In response to a second return operation on the screen display area, the second return operation may be a user swiping up and / or left on the video function bar; the second return operation may be used to reduce the area ratio of the screen display area, and accordingly, the area ratio of the screen display area may be restored from the original area ratio to the target area ratio.

[0062] In the method of this embodiment, after the area ratio of the screen display area is adjusted to the target area ratio, a return operation can also be triggered to return the area ratio of the screen display area from the target area ratio to the original area ratio of the screen display area, and vice versa, thereby increasing the flexibility and recoverability of the area ratio adjustment.

[0063] In an exemplary embodiment, after reducing the current area ratio to the target area ratio, the following steps may be further performed:

[0064] Background filling is performed on the non-screen area in the screen display area whose area ratio is the target area ratio; the non-screen area is the area other than the screen in the screen display area.

[0065] In this embodiment, the adjustment operation may include a first adjustment operation; the first adjustment operation may be used to reduce the area ratio of the screen display area. During this process, the area ratio of the screen display area is continuously reduced, wherein the vertical size of the screen display area may be reduced while the horizontal size remains unchanged, and its horizontal size may be consistent with the horizontal size of the display interface. Under the original area ratio, the screen covers the entire screen display area, the horizontal size of the screen is consistent with the horizontal size of the screen display area, and the vertical size of the screen is consistent with the vertical size of the screen display area. In the process of adjusting the area ratio through the first adjustment operation, as the screen display area is reduced, the overall screen displayed in the screen display area will also be reduced, but the screen display ratio of the screen remains unchanged, so there will be a non-screen area in the screen display area, and the non-screen area is the area other than the screen in the screen display area. In this case, the background of the non-screen area can be filled, such as color filling, etc. The non-screen area of the screen display area can be filled with black, etc.

[0066] In the method of this embodiment, during the process of adjusting the area ratio of the screen display area, the non-screen area of the screen display area can be simultaneously filled with color, thereby ensuring the coordination of the screen.

[0067] In an exemplary embodiment, the display interface also displays functional areas, and the above method may further include the following steps: adjusting the functional area ratio of the functional area according to the change of the area ratio of the screen display area; the functional area ratio is used to indicate the ratio of the functional area in the display interface; the sum of the area ratio of the screen display area and the functional area ratio remains unchanged.

[0068] The display interface of the application can also display functional areas, and the sum of the area ratio of the display area of the screen and the functional area ratio of the functional area remains unchanged.

[0069] In the method of this embodiment, the area ratio of the screen display area can be flexibly adjusted on the display interface of the target device. As a result, the functional area ratio of the functional area for processing images or videos in the same display interface can also be changed accordingly, which can improve the flexibility and simplicity of screen adjustment. If the area ratio of the screen display area is too large, the functional area ratio of the functional area can be increased by reducing the area ratio of the screen display area, which facilitates the subsequent processing of images or videos and improves the simplicity and efficiency of image processing.

[0070] In an exemplary embodiment, the function area includes a function implementation button, and the above method further includes the following steps: in response to a selection operation on the function implementation button, displaying function operation information corresponding to the function implementation button in the screen display area and / or the function area.

[0071] The function area may include a function bar, and the function bar may include at least one function implementation button. The function operation information refers to the relevant information displayed in the screen display area and / or the function area after the selection operation for the function implementation button is triggered. The at least one function implementation button may include common functions of the application, such as the real-time mode button Live, the playback mode button History, the information button Message, the service button Service, etc. The real-time mode button may include at least one real-time operation function button, such as the smart reply button Smart Responses, the album button Albums, the time-lapse video button Time-Lapse Video, the associated device button associated device, the facial recognition button Facial recognition, the package recognition button parcel, and the pet recognition button cat and dog, etc. The at least one real-time operation function button can be used to adjust the acquisition operation of the acquisition device camera, and can also be used to adjust and process the picture displayed in the screen display area; such as Figure 3 As shown, triggering the real-time mode button can display the at least one real-time operation function button (a type of function operation information) in the function area of the display interface, and can display the real-time shooting picture of the acquisition device (a type of function operation information) in the picture display area of the display interface; as shown Figure 4 As shown, by triggering the playback mode button History, the spatial state information of the target space in the historical time period (a type of functional operation information) can be displayed in the function area in the form of a timeline, such as human activity information (for example, a baby crying was detected at 23:30:00, and human activity was detected in the living room at 21:41:00), and the shooting images of the acquisition device in the historical time period (a type of functional operation information) can be displayed in the image display area.

[0072] In the method of this embodiment, the display interface of the application may include function implementation buttons to facilitate multi-functional operations on image acquisition and image processing, thereby improving the simplicity and efficiency of image processing.

[0073] In another exemplary embodiment, Figure 10 As shown, a picture processing method is provided, which may include:

[0074] Step 1002: Display the image display area on the display interface of the target device. The image display area is used to display the image from the acquisition device.

[0075] The application's display interface is divided into two core areas: the "video screen area," which is the screen display area, and the "function area," which is the functional area. The display interface can display the screen display area, which can be used to display images from a capture device (e.g., a camera). The screen can display images and / or videos captured by the camera in real time, such as a living room scene. Additionally, the application's display interface can also display the functional area. The sum of the screen display area's area ratio and the functional area ratio of the functional area remains unchanged.

[0076] Step 1004 : In response to the first adjustment operation on the screen display area, obtain the current area ratio of the screen display area.

[0077] The screen display ratio of the screen display area is displayed in different ratios (16:9, 4:3, 1:1) depending on the device type of the acquisition device; (1) This ratio is determined by the camera, and each device has a fixed ratio; (2) The video ratio will be uploaded to the cloud along with the video content. The app only reads and displays this data through the cloud and does not change its actual ratio; (3) Currently, mainstream cameras only support 16:9, 1:1, and 4:3. Users can "slide" to enlarge or reduce the area ratio of the screen display area. When the original area ratio of the screen display area is the target area ratio (such as the area ratio of the screen that covers the entire 16:9 screen display ratio), the screen can be fixed and will not change.

[0078] Step 1006: If the current area ratio of the screen display area is the original area ratio and is greater than the target area ratio, the area ratio of the screen display area is reduced to the target area ratio, the screen display ratio of the screen is kept unchanged, and the functional area ratio is increased.

[0079] Among them, when the original area ratio is not the target area ratio of the screen that covers the entire 16:9 screen display ratio, you can press and hold the "Video Function Bar" and slide it upwards. The area ratio of the screen display area can be reduced to the target area ratio. In the process of reducing to the target area ratio, the non-screen area in the screen display area where there is no picture can be automatically filled with black. When the area ratio of the screen display area is reduced to the target area ratio, the picture will no longer change automatically. If the user lets go during the sliding process, the area ratio of the screen display area can automatically return to the target area ratio.

[0080] Step 1008, in response to the second adjustment operation, obtain the current area ratio of the screen display area. If the current area ratio is the target area ratio, increase the current area ratio to the original area ratio, keep the screen display ratio unchanged, and reduce the functional area ratio.

[0081] In the method provided in the embodiment of the present application, the area ratio of the screen display area can be flexibly adjusted in the display interface of the target device, and the functional area ratio of the functional area for processing images or videos in the same display interface can also be changed accordingly, which can improve the flexibility and simplicity of screen adjustment. If the area ratio of the screen display area is too large, the area ratio of the screen display area can be reduced and the functional area ratio of the functional area can be increased to facilitate subsequent processing of images or videos, thereby improving the simplicity and efficiency of image processing. At the same time, it will not destroy the display ratio of the screen itself in the screen display area, and will not cause the screen to be stretched and deformed.

[0082] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0083] Based on the same inventive concept, embodiments of the present application also provide a picture processing device for implementing the picture processing method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more picture processing device embodiments provided below can be found in the limitations of the picture processing method described above and will not be repeated here.

[0084] In an exemplary embodiment, Figure 11 As shown, a picture processing device is provided, and the device 1100 may include:

[0085] Display module 1101, used to display the picture display area on the display interface of the target device; the picture display area is used to display the picture from the acquisition device;

[0086] Adjustment module 1102 is used to respond to the adjustment operation on the screen display area. If the area ratio of the screen display area meets the adjustment conditions, the area ratio is adjusted and the screen display ratio of the screen is kept unchanged; the area ratio is used to indicate the ratio of the screen display area in the display interface; the screen display ratio is used to indicate the display ratio of the screen itself.

[0087] In an exemplary embodiment, the adjustment module 1102 is also used to obtain the current area ratio of the screen display area in response to the adjustment operation on the screen display area; if the current area ratio is the original area ratio and is different from the target area ratio, or if the current area ratio is the adjusted area ratio, it is determined that the current area ratio meets the adjustment condition.

[0088] In an exemplary embodiment, the adjustment module 1102 is further configured to determine that the current area proportion does not meet the adjustment condition if the current area proportion is the original area proportion and is the same as the target area proportion.

[0089] In an exemplary embodiment, the adjustment operation includes a first adjustment operation; the first adjustment operation is used to reduce the area proportion; the adjustment module 1102 is used to respond to the first adjustment operation, if the current area proportion is greater than the target area proportion, then reduce the current area proportion to the target area proportion; or, the adjustment operation includes a second adjustment operation; the second adjustment operation is used to increase the area proportion; the adjustment module 1102 is used to respond to the second adjustment operation, if the current area proportion is the target area proportion, then increase the current area proportion to the original area proportion.

[0090] In an exemplary embodiment, the adjustment module 1102 is also used to restore the area ratio of the screen display area to the original area ratio, or to restore the area ratio to the target area ratio in response to a first return operation or a second return operation for the screen display area; the first return operation is the inverse operation of the first adjustment operation, and the second return operation is the inverse operation of the second adjustment operation.

[0091] In an exemplary embodiment, the adjustment module 1102 is further configured to perform background filling on a non-screen area in the screen display area whose area ratio is the target area ratio; the non-screen area is an area in the screen display area excluding the screen.

[0092] In an exemplary embodiment, the display interface also displays functional areas, and the adjustment module 1102 is further used to adjust the functional area ratio of the functional area according to the change of the area ratio of the screen display area; the functional area ratio is used to indicate the ratio of the functional area in the display interface; the sum of the area ratio of the screen display area and the functional area ratio remains unchanged.

[0093] In an exemplary embodiment, the functional area includes a function implementation button, and the display module 1101 is also used to display the function operation information corresponding to the function implementation button in the screen display area and / or the functional area in response to a selection operation on the function implementation button.

[0094] Each module in the above-mentioned image processing device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of the processor of the electronic device in hardware form, or can be stored in the memory of the electronic device in software form, so that the processor can call and execute the corresponding operations of each module.

[0095] In an exemplary embodiment, an electronic device is provided. The electronic device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 12As shown. The electronic device includes a processor, memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are connected to the system bus via the input / output interface. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The input / output interface of the electronic device is used to exchange information between the processor and an external device. The communication interface of the electronic device is used to communicate with an external terminal via wired or wireless communication, and the wireless communication can be achieved via Wi-Fi, a mobile cellular network, near field communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a method for image processing. The display unit of the electronic device is used to form a visually visible image, and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the electronic device casing, or an external keyboard, touchpad or mouse.

[0096] Those skilled in the art will understand that Figure 12 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0097] In one embodiment, an electronic device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0098] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0099] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0100] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0101] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the above-mentioned embodiments. In particular, any reference to memory, database, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), data processing logic devices based on quantum computing, and the like.

[0102] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0103] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A picture processing method, characterized in that: The method comprises: Displaying a picture display area on the display interface of the target device; the picture display area is used to display the picture from the acquisition device; In response to the adjustment operation on the screen display area, if the area ratio of the screen display area meets the adjustment conditions, the area ratio is adjusted and the screen display ratio of the screen is kept unchanged; the area ratio is used to indicate the ratio of the screen display area in the display interface; the screen display ratio is used to indicate the display ratio of the screen itself.

2. The method according to claim 1, characterized in that If the area ratio of the screen display area meets the adjustment condition, before adjusting the area ratio, the method further includes: In response to the adjustment operation on the screen display area, obtaining the current area ratio of the screen display area; If the current area proportion is the original area proportion and is different from the target area proportion, or if the current area proportion is the adjusted area proportion, it is determined that the current area proportion meets the adjustment condition.

3. The method according to claim 2, characterized in that After obtaining the current area ratio of the screen display area, the method further includes: If the current area proportion is the original area proportion and is the same as the target area proportion, it is determined that the current area proportion does not meet the adjustment condition.

4. The method according to claim 2, characterized in that The adjustment operation includes a first adjustment operation; the first adjustment operation is used to reduce the area ratio; In response to the adjustment operation on the screen display area, if the area ratio of the screen display area meets the adjustment condition, adjusting the area ratio includes: In response to the first adjustment operation, if the current area proportion is greater than the target area proportion, reducing the current area proportion to the target area proportion; or, The adjustment operation includes a second adjustment operation; the second adjustment operation is used to increase the area ratio; In response to the adjustment operation on the screen display area, if the area ratio of the screen display area meets the adjustment condition, adjusting the area ratio includes: In response to the second adjustment operation, if the current area proportion is the target area proportion, the current area proportion is increased to the original area proportion.

5. The method according to claim 4, characterized in that After adjusting the area ratio, the method further includes: In response to the first return operation or the second return operation for the screen display area, the area ratio of the screen display area is restored to the original area ratio, or the area ratio is restored to the target area ratio; the first return operation is the inverse operation of the first adjustment operation, and the second return operation is the inverse operation of the second adjustment operation.

6. The method according to claim 4, characterized in that After reducing the current area ratio to the target area ratio, the method further includes: Background filling is performed on a non-screen area in the screen display area whose area ratio is the target area ratio; the non-screen area is an area in the screen display area excluding the screen.

7. The method according to any one of claims 1 to 6, characterized in that The display interface further displays a functional area, and the method further includes: According to the change of the area ratio of the screen display area, the functional area ratio of the functional area is adjusted; the functional area ratio is used to indicate the ratio of the functional area in the display interface; the sum of the area ratio of the screen display area and the functional area ratio remains unchanged.

8. The method according to claim 7, characterized in that The function area includes a function implementation button, and the method further includes: In response to a selection operation on the function implementation button, function operation information corresponding to the function implementation button is displayed in the screen display area and / or the function area.

9. A picture processing device, characterized in that: The device comprises: A display module is used to display a picture display area on the display interface of the target device; the picture display area is used to display the picture from the acquisition device; An adjustment module is used to respond to an adjustment operation on the screen display area. If the area ratio of the screen display area meets the adjustment conditions, the area ratio is adjusted and the screen display ratio of the screen is kept unchanged; the area ratio is used to indicate the ratio of the screen display area in the display interface; the screen display ratio is used to indicate the display ratio of the screen itself.

10. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

12. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images