Equipment operation method and device, electronic equipment and computer readable medium

By combining touch events and image detection, the camera application is automatically started, and the problem of cumbersome startup method of mobile phone cameras is solved, achieving rapid startup and reducing the risk of incorrect operation.

CN119211415APending Publication Date: 2024-12-27GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310756493.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-06-25
Publication Date
2024-12-27

AI Technical Summary

Technical Problem

The starting method of existing mobile phone camera applications is too cumbersome. Users need to click on the camera icon, and they need to light up the screen and unlock it in the locked screen state, resulting in cumbersome and time-consuming operation.

Method used

By detecting a first touch event in the first area of ​​the electronic device and the situation where the camera acquires a designated image, the camera application is automatically run, and the preview interface of the camera application is displayed on the screen, simplifying the startup process.

Benefits of technology

It realizes the rapid start of the camera application, reduces the possibility of starting the camera application due to misoperation, saves the steps of opening the system desktop and unlocking the screen, and improves operation efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119211415A_ABST
    Figure CN119211415A_ABST
Patent Text Reader

Abstract

The invention discloses an equipment operation method and device, electronic equipment and a computer readable medium, and relates to the technical field of mobile terminals.The method comprises the steps that when a first touch event acting on a first area of the electronic equipment is detected and it is detected that a camera collects a specified image, the first touch event acts on the first area of the electronic equipment; running a camera application installed in the electronic equipment; and displaying a preview interface corresponding to the camera application on the screen. Therefore, the camera application is started by combining the first touch event with the detection of the specified image, compared with a starting mode of clicking the icon of the camera application, not only can the camera application be quickly started, but also the first touch event and the detection of the specified image are combined to jointly serve as a triggering condition for starting the camera application, so that the starting efficiency of the camera application is improved. The possibility that a camera application is started due to misoperation can be reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of mobile terminal technology, and more specifically, to a device operation method, apparatus, electronic device and computer-readable medium. Background Art

[0002] With the rapid development of smart phones, the camera has become one of the most important configurations in a mobile phone. The camera function of the mobile phone has also developed from the rear camera function to the front camera function, and then evolved into today's multi-camera function, bringing many conveniences to people's lives and subtly changing people's lifestyles.

[0003] However, the current method of starting the camera application of a mobile phone is too complicated. Usually, a user needs to click a camera icon to start the camera. This conventional method is complicated and time-consuming. Summary of the invention

[0004] The present application proposes a device operation method, apparatus, electronic device and computer-readable medium to improve the above-mentioned defects.

[0005] In a first aspect, an embodiment of the present application provides a device operation method, which is applied to an electronic device, wherein the electronic device includes a camera and a screen, and the method includes: when a first touch event acting on a first area of ​​the electronic device is detected and when it is detected that the camera captures a specified image, running a camera application installed in the electronic device; and displaying a preview interface corresponding to the camera application on the screen.

[0006] In a second aspect, an embodiment of the present application further provides a device operating apparatus, which is applied to an electronic device, wherein the electronic device includes a camera and a screen, and the apparatus includes: an operation unit and a display unit. The operation unit is used to operate a camera application installed in the electronic device when a first touch event acting on a first area of ​​the electronic device is detected and the camera captures a specified image. The display unit is used to display a preview interface corresponding to the camera application on the screen.

[0007] In a third aspect, an embodiment of the present application also provides an electronic device, comprising: one or more processors; a memory; a camera and a screen; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the above method.

[0008] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the above method.

[0009] The device operation method, apparatus, electronic device and computer-readable medium provided in the present application, when a first touch event acting on a first area of ​​the electronic device is detected and a designated image is captured by the camera, runs a camera application installed in the electronic device; and displays a preview interface corresponding to the camera application on the screen. Therefore, by starting the camera application by combining the first touch event in the first area with the detection of the designated image, not only can the camera application be started quickly, compared to the startup method by clicking the camera application icon, but also, by combining the first touch event and the detection of the designated image as a trigger condition for starting the camera application, the possibility of starting the camera application due to misoperation can be reduced.

[0010] Other features and advantages of the embodiments of the present application will be described in the subsequent description, and partly become apparent from the description, or can be understood by practicing the embodiments of the present application. The purposes and other advantages of the embodiments of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0012] Figure 1 A schematic diagram of the structure of a straight-bar mobile phone provided in an embodiment of the present application is shown;

[0013] Figure 2 A schematic diagram of the structure of a foldable screen mobile phone provided in an embodiment of the present application is shown;

[0014] Figure 3 A schematic diagram showing an electronic device provided by an embodiment of the present application in an unfolded state is shown;

[0015] Figure 4 A method flow chart of a device operation method provided by an embodiment of the present application is shown;

[0016] Figure 5 A method flow chart showing a device operation method provided by another embodiment of the present application is shown;

[0017] Figure 6 A schematic diagram showing acceleration in three dimensions provided by an embodiment of the present application is shown;

[0018] Figure 7 A schematic diagram showing a first direction and a second direction provided by an embodiment of the present application is shown;

[0019] Figure 8 A schematic diagram showing a side frame of an electronic device provided by an embodiment of the present application is shown;

[0020] Fig. 9 A schematic diagram showing changes in acceleration values ​​in three dimensions provided by an embodiment of the present application is shown;

[0021] Fig.10 A schematic diagram showing changes in acceleration values ​​in three dimensions provided by another embodiment of the present application is shown;

[0022] Fig.11 A method flow chart showing a device operation method provided by another embodiment of the present application is shown;

[0023] Fig.12 Shows Fig.11 A schematic diagram of an implementation of step S1110;

[0024] Fig.13 A method flow chart showing a device operation method provided by yet another embodiment of the present application is shown;

[0025] Fig.14 A module block diagram of a device operating apparatus provided by an embodiment of the present application is shown;

[0026] Fig.15 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0027] Fig.16 A storage unit for storing or carrying program codes for implementing a device operating method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0028] In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0029] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0030] With the rapid development of smart phones, the camera has become one of the most important configurations in a mobile phone. The camera function of mobile phones has also developed from the rear camera function to the front camera function, and then evolved into today's multi-camera function, which has brought many conveniences to people's lives and subtly changed people's lifestyles. Usually, a smart phone includes a camera and a screen. The camera is used to capture images, and the screen is used to display the captured images or display the preview of the camera on the screen when the camera application of the mobile phone is running.

[0031] For example, the smart phone may be a straight-screen phone 10, such as Figure 1 As shown, the smart phone may include a front camera 102, a rear camera 103 and a display screen 101, wherein the front camera 102 and the display screen 101 are arranged on the same side of the smart phone, and the rear camera 103 is arranged on the back cover of the smart phone.

[0032] For example, Figure 2 As shown, the smart phone can be a folding screen mobile phone 20, which can include a foldable housing assembly 210, a flexible display screen 220 and an electronic component (not shown in the figure), the electronic component is arranged in the foldable housing assembly 210, and the flexible display screen 220 is laid on the foldable housing assembly 210. The foldable housing assembly 210 is used to carry the flexible display screen 220 and protect the electronic component. The electronic component can include, but is not limited to, a central processing unit, a memory, a camera, a receiver, a fingerprint module, etc., and the specific electronic component may not be limited in the embodiment of the present application.

[0033] The foldable housing assembly 210 includes a first housing 211, a second housing 212 and a hinge mechanism 213, wherein the first housing 211 and the second housing 212 are respectively connected to the two sides of the hinge mechanism 213. The second housing 212 can be folded or unfolded relative to the first housing 211 through the hinge mechanism 213, so that the foldable housing assembly 210 drives the flexible display screen 220 to fold or unfold. When the foldable housing assembly 210 and the flexible display screen 220 are in a folded state, the volume of the foldable screen mobile phone 20 is relatively small, which is convenient for storage and carrying. When the foldable housing assembly 210 and the flexible display screen 220 are in an unfolded state, the volume of the foldable screen mobile phone 20 is relatively large, which is convenient for displaying information.

[0034] For example, Figure 2The foldable screen mobile phone shown is an inner foldable screen, that is, assuming that the foldable shell assembly 210 includes a front surface and a rear surface, that is, the first shell 211 and the second shell 212 both include a front surface and a rear surface, and the flexible display screen 220 is arranged on the front surface of the foldable shell assembly 210, that is, the first display portion of the flexible display screen 220 is arranged on the front surface of the first shell 211, and the second display portion of the flexible display screen 220 is arranged on the front surface of the second shell 212. For details, please refer to Figure 3 In this embodiment, the flexible display screen 220 includes a first display portion 221 connected to the first housing 211 and a second display portion 222 connected to the second housing 212. The first display portion 221 and the second display portion 222 are folded or unfolded relative to the first housing 211 and the second housing 212, respectively. In some embodiments, the first display portion 221 and the second display portion 222 may be an integral structure, so that the flexible display screen 220 is a whole-piece flexible display screen; or, in some other embodiments, the first display portion 221 and the second display portion 222 may be non-flexible parts, and the first display portion 221 and the second display portion 222 are folded or unfolded relative to each other through the hinge mechanism 213. In this embodiment, when the first housing 211 and the second housing 212 are in a superimposed state, the first display portion 221 and the second display portion 222 are close to or even partially attached to each other, so that the folding screen mobile phone 20 presents a structure of an inner folding screen, that is, the flexible display screen 220 at this time serves as the internal display of the folding screen mobile phone 20, and the user does not use the flexible display screen 220 at this time.

[0035] It should be noted that if Figure 2 As shown, the folding screen mobile phone 20 also includes a secondary screen 230, which is arranged on at least one of the rear surface of the first shell 211 or the rear surface of the second shell 212, and the rear surface can be regarded as the back cover of the first shell 211 or the second shell 212. Exemplarily, the secondary screen 230 is arranged on the rear surface of the first shell 211. In addition, the first volume key 241 and the second volume key 242 of the electronic device are arranged on the side of the first shell 211. The first shell 211 includes a first side edge 214, and the second shell 212 includes a second side edge 215. The first side edge 214 and the second side edge 215 are separated on both sides of the hinge mechanism 213. When the electronic device is converted from the unfolded state to the folded state, the first side edge 214 and the second side edge 215 gradually approach each other. When the electronic device is fully folded, the first side edge 214 and the second side edge 215 can fit together.

[0036] Exemplarily, the rear surface of the first shell is provided with an image acquisition component of the folding screen mobile phone 20, which may include components such as a front camera, a rear camera, and a flash. The sub-screen 230 and the rear camera are both provided on the rear surface of the first shell 211, so that when the electronic device is in a folded state, the user can use the sub-screen 230 and the rear camera.

[0037] However, the inventors found in their research that the current method of starting the camera application of mobile phones is too cumbersome. Usually, users need to turn on the screen first, then unlock the screen, and then click the camera icon to start the camera. This conventional method is cumbersome and time-consuming.

[0038] Therefore, in order to overcome the above defects, the present application embodiment provides a device operation method, which can quickly start the camera application through an operation gesture. Figure 4 , Figure 4 The device operation method provided by an embodiment of the present application is shown, and the method is applied to an electronic device, and the electronic device may be the above-mentioned straight-screen mobile phone, folding screen mobile phone or other smart phone, and the electronic device may include a camera and a screen. Specifically, the method may include: S401 to S402.

[0039] S401: When a first touch event acting on a first area of ​​the electronic device is detected and a designated image is captured by the camera, a camera application installed in the electronic device is run.

[0040] As an implementation mode, the first touch event may be a single-click operation, a continuous click operation, a long-press operation or a sliding operation, and the area used for the first touch event is the first area of ​​the electronic device, wherein the continuous click operation may be a double-click or a multiple continuous click, and the number of continuous clicks of the multiple continuous clicks is greater than 2, and there is no limitation on this. It should be noted that the detection of the first touch event indicated in the embodiment of the present application refers to detecting whether there is a first touch event in the first area of ​​the electronic device, that is, the first touch event acts on the first area of ​​the electronic device, and the first area may be a touch screen of the electronic device, that is, a screen. In addition, the first area may also be an area of ​​a physical button of the electronic device (such as the aforementioned volume button), and further, the first area may also be an area that is neither a screen area nor a physical button, for example, the first area may be a side area or a back cover area of ​​the electronic device, for example, the side area may be the aforementioned first side 214 and second side 215. If the area of ​​the electronic device on which the first touch event acts is different, then the way in which the electronic device detects the first touch event is also different, which will be specifically described in the subsequent embodiments.

[0041] As an implementation method, the implementation method of detecting whether the camera has captured a specified image is to obtain an initial image captured by the camera and determine whether the initial image contains the specified image, for example, by using a face detection network or a deep learning neural network to determine whether the initial image contains the specified image. After determining that the specified image exists in the initial image, it can be determined that the camera has captured the specified image.

[0042] In an embodiment of the present application, detecting a first touch event acting on a first area of ​​the electronic device and detecting that the camera has captured a designated image are used together as trigger conditions for running a camera application installed in the electronic device. It is understandable that the images captured by the user using the camera of the electronic device may include multiple types, such as landscape type images, pet type images, character type images, or food type images, etc. Therefore, the designated image may be a landscape image, a pet image, a face image, or a food image, etc., and the designated image is set to different types of images based on actual usage requirements. For example, in order to be able to quickly capture landscape images, the designated image can be set as a landscape image. Exemplarily, the user can set the type of the designated image in the electronic device so as to set the trigger condition for the rapid capture of the corresponding type of image according to their own needs.

[0043] In an embodiment of the present application, the device operation method can be applied to person photography. If the designated image is a face image, the detection of a first touch event acting on a first area of ​​the electronic device (which can be named the first condition) and the detection of the camera capturing the designated image (which can be named the second condition) can serve as the starting conditions for the user to quickly use the electronic device to photograph a person.

[0044] It should be noted that the first condition and the second condition are used together as trigger conditions for running the camera application installed in the electronic device. The detection order of the first condition and the second condition may not be limited. That is, it is possible to determine whether the second condition is met when the first condition is met. That is, when the first touch event acting on the first area of ​​the electronic device is detected and the camera is detected to collect a specified image, the implementation method of running the camera application installed in the electronic device is to detect the first touch event acting on the first area of ​​the electronic device, and when the first touch event is detected, start the camera of the electronic device to detect whether the image collected by the camera contains the specified image. If the specified image exists, it is determined that the first touch event acting on the first area of ​​the electronic device is detected and the camera is detected to collect the specified image, and then run the camera application installed in the electronic device. That is, when it is determined that the first touch event is detected, the camera is started to collect images and verify whether the specified image exists. Since the power consumption of the camera's image collection operation and the specified image recognition operation is high, that is, higher than the power consumption of detecting the first touch event of the first area, the power consumption of the electronic device can be reduced by starting the camera to collect images after determining that the first touch event of the first area is detected.

[0045] Of course, it is also possible to determine whether the first condition is met when the second condition is met. That is, when a first touch event acting on the first area of ​​the electronic device is detected and the camera captures a specified image, the implementation method of running the camera application installed in the electronic device is to detect whether the image captured by the camera contains the specified image, and if the specified image exists, detect the first touch event acting on the first area of ​​the electronic device, and if the first touch event is detected, it is determined that the camera application installed in the electronic device is run when the first touch event acting on the electronic device is detected and the camera captures the specified image.

[0046] It can be understood that no matter whether the first condition or the second condition is detected first, both can be used as trigger conditions for starting the camera application. In the embodiment of the present application, based on power consumption considerations, the first condition is detected first, and then the second condition is detected when the first condition is met. The specific conditions are not limited here.

[0047] S402: Displaying a preview interface corresponding to the camera application on the screen.

[0048] The preview interface is the interface of the camera application. When the camera application is running, the preview interface is used to display the image captured by the camera. The user can input a shutter operation in the preview interface to trigger the camera of the electronic device to perform an image capture operation, and the camera application saves the captured image. Through the preview interface, the user can operate the camera application to complete the image capture operation.

[0049] It should be noted that the camera can be a camera set on the same side as the screen, or a camera set on a different side from the screen. If the camera and the screen are set on different sides, the application scenario of the device operation method is a mode of photographing other users, that is, the user uses the electronic device to photograph other users. If the electronic device is the aforementioned straight-screen mobile phone, then the camera can be a rear camera. If the electronic device is the aforementioned folding screen mobile phone, then the camera can be a rear camera, and the screen can be the aforementioned flexible display 220. In this scenario, the user holds the electronic device, the camera of the electronic device is facing the subject, and the screen of the electronic device is facing the user. Then, the user inputs a first touch event in the first area of ​​the electronic device, and the electronic device detects that the image captured by the camera includes a face image, that is, the face of the subject, so that the camera application of the electronic device can be quickly opened and a preview interface can be displayed on the screen. If the camera and the screen are set on the same side, the application scenario of the device operation method is the selfie mode. Assuming that the electronic device is the aforementioned straight-screen mobile phone, the camera can be the front camera. If the electronic device is the aforementioned folding-screen mobile phone, the camera can be the rear camera, and the screen can be the aforementioned sub-screen 230. In this scenario, the user holds the electronic device, the camera and the screen of the electronic device are facing the user, the user inputs a first touch event in the first area of ​​the electronic device, and the electronic device detects that the image captured by the camera includes a facial image, that is, the user's face, so that the camera application of the electronic device can be quickly opened and a preview interface is displayed on the screen.

[0050] Therefore, it can be seen that the device operation method can be applied to the mode of photographing other users, and can also be applied to the selfie mode. The electronic device can be the aforementioned candy-bar mobile phone, or a folding screen mobile phone. The designated image can be a face image, or other types of images, which are not limited here.

[0051] It should be noted that, in the prior art, the way to start the camera is usually to find the camera application icon on the screen of the electronic device and click on the camera application icon to start it. If the user is using an electronic device, for example, operating other applications or browsing other content, and needs to start the camera at this time, it is necessary to exit the application or the browsing interface, return to the system desktop, find the camera application icon on the system desktop and then click on the camera application icon. Even when the electronic device is locked, the user needs to light up the screen, unlock the electronic device, open the system desktop, find the camera application icon on the system desktop, and start the camera application by clicking on the icon. Regardless of the aforementioned method, the user needs to control the electronic device to display the system desktop through a series of operations, and find the camera application icon and click on the icon. This operation method is relatively cumbersome, and even when the user is using the electronic device to run applications other than the camera application or the electronic device is locked, the operation of starting the camera application is more cumbersome.

[0052] Therefore, the method provided in the embodiment of the present application runs the camera application installed in the electronic device when the first touch event acting on the first area of ​​the electronic device is detected and the camera captures the specified image; and displays the preview interface corresponding to the camera application on the screen. Therefore, by combining the first touch event in the first area and the detection of the specified image to start the camera application, compared with the startup method by clicking the camera application icon, not only the cumbersome operation of opening the system desktop and finding the camera application icon among multiple icons on the system desktop is omitted, but also compared with the case where the user is using the electronic device to run an application other than the camera application, the operation of exiting the application can be further omitted. Furthermore, compared with the case where the electronic device is in the lock screen, the operation of lighting up the screen and unlocking the electronic device can be omitted. Therefore, the method provided in the embodiment of the present application can quickly start the camera application. In addition, the first touch event and the detection of the specified image are combined as the trigger condition for starting the camera application, which can reduce the possibility of starting the camera application due to misoperation.

[0053] It is understandable that in order to facilitate the description of the device method provided in the embodiments of the present application, the implementation methods of each method will be explained in the selfie mode later, but this does not limit the embodiments of the present application to be used only in the selfie mode.

[0054] See also Figure 5 , Figure 5 The device operation method provided by an embodiment of the present application is shown, and the method is applied to an electronic device, and the electronic device may be the above-mentioned straight-screen mobile phone, folding screen mobile phone or other smart phone, and the electronic device may include a camera and a screen. Specifically, the method may include: S501 to S505.

[0055] S501: Detect a first touch event acting on a first area of ​​the electronic device.

[0056] As mentioned above, when the first area of ​​the electronic device on which the first touch event acts is different, the way in which the electronic device detects the first touch event is also different. Exemplarily, the first touch event acts on the first area of ​​the electronic device. If the first area is the touch screen of the electronic device, if the electronic device includes multiple screens, the touch screen can be the screen of the electronic device used to display the preview interface, and of course it can also be other screens. If the electronic device has only one screen, the first area is the screen of the electronic device. Then the way in which the electronic device detects the first touch event is to detect the touch gesture acting on the touch screen of the electronic device, and determine whether the touch gesture is the first touch event. If the first area is the area of ​​the physical button of the electronic device, then the way in which the electronic device detects the first touch event is to determine whether the first touch event is detected by the detection module of the physical button. For example, the first touch event is a double click, and the first area is the area of ​​the volume button of the electronic device. It is determined whether the double click operation of the volume button is received by detecting the KEYCODE_VOLUME_DOWN message.

[0057] As an implementation method, the first area can also be an area other than the aforementioned touch screen area and physical button area. However, no matter which area of ​​the electronic device the first area is, the first touch event can be determined by the acceleration data of the electronic device, because the user inputting the first touch event in any area of ​​the electronic device may cause the acceleration data of the electronic device to change. Therefore, in the embodiment of the present application, the implementation method of detecting the first touch event is to obtain the acceleration data collected by the acceleration sensor; and determine whether there is a first touch event acting on the first area of ​​the electronic device based on the acceleration data.

[0058] It should be noted that the acceleration data may include acceleration values ​​in three dimensions, namely, the acceleration value in the x-axis direction, the acceleration value in the y-axis direction, and the acceleration value in the z-axis direction. Figure 6 As shown, the x-axis and y-axis directions are parallel to the screen of the electronic device, and the z-axis direction is perpendicular to the screen, wherein the x-axis direction is parallel to the top or bottom edge of the screen, and the y-axis direction is parallel to the side edge of the screen. Therefore, the acceleration change of the electronic device caused by the user's tapping of the electronic device can be decomposed into the components of the three dimensions, namely, the acceleration value in the x-axis direction, the acceleration value in the y-axis direction, and the acceleration value in the z-axis direction.

[0059] As an embodiment, the first touch event acts on a first area of ​​the electronic device, and the first area is a designated border area of ​​the electronic device. Exemplarily, the designated border area is a side border area of ​​the electronic device. For example, if the electronic device is the aforementioned candy bar mobile phone, the designated border area is a left border or a right border. If the electronic device is the aforementioned folding screen mobile phone, the designated border area may be the first side border or the second side border of the first shell, wherein the first side border and the second side border of the first shell are two sides located between the first side edge 214 of the first shell and the hinge mechanism 213 of the folding screen mobile phone. Exemplarily, the first touch event is a double-click event, that is, the first touch event acting on the electronic device is a double-click event acting on the first side border or the second side border of the electronic device. Figure 7 and 8 As shown, taking the electronic device as a folding screen mobile phone as an example, the first area of ​​the electronic device acted on by the first touch event is the first side frame or the second side frame of the first shell of the electronic device. Figure 8 As shown, the first side frame 801 and the second side frame 802 of the first shell are respectively located on the right and left sides of the auxiliary screen 230 of the first shell, that is, Figure 8 From the perspective shown, the first side edge 214 of the first housing is located below the secondary screen 230, the hinge mechanism 213 is located above the secondary screen 230, the first side frame 801 of the first housing is located on the right side of the secondary screen 230, and the second side frame 802 is located on the left side of the secondary screen 230. Physical buttons such as a power button 803 and a volume button 804 are provided on the first side frame 801 of the first housing. Figure 7 As shown, the first touch event is double-clicking the first side frame 801 of the first shell along the first direction F1, or double-clicking the second side frame 802 of the first shell along the second direction F2.

[0060] If the first touch event is double-clicking the first side frame 801 of the first housing along the first direction F1, the corresponding change in acceleration data is as follows: Fig. 9 As shown, Fig. 9 The curve represented by the thick solid line in the figure is the curve of the acceleration value in the x-axis direction. Fig. 9 The dotted line in the figure represents the acceleration value change curve in the y-axis direction. Fig. 9 The curve represented by the thin solid line in the figure is the curve of the acceleration value in the z-axis direction. Fig. 9 The horizontal axis in is the number of frames of acceleration data collected by the acceleration sensor of the electronic device. Fig. 9 The vertical axis in is the acceleration value. It can be seen that the acceleration value can be positive or negative.

[0061] It should be noted that the acceleration sensor outputs data at a frequency of 200 frames per second, and of course it can also be other sampling rates such as 100Hz and 50Hz, which is not limited to 200Hz. The sampling interval of the acceleration sensor is 0.1 seconds, that is, the electronic device obtains 200 frames of acceleration data collected by the acceleration sensor within 1 second every 0.1 seconds to determine whether there is a first touch event. Exemplarily, the acceleration data can be input into the knock detection model. For example, during the 0th second to the 1st second, since it is less than 1 second, no acceleration data is collected, so the acceleration data will not be input into the knock detection model. At 1.0 seconds, the 200 frames of acceleration data collected by the acceleration sensor during the 0th second to the 1st second are input into the knock detection model. If the knock detection model return value is 1, it is considered that the user has a knock action, that is, the first touch event acting on the electronic device is detected, and if the knock detection model return value is 0, it is considered that the user has no knock action, that is, the first touch event acting on the electronic device is not detected. Then, at an interval of 0.1 seconds, that is, at 1.1 seconds, the acceleration data collected by the acceleration sensor from 0.1 seconds to 1.1 seconds is input into the tapping detection model, and the aforementioned detection operation is repeated. Then, by analogy, at 1.2 seconds, the data from 0.2 seconds to 1.2 seconds is input into the tapping detection model, at 1.3 seconds, the data from 0.3 seconds to 1.3 seconds is input into the tapping detection model, and so on, until the first touch event is detected.

[0062] Specifically, from Fig. 9 It can be seen that the acceleration value in the x-axis direction changes greatly near the horizontal coordinates of 60 and 120. It can be understood that Figure 6 It can be seen that the direction of the x-axis is from the second side frame 802 to the first side frame 801, that is, the direction of the x-axis is Figure 7 Therefore, when the first touch event is a tapping action in the first direction F1 acting on the first side frame 801, each tapping will generate an obvious acceleration in the x-axis direction, and the direction of the acceleration is negative. Fig. 9 It can be seen that in the 200 frames of acceleration data currently collected by the acceleration sensor, the curve corresponding to the x-axis corresponds to two obvious troughs, and each trough corresponds to a tapping action in the first direction F1 acting on the first side frame 801. Therefore, by pre-training the tapping detection model, it can identify two consecutive troughs of the acceleration value in the x-axis direction, so that it can identify the first touch event.

[0063] If the first touch event is double-clicking the second side frame 802 of the first housing along the second direction F2, the corresponding change in acceleration data is as follows: Fig.10 As shown, Fig.10The curve represented by the thick solid line in the figure is the curve of the acceleration value in the x-axis direction. Fig.10 The dotted line in the figure represents the acceleration value change curve in the y-axis direction. Fig.10 The curve represented by the thin solid line in the figure is the curve of the acceleration value in the z-axis direction. Fig.10 The horizontal axis in is the number of frames of acceleration data collected by the acceleration sensor of the electronic device. Fig.10 The vertical axis in is the acceleration value. Fig.10 It can be seen that the acceleration value in the x-axis direction changes greatly around the horizontal coordinates 60 and 120. It can be understood that when the first touch event is a tapping action in the second direction F2 acting on the second side frame 802, each tapping will generate an obvious acceleration in the x-axis direction, and the direction of the acceleration is positive. Fig.10 It can be seen that in the 200 frames of acceleration data currently collected by the acceleration sensor, the curve corresponding to the x-axis corresponds to two obvious peaks, and each playback corresponds to a tapping action in the second direction F2 acting on the second side frame 802. Therefore, by pre-training the tapping detection model, it can identify two consecutive peaks of the acceleration value in the x-axis direction, so that it can identify the first touch event.

[0064] It should be noted that the embodiments of the present application do not limit the number of taps, tap direction, and tap area corresponding to the first touch event. For different areas, they can all be reflected in the changes in acceleration data. As long as the tap detection model is pre-trained so that it can recognize the changes in acceleration data, the first touch event can be recognized. For example, the first touch event can be a double-click on the back cover of an electronic device, and the corresponding acceleration data change is two consecutive peaks of the acceleration value in the z-axis direction, which is not limited here.

[0065] S502: When the first touch event is detected, start the camera of the electronic device.

[0066] Exemplarily, the camera of the electronic device is in a turned-off state. In this state, the electronic device detects a first touch event acting on a first area of ​​the electronic device. When the first touch event is detected, the camera of the electronic device is started. If the first touch event is not detected, the process returns to execute S501 to continue detecting the first touch event.

[0067] S503: Detect whether the images captured by the camera contain a specified image.

[0068] When the first touch event is detected, the electronic device will start the camera to detect whether the specified image exists in the image captured by the camera, that is, whether the specified image exists within the field of view of the camera, so as to determine whether the first touch event acting on the first area of ​​the electronic device is to capture the specified image or is a false trigger.

[0069] As an implementation method, the implementation method of detecting whether the image captured by the camera contains a specified image can be that an image recognition model can be pre-set, and the image captured by the camera is input into the image recognition model as an initial image. The image recognition model can recognize the initial image and determine whether the specified image exists in the initial image. Exemplarily, the image recognition model can output a first probability value, which is used to characterize the probability that the specified image exists in the initial image. For example, in an embodiment of the present application, the specified image is a face image, then the image recognition model is a face detection network, for example, it can be a deep learning neural network, and the image recognition model can give the possibility of the presence of a face image in the initial image, that is, the first probability value.

[0070] As an implementation mode, if the first probability value is greater than a specified threshold, it can be determined that the image captured by the camera contains a specified image, thereby executing the subsequent operation of opening the camera application, wherein the specified threshold can be set according to actual use requirements, for example, the specified threshold can be 0.8. As another implementation mode, in order to avoid the situation where the target corresponding to the specified image may only flash or stay briefly within the field of view of the camera, images within a certain period of time can be continuously captured, and after determining that a face image exists in multiple images, it is determined that the image captured by the camera contains a specified image. It can be understood that, although theoretically, as long as there is a specified image in one image, it can be determined that the camera has captured the specified image, but considering the accuracy, in the embodiment of the present application, when only one specified image is captured, the determination conclusion that the image captured by the camera contains the specified image is not made, that is, the subsequent operation of S504 is not executed, but when the specified image is continuously captured, it is determined that the image captured by the camera contains the specified image, and then the subsequent operation is executed.

[0071] Specifically, the implementation method for determining whether the specified image is continuously captured is to continuously obtain the images captured by the camera as initial images within a preset time period; determine the first probability value of each initial image captured, wherein the first probability value is used to characterize the possibility that the initial image contains the specified image; if the number of initial images detected whose first probability value is greater than a specified threshold is greater than a specified number, it is determined that the images captured by the camera contain the specified image. The preset time period can be set based on actual usage requirements. Exemplarily, the image sampling frequency of the camera is 10 Hz, that is, 10 frames of images are captured within 1 second, and the preset time period is set to 2 seconds, so that it can be determined based on 20 frames of images whether the condition for continuously capturing the specified image is met. Taking the designated image as a face image as an example, the image size collected by the camera is 240*240, then within the preset time period, each time an initial image is collected, the initial image is input into the face detection network, and the face detection network outputs a first probability value, the value range of the first probability value is [0,1], and the designated threshold is 0.8, then the electronic device determines the first probability value of the initial image to determine whether the first probability value is greater than the designated threshold, if it is greater than the designated threshold, the parameter value is increased by 1, wherein the parameter value is a statistical value of the number of initial images whose first probability value is greater than the designated threshold, the initial value of the parameter value is 0, then when it is determined that the first probability value of a certain initial image is greater than the designated threshold, the parameter value is increased by 1. By analogy, within the preset time period, the initial image is continuously acquired, and the first probability value of the initial image is continuously obtained and it is determined whether the first probability value is greater than the designated threshold, once the first probability value is greater than the designated threshold, the parameter value is increased by 1, and when the parameter value is greater than the designated number, it is determined that the image collected by the camera contains the designated image, that is, the condition of continuously collecting the designated image is met. Among them, the specified number is 2, that is, when there are at least 3 initial images including the specified image within the preset time period, it is determined that the image captured by the camera contains the specified image, so as to perform the subsequent operation of opening the camera application.

[0072] It should be noted that, since the face detection network determines the first probability value of the initial image while the camera is collecting the initial image, and simultaneously counts the number of initial images whose first probability value is greater than the specified threshold. Therefore, there is no need to wait until all the initial images within the preset time period are collected before determining the first probability value of each initial image. As long as the number of initial images whose first probability value is greater than the specified threshold is determined to be greater than the specified number within the preset time period, it can be determined that the specified image exists in the images collected by the camera, thereby starting the camera application.

[0073] S504: Running a camera application installed in the electronic device.

[0074] S505: Displaying a preview interface corresponding to the camera application on the screen.

[0075] Exemplarily, the camera and the screen are located on the same side, that is, the first touch event in the first area is used to trigger the selfie mode of the electronic device. Then, in combination with the two conditions of detecting the first touch event acting on the electronic device (i.e., the aforementioned first condition) and detecting that the camera captures a specified image (i.e., the aforementioned second condition), the camera application can be opened by mistake to avoid being opened. This is because, if the camera application is only triggered to start with the first touch event, it is easy for the user to input the first touch event when using the electronic device but then have no need to take a selfie, which will cause the camera application to be accidentally touched. Therefore, in combination with the aforementioned first and second conditions, it can be determined that the user inputs the first touch event when facing the camera and the screen, indicating that the user is very likely to input the first touch event in the first area for the purpose of taking a selfie. Therefore, in combination with the aforementioned first and second conditions, the startup of the camera application is made more accurate.

[0076] In addition, since the power consumption of acceleration data acquisition is lower than that of image recognition, when the first condition is met, the camera is started to determine whether the second condition is met, so as to avoid excessive power consumption of the electronic device caused by turning on the camera for a long time to acquire and recognize images. However, in the embodiment of the present application, the second condition may be determined first and then the first condition may be determined, that is, detecting whether the image acquired by the camera contains a specified image; if the specified image exists, detecting the first touch event acting on the electronic device; if the first touch event is detected, determining that the first touch event acting on the electronic device is detected and the camera acquires the specified image, and the specific process of detecting the first touch event acting on the electronic device and the camera acquiring the specified image can refer to the aforementioned content, which will not be repeated here.

[0077] See also Fig.11 , Fig.11 The device operation method provided by an embodiment of the present application is shown, and the method is applied to an electronic device, and the electronic device may be the above-mentioned folding screen mobile phone, that is, the electronic device may include a camera and a screen, and the camera may be the above-mentioned secondary screen 230, and the camera is a rear camera set on the rear surface of the first housing. The specific structure of the folding screen mobile phone can refer to the above content. Specifically, the method may include: S1110 to S1120.

[0078] S1110: When it is determined that the electronic device is in a folded state, and when a first touch event acting on a first area of ​​the electronic device is detected and when it is detected that the camera captures a specified image, run a camera application installed in the electronic device.

[0079] As an implementation method, Fig.11 The application scenario of the method shown is that the electronic device is a folding screen mobile phone, and the user uses the camera on the same side of the secondary screen to take a selfie when the folding screen mobile phone is in a folded state, and the preview interface of the camera application is displayed on the secondary screen, that is, Figure 7 Therefore, since it is aimed at the selfie scene of the folding screen mobile phone in the folded state, the electronic device can be limited to be in the folded state, that is, the trigger condition for automatically triggering the start of the camera application is set to include detecting the first touch event acting on the electronic device (the aforementioned first condition), detecting that the camera captures a specified image (the aforementioned second condition) and the electronic device is in the folded state (which can be named the third condition), wherein the specified image in the second condition is a face image, and the first touch event in the first condition is the aforementioned Figure 7 As shown, double-clicking the first side frame 801 of the first shell along the first direction F1 and / or double-clicking the second side frame 802 of the first shell along the second direction F2.

[0080] As mentioned above, the use state of the folding screen mobile phone may include an unfolded state and a folded state. The judgment order of the first condition, the second condition and the third condition is not limited in the embodiment of the present application. As an implementation method, the third condition can be judged first, then the first condition and finally the second condition. This is because the application scenario of the embodiment of the present application is a selfie scene in the folded state of the folding screen mobile phone, and the camera of the electronic device can be started and used in any scenario. In this scenario, the user's usual operation method is to first set the use state of the folding screen mobile phone to the folded state, and then double-click the first side frame 801 and / or the second side frame 802 of the electronic device, and then, when the camera determines that the captured image has a face image, the user successfully starts the camera application. Therefore, judging the third condition first is more in line with the user's usage habits. It should be noted that the first area of ​​the first touch time can also be the side of the second shell, that is, the side of the second shell corresponding to the first shell, which is not limited here.

[0081] Then the S1110 may include Fig.12 S1111 to S1117 shown.

[0082] S1111: Acquire the usage status of the electronic device.

[0083] As an implementation, the usage state may include a folded state and an unfolded state, that is, the usage state of the electronic device may be a folded state or an unfolded state. For example, for an Android operating system, the state of the folding screen may be obtained through WindowInfoTracker in the WindowManager API, that is, the usage state may be obtained.

[0084] In addition, the use state of the electronic device can also be determined by the angle between the first shell and the second shell of the electronic device. As an embodiment, the electronic device also includes an angle detection module, which is used to detect the angle between the first shell 211 and the second shell 212. In some embodiments, the angle detection module includes but is not limited to: an angle sensor and a distance sensor. For example, the angle detection module can be a Hall angle sensor. Exemplarily, the hinge mechanism of the electronic device includes a rotating shaft, and an angle sensor is provided at the position of the rotating shaft of the electronic device. Specifically, the first shell and the second shell can rotate around the rotating shaft. The rotation path of the rotating shaft collected by the angle sensor is obtained, and the angle sensor is installed at the rotating shaft. The rotation amplitude between the first shell and the second shell is determined according to the rotation path, and then the rotation angle between the first shell and the second shell can be determined, thereby obtaining the angle between the first shell and the second shell.

[0085] As an implementation, it is assumed that the use state of the electronic device includes a folded state, an intermediate state, and an unfolded state. Among them, when the electronic device is in the folded state, the first shell and the second shell can completely overlap, and in the unfolded state, the angle between the first shell and the second shell is the largest, for example, it can be 180 degrees, in the intermediate state and the unfolded state, the first shell and the second shell are in a non-contact state, and the intermediate state is in a state between the folded state and the unfolded state, that is, in the process of changing from the folded state to the intermediate state to the unfolded state, the angle between the first shell and the second shell of the folding screen gradually increases.

[0086] It can be understood that, when it is determined that the angle between the first shell and the second shell is less than or equal to the first angle threshold, the use state of the electronic device is determined to be a folded state, and when it is determined that the angle between the first shell and the second shell is greater than or equal to the second angle threshold. Among them, the first angle threshold can be a smaller angle value. Exemplarily, the value range of the first angle threshold is 0° to 30°. The second angle threshold can be a larger angle value. Exemplarily, the value range of the first angle threshold is 150° to 180°. Therefore, by obtaining the angle between the first shell and the second shell, it can be determined whether the use state of the electronic device is a folded state or an unfolded state.

[0087] S1112: Determine whether the usage state is a folded state.

[0088] If the current use state of the electronic device is the folded state, then S1113 is executed to continue to determine whether the first touch event is detected. If the current use state of the electronic device is not the folded state, for example, the unfolded state, then the process returns to S1111 to continue to obtain the use state of the electronic device and continue to determine whether the newly obtained use state is the folded state, until it is determined that the current use state of the electronic device is the folded state.

[0089] S1113: Detect a first touch event acting on a first area of ​​the electronic device.

[0090] S1114: Determine whether a first touch event is detected.

[0091] It should be noted that when the first touch event is detected, S1115 can be continued to be executed, that is, the camera is started to determine whether the image captured by the camera includes the specified image. If the first touch event is not detected, S1113 and subsequent steps can be returned to be executed until the first touch event is detected. Of course, S1111 can also be returned to be executed, that is, the operation of obtaining the usage status of the electronic device and subsequent operations are re-executed until the first touch event is detected when the electronic device is in a folded state.

[0092] S1115: Start the camera of the electronic device.

[0093] S1116: Detect whether the images captured by the camera contain a specified image.

[0094] If the specified image exists, S1117 is executed, that is, the camera application is run. If the specified image does not exist, the process returns to S1113, that is, the first touch event may be triggered by mistake, so it is determined again whether the user inputs the first touch event again.

[0095] S1117: Run a camera application installed in the electronic device.

[0096] S1120: Displaying a preview interface corresponding to the camera application on the screen.

[0097] It should be noted that, for the contents not described in detail in the above steps, reference can be made to the above embodiments and they will not be described again here.

[0098] Taking the scenario where a user takes a selfie in the folded state of a foldable screen mobile phone as an example, the user first sets the foldable screen mobile phone to the folded state, and then double-clicks the side frame of the foldable screen mobile phone in the folded state to open the camera application of the electronic device and display the preview interface corresponding to the camera application on the screen facing the user. In the embodiment of the present application, it is first determined that the electronic device is in the folded state, so that it can be determined that the electronic device meets the hardware form of the scene, and then the double-click operation is detected, so that it can be determined that the opening gesture of the scene is received, and then the camera of the electronic device is started and it is determined whether there is a face image in the image captured by the camera. If there is a face image, it can be determined that the user has the need to take a selfie, and the camera and the screen are on the same side, so after the camera application is started, the preset interface corresponding to the camera application is displayed on the screen, and the user can just observe the picture currently captured by the camera through the preset interface.

[0099] It should be noted that if the above-mentioned designated image is a face image, then to determine whether the designated image exists in the image captured by the camera, it is not only necessary to determine whether the image captured by the camera contains a face-type image, but also whether the face image is the image of the user of the electronic device. Exemplarily, the electronic device pre-acquires the user's image. For example, the user of the electronic device may designate an image from multiple images in the electronic device's photo album as the user's image, i.e., the reference image. When the electronic device determines that the captured initial image contains a face-type image, it uses the initial image containing the face type as the image to be processed, and matches the image to be processed with the reference image. If the image to be processed matches the reference image, it is determined that the face image is the image of the user of the electronic device. Then, the camera application installed in the electronic device is run, and a preview interface corresponding to the camera application is displayed on the screen.

[0100] In addition, in some embodiments, if it is detected that the number of initial images whose first probability value is greater than the specified threshold is greater than the specified number, it is determined that the image captured by the camera contains the specified image. In this embodiment, when it is detected that the number of initial images whose first probability value is greater than the specified threshold is greater than the specified number, each initial image whose first probability value is greater than the specified threshold is obtained as an image to be processed, and each image to be processed is matched with the reference image. If the number of successfully matched images to be processed is greater than the preset number, it is determined that the image captured by the camera contains the specified image, and then the camera application installed in the electronic device is run, and the preview interface corresponding to the camera application is displayed on the screen.

[0101] See also Fig.13 , Fig.13A device operation method provided in an embodiment of the present application is shown. The method is applied to an electronic device, and the electronic device may include a camera and a screen. Specifically, the method may include: S1301 to S1303.

[0102] S1301: When a first touch event acting on a first area of ​​the electronic device is detected and a designated image is captured by the camera, a camera application installed in the electronic device is run.

[0103] S1302: Displaying a preview interface corresponding to the camera application on the screen.

[0104] S1303: If a second touch event acting on a second area of ​​the electronic device is detected, control the camera application to perform an image acquisition operation.

[0105] It should be noted that the implementation method of the electronic device detecting the second touch event can refer to the implementation method of the above-mentioned retrieval of the first touch event. The second touch event is used to control the camera application to perform the image acquisition operation, so for the camera application, the second touch event is equivalent to the triggering condition of the shutter operation of the camera application, that is, the user can quickly press the shutter of the camera application through the second touch event, thereby realizing shooting using the camera application.

[0106] As an implementation mode, the second touch event acts on the second area of ​​the electronic device. Exemplarily, the first area and the second area are the same, that is, the first touch event and the second touch event act on the same area of ​​the electronic device. Therefore, for the user, the first touch event is input in the first area, and the camera application is started and the preview screen of the camera application is run on the screen when the opening condition of the camera application is met. Then, the user continues to input the second touch event in the first area to control the camera application to shoot. Since the first touch event and the second touch event have the same action area, for the user, after starting the camera application through the first touch event, the user's hand may still stay near the first area where the first touch event acts, and then continue to input the second touch event in the first area, so that after the user starts the camera application, there is no need to move the hand to other areas to input the second touch event, which reduces the cumbersomeness of the user's operation and avoids the need for the user to remember different operation areas.

[0107] As another implementation, the first touch event and the second touch event may be the same touch gesture. For example, if the first touch event is a double-click operation, the second touch event is also a double-click operation, thereby avoiding the user from remembering too many operation gestures. For the user, when the camera application is not running on the screen, a double-click operation may trigger the start of the camera application and display the preview interface of the camera application on the screen. When the preview interface of the camera application is displayed on the screen, a double-click operation, i.e., a double-tap, on the electronic device may trigger the camera application to shoot.

[0108] It should be noted that whether the above-mentioned first touch event and the second touch event are the same and whether the action area is the same can be set based on actual use requirements, and the embodiment of the present application does not limit this. In order to reduce the complexity of the user's operation, as an implementation method, the action area of ​​the first touch event and the second touch event can be set to be the same. For example, the action area of ​​the first touch event and the second touch event are both the right side frame area of ​​the electronic device. Exemplarily, the right side frame area can be the first side frame area of ​​the first shell of the aforementioned folding screen mobile phone or the side frame area of ​​the second shell corresponding to the first side frame area of ​​the first shell. The second touch event can be the same as or different from the first touch event. As an implementation method, the second touch event can include a variety of operation gestures, and there are gestures that are the same as the first touch event in the multiple operation gestures, and there are gestures that are different from the second touch event. For example, the first touch event is a double-click event, that is, a double-click operation, and the multiple operation gestures included in the second touch event include a double-click operation, and also include other operation gestures, such as single-click, triple-click, slide, continuous press, etc. Each of the multiple operation gestures corresponds to a shooting mode, and different shooting modes correspond to different shooting parameters, which may include filter type, camera parameters (e.g., exposure time, exposure compensation), composition method, etc. Among them, the shooting mode corresponding to the operation gesture that is the same as the first touch event is the basic mode, and the shooting parameters corresponding to the basic mode are all default parameters, and the filter type is the filter that the user uses most frequently. Therefore, the shooting mode that the user uses most frequently, that is, the basic mode, can be quickly started through the operation gesture that is the same as the first touch event. Therefore, for the modes that the user frequently uses, the user does not need to deliberately remember special operation gestures, and only needs to be the same as the operation gesture of the first touch event. For the modes that are not commonly used, some operation gestures that are different from the first touch event can be set to start. Moreover, the operation gesture not only starts different shooting modes, but can trigger the camera application to shoot and shoot in the shooting mode corresponding to the operation gesture.

[0109] See also Fig.14, which shows a structural block diagram of a device operating apparatus 1400 provided in an embodiment of the present application. The apparatus may include: an operating unit 1401 and a display unit 1402.

[0110] The running unit 1401 is used to run a camera application installed in the electronic device when a first touch event acting on a first area of ​​the electronic device is detected and a designated image is captured by the camera.

[0111] Furthermore, the running unit 1401 is also used to detect a first touch event applied to the electronic device before running a camera application installed in the electronic device when a first touch event applied to the first area of ​​the electronic device is detected and when a specified image is captured by the camera; start the camera of the electronic device when the first touch event is detected; detect whether the image captured by the camera contains a specified image; and if the specified image exists, determine that the first touch event applied to the first area of ​​the electronic device is detected and when the camera captures the specified image.

[0112] Furthermore, the running unit 1401 is also used to detect whether there is a specified image in the image captured by the camera before running the camera application installed in the electronic device when a first touch event acting on the first area of ​​the electronic device is detected and the camera is detected to have captured a specified image; if the specified image exists, detect the first touch event acting on the electronic device; if the first touch event is detected, determine that the first touch event acting on the first area of ​​the electronic device is detected and the camera is detected to have captured the specified image.

[0113] Furthermore, the first touch event acts on a designated border area of ​​the electronic device.

[0114] Furthermore, the first touch event is a double-click event.

[0115] Furthermore, the electronic device is provided with an acceleration sensor, and the operation unit 1401 is further configured to obtain acceleration data collected by the acceleration sensor; and determine whether there is a first touch event acting on the electronic device based on the acceleration data.

[0116] Furthermore, the operating unit 1401 is also used to continuously obtain images captured by the camera as initial images within a preset time period; determine a first probability value for each captured initial image, wherein the first probability value is used to characterize the possibility that a specified image exists in the initial image; if the number of initial images detected whose first probability value is greater than a specified threshold is greater than a specified number, it is determined that the specified image exists in the image captured by the camera.

[0117] Furthermore, the electronic device includes a foldable shell assembly, the foldable shell assembly includes a first shell and a second shell rotatably connected to the first shell, the front surface of the first shell and the front surface of the second shell can be close to or away from each other, and the camera and the screen are both arranged on the rear surface of the first shell. The operation unit 1401 is also used to run the camera application installed in the electronic device when it is determined that the electronic device is in a folded state, and when a first touch event acting on the electronic device is detected and when it is detected that the camera captures a specified image.

[0118] Furthermore, the running unit 1401 is also used to obtain the usage status of the electronic device; if the usage status is a folded state, detect a first touch event acting on a first area of ​​the electronic device; when the first touch event is detected, start the camera of the electronic device; detect whether there is a specified image in the image captured by the camera; if the specified image exists, run the camera application installed in the electronic device.

[0119] Furthermore, the image is specified to be a face image.

[0120] The display unit 1402 is used to display a preview interface corresponding to the camera application on the screen.

[0121] Furthermore, the device operating apparatus 1400 further includes a photographing unit, which is used to control the camera application to perform an image acquisition operation if a second touch event acting on a second area of ​​the electronic device is detected.

[0122] Furthermore, the first area and the second area are the same area of ​​the electronic device.

[0123] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0124] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0125] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0126] Please refer to Fig.15, which shows a structural block diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 may be an electronic device such as a smart phone, a tablet computer, an e-book, etc. that can run applications. The electronic device 100 in the present application may be the aforementioned straight-screen mobile phone or folding-screen mobile phone. Specifically, the electronic device 100 may include one or more of the following components: a processor 110, a memory 120, a camera 140, a screen 150, and one or more applications, wherein one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and one or more programs are configured to execute the method described in the aforementioned method embodiment. Among them, the camera 140 and the screen 150 can refer to the aforementioned embodiment and will not be repeated here.

[0127] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0128] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0129] Please refer to Fig.16 , which shows a structural block diagram of a computer-readable medium provided in an embodiment of the present application. The computer-readable medium 1600 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0130] The computer readable medium 1600 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable medium 1600 includes a non-transitory computer-readable storage medium. The computer readable medium 1600 has storage space for program code 1610 that performs any method step of the above method. These program codes can be read from or written to one or more computer program products. The program code 1610 can be compressed, for example, in an appropriate form.

[0131] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A device operation method, characterized in that: Applied to an electronic device, the electronic device includes a camera and a screen, and the method includes: When a first touch event acting on a first area of ​​the electronic device is detected and a designated image is captured by the camera, running a camera application installed in the electronic device; A preview interface corresponding to the camera application is displayed on the screen.

2. The method according to claim 1, characterized in that In the case where the first touch event acting on the first area of ​​the electronic device is detected and the camera captures a specified image, before running the camera application installed in the electronic device, the method further includes: Detecting a first touch event acting on a first area of ​​the electronic device; When the first touch event is detected, starting a camera of the electronic device; Detect whether there is a specified image in the image captured by the camera; If the designated image exists, it is determined that a first touch event acting on a first area of ​​the electronic device is detected and that the camera captures the designated image.

3. The method according to claim 1, characterized in that In the case where the first touch event acting on the first area of ​​the electronic device is detected and the camera captures a specified image, before running the camera application installed in the electronic device, the method further includes: Detect whether there is a specified image in the image captured by the camera; If the designated image exists, detecting a first touch event acting on a first area of ​​the electronic device; If the first touch event is detected, it is determined that the first touch event acting on the first area of ​​the electronic device is detected and that the camera captures a designated image.

4. The method according to claim 2 or 3, characterized in that: The first area is a designated border area of ​​the electronic device.

5. The method according to claim 2 or 3, characterized in that: The first touch event is a double-click event.

6. The method according to claim 2 or 3, characterized in that: The electronic device is provided with an acceleration sensor, and the detecting a first touch event acting on a first area of ​​the electronic device includes: Acquiring acceleration data collected by the acceleration sensor; Determine whether there is a first touch event acting on a first area of ​​the electronic device based on the acceleration data.

7. The method according to claim 2 or 3, characterized in that: The detecting whether the image captured by the camera contains a specified image comprises: Within a preset time period, continuously acquiring images captured by the camera as initial images; Determine a first probability value for each acquired initial image, wherein the first probability value is used to characterize the possibility that a specified image exists in the initial image; If it is detected that the number of initial images whose first probability value is greater than the specified threshold is greater than the specified number, it is determined that the specified image exists in the images captured by the camera.

8. The method according to claim 1, characterized in that The electronic device comprises a foldable housing assembly, wherein the foldable housing assembly comprises a first housing and a second housing rotatably connected to the first housing, wherein the front surface of the first housing and the front surface of the second housing can be close to or away from each other, and the camera and the screen are both arranged on the rear surface of the first housing; The step of running a camera application installed in the electronic device when a first touch event acting on a first area of ​​the electronic device is detected and a designated image is captured by the camera includes: When it is determined that the electronic device is in a folded state, and when a first touch event acting on a first area of ​​the electronic device is detected and when it is detected that the camera captures a specified image, a camera application installed in the electronic device is run.

9. The method according to claim 8, characterized in that The step of running a camera application installed in the electronic device upon determining that the electronic device is in a folded state and upon detecting a first touch event acting on a first area of ​​the electronic device and detecting that the camera captures a specified image comprises: Acquiring the usage status of the electronic device; If the use state is the folded state, detecting a first touch event acting on a first area of ​​the electronic device; When the first touch event is detected, starting a camera of the electronic device; Detect whether there is a specified image in the image captured by the camera; If the specified image exists, a camera application installed in the electronic device is run.

10. The method according to claim 1, characterized in that The designated image is a face image.

11. The method according to claim 1, characterized in that: After running the camera application installed in the electronic device, the method further includes: If a second touch event acting on a second area of ​​the electronic device is detected, the camera application is controlled to perform an image acquisition operation.

12. The method according to claim 11, characterized in that The first area and the second area are the same area of ​​the electronic device.

13. An equipment operating device, characterized in that: Applied to an electronic device, the electronic device includes a camera and a screen, and the device includes: an operating unit, configured to operate a camera application installed in the electronic device when a first touch event acting on a first area of ​​the electronic device is detected and when a designated image is captured by the camera; The display unit is used to display a preview interface corresponding to the camera application on the screen.

14. An electronic device, characterized in that: include: one or more processors; Memory; Camera and screen; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-12.

15. A computer readable medium, characterized in that The computer-readable medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method according to any one of claims 1 to 12.