Screen capture method and device, electronic device and storage medium

Abstract

The present disclosure relates to a screenshot method and device, an electronic device and a storage medium. The method comprises: receiving an expression screenshot request, wherein the expression screenshot request is used to request a screenshot based on a facial expression; based on the expression screenshot request, an image is captured by a camera; when the facial expression in the image matches a preset expression, a screenshot operation is triggered. The present disclosure does not require a screenshot to be taken by clicking a virtual button or a combination of hardware buttons, and the operation is highly convenient, and it is not easy to miss the image or video clip that needs to be captured.

Description

Technical Field

[0001] The present disclosure relates to the field of image technology, and in particular to a screenshot method and device, an electronic device, and a storage medium. Background Art

[0002] Screenshot is a method of obtaining the screen content of a terminal device such as a mobile phone by capturing a screen image or a screen video. In the related art, there are mainly two ways of screenshot: the first is to take a screenshot by clicking a virtual screenshot button; the second is to take a screenshot by a combination of hardware buttons. Among them, the first screenshot method requires calling out the screenshot button in advance so that the screenshot button is displayed on the screen, and the operation is relatively cumbersome. The second screenshot method generally requires a long press, which is prone to misoperation, and when playing a video on the screen, it is easy to miss the video frame or video clip that needs to be captured. Summary of the invention

[0003] The present disclosure proposes a screen capture technology solution.

[0004] According to one aspect of the present disclosure, a screenshot method is provided, comprising:

[0005] Receiving an expression screenshot request, wherein the expression screenshot request is used to request a screenshot based on a facial expression;

[0006] Based on the expression screenshot request, capturing an image through a camera;

[0007] When the facial expression in the image matches the preset expression, a screenshot operation is triggered.

[0008] In a possible implementation, when the facial expression in the image matches a preset expression, triggering a screenshot operation includes:

[0009] When the facial expression in the image matches the first preset expression, a screen image is captured.

[0010] In a possible implementation, when the facial expression in the image matches a preset expression, triggering a screenshot operation includes:

[0011] When the facial expression in the image matches the second preset expression, screen recording starts.

[0012] In a possible implementation, after starting screen recording, the method further includes:

[0013] Continue to collect images through the camera;

[0014] When the facial expression in the image matches the third preset expression, screen recording is stopped.

[0015] In a possible implementation, when the facial expression in the image matches a preset expression, triggering a screenshot operation includes:

[0016] When the facial expression in the image matches the second preset expression, the first playing time point of the video played on the screen is recorded.

[0017] In a possible implementation, after a first playback time point of the video played on the recording screen, the method further includes:

[0018] Continue to collect images through the camera;

[0019] When the facial expression in the image matches a third preset expression, recording a second playback time point of the video;

[0020] Sending a screen recording request to the server, wherein the screen recording request includes identification information of the video, the first playback time point, and the second playback time point;

[0021] Receive a video segment returned by the server based on the screen recording request, wherein the video segment is a video segment between the first playback time point and the second playback time point of the video.

[0022] In a possible implementation, the screen recording request further includes a definition selection request, where the definition selection request is used to select the definition of the video clip.

[0023] In a possible implementation manner, after collecting the image by the camera, the method further includes:

[0024] If it is detected that the image contains a face, extracting facial feature points in the image;

[0025] Performing similarity calculation on the facial feature points in the image and the facial feature points of the preset expression to obtain a similarity calculation result;

[0026] It is determined whether the facial expression in the image matches the preset expression according to the similarity calculation result.

[0027] According to another aspect of the present disclosure, a screen capture device is provided, comprising:

[0028] A receiving module, used to receive an expression screenshot request, wherein the expression screenshot request is used to request a screenshot based on a facial expression;

[0029] A first acquisition module, used to acquire images through a camera based on the expression screenshot request;

[0030] The trigger module is used to trigger a screenshot operation when the facial expression in the image matches a preset expression.

[0031] In a possible implementation, the trigger module is used to:

[0032] When the facial expression in the image matches the first preset expression, a screen image is captured.

[0033] In a possible implementation, the trigger module is used to:

[0034] When the facial expression in the image matches the second preset expression, screen recording starts.

[0035] In a possible implementation manner, the device further includes:

[0036] A second acquisition module, used to continue to acquire images through the camera;

[0037] The screen recording stop module is used to stop screen recording when the facial expression in the image matches the third preset expression.

[0038] In a possible implementation, the trigger module is used to:

[0039] When the facial expression in the image matches the second preset expression, the first playing time point of the video played on the screen is recorded.

[0040] In a possible implementation manner, the device further includes:

[0041] A third acquisition module, used to continue to acquire images through the camera;

[0042] A recording module, configured to record a second playback time point of the video when the facial expression in the image matches a third preset expression;

[0043] A sending module, used to send a screen recording request to a server, wherein the screen recording request includes identification information of the video, the first playback time point, and the second playback time point;

[0044] A receiving module is used to receive the video segment returned by the server based on the screen recording request, wherein the video segment is the video segment between the first playback time point and the second playback time point of the video.

[0045] In a possible implementation, the screen recording request further includes a definition selection request, where the definition selection request is used to select the definition of the video clip.

[0046] In a possible implementation manner, the device further includes:

[0047] An extraction module, configured to extract facial feature points in the image if a face is detected in the image;

[0048] A similarity calculation module is used to calculate the similarity between the facial feature points in the image and the facial feature points of the preset expression to obtain a similarity calculation result;

[0049] A judgment module is used to judge whether the facial expression in the image matches the preset expression according to the similarity calculation result.

[0050] According to another aspect of the present disclosure, there is provided an electronic device, comprising:

[0051] processor;

[0052] a memory for storing processor-executable instructions;

[0053] Wherein, the processor is configured to: execute the above-mentioned screenshot method.

[0054] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above-mentioned screenshot method is implemented.

[0055] In the disclosed embodiment, an expression screenshot request is received and an image is captured through a camera based on the expression screenshot request. When the facial expression in the image matches a preset expression, a screenshot operation is triggered. Thus, there is no need to take a screenshot by clicking a virtual button or a combination of hardware buttons. The operation is more convenient and it is not easy to miss the image or video clip that needs to be captured.

[0056] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

[0057] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

[0059] Figure 1 A flowchart of a screenshot method according to an embodiment of the present disclosure is shown.

[0060] Figure 2 A schematic diagram showing an expression screenshot button in a closed state in a screenshot method according to an embodiment of the present disclosure.

[0061] Figure 3 A schematic diagram showing an expression screenshot button in an turned-on state in a screenshot method according to an embodiment of the present disclosure.

[0062] Figure 4 A block diagram of a screenshot device according to an embodiment of the present disclosure is shown.

[0063] Figure 5 is a block diagram of an electronic device 800 according to an exemplary embodiment. DETAILED DESCRIPTION

[0064] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0065] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0066] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0067] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0068] Figure 1 A flowchart of a screenshot method according to an embodiment of the present disclosure is shown. The execution subject of the screenshot method may be a screenshot device. For example, the screenshot method may be executed by a terminal device or other processing device. The terminal device may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device or a wearable device, etc. In some possible implementations, the screenshot method may be implemented by a processor calling computer-readable instructions stored in a memory. For example Figure 1 As shown, the method includes steps S11 to S13.

[0069] In step S11, an expression screenshot request is received, wherein the expression screenshot request is used to request a screenshot based on a facial expression.

[0070] In a possible implementation, when the expression screenshot button on the screen is in an off state, if it is detected that the expression screenshot button is clicked, it is determined that an expression screenshot request is received, and the expression screenshot button is switched to an on state.

[0071] In a possible implementation, the expression screenshot request is a screen image capture request. In this implementation, the expression screenshot request can be used to capture a screen image.

[0072] In another possible implementation, the expression screenshot request is a screen recording request. In this implementation, the expression screenshot request can be used for screen recording.

[0073] In a possible implementation, the expression screenshot request includes an expression screenshot mode activation request; after receiving the expression screenshot request, the method further includes: activating the expression screenshot mode based on the expression screenshot mode activation request.

[0074] In one example, the expression screenshot request may only include an expression screenshot mode activation request, but not an expression screenshot type selection request. The expression screenshot type may be screen capture or screen recording. In this example, the triggering of screen capture or screen recording may be determined based on the difference between the preset expressions matched by the facial expressions in the image captured by the camera. For example, in response to the facial expression in the image captured by the camera matching the first preset expression, the screen capture is triggered; in response to the facial expression in the image captured by the camera matching the second preset expression, the screen recording is triggered.

[0075] Figure 2 A schematic diagram showing an expression screenshot button in a closed state in a screenshot method according to an embodiment of the present disclosure is shown. Figure 2 In the embodiment, the expression screenshot button 21 is in the closed state, and at this time, the expression screenshot mode is in the closed state.

[0076] In one example, the expression screenshot mode is in an off state by default, that is, the expression screenshot button is in an off state by default. By setting the expression screenshot mode to an off state by default, memory usage can be reduced.

[0077] In one example, if Figure 2As shown, the expression screenshot button 21 can be displayed in the video playback interface. In other examples, the expression screenshot button can also be displayed on the desktop of the terminal device, any interface of the native application, any interface of the HTML5 application, or a web page, or an entrance for turning on and off the expression screenshot mode can be provided in the terminal device, the native application, the HTML5 application, or the web page, which is not limited in the embodiments of the present disclosure.

[0078] Figure 3 A schematic diagram showing an expression screenshot button in an open state in a screenshot method according to an embodiment of the present disclosure. Figure 3 In the embodiment, the expression screenshot button 21 is in the turned-on state.

[0079] In a possible implementation, the expression screenshot request also includes an expression screenshot type selection request, wherein the expression screenshot type may be a screenshot image capture or a screen recording. After receiving the expression screenshot request, the method further includes: based on the expression screenshot type selection request, determining the screenshot image capture or the screen recording as a screenshot operation corresponding to the expression screenshot mode. In this implementation, the user may select the screenshot operation corresponding to the expression screenshot mode from the screenshot image capture and the screen recording in advance.

[0080] In step S12, based on the expression screenshot request, an image is captured by a camera.

[0081] In a possible implementation, in response to an expression screenshot request, images may be continuously captured by a camera, and face detection may be performed on the captured images in real time. If a face is detected in the image, facial feature points in the image may be extracted.

[0082] In one possible implementation, after capturing an image through a camera, the method further includes: if it is detected that the image contains a face, extracting facial feature points in the image; performing a similarity calculation between the facial feature points in the image and facial feature points of a preset expression to obtain a similarity calculation result; and judging whether the facial expression in the image matches the preset expression based on the similarity calculation result.

[0083] In one example, similarity calculation is performed between facial feature points in the image and facial feature points of a preset expression to obtain a similarity calculation result, including: determining a first feature vector corresponding to the facial expression in the image according to position information of the facial feature points in the image; determining a second feature vector corresponding to the preset expression according to position information of the facial feature points of the preset expression; calculating cosine similarity between the first feature vector and the second feature vector, and determining the cosine similarity as the similarity calculation result. Judging whether the facial expression in the image matches the preset expression according to the similarity calculation result includes: if the absolute value of the cosine similarity is greater than a first threshold, determining that the facial expression in the image matches the preset expression; if the absolute value of the cosine similarity is less than or equal to the first threshold, determining that the facial expression in the image does not match the preset expression.

[0084] In an example, the number of facial feature points may be 106 or more, which is not limited here.

[0085] The embodiments of the present disclosure may use relevant technologies to determine whether a facial expression matches a preset expression, which will not be elaborated here.

[0086] In step S13, when the facial expression in the image matches the preset expression, a screenshot operation is triggered.

[0087] In the embodiment of the present disclosure, the number of preset expressions may be one or more.

[0088] In a possible implementation, if there are multiple preset expressions, a screenshot operation is triggered when the facial expression in the captured image matches information of any preset expression.

[0089] In a possible implementation, the facial expression in the captured image may be matched with the preset expression in real time to determine whether the facial expression in the captured image matches the preset expression.

[0090] In a possible implementation, when the facial expression in the image matches a preset expression, a screenshot operation is triggered, including: when the facial expression in the image matches a first preset expression, a screen image is captured.

[0091] For example, the first preset expression is a winking expression.

[0092] It should be noted that, although the first preset expression is introduced above by taking the winking expression as an example, those skilled in the art will appreciate that the present disclosure should not be limited thereto. Those skilled in the art can flexibly set the first preset expression according to actual application scenario requirements and / or personal preferences.

[0093] In a possible implementation, the method further includes: after capturing the screen image, saving the screen image to a local photo album.

[0094] In one example, after capturing the screen image, the screen image is automatically saved to a local photo album.

[0095] In another example, after capturing a screen image, the user is asked to confirm whether to save the screen image, and after the user confirms, the screen image is saved to a local photo album.

[0096] In the embodiment of the present disclosure, the captured screen image may be a static image or a dynamic image.

[0097] In a possible implementation, when the facial expression in the image matches a preset expression, a screenshot operation is triggered, including: when the facial expression in the image matches a second preset expression, screen recording is started.

[0098] For example, the second preset expression is a smiling expression.

[0099] It should be noted that, although the second preset expression is introduced as an example with a smile expression, those skilled in the art will appreciate that the present disclosure should not be limited thereto. Those skilled in the art can flexibly set the second preset expression according to actual application scenario requirements and / or personal preferences.

[0100] In a possible implementation, after starting screen recording, the method further includes: continuing to capture images through the camera; and stopping screen recording when the facial expression in the image matches a third preset expression.

[0101] In this implementation, the video can be captured by recording the screen on the client. In this implementation, the definition of the captured video can be the same as the definition displayed on the client. For example, when the client plays the video, the definition of the captured video can be the same as the definition of the video played on the client.

[0102] In one example, the third preset expression is the same as the second preset expression. For example, the third preset expression and the second preset expression are both smiling expressions.

[0103] In another example, the third preset expression is different from the second preset expression.

[0104] It should be noted that, although the triggering method of stopping screen recording is described above by taking the facial expression in the image captured by the camera matching the third preset expression as an example, those skilled in the art will appreciate that the present disclosure should not be limited thereto. Those skilled in the art can flexibly set the triggering method of stopping screen recording according to actual application scenario requirements and / or personal preferences.

[0105] For example, in another possible implementation, after starting screen recording, the method further includes: when detecting that a preset stop screen recording button on the screen is clicked, stopping screen recording. In this implementation, stopping screen recording can be triggered by a virtual button on the screen.

[0106] In another possible implementation, after starting screen recording, the method further includes: when detecting that a preset hardware button or a combination of preset hardware buttons is pressed, stopping screen recording. In this implementation, stopping screen recording can be triggered by a hardware button or a combination of hardware buttons.

[0107] In another possible implementation, after starting screen recording, the method further includes: when the screen recording time reaches a preset time, stopping the screen recording. For example, the preset time is 10 seconds. In this implementation, the screen recording can be automatically stopped when the screen recording time reaches the preset time.

[0108] In a possible implementation, the method further includes: after stopping screen recording, saving the captured video to a local photo album.

[0109] In a possible implementation, when the facial expression in the image matches the preset expression, triggering a screenshot operation includes: when the facial expression in the image matches the second preset expression, recording a first playback time point of the video played on the screen. In this implementation, the first playback time point indicates the playback time point of the video played on the screen when it is detected that the facial expression in the captured image matches the second preset expression.

[0110] In a possible implementation, after recording the first playback time point of the video played on the screen, the method further includes: continuing to capture images through the camera; when the facial expression in the image matches the third preset expression, recording the second playback time point of the video; sending a screen recording request to the server, wherein the screen recording request includes the identification information of the video, the first playback time point, and the second playback time point; receiving a video clip returned by the server based on the screen recording request, wherein the video clip is a video clip between the first playback time point and the second playback time point of the video. In this implementation, the second playback time point indicates the playback time point of the video played on the screen when it is detected that the facial expression in the captured image matches the third preset expression. In this implementation, the identification information of the video can be used to distinguish different videos. For example, the identification information of the video is the ID of the video.

[0111] In this implementation, the server may generate a video clip corresponding to the screen recording request and return it to the client.

[0112] As an example of this implementation, the screen recording request also includes a definition selection request, and the definition selection request is used to select the definition of the video clip. In this example, when the video clip corresponding to the screen recording request is generated by the server, it is possible to support the capture of video clips with multiple definitions.

[0113] In the disclosed embodiment, by receiving an expression screenshot request, based on the expression screenshot request, an image is captured through a camera, and when the facial expression in the image matches a preset expression, a screenshot operation is triggered, thereby eliminating the need to click a virtual button or a combination of hardware buttons to take a screenshot, and the operation is more convenient, the operation cost is lower, and the screenshot operation has a higher response sensitivity, and it is not easy to miss the image or video clip that needs to be captured. In addition, with the disclosed embodiment, screenshots are still supported even when it is inconvenient to operate with both hands.

[0114] It can be understood that the above-mentioned various method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. Due to space limitations, the present disclosure will not go into details.

[0115] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0116] In addition, the present disclosure also provides a screenshot device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any screenshot method provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding records in the method part and will not be repeated here.

[0117] Figure 4 A block diagram of a screen capture device according to an embodiment of the present disclosure is shown. Figure 4 As shown, the screenshot device includes: a receiving module 41, used to receive an expression screenshot request, wherein the expression screenshot request is used to request a screenshot based on a facial expression; a first acquisition module 42, used to acquire an image through a camera based on the expression screenshot request; and a trigger module 43, used to trigger a screenshot operation when the facial expression in the image matches a preset expression.

[0118] In a possible implementation, the trigger module 43 is used to capture a screen image when the facial expression in the image matches a first preset expression.

[0119] In a possible implementation, the trigger module 43 is used to start screen recording when the facial expression in the image matches the second preset expression.

[0120] In a possible implementation, the device also includes: a second acquisition module, used to continue to acquire images through the camera; and a screen recording stop module, used to stop screen recording when the facial expression in the image matches a third preset expression.

[0121] In a possible implementation, the trigger module 43 is used to record a first playback time point of the video played on the screen when the facial expression in the image matches the second preset expression.

[0122] In a possible implementation, the device also includes: a third acquisition module, used to continue to acquire images through the camera; a recording module, used to record the second playback time point of the video when the facial expression in the image matches the third preset expression; a sending module, used to send a screen recording request to the server, wherein the screen recording request includes the identification information of the video, the first playback time point and the second playback time point; a receiving module, used to receive a video clip returned by the server based on the screen recording request, wherein the video clip is a video clip between the first playback time point and the second playback time point of the video.

[0123] In a possible implementation, the screen recording request also includes a definition selection request, where the definition selection request is used to select the definition of the video clip.

[0124] In a possible implementation, the device also includes: an extraction module, which is used to extract facial feature points in the image if it is detected that the image contains a face; a similarity calculation module, which is used to perform similarity calculation on the facial feature points in the image and the facial feature points of a preset expression to obtain a similarity calculation result; and a judgment module, which is used to judge whether the facial expression in the image matches the preset expression based on the similarity calculation result.

[0125] In the disclosed embodiment, an expression screenshot request is received and an image is captured through a camera based on the expression screenshot request. When the facial expression in the image matches a preset expression, a screenshot operation is triggered. Thus, there is no need to take a screenshot by clicking a virtual button or a combination of hardware buttons. The operation is more convenient and it is not easy to miss the image or video clip that needs to be captured.

[0126] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0127] The embodiment of the present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above method is implemented. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0128] The embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured as the above method.

[0129] The electronic device may be provided as a terminal, a server, or a device in other forms.

[0130] Figure 5 8 is a block diagram of an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0131] Reference Figure 5 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0132] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0133] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0134] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0135] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0136] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0137] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0138] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of the components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0139] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0140] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0141] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above method.

[0142] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0143] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0144] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0145] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0146] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0147] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0148] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0149] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0150] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A screenshot method, characterized in that: include: Displaying an expression screenshot button in the video playback interface, wherein the expression screenshot button is used to indicate that the expression screenshot is in a closed state; Detecting that the expression screenshot button is clicked, determining to receive an expression screenshot request, and switching the expression screenshot button from being used to indicate that the expression screenshot is in an off state to being used to indicate that the expression screenshot is in an on state, wherein the expression screenshot request is used to request a screenshot based on a facial expression; Based on the expression screenshot request, capturing an image through a camera; When the facial expression in the image matches the second preset expression, recording a first playback time point of the video played on the screen; Continue to collect images through the camera; When the facial expression in the image matches a third preset expression, recording a second playback time point of the video; Sending a screen recording request to the server, wherein the screen recording request includes identification information of the video, the first playback time point, and the second playback time point; Receive a video segment returned by the server based on the screen recording request, wherein the video segment is a video segment between the first playback time point and the second playback time point of the video.

2. The method according to claim 1, characterized in that The method further comprises: When the facial expression in the image matches the first preset expression, a screen image is captured.

3. The method according to claim 1, characterized in that The screen recording request also includes a definition selection request, and the definition selection request is used to select the definition of the video clip.

4. The method according to claim 1, characterized in that: After the image is captured by the camera, the method further includes: If it is detected that the image contains a face, extracting facial feature points in the image; Performing similarity calculation on the facial feature points in the image and the facial feature points of the second preset expression to obtain a similarity calculation result; It is determined whether the facial expression in the image matches the second preset expression according to the similarity calculation result.

5. A screen capture device, characterized in that: include: A receiving module, used to display an expression screenshot button in the video playback interface, wherein the expression screenshot button is used to indicate that the expression screenshot is in a closed state; Detecting that the expression screenshot button is clicked, determining to receive an expression screenshot request, and switching the expression screenshot button from being used to indicate that the expression screenshot is in an off state to being used to indicate that the expression screenshot is in an on state, wherein the expression screenshot request is used to request a screenshot based on a facial expression; A first acquisition module, used to acquire images through a camera based on the expression screenshot request; A trigger module, configured to record a first playback time point of the video played on the screen when the facial expression in the image matches a second preset expression; A third acquisition module, used to continue to acquire images through the camera; A recording module, configured to record a second playback time point of the video when the facial expression in the image matches a third preset expression; A sending module, used to send a screen recording request to a server, wherein the screen recording request includes identification information of the video, the first playback time point, and the second playback time point; A receiving module is used to receive the video segment returned by the server based on the screen recording request, wherein the video segment is the video segment between the first playback time point and the second playback time point of the video.

6. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the method described in any one of claims 1 to 4.

7. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 4 is implemented.

Images