Information processing method and related equipment

Abstract

The embodiment of the invention provides an information processing method and related equipment. According to the method, the electronic equipment can display the note interface while playing the video, process the video, then automatically display the processed result in the note, record other information in the note and check the recorded information. The electronic device can also extract the text in the webpage and automatically store the extracted text in the note. The related information includes but is not limited to voice information, text information, picture information and the like. Wherein the recorded information can comprise information input by the user, text information converted from voice, recorded videos, screenshots of the played videos, editing based on the input information, and taking the edited content as the content in the notes. According to the mode, the efficiency of acquiring and recording information through the electronic equipment can be greatly improved.

Description

Information processing method and related equipment

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 22, 2022, with application number 202211468016.6 and application name “A Method for Information Processing and Related Equipment”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to an information processing method and related equipment. Background Art

[0003] On the one hand, as the functions of electronic devices are gradually improved, more and more electronic devices can not only meet the communication needs of users, but also provide users with multiple channels to obtain external information, as well as a variety of entertainment methods. For example, users can obtain information by watching videos, browsing web pages, etc. On the other hand, compared with paper-based information recording methods, electronic devices can provide a more convenient way to record information. Electronic devices not only support the recording of various information, as well as the deletion, modification and sharing of recorded information, but also support multiple recording forms (for example, text, pictures, and videos, etc.). For example, the memo application in an electronic device can be used to record some memo information, matters, notes, etc., and can also be used to collect some useful data obtained from other applications (for example, news applications, etc.) in daily life and learning process.

[0004] In other words, electronic devices themselves are tools for acquiring and recording information. Users can simultaneously record information acquired through electronic devices. However, in practice, this simultaneous acquisition and recording method involves multiple applications within the electronic device, which is still inconvenient.

[0005] Therefore, how to improve the efficiency of obtaining and recording information through electronic devices is an urgent problem to be solved.

[0006] Summary of the Invention

[0007] This application provides an information processing method and related equipment. According to this method, an electronic device can display a note interface while playing a video, process the video, and then automatically display the processed results in the note. Other information can also be recorded in the note and the recorded information can be viewed. The electronic device can also extract text from a web page and automatically save the extracted text to the note. This method can greatly improve the efficiency of obtaining and recording information through electronic devices.

[0008] In a first aspect, the present application provides an information processing method. The method may include: an electronic device may display a first interface, the first interface may include a first area, a second area, and a video processing control; in response to an operation on the video processing control, the electronic device may process a first video; after the electronic device generates a processing result for the first video, the processing result is automatically displayed in the second area. The first area may display a first image from the first video in a playback state. The second area may be used to edit recorded information.

[0009] In the solution provided by this application, an electronic device can simultaneously process a video playing in a first area and automatically display the processed video in a second area. The second area can be used to edit recorded information. In this way, the electronic device can automatically display the processing structure of the video playing in the first area in the second area, eliminating the need for users to perform operations in the first and second areas, thereby improving the efficiency of recording information.

[0010] In some embodiments of the present application, the first interface may be the user interface 104 shown in Figure 1D. In still other embodiments of the present application, the first interface may be the user interface 105 shown in Figure 1E.

[0011] In some embodiments of the present application, the first area may be area 1, and the second area may be area 2. In some embodiments of the present application, the first area may also be the video playback area 20211.

[0012] In some embodiments of the present application, the second area may be a floating window 1042 .

[0013] It can be understood that the first area and the second area can be display areas of different applications.

[0014] In some embodiments of the present application, the first area and the second area may also be display areas in the same application. In this case, the application can play videos and record information.

[0015] In combination with the first aspect, in one possible implementation, after the electronic device generates a processing result for the first video and before the processing result is automatically displayed in the second area, the method may further include: automatically displaying the current processing status in the second area during the process of the electronic device processing the first video.

[0016] In the solution provided by this application, not only can the second area automatically display the processing results of the electronic device after it generates them, but it can also automatically display the current processing status in the second area while the electronic device is processing the first video. This approach allows users to see the processing results of the electronic device in real time. If any problems arise during the processing, users can promptly change or stop the processing of the first video, saving time.

[0017] In combination with the first aspect, in a possible implementation, the video processing control includes a first control in a first state. In response to an operation on the video processing control, the electronic device processes the first video, which may specifically include: in response to the operation on the first control in the first state, the electronic device may switch the state of the first control to the second state, and record the image in the first video displayed in the first area. In the process of the electronic device processing the first video, the current processing state is automatically displayed in the second area, which may specifically include: in the process of the electronic device recording the image in the first video displayed in the first area, the first card is automatically displayed in the second area. The electronic device generates a processing result for the first video, which may specifically include: in response to the operation on the first control in the second state, the electronic device may switch the state of the first control to the first state, stop recording the image in the first area, and generate the second video. Automatically displaying the processing result in the second area may specifically include: automatically displaying the second video in the first card.

[0018] In the solution provided by this application, the electronic device can support recording a video while playing it, and automatically generate an excerpt card (e.g., a first card) in a second area (e.g., a note interface of a note-taking application) during the recording process. After the recording is completed, the recorded video is automatically generated in the excerpt card, thereby improving the efficiency of recording information. In this case, the electronic device can also support the user to enter other information in the card or in a non-card area of ​​the note interface where the card is located.

[0019] It is understood that the first card is an excerpt card. Specifically, the first card can be card 1. The first video can be video S. The second video can be the excerpt video mentioned later.

[0020] According to this implementation, the electronic device processing the first video may refer to the electronic device recording the first video. The processing result may refer to the recorded video (which may be simply referred to as the recorded video). During the recording process, the electronic device may automatically display text, images, etc. in the second area indicating that the electronic device is currently in the recording state. After the recording is completed and the recorded video is generated, the electronic device may automatically display the recorded video in the second area.

[0021] For example, if the current processing state is video recording, the electronic device may display the user interfaces shown in Figures 2B-2R. The right half of the split-screen area in these user interfaces is a second area that automatically displays the current processing state. As shown in Figure 2B, the electronic device may display Card 1 in Area 2, which may display the words "Recording," indicating that the video is still being recorded.

[0022] In combination with the first aspect, in a possible implementation, the video processing control may include a first control in a first state. In response to an operation on the video processing control, the electronic device processes the first video, which may specifically include: in response to the operation on the first control in the first state, the electronic device may switch the state of the first control to the second state, and record the image in the first video displayed in the first area. The electronic device generates a processing result for the first video, which may specifically include: in response to the operation on the first control in the second state, the electronic device may switch the state of the first control to the first state, stop recording the image in the first area, and generate the second video. Automatically displaying the processing result in the second area may specifically include: automatically displaying the second video in the first card in the first area.

[0023] In the solution provided in the present application, the electronic device can support recording the video while playing the video, and automatically generate the recorded video in the excerpt card in the second area after the recording is completed, thereby improving the efficiency of recording information.

[0024] In some embodiments of the present application, in response to an operation on a first control in a first state, the electronic device may generate a first card in the second area, but does not display the current processing status in the first card during the recording process. Instead, the recorded video is displayed in the first card after the recording is completed.

[0025] In some embodiments of the present application, the electronic device may also generate an excerpt card containing the recorded video in the second area after the recording is completed.

[0026] It is understood that the first state can be understood as a non-recording state, and the second state can be understood as a recording state. In some embodiments of the present application, the first control in the first state can refer to the start recording control 10411, and the first control in the second state can refer to the end recording control 20231. The first video can be video S. The second video can be an excerpt video (as shown in Figure 2S).

[0027] In conjunction with the first aspect, in one possible implementation, the method may further include: in response to an operation on a first control in a first state, the electronic device may display a second control in a third state; while recording an image in a first video displayed in a first area, in response to an operation on a second control in a third state, the electronic device may switch the state of the second control to a fourth state and display a plurality of color options; in response to an operation on an image in a first video displayed in the first area, graffiti traces of a first color may be displayed on the image in the first video. The first color is a default color option among the plurality of color options. The second video includes an image containing graffiti traces of the first color.

[0028] In the solution provided in the present application, during the process of recording the image in the first video displayed in the first area, the user can directly doodle on the image displayed in the first video, and the doodle traces can be saved in the recorded video.

[0029] It is understandable that the third state can be understood as the graffiti state being turned off, and the second state can be understood as the graffiti state being turned on. In some embodiments of the present application, the second control in the third state can be the graffiti control 20232 shown in Figure 2B, and the second control in the fourth state can be the graffiti control 20232 after the background is highlighted (as shown in Figure 2F), or it can be the graffiti control 20232 after the color is changed to blue. The several color options can refer to the brush colors corresponding to the controls 20311, 20312, 20313, and 20314 in the color selection control 2031. The first color can be the brush color corresponding to the control 20311. For details on this part, please refer to the relevant descriptions of Figures 2C and 2D, which will not be repeated here.

[0030] In some embodiments of the present application, in response to operations on the plurality of color options, the electronic device can switch the color of the graffiti. For details of this part, please refer to the relevant description of Figures 2D-2E, and will not be repeated here.

[0031] In conjunction with the first aspect, in one possible implementation, the method may further include: in response to an operation on a first control in a first state, the electronic device may display a third control; and in response to the operation on the third control, at a first moment in the process of recording an image in a first video displayed in the first area, the electronic device may add a first time label and a first text addition area to the first card. The first time label displays the first moment, and the first text addition area is used to enter text.

[0032] In the solution provided in the present application, the electronic device can add a time tag to the video being recorded, and the time tag can be automatically added to the second area, which can facilitate subsequent quick viewing of the video content corresponding to the time tag.

[0033] In some embodiments of the present application, the third control may be a label control 20233. The first moment in the process of recording the image in the first video displayed in the first area may be the 9th second of the recorded video. The first time label may be a time label 20811. The first text addition area may be a text addition area 20812.

[0034] It is understandable that the first text adding area can be used to input text. For details, please refer to the relevant descriptions of Figures 2H to 2J, which will not be repeated here.

[0035] In combination with the first aspect, in a possible implementation, the method may further include: in response to an operation on the first control in the first state, the electronic device may display a fourth control; at a second moment in the process of recording the image in the first video displayed in the first area, the first area displays a second image, and in response to the operation on the fourth control, the electronic device may capture the second image and automatically add the second image to the first card.

[0036] In the solution provided by this application, the electronic device can capture the image displayed by the first video rather than the image displayed on the entire screen. Furthermore, the resulting image can be automatically added directly to the second area. This eliminates the need for users to manually select the captured image in the gallery application and then add it to the second area, saving time and improving the efficiency of recording information. Furthermore, because the captured image is in the first area rather than the entire screen, users can obtain a more concise and intuitive image. Furthermore, the captured image can be automatically displayed in an excerpt card, making it easier to subsequently review the notes in the card.

[0037] In some embodiments of the present application, the second image may be an image in the first video at the second moment.

[0038] In some embodiments of the present application, the fourth control may be a screenshot control 10412. The second image may be a screenshot 21112.

[0039] In conjunction with the first aspect, in one possible implementation, the method may further include: at a second moment during the recording of an image in the first video displayed in the first area, in response to an operation on a fourth control, the electronic device may add a second time label and a second text addition area to the first card. The second time label displays the second moment, and the second text addition area is used for entering text.

[0040] In the solution provided in the present application, the electronic device can also add time tags and text areas to the screenshots taken during the recording process, which can facilitate quick viewing of the screenshots when the video is played later.

[0041] In some embodiments of the present application, the second moment may be the 15th second of the recorded video. The second time tag may be time tag 21111. The second text adding area may be text adding area 21113.

[0042] It is understandable that the second text adding area can be used to input text. For details, please refer to the relevant descriptions of Figures 2K to 2M, which will not be repeated here.

[0043] In combination with the first aspect, in a possible implementation, the method may also include: during the process of recording the image in the first video displayed in the first area, the electronic device may display a fifth control in a fifth state; in response to the operation of the fifth control in the fifth state, the electronic device may switch the state of the fifth control to a sixth state; when the electronic device displays the fifth control in the sixth state, the electronic device may collect the first voice and display the text converted from the first voice in the first card.

[0044] In the solution provided by this application, the electronic device can collect the sound information of the first video and convert it into text to automatically display it in the second area. This can save the user's time for manual input and improve the efficiency of recording information.

[0045] It can be understood that the fifth state can be understood as the state of turning off the speech-to-text function, and the sixth state can be understood as the state of turning on the speech-to-text function. In some embodiments of the present application, the fifth control of the fifth state can be the audio-to-text control 10413 shown in Figure 2M, and the fifth control of the sixth state can be the audio-to-text control 10413 after the background is highlighted (as shown in Figure 2N), or the audio-to-text control 10413 after the color is changed to blue. In this case, the electronic device can display the text obtained by converting the first voice in the audio-to-text area 21411 in card 1.

[0046] In conjunction with the first aspect, in one possible implementation, the method may further include: while recording an image in a first video displayed in a first area, the electronic device may display a sixth control in a seventh state; at a third moment, the first area displays a third image from the first video, and in response to an operation on the sixth control in the seventh state, the electronic device may switch the state of the sixth control to an eighth state, extract text from the third image, and display a first text area on the first area; at a fourth moment, when the electronic device displays the sixth control in the eighth state, the first area displays a fourth image from the first video, and a first text area is displayed on the first area, and in response to the operation on the first text area, the electronic device may display several editing options. The first text area includes the text from the third image extracted by the electronic device. The several editing options are used to edit the text in the first text area. The fourth moment is later than the third moment.

[0047] In the solution provided in this application, the electronic device can extract text from the video being played and support editing of the text (for example, selecting all, copying, inserting notes, etc.), saving the user's time for manual input and improving the efficiency of recording information.

[0048] It is understood that the seventh state can be understood as a state in which the text extraction function for the video screen is turned off, and the eighth state can be understood as a state in which the text extraction function for the video screen is turned on. In some embodiments of the present application, the sixth control in the seventh state can be the text extraction control 10414 shown in Figure 2O, and the sixth control in the eighth state can be the text extraction control 10414 with the background highlighted (as shown in Figure 2P), or can be the text extraction control 10414 with the color changed to blue.

[0049] In some embodiments of the present application, the third moment may be the moment when the electronic device displays the user interface 215 shown in FIG. 2O . The third image may be an image in the video S displayed in the left half of the split-screen area shown in FIG. 2O . The text in the third image may include text 2161. The first text area may be the area where text 2161 is located.

[0050] In some embodiments of the present application, the plurality of editing options may be editing options included in the editing options area 2171 .

[0051] In conjunction with the first aspect, in one possible implementation, the video processing control may include a fourth control. In response to an operation on the video processing control, the electronic device processes the first video; after the electronic device generates a processing result for the first video, the processing result is automatically displayed in the second area. Specifically, the electronic device may include: at a fifth moment, the first area displays a fifth image from the first video; in response to an operation on the fourth control, the electronic device may capture the fifth image and automatically add the fifth image to a non-card area in the second area.

[0052] In the solution provided in the present application, when the video is not being recorded, the electronic device can also capture the scene in the video being played and automatically display the captured image in the second area.

[0053] In some embodiments of the present application, the fifth moment may be the moment when the electronic device displays the user interface 406 shown in FIG4F . The fifth image may be the image in the video playback area 20211 shown in FIG4F , namely, the screenshot 40711 .

[0054] It can be understood that the non-card area refers to the area other than the excerpt card.

[0055] In conjunction with the first aspect, in one possible implementation, the video processing control may include a fifth control in a fifth state. In response to an operation on the video processing control, the electronic device processes the first video. Specifically, this may include: in response to an operation on the fifth control in the fifth state, the electronic device may switch the state of the fifth control to a sixth state, and collect the audio of the first video and convert it into text. While the electronic device is processing the first video, the current processing state is automatically displayed in the second area. Specifically, this may include: while collecting the audio of the first video and converting it into text, the second card is automatically displayed in the second area. The second card displays the text currently converted by the electronic device. The electronic device generates a processing result for the first video. Specifically, this may include: in response to an operation on the fifth control in the sixth state, the electronic device may switch the state of the fifth control to the fifth state, stop collecting the audio of the first video, and generate a first text. Automatically displaying the processing result in the second area may specifically include: automatically displaying the first text in the second card. The first text is the text obtained by converting the audio of the first video collected by the electronic device.

[0056] In the solution provided by this application, when not recording a video, the electronic device can also collect the sound signal of the first video, convert it into text, and then automatically display it in the second card in the second area. During the process of collecting the sound signal, the electronic device can display the converted text in real time in the second card in the second area.

[0057] In some embodiments of the present application, the fifth control in the fifth state may be the audio-to-text control 10413 shown in FIG4E , and the fifth control in the sixth state may be the audio-to-text control 10413 with a highlighted background (as shown in FIG4F ), or the audio-to-text control 10413 with its color changed to blue. In this case, the electronic device may display the first text in the audio-to-text area 4061 in card 1.

[0058] In some embodiments of the present application, the second card may be card 2 .

[0059] In combination with the first aspect, in a possible implementation, the video processing control may include a fifth control in a fifth state. In response to an operation on the video processing control, the electronic device processes the first video, which may specifically include: in response to the operation on the fifth control in the fifth state, the electronic device may switch the state of the fifth control to the sixth state, and collect the voice corresponding to the first video and convert it into text; the electronic device generates a processing result for the first video, which may specifically include: in response to the operation on the fifth control in the sixth state, the electronic device may switch the state of the fifth control to the fifth state and generate a first text. The first text may be the text converted from the collected voice of the first video. Automatically displaying the processing result in the second area may specifically include: automatically displaying the first text in the second card in the second area.

[0060] In the solution provided by the present application, when the video is not being recorded, the electronic device may also collect the sound signal (i.e., voice) of the first video, convert it into text, and then automatically display it in the second card in the second area. During this conversion process, the electronic device may not initially display the converted text in the second area, but instead automatically display the converted text in the second card in the second area after the state of the fifth control is switched to the fifth state.

[0061] In combination with the first aspect, in a possible implementation, the video processing control may include a sixth control in a seventh state. In response to an operation on the video processing control, the electronic device processes the first video, which may specifically include: at the sixth moment, the first area displays the sixth image in the first video; in response to an operation on the sixth control in the seventh state, the electronic device may switch the state of the sixth control to the eighth state, and extract the text in the sixth image, and automatically display the second text area on the first area. The electronic device generates a processing result for the first video, which may specifically include: in response to an operation on the second text area, the electronic device may determine the text to be inserted. Automatically displaying the processing result in the second area may specifically include: automatically displaying the text to be inserted on the second area. Wherein, the second text area includes the text in the sixth image extracted by the electronic device.

[0062] In the solution provided in the present application, when the video is not recorded, the electronic device can also extract the text in the first video and support the user to edit it.

[0063] In some embodiments of the present application, the sixth control in the seventh state can be the text extraction control 10414 shown in Figure 3I, and the sixth control in the eighth state can be the text extraction control 10414 after the background is highlighted (as shown in Figures 4A-4D), or it can be the text extraction control 10414 after the color changes to blue.

[0064] In some embodiments of the present application, the sixth moment may be the moment when the electronic device displays the user interface 309 shown in FIG. 3I . The sixth image may be an image in the video S displayed in the left half of the split-screen area shown in FIG. 3I . The text in the sixth image may include text 4011. The second text area may be the area where text 4011 is located.

[0065] In some embodiments of the present application, in response to an operation on the second text area, the electronic device determines that text is to be inserted. The electronic device may include: detecting a user operation on the insert note option in user interface 402, and the electronic device may determine that the text to be inserted is text 4011. Accordingly, the electronic device may display user interface 403 as shown in FIG4C.

[0066] In some embodiments of the present application, the electronic device may automatically display the text to be inserted (eg, text 4011 ) in the note area 40121 in area 2 .

[0067] In conjunction with the first aspect, in one possible implementation, after the second text area is automatically displayed on the first area, the method may further include: at a seventh moment, when the electronic device displays the sixth control in the eighth state, displaying the seventh image in the first video on the first area and displaying the second text area on the first area. The seventh moment is later than the sixth moment.

[0068] In the solution provided in the present application, after the electronic device extracts the text from the first video, it does not affect the playback of the first video.

[0069] In some embodiments of the present application, the seventh moment may be the moment when the electronic device displays the user interface 403 shown in FIG4C . The seventh image may be an image in the video S displayed in the left half of the split-screen area shown in FIG4C .

[0070] In conjunction with the first aspect, in one possible implementation, the video processing control may include a sixth control in a seventh state. The method may include: at an eighth moment, the first area displays an eighth image from the first video; in response to an operation on the sixth control in the seventh state, the electronic device switches the state of the sixth control to the eighth state, extracts text from the eighth image, and automatically displays a third text area on the first area; in response to the operation on the third text area, the electronic device may display several editing options. The third text area may include the text from the eighth image extracted by the electronic device. The several editing options may be used to edit the text in the third text area.

[0071] In some embodiments of the present application, the eighth moment may be the moment when the electronic device displays user interface 403 as shown in FIG4C . The eighth image may be an image in video S displayed in the left half of the split-screen area as shown in FIG4C . The text in the eighth image may include text 4011. The third text area may be the area where text 4011 is located.

[0072] In conjunction with the first aspect, in one possible implementation, the method may further include: in response to an operation on the first time tag, causing the second video in the first card to jump to display a ninth image. The ninth image is the image displayed in the first video at the first moment. The second video is a video recorded from the image in the first video displayed in the first area.

[0073] In some embodiments of the present application, the ninth image may be an image in the video S in the left half split-screen area of ​​FIG. 2G .

[0074] In conjunction with the first aspect, in one possible implementation, the method may further include: in response to an operation on the second time tag, causing the second video in the first card to jump to display a second image. The second image may be the image displayed in the first video at the second moment. The second video is a video recorded from the image in the first video displayed in the first area.

[0075] In combination with the first aspect, in a possible implementation method, the electronic device displays the first interface, which may specifically include: in response to an operation on the second interface, the electronic device displays the first interface; wherein the first area and the second interface display the screen of the first video in the first application.

[0076] In some embodiments of the present application, the second interface may be the user interface 103 shown in Figure 1C. The operation on the second interface may be a three-finger swipe down operation.

[0077] In some other embodiments of the present application, the second interface may be the user interface 106 shown in FIG1F . The operation on the second interface may be an operation on the video excerpt option 10611 .

[0078] In some embodiments of the present application, the first application may be application A.

[0079] In conjunction with the first aspect, in one possible implementation, before the electronic device displays the first interface, the method may include: in response to an operation on a seventh control in the third interface, the electronic device may display a fourth interface. The fourth interface includes a third area and a second area. The electronic device displaying the first interface may specifically include: in response to an operation on a first play entry in the third area, the electronic device may display the first interface. The third interface and the second area display content of the second application. The third area displays content of the first application.

[0080] In some embodiments of the present application, the third interface may be the user interface 110 shown in FIG1J . The fourth interface may be the user interface 111 shown in FIG1K . The third area may be the display area 1111 . The first play entry may be the thumbnail 1021 .

[0081] In some embodiments of the present application, the second application may be a note-taking application (eg, a memo application, a note application, etc.).

[0082] In a second aspect, the present application provides an information processing method. The method may include: an electronic device may display a first webpage; in response to an operation on the first webpage, the electronic device extracts text from the first webpage and automatically saves the extracted text from the first webpage to a second application.

[0083] In the solution provided in this application, the electronic device can quickly extract text from a web page and automatically save it to a second application, thereby improving the efficiency of recording information.

[0084] In some embodiments of the present application, the first web page may be the web page shown in the user interface 601 .

[0085] In a third aspect, the present application provides an electronic device, comprising: one or more processors, and one or more memories; the one or more memories are coupled to the one or more processors, the memory being used to store computer program code, the computer program code comprising computer instructions, the one or more processors calling the computer instructions to enable the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0086] In a fourth aspect, the present application provides an electronic device, comprising: one or more processors, and one or more memories; the one or more memories are coupled to the one or more processors, the memory being used to store computer program code, the computer program code comprising computer instructions, the one or more processors calling the computer instructions to enable the electronic device to execute the method described in the second aspect or any one of the implementations of the second aspect.

[0087] In a fifth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect or any one of the implementations of the first aspect.

[0088] In a sixth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the second aspect or any one of the implementations of the second aspect.

[0089] In the seventh aspect, an embodiment of the present application provides a chip, which can be applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute the method described in the first aspect or any implementation of the first aspect.

[0090] In an eighth aspect, an embodiment of the present application provides a chip, which can be applied to an electronic device. The chip includes one or more processors, which are used to call computer instructions to enable the electronic device to execute the method described in the second aspect or any one of the implementations of the second aspect.

[0091] In a ninth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0092] In a tenth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, causes the electronic device to execute the method described in the second aspect or any one of the implementations of the second aspect.

[0093] It can be understood that the electronic device provided in the third aspect, the computer storage medium provided in the fifth aspect, the chip provided in the seventh aspect, and the computer program product provided in the ninth aspect are all used to execute the method described in the first aspect or any one of the implementations of the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation method in the first aspect, and will not be repeated here. The electronic device provided in the fourth aspect, the computer storage medium provided in the sixth aspect, the chip provided in the eighth aspect, and the computer program product provided in the tenth aspect are all used to execute the method described in the second aspect or any one of the implementation methods of the second aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation method in the second aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0094] 1A-1L are a set of exemplary user interfaces involved in triggering the video excerpt mode;

[0095] Figures 2A-2S are a set of exemplary user interfaces involved in Function 1;

[0096] 3A-3L are a set of exemplary user interfaces involved in viewing a snippet card;

[0097] Figures 4A-4G are a set of exemplary user interfaces related to Function 2-Function 4;

[0098] 5A-5C are a set of exemplary user interfaces involved in viewing notes;

[0099] 6A-6F are a set of exemplary user interfaces involved in function 5;

[0100] FIG7 is an exemplary flow chart of an information processing method provided in an embodiment of the present application;

[0101] FIG8 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0102] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0103] It should be understood that the terms "first," "second," and the like in the specification, claims, and drawings of this application are used to distinguish between different objects, rather than to describe a particular order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0104] References to "embodiments" in this application mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

[0105] Electronic devices can provide multiple channels for obtaining information and can also serve as tools for recording information. Users can use electronic devices to obtain information and also use them to record the information they have obtained.

[0106] An embodiment of the present application provides an information processing method. The information processing method can be used to generate notes on an electronic device. The information involved in this application includes, but is not limited to, voice information, text information, image information, and video information. The information processing involved in this application includes, but is not limited to, recording information and viewing information. Recording information includes input information, as well as processing the input information and using the processed results as the content of the note. For example, recording information may include converting acquired voice information into text information, editing or marking the input text information or image information, etc.

[0107] By implementing the information processing method, the electronic device can realize one or more of the following functions, but is not limited to the following functions.

[0108] Function 1. When recording information, the electronic device can support recording the video while playing the video, and generate a card containing the recorded video in the note window (also referred to as the note interface) of a note application (for example, a memo application and a note application, etc.). In this case, the electronic device can also support the user to enter other information in the card or in the note window where the card is located. It can be understood that the other information mentioned here refers to information other than the video. For example, text information (which may be referred to as text in the following content), voice information (which may be referred to as voice in the following content), picture information (which may be referred to as picture in the following content), etc.

[0109] For the convenience of description, this application records the recorded video as an excerpt video and the cards generated in the note window as excerpt cards.

[0110] During the video recording process, the electronic device can support graffiti on the video screen. Moreover, the excerpted video can include graffiti traces. In other words, after the video recording is completed, when the electronic device plays the excerpted video in the note window, the graffiti traces can be displayed on the corresponding screen of the excerpted video.

[0111] During the video recording process, the electronic device can support capturing the video screen, that is, obtaining a screenshot corresponding to the video being played and inserting the screenshot into the excerpt card. It is understood that when capturing the video screen, the electronic device can also generate a corresponding time tag and a corresponding input area in the excerpt card. The electronic device can support the user to enter other information in the corresponding input area.

[0112] It should be noted that in some embodiments of the present application, the screenshots captured by the electronic device may include not only the video screen but also the content of other areas. In still other embodiments of the present application, regardless of whether the window playing the video is large or small, the screenshots captured by the electronic device are screenshots of the video screen and do not include the content of other areas displayed by the electronic device.

[0113] During the video recording process, the electronic device can add tags and generate a corresponding input area in the excerpt card. The electronic device can support the user to enter other information in the corresponding input area.

[0114] During the video recording process, the electronic device can support voice-to-text conversion. Moreover, the converted text can be added to the excerpt card. It is understood that the electronic device can switch between turning on the voice-to-text function and turning off the voice-to-text function. It is understood that the user can trigger the electronic device to turn on the voice-to-text function before recording the video, and can also trigger the electronic device to turn on the voice-to-text function during the video recording process.

[0115] During the video recording process, the electronic device can extract text from the video, support inserting the text into notes, and also support operations such as copying and selecting all of the text.

[0116] Function 2. When recording information, the electronic device can support extracting text from the video while playing the video, inserting the text into notes, and also support operations such as copying and selecting all of the text.

[0117] Function 3: When recording information, the electronic device can support voice-to-text conversion while playing a video and generate an excerpt card in the note window of a note-taking application (such as a memo application and a note application). The generated excerpt card contains the converted text.

[0118] Function 4. When recording information, whether playing a video in a large window or a small window, the electronic device can support capturing the video screen while playing the video and insert the captured image into the note window of a note-taking application (for example, a memo application and a note application, etc.).

[0119] It is understandable that after the electronic device enters the video excerpt mode, the above functions 1 to 4 can be implemented.

[0120] Function 5. When recording information, the electronic device can support extracting text from a web page and saving the extracted text to a note-taking application (eg, a memo application, a note application, etc.).

[0121] It should be noted that in the process of recording information and generating notes, in addition to function 1-function 5, the electronic device can also realize other functions. Based on function 1-function 5, the electronic device can record information more conveniently. For the relevant content in the scenarios of recording information and viewing information, please refer to the following description of Figures 1A-1L, Figures 2A-2S, Figures 3A-3L, Figures 4A-4G, Figures 5A-5C and Figures 6A-6F, which will not be repeated here.

[0122] It is understood that the electronic devices in this application refer to terminal devices such as mobile phones and tablet computers. It is understood that the electronic devices can also be wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), or specialized cameras (e.g., SLR cameras, compact cameras), etc. This application does not impose any restrictions on the specific types of electronic devices.

[0123] The following first introduces how to trigger the video excerpt mode.

[0124] 1. Trigger the video excerpt mode while playing the video (as shown in Figure 1A-1C)

[0125] An electronic device can detect a user operation on a video application (e.g., application A). In response to the user operation, the electronic device can start the video application and display the main interface of the video application (i.e., the interface displayed by default after startup). The main interface of the video application may include thumbnails of several videos. The thumbnails of the several videos can be used to trigger the electronic device to play the several videos. The electronic device can detect a user operation on the corresponding thumbnails. In response to the user operation, the electronic device can display the playback interface of the video corresponding to the corresponding thumbnail. In one possible implementation, the electronic device can detect a three-finger swipe operation on the playback interface, and in response to the operation, the electronic device can enter a video excerpt mode. In another possible implementation, the electronic device can also detect an operation on a stylus shortcut control, and in response to the operation, the electronic device can display an interface with a video excerpt option. The video excerpt option can be used to trigger the electronic device to enter a video excerpt mode.

[0126] It is understandable that the user operations mentioned in this application may include but are not limited to touch (for example, click, etc.), voice control, gestures and other operations, and this application does not limit this.

[0127] Referring to the user interface 101 shown in Figure 1A, the user interface 101 displays a page including application icons, which may include multiple application icons (for example, a weather application icon, a calendar application icon, a mail application icon, a settings application icon, an application store application icon, a note application icon 1011, an album application icon, an application A application icon 1012, etc.). These application icons can be used to trigger the electronic device to start the corresponding application. Among them, the note application icon 1011 is an icon of a note application (i.e., a note application). The note application is a note-type application. That is, users can use the note application to record text information, picture information, etc. The application A application icon 1012 is an icon of application A. Application A is a video application.

[0128] In response to a user operation on the application icon 1012 of application A, the electronic device can start application A and display the user interface 102 as shown in Figure 1B. The user interface 102 is the main interface of application A. The user interface 102 may include thumbnails of several videos (for example, thumbnail 1021). For ease of description, this application will record the video corresponding to the thumbnail 1021 as video S. The electronic device can detect the user operation on the thumbnail 1021. In response to the user operation, the electronic device can play the video corresponding to the thumbnail 1021 (i.e., video S) and display the user interface 103 as shown in Figure 1C. The user interface 103 may include a display area 1031 and a display area 1032. Among them, the display area 1031 is the main interface of application A displayed in split screen by the electronic device, and the display area 1032 is the playback interface of the video S displayed in split screen by the electronic device. It can be understood that the display area 1032 may include video S and may also include other areas (for example, an introduction area, a video recommendation area, etc.).

[0129] 1. Gesture trigger (as shown in Figure 1C-1E)

[0130] In some embodiments of the present application, after the electronic device enters the excerpt mode, a floating window may be displayed in addition to the playback interface of the video S. The floating window displays the initialization interface of a new note of a note-taking application (e.g., a memo application and a note application).

[0131] For example, the electronic device may detect a three-finger swipe down operation on user interface 103. In response to this operation, the electronic device may enter excerpt mode and display user interface 104 as shown in FIG1D . Similar to user interface 103, user interface 104 may still include the main interface of application A and the playback interface of video S. However, user interface 104 may also include a toolbar 1041 and a floating window 1042.

[0132] Among them, toolbar 1041 may include a start recording control 10411, a screenshot control 10412, an audio-to-text control 10413, a text extraction control 10414, and an exit control 10415. Start recording control 10411 can be used to start video recording. Screenshot control 10412 is used to capture the video screen. Audio-to-text control 10413 is used for voice-to-text conversion. Text extraction control 10414 is used to extract text from the video. Exit control 10415 is used to exit video excerpt mode. Floating window 1042 displays a new note created by the electronic device in a note-taking application (e.g., a memo application and a note application).

[0133] It is understandable that the user can drag the floating window 1042 to change its position. The electronic device can detect the drag operation acting on the floating window 1042. In response to the operation, the electronic device can move the position of the floating window 1042.

[0134] In some embodiments of the present application, after the electronic device enters the excerpt mode, it can display the playback interface of the video S and the newly created notes of the note-taking application (for example, a memo application and a note application, etc.) in split screen.

[0135] For example, the electronic device may detect a three-finger swipe down operation on the user interface 103. In response to this operation, the electronic device may enter the excerpt mode and display the user interface 105 as shown in FIG1E . The user interface 105 may include area 1 and area 2. Area 1 is the playback interface of the video S, and area 2 is the new note interface (i.e., an initialization interface involved after creating a new note). In other words, what the electronic device displays in area 2 is the new note created by the electronic device in the note application. The user interface 105 may also include a toolbar 1041.

[0136] It is understood that the toolbar 1041 can be suspended on area 1 and area 2. The user can drag the toolbar 1041 to change its position. The electronic device can detect the drag operation on the toolbar 1041. In response to the operation, the electronic device can move the position of the toolbar 1041.

[0137] It can be understood that the following descriptions of other contents are all based on the split-screen display of the playback interface of video S and the new notes of note-type applications (for example, memo applications and note applications, etc.) for illustrative purposes. The relevant descriptions of the floating window can refer to this example.

[0138] 2. Trigger the stylus shortcut control (as shown in Figure 1C-1F)

[0139] It is understood that when the electronic device establishes a Bluetooth connection with the stylus, the electronic device may display a stylus shortcut control that can be used to quickly trigger the electronic device to start several functions related to the stylus.

[0140] As shown in FIG1C , the user interface 103 may further include a stylus hover control 1033 . The electronic device may detect a user operation on the stylus hover control 1033 . In response to the user operation, the electronic device may display the user interface 106 shown in FIG1F . The user interface 106 may include a display area 1061 . The display area 1061 may include several options (e.g., a video excerpt option 10611 , an open note option, a new note option, a screenshot option, a partial screenshot option, a global annotation option, and a settings option). These options are shortcut options corresponding to several stylus-related functions.

[0141] The electronic device may detect a user operation on the video excerpt option 10611. In response to the user operation, the electronic device may display the user interface 104 as shown in FIG. 1D or the user interface 105 as shown in FIG. 1E.

[0142] 2. Triggering video excerpt mode in note-taking apps (Figures 1A, 1G, and 1L)

[0143] The electronic device can detect user operations on note-taking applications (for example, memo applications and note applications, etc.). In response to the user operation, the electronic device can start the note-taking application and display the main interface of the note-taking application. The main interface of the note-taking application may include a new control. The electronic device can detect user operations on the new control. In response to the user operation, the electronic device can create a new note and display an initialization interface for the new note. The electronic device can enter a video excerpt mode based on the initialization interface. In one possible implementation, the electronic device can detect user operations on the initialization interface for the new note, and in response to the user operation, the electronic device can display an interface with a video excerpt option. The video excerpt option can be used to trigger the electronic device to enter the video excerpt mode. In another possible implementation, the initialization interface for the new note may include a video excerpt option.

[0144] As shown in Figure 1A , the electronic device may detect a user operation on a note-taking application icon 1011. In response to this user operation, the electronic device may launch the note-taking application and display a user interface 107 as shown in Figure 1G . User interface 107 is the main interface of the note-taking application. User interface 107 may include a new control 1071. The electronic device may detect the user operation on the new control 1071. In response to this user operation, the electronic device may create a new note and display a user interface 108 as shown in Figure 1H . User interface 108 is an initialization interface involved in creating a new note. User interface 108 may include a control 1081. The electronic device may detect the user operation on control 1081. In response to this user operation, the electronic device may display a user interface 109 as shown in Figure 1I . User interface 109 may include a display area 1091. Display area 1091 may include several tool options (e.g., a video excerpt option 10911, a photo option, a document scan option, a card and certificate collection option, and a select from gallery option). The electronic device may detect the user operation on the video excerpt option 10911. In response to the user operation, the electronic device may display a user interface 110 as shown in FIG1J . The user interface 110 may include a display area 1101. The display area 1101 may include icons of several video applications (e.g., icon 11011). Icon 11011 is an icon of application A. It is understandable that the several video applications may be applications that are in the video application whitelist and have been installed in the electronic device. The electronic device may detect the user operation on icon 11011. In response to the user operation, the electronic device may enter a video excerpt mode and display a user interface 111 as shown in FIG1K . The user interface 111 may include a display area 1111, area 2, and a toolbar 1041. The display area 1111 is the main interface of application A. The display area 1111 may include thumbnails 1021.

[0145] The electronic device can detect a user operation on the thumbnail 1021. In response to the user operation, the electronic device can play the video corresponding to the thumbnail 1021 (ie, video S) and display the user interface 105 as shown in FIG. 1E.

[0146] In some embodiments of the present application, an electronic device may display a functional introduction interface for a video excerpt. For example, the electronic device may detect a user operation on the video excerpt option 10911. In response to this user operation, the electronic device may display a user interface 112 as shown in FIG1L . User interface 112 may include a display area 1121. Display area 1121 may include a functional introduction to the video excerpt. Display area 1121 may include controls 11211. The electronic device may detect a user operation on control 11211. In response to this user operation, the electronic device may display a user interface 110 as shown in FIG1J .

[0147] It should be noted that the user can also trigger the electronic device to enter the video excerpt mode through other methods (for example, other gestures, etc.), and this application does not limit this.

[0148] The following is an exemplary introduction to the implementation of Function 1 with reference to FIG. 2A to FIG. 2S .

[0149] The electronic device may detect a user operation on the toolbar 1041 shown in FIG1E . In response to the user operation, the electronic device may move the toolbar 1041 and display the user interface 201 shown in FIG2A . The user interface 201 includes the toolbar 1041 .

[0150] 1. Start recording (Figure 2A)

[0151] The electronic device can detect the start recording control 10411 included for the toolbar 1041. In response to the start recording control 10411, the electronic device can start recording the video, generate an excerpt card in the note, and display the user interface 202 as shown in Figure 2B. The user interface 202 may include area 1 and area 2. Area 1 is the playback interface of video S. Area 1 may include a video playback area 20211. In addition to the video playback area 20211, area 1 may also include other areas such as an introduction area and a video recommendation area. Area 2 is a note interface. The notes displayed on the note interface may be newly created notes when the electronic device enters the video excerpt mode (as shown in Figures 1D and 1E), or may be notes originally displayed before triggering the entry into the video excerpt mode (as shown in Figure 1I). Area 2 may include an excerpt card generated by the electronic device. For ease of description, this application refers to the excerpt card as Card 1. "Recording" is displayed in Card 1, which indicates that the video is still in the recording state. Card 1 may include a card name area 20221 and an original video link 20222. It is understood that the card name area 20221 is an editable area. The user can change the name of the corresponding excerpt card displayed in the card name area 20221. The original video link 20222 is used to replay the original video corresponding to the excerpt card (for example, video S). When viewing the note later, the electronic device can detect the user's operation on the original video link 20222. In response to the user operation, the electronic device can start application A and display the playback interface of video S in application A.

[0152] The user interface 202 may also include a toolbar 2023. Similar to the toolbar 1041, the toolbar 2023 includes a screenshot control 10412, an audio-to-text control 10413, a text extraction control 10414, and an exit control 10415. Unlike the toolbar 1041, the toolbar 2023 may also include an end recording control 20231, a graffiti control 20232, and a label control 20233. Among them, the end recording control 20231 can be used to end video recording. The end recording control 20231 may also include the remaining maximum recording time. It is understandable that the maximum time for recording a video can be pre-set according to actual needs (for example, 5 minutes), and this application does not impose any restrictions on this. The graffiti control 20232 can be used to graffiti on the video screen. The label control 20233 can be used to add a time tag to the recorded video.

[0153] 2. Doodle while recording (Figure 2B-2F)

[0154] The electronic device can detect a user operation on the graffiti control 20232 in the user interface 202. In response to the user operation, the electronic device can display the user interface 203 shown in Figure 2C. The user interface 203 may include a color selection control 2031. The color selection control 2031 is used to display the brush colors supported for graffiti. The color selection control 2031 may include a control 20311, a control 20312, a control 20313, and a control 20314. These four controls correspond to four brush colors. As shown in Figure 2C, the control 20311 is selected, and its corresponding brush color is the current brush color. The user can graffiti in the video playback area 20211 based on the brush color corresponding to the control 20311.

[0155] It is understood that after the electronic device detects a user operation on the graffiti control 20232, the graffiti control 20232 may be in a selected state. In some embodiments of the present application, as shown in FIG2C , when the graffiti control 20232 is in the selected state, the background of the graffiti control 20232 may be highlighted. In still other embodiments of the present application, when the graffiti control 20232 is in the selected state, the color of the graffiti control 20232 is blue. When the graffiti control 20232 is in the unselected state, the color of the graffiti control 20232 is black.

[0156] The electronic device may detect a user operation on the video play area 20211 in the user interface 203. In response to the user operation, the electronic device may display the user interface 204 shown in FIG2D. The video play area 20211 of the user interface 204 may display graffiti traces.

[0157] The electronic device can detect a user operation on control 20313 in user interface 204. In response to the user operation, the electronic device can display user interface 205 as shown in FIG2E . Control 20313 in user interface 205 is selected, and its corresponding brush color is the current brush color. The user can doodle in video playback area 20211 based on the brush color corresponding to control 20313.

[0158] The electronic device may detect a user operation on the video playback area 20211 in the user interface 205. In response to the user operation, the electronic device may display the user interface 206 shown in FIG2F. The video playback area 20211 of the user interface 206 may display graffiti traces.

[0159] The electronic device can detect a user operation on the graffiti control 20232 in the user interface 206. In response to the user operation, the graffiti control 20232 can change from a selected state to an unselected state, and accordingly, the highlighting of the background of the graffiti control 20232 can also disappear. In some embodiments of the present application, when the graffiti control 20232 changes from a selected state to an unselected state, its color can change from blue to black.

[0160] 3. Add tags while recording (Figure 2G-2J)

[0161] When video S plays to the 13th second, the electronic device may display user interface 207 as shown in FIG2G . The end recording control 20231 in user interface 207 displays the maximum remaining recording time as 04:51, or 4 minutes and 51 seconds. In other words, the video has been recorded for 9 seconds. The electronic device may detect a user operation on the label control 20233 in user interface 207. In response to the user operation, the electronic device may generate a time label in the excerpt card and display user interface 208 as shown in FIG2H . User interface 208 may include area 2. Area 2 is a note interface. Area 2 may include card 1. Card 1 may include a time label 20811 and a text addition area 20812. The time displayed on time label 20811 is 00:09. This indicates that the electronic device added time label 20811 at the 9th second of the video recording. Text addition area 20812 is an editable area. The user can enter text in text addition area 20812.

[0162] The electronic device may detect a user operation on the text addition area 20812. In response to the operation, the electronic device may display the user interface 209 shown in FIG2I. The user interface 209 may include a keyboard 2091. A cursor may be displayed in the text addition area 20812 in the user interface 209. The user may input in the text addition area 20812 using the keyboard 2091.

[0163] The electronic device may detect a user operation on the keyboard 2091 in the user interface 209. In response to the user operation, the electronic device may display the user interface 210 shown in FIG2J. The text adding area 20812 in the user interface 209 may display “Potato”, which is the content input by the user.

[0164] It is understandable that the video playback area 20211 may display a playback progress bar (as shown in FIG. 2G ) or may not display a playback progress bar (as shown in FIG. 2J ).

[0165] In some embodiments of the present application, the number of characters that can be added to the text addition area 20812 does not exceed a preset number of characters. It is understood that the preset number of characters can be set based on actual needs and is not limited by the present application. For example, the preset number of characters can be 50. This means that a maximum of 50 characters can be added to the text addition area 20812.

[0166] 4. Capture the video screen while recording (Figure 2J-2M)

[0167] The electronic device can detect a user operation on the screenshot control 10412 in the user interface 210. In response to the user operation, the electronic device can capture the screen displayed in the video playback area 20211 and display the user interface 211 as shown in Figure 2K. The user interface 211 may include area 2. Area 2 is a note interface. Area 2 may include card 1. Card 1 may include a time label 21111, a screenshot 21112 and a text adding area 21113. The time displayed on the time label 21111 is 00:15. This indicates that the electronic device captured the screenshot 21112 at the 15th second of the video recording and added the time label 21111. The text adding area 21113 is an editable area. The user can enter text in the text adding area 21113.

[0168] The electronic device may detect a user operation on the text addition area 21113. In response to the operation, the electronic device may display a user interface 212 as shown in FIG2L. The user interface 212 may include a keyboard 2091. A cursor may be displayed in the text addition area 21113 in the user interface 212. The user may input in the text addition area 21113 using the keyboard 2091.

[0169] The electronic device may detect a user operation on the keyboard 2091 in the user interface 212. In response to the user operation, the electronic device may display the user interface 213 as shown in FIG2M. The text adding area 21113 in the user interface 213 may display the content input by the user.

[0170] In some embodiments of the present application, similar to the text adding area 20812, the number of characters that can be added in the text adding area 21113 also does not exceed the preset number of characters. It is understood that the preset number of characters can be set according to actual needs and this application does not impose any restrictions on this.

[0171] 5. Enable voice-to-text function while recording (Figure 2M-2O)

[0172] The electronic device can detect a user operation on the speech-to-text control 10413 in the user interface 213. In response to the user operation, the electronic device can enable the speech-to-text function and display the user interface 214 shown in FIG2N. The user interface 214 can include area 2. Area 2 is a note interface. Area 2 can include card 1. Card 1 can include a speech-to-text area 21411. It is understood that after the speech-to-text function is enabled, the electronic device can collect sound signals and convert the sound signals into text, which is displayed in the speech-to-text area 21411.

[0173] In some embodiments of the present application, the audio-to-text area 21411 in card 1 may be located below the excerpted video.

[0174] It is understandable that after the electronic device detects a user operation on the audio-to-text control 10413, the audio-to-text control 10413 may be in a selected state. In some embodiments of the present application, as shown in FIG2N , when the audio-to-text control 10413 is in a selected state, the background of the audio-to-text control 10413 may be highlighted. In some other embodiments of the present application, when the audio-to-text control 10413 is in a selected state, the color of the audio-to-text control 10413 is blue. When the audio-to-text control 10413 is in an unselected state, the color of the audio-to-text control 10413 is black.

[0175] The electronic device may detect a user operation on the speech-to-text control 10413 in the user interface 214. In response to the user operation, the electronic device may turn off the speech-to-text function and display the user interface 215 shown in FIG2O.

[0176] 6. Extract text from video while recording (Figure 2O-2R)

[0177] The electronic device can detect a user operation on the text extraction control 10414 in the user interface 215. In response to the user operation, the electronic device can extract the text in the current screen displayed by the video S and display the user interface 216 as shown in Figure 2P. The video playback area 20211 in the user interface 216 continues to play the video S. A mask is added to the video S. In layman's terms, the screen of the video S looks grayed out. The text extracted by the electronic device (for example, text 2161) can be covered above the video playback area 20211. The user can edit the text (for example, insert a note, select all, copy, etc.).

[0178] Similarly, after the electronic device detects a user operation on the text extraction control 10414, the text extraction control 10414 may be in a selected state. In some embodiments of the present application, as shown in FIG2P , when the text extraction control 10414 is in the selected state, the background of the text extraction control 10414 may be highlighted. In still other embodiments of the present application, when the text extraction control 10414 is in the selected state, the color of the text extraction control 10414 is blue. When the text extraction control 10414 is not selected, the color of the text extraction control 10414 is black.

[0179] The electronic device can detect a user operation on the text 2161. In response to the user operation, the electronic device can display a user interface 217 as shown in Figure 2Q. The user interface 217 may include an editing option area 2171. The editing option area 2171 may include several editing options (for example, an insert note option, a copy option, a select all option, etc.). Among them, the insert note option can be used to quickly insert the selected text into the note interface (for example, the note interface shown in area 2). It can be understood that the location for inserting the note can be the text adding area during the last editing. The text adding area during the last editing can be in the note or in card 1.

[0180] The electronic device may detect a user operation on the text extraction control 10414 in the user interface 217. In response to this user operation, the electronic device may stop displaying the extracted video text and display the user interface 218 shown in FIG2R . The end recording control 20231 in the user interface 218 displays the maximum remaining recording time as 04:04, or 4 minutes and 4 seconds. In other words, the video has been recorded for 56 seconds.

[0181] 7. End video recording (Figure 2R-Figure 2S)

[0182] The electronic device may detect a user operation on the "End Recording" control 20231 in the user interface 218. In response to this user operation, the electronic device may end the video recording, generate a video excerpt, and display the user interface 219 shown in FIG2S. The user interface 219 may include a playback interface and a note interface for video S. The note interface may include card 1. Card 1 may include a display area 2191. Display area 2191 displays the video excerpt. Display area 2191 may include a playback toolbar 21911. The playback toolbar 21911 may include a start playback control 219111, a playback progress bar 219112, an audio-to-text control 219113, and a zoom playback control 219114. The playback progress bar 219112 may include the elapsed playback time and the total video duration. The playback progress bar 219112 may also include several time nodes (e.g., node 1 and node 2), which correspond to the time tags in card 1. Node 1 corresponds to time tag 20811. Node 2 corresponds to the time label 21111.

[0183] It should be noted that, as shown in FIG2S , when the excerpt video is in a paused playback state, the audio-to-text control 219113 is gray, which means that the control cannot be triggered.

[0184] The following is an exemplary introduction to viewing the relevant content of the excerpt card with reference to FIG. 3A to FIG. 3L .

[0185] 1. Check the graffiti traces in the excerpt video (Figure 3A)

[0186] The video playback area 20211 in the user interface 219 may further include a pause control 2192. The electronic device may detect a user operation on the pause control 2192. In response to the user operation, the electronic device may pause the playback of the video S. The electronic device may also detect a user operation on the start playback control 219111. In response to the user operation, the electronic device may start playing the excerpt video. When the excerpt video plays to the 7th second, the electronic device may display the user interface 301 as shown in FIG3A. The excerpt video in the user interface 301 is in the playback state. At this time, the screen displayed by the excerpt video contains traces of graffiti.

[0187] 2. Jump to play excerpt video based on time tags (Figure 3A-Figure 3C)

[0188] The electronic device can detect a user operation on time tag 20811 in user interface 301. In response to the user operation, the electronic device can jump to the time node corresponding to time tag 20811 and display user interface 302 as shown in Figure 3B. The video excerpt in user interface 302 jumps to node 1.

[0189] The electronic device can detect a user operation on time tag 21111 in user interface 301. In response to the user operation, the electronic device can jump to the time node corresponding to time tag 21111 and display user interface 303 as shown in Figure 3C. The video excerpt in user interface 303 jumps to node 2.

[0190] 3. Slide to view the excerpt card (Figure 3C-Figure 3D)

[0191] The electronic device may detect an upward swipe operation on the non-video area of ​​card 1 in user interface 303. In response to this operation, the electronic device may display user interface 304 as shown in FIG3D . In user interface 304, the content displayed in the non-video area of ​​card 1 is different from the content displayed in the non-video area of ​​card 1 in user interface 303.

[0192] In some embodiments of the present application, the electronic device may detect a downward sliding operation on the scroll bar 3031 in the user interface 303. In response to this operation, the electronic device may display the user interface 304 as shown in FIG3D.

[0193] In some embodiments of the present application, in response to an upward swipe operation on the non-video area of ​​card 1 in user interface 303, the electronic device may still display the video excerpt and audio-to-text area 21411 in card 1, but the displayed video note area in card 1 may be different. That is, in response to the upward swipe operation, the video note area displayed by the electronic device may slide upward, while the video excerpt and audio-to-text area 21411 in card 1 may not slide upward.

[0194] It can be understood that the video note area in the excerpt card refers to other areas in the excerpt card except the excerpt video and audio-to-text areas.

[0195] 4. Enable the voice-to-text function when playing excerpted videos (Figure 3E-3G)

[0196] When the excerpt video is played to the 34th second, the electronic device may display the user interface 305 shown in FIG3E . It is understandable that, as shown in FIG3E , when the excerpt video is in the playing state, the audio-to-text control 219113 may be triggered.

[0197] The electronic device can detect a user operation on the audio-to-text control 219113 in the user interface 305. In response to the user operation, the electronic device can enable the speech-to-text function and display the user interface 306 shown in FIG3F. The audio-to-text area 21411 in the user interface 306 can display text converted from the sound signal collected by the electronic device.

[0198] In some embodiments of the present application, the audio-to-text area 21411 can display a maximum of h lines of text. h is a positive integer. It is understood that the specific value of h can be set according to actual needs and is not limited by this application. For example, h can be 3. For another example, h can also be 2.

[0199] In some embodiments of the present application, when the speech-to-text function is turned on in the electronic device, if the text in the speech-to-text area 21411 exceeds h lines, the electronic device can display the most recently converted h lines of text and fold the other lines of text.

[0200] The electronic device may detect a user operation on the pause playback control 3061 in the user interface 306. In response to this operation, the electronic device may pause playback of the excerpted video, disable the speech-to-text function, and display the user interface 307 shown in FIG3G . The speech-to-text control 219113 in the user interface 307 is grayed out, indicating that the control cannot be triggered. The user interface 307 may include a text expansion control 3071. The text expansion control 3071 is used to expand the text in the speech-to-text area 21411.

[0201] 5. Folding and unfolding the audio-to-text area and excerpt cards (Figure 3G-3I)

[0202] The electronic device can detect a user operation on the text expansion control 3071. In response to the user operation, the electronic device can display the user interface 308 shown in Figure 3H. The audio-to-text area 21411 in the user interface 308 displays four lines of text. These four lines of text are the text converted from all the sound signals previously collected by the electronic device. The user interface 308 can include a text folding control 3081. The text folding control 3081 can be used to fold the text in the audio-to-text area 21411. The user interface 308 can also include a card folding control 3082. The card folding control 3082 can be used to fold card 1.

[0203] It is understandable that the electronic device can detect a user operation on the text folding control 3081. In response to the user operation, the electronic device can display a user interface 307 as shown in FIG3G.

[0204] The electronic device may detect a user operation on card folding control 3082. In response to the user operation, the electronic device may display user interface 309 as shown in FIG3I. Card 1 in user interface 309 is in a folded state. User interface 309 may include card expansion control 3091. Card expansion control 3091 may be used to expand card 1.

[0205] It is understandable that the electronic device can detect a user operation on the card expansion control 3091. In response to the user operation, the electronic device can display the user interface 308 shown in FIG3H.

[0206] 6. Display status of the video note area in the excerpt card when playing the excerpt video (Figure 3J-Figure 3L)

[0207] In some embodiments of the present application, when the excerpt video is played, the non-video area (i.e., the audio-to-text area and the video note area) can be displayed slidingly. In addition, the time labels, corresponding screenshots, and corresponding text addition areas corresponding to the time nodes that have been played in the excerpt video can be displayed normally, while the time labels, corresponding screenshots, and corresponding text addition areas corresponding to the time nodes that have not been played in the excerpt video are covered with a mask. In some embodiments of the present application, during the playback of the excerpt video, the time label corresponding to the most recently played time node in the non-video area can be highlighted. For example, the time label can be changed from black to blue.

[0208] When the video excerpt plays to the 7th second, the electronic device may display the user interface 310 shown in FIG3J . At this point, the video excerpt has not yet played to Node 1 and Node 2. Therefore, the time labels corresponding to Node 1 and Node 2 (i.e., time label 20811 and time label 21111) in the user interface 310, as well as the corresponding text addition areas, are covered with a mask.

[0209] When the excerpt video plays to the 9th second, the electronic device may display the user interface 311 shown in FIG3K . At this point, the excerpt video has played to node 1 but not to node 2. Therefore, the time label corresponding to node 1 (i.e., time label 20811) and its corresponding text addition area (i.e., text addition area 20812) in the user interface 311 are displayed normally, while the time label corresponding to node 2 (i.e., time label 21111) in the user interface 311 is covered with a mask.

[0210] When the excerpt video plays to the 15th second, the electronic device may display the user interface 312 shown in FIG3L . At this point, the excerpt video has played to node 2, so the electronic device slides to the time label corresponding to node 2 (i.e., time label 21111) and its corresponding screenshot (i.e., screenshot 21112).

[0211] In some embodiments of the present application, the electronic device may highlight the time tag corresponding to the most recently played node.

[0212] In some other embodiments of the present application, when the excerpt video is played, the audio-to-text area does not slide and display, and the video note area can slide and display. The specific implementation method of this part of the content can be referred to above and will not be repeated here.

[0213] The following describes exemplary implementations of Function 2 to Function 4 with reference to FIG. 4A to FIG. 4G .

[0214] It is understood that the text extraction method when the electronic device enters video excerpt mode but is not recording video is similar to the text extraction method when the electronic device enters video excerpt mode and is recording video. The speech-to-text conversion method when the electronic device enters video excerpt mode but is not recording video is similar to the speech-to-text conversion method when the electronic device enters video excerpt mode and is recording video. The method for capturing a video screen when the electronic device enters video excerpt mode but is not recording video is similar to the method for capturing a video screen when the electronic device enters video excerpt mode and is recording video.

[0215] The electronic device can detect a user operation on the text extraction control 10414 in the user interface 309. In response to the user operation, the electronic device can extract the text in the current screen displayed by the video S and display the user interface 401 as shown in Figure 4A. A mask is added to the video playback area 20211 in the user interface 401, and is also covered with the text extracted by the electronic device (for example, text 4011). The user can edit the text (for example, select, select all, and copy, etc.). The user interface 401 may include area 2. Area 2 may include a note area 40121. It can be understood that the note area 40121 is the text addition area when the user last edited. A cursor is displayed in the note area 40121.

[0216] The electronic device may detect a user operation on text 4011. In response to the user operation, the electronic device may select text 4011 and display user interface 402 as shown in Figure 4B. User interface 402 may include an edit option area 2171. Edit option area 2171 may include an insert note option.

[0217] The electronic device may detect a user operation on the insert note option in the user interface 402. In response to the operation, the electronic device may display a user interface 403 as shown in FIG4C.

[0218] Of course, the user can also perform other forms of editing (eg, selection, selection all, and copy, etc.) on the selected text (eg, text 4011 ), and this application does not impose any restrictions on this.

[0219] It is understandable that the user interface 401 may further include a start play control 4013. The electronic device may detect a user operation on the start play control 4013. In response to the user operation, the electronic device may start playing the video S and display the user interface 404 as shown in FIG4D . The picture of the video S displayed in the video play area 20211 in the user interface 404 is different from the picture of the video S displayed in the video play area 20211 in the user interface 401. However, when the video S is played to the first minute, the electronic device detects a user operation on the text extraction control 10414. Therefore, the text extracted by the electronic device overlaid on the video play area 20211 in the user interface 401 and the user interface 404 is the same, both being the text in the picture displayed when the video S is played to the first minute.

[0220] The electronic device may detect a user operation on the text extraction control 10414 in the user interface 404. In response to the user operation, the electronic device may stop displaying the extracted video text and display the user interface 405 as shown in FIG4E.

[0221] The electronic device can detect a user operation on the audio-to-text control 10413 in the user interface 405. In response to the user operation, the electronic device can turn on the speech-to-text function, generate a new excerpt card in the note, and display the user interface 406 as shown in Figure 4F. For ease of description, this application refers to the new excerpt card as card 2. Card 2 may include an audio-to-text area 4061. It is understandable that after the electronic device turns on the speech-to-text function, it can collect sound signals and convert the sound signals into text to be displayed in the audio-to-text area 4061.

[0222] The electronic device may detect a user operation on the screenshot control 10412 in the user interface 406. In response to this user operation, the electronic device may capture the image displayed in the video playback area 20211 and display the user interface 407 shown in FIG4G . User interface 407 may include the playback interface of video S and area 2. Area 2 may include screenshot 40711. It is understood that screenshot 40711 is in the note, not in the excerpt card. That is, screenshot 40711 is in the non-card area of ​​area 2.

[0223] It is understandable that the electronic device can detect a downward sliding operation for area 2. In response to this operation, the electronic device can view other contents of the note corresponding to area 2 (for example, excerpted video, text, screenshots, etc.).

[0224] The following is an exemplary introduction to viewing the relevant content of the notes with reference to Figures 5A-5C.

[0225] The user can view the notes saved after the electronic device enters the video excerpt mode in a note-taking application (eg, a memo application and a note application, etc.).

[0226] In some embodiments of the present application, an excerpt video in a note interface is playing. At this time, the electronic device can detect an upward sliding operation on the note interface. In response to the operation, the electronic device can play the excerpt video in a small window.

[0227] The electronic device may display a user interface 501 as shown in FIG5A . The electronic device may detect a user operation on the start play control 219111 in the user interface 501. In response to the user operation, the electronic device may start playing the excerpt video in card 1 and display a user interface 502 as shown in FIG5B .

[0228] The electronic device may detect an upward swipe operation on the user interface 502. In response to the user operation, the electronic device may display a user interface 503 as shown in FIG5C. The user interface 503 may include a video window 5031. The video window 5031 is a playback window for the excerpt video in the card 1. The video window 5031 may include an exit control 50311 and a play toolbar 50312. The exit control 50311 may be used to exit the video window 5031. The play toolbar 50312 may include a pause control, a play progress bar, and a zoom control. The pause control is used to pause the playback of the excerpt video. The play progress bar is used to view the playback progress of the excerpt video. The zoom control is used to zoom in on the playback of the excerpt video.

[0229] In some embodiments of the present application, when an electronic device displays an excerpt card in a note (e.g., card 1 in user interface 501), the excerpt card can be folded to f% of the screen height. It is understood that the range of f is (0, 100), and the specific value of f can be set according to actual needs and is not limited by this application. For example, f can be 60.

[0230] In some embodiments of the present application, when an electronic device displays an excerpt card in a note (e.g., card 1 in user interface 501), the maximum height of the excerpt card after expansion does not exceed a first preset height. When the maximum height of the excerpt card after expansion reaches the first preset height and a portion of its content is still not displayed, the content in the excerpt card can be displayed by sliding. It is understood that the first preset height can be set according to actual needs, and this application does not impose any restrictions on this. For example, the first preset height can be the screen height of the electronic device.

[0231] In some embodiments of the present application, when an electronic device displays an excerpt video in a note (e.g., an excerpt video in card 1), the height of the excerpt video may be within a first preset range. It is understood that the first preset range may be set according to actual needs, and the present application does not impose any restrictions on this. For example, the minimum value of the first preset range is 1 / 5 of the screen height (i.e., the screen height of the electronic device), the maximum value of the first preset range is 1 / 3 of the screen height, and the first preset range may include the minimum value and the maximum value.

[0232] In some embodiments of the present application, when the electronic device displays the audio-to-text area in the note (for example, the audio-to-text area 21411 in the card 1 as shown in Figure 5A), the maximum height of the audio-to-text area after expansion does not exceed the second preset height. When the maximum height of the audio-to-text area after expansion reaches the second preset height, and a part of the content is still not displayed, the content in the audio-to-text area can be slid and displayed. It is understandable that the second preset height can be set according to actual needs, and this application does not limit this. For example, the second preset height can be 1 / 3 screen height.

[0233] The following describes an exemplary implementation of Function 5 with reference to FIG. 6A to FIG. 6F .

[0234] The electronic device may detect a user operation on a web page. In response to the user operation, the electronic device may extract text from the web page and save the extracted text in a note-taking application (eg, a memo application, a note application, etc.).

[0235] As shown in Figure 6A, user interface 601 is a web page interface. The electronic device can detect a user operation on user interface 601. In response to the user operation, the electronic device can extract the text in user interface 601 and save the text to a note-taking application (e.g., a memo application and a note application). At the same time, the electronic device can also display a corresponding animation. The animation effect can be seen in Figures 6B to 6F. Specifically, as shown in Figures 6B to 6F, user interface 602 may include display area 6021, user interface 603 may include display area 6031, user interface 604 may include display area 6041, user interface 605 may include display area 6051, and user interface 606 may include display area 6061. Among them, display area 6021, display area 6031, and display area 6041 are gradually shrinking web page interfaces. Moreover, display area 6031 and display area 6041 include incomplete web page interfaces. Display area 6051 and display area 6061 are web page collection prompt information. Compared with display area 6061, display area 6051 is covered with a mask, which indicates that the electronic device has not completed the web page collection when displaying user interface 605. It can be understood that when the electronic device displays user interface 606, the electronic device has completed the collection of the web page shown in user interface 601.

[0236] It is understandable that the electronic device can detect a user operation on the display area 6061. In response to the user operation, the electronic device can display the text of the web page interface (eg, user interface 601) saved in the note application.

[0237] It should be noted that the web page collection mentioned in this application refers to: extracting text from a web page and saving the extracted text to a note-taking application.

[0238] It can be understood that the user interfaces shown in Figures 1A-1L, 2A-2S, 3A-3L, 4A-4G, 5A-5C, and 6A-6F are merely examples provided for this application and should not be regarded as limitations on this application.

[0239] FIG7 is an exemplary flowchart of an information processing method provided in an embodiment of the present application.

[0240] In some possible cases, the exemplary process involved in the electronic device recording information can refer to the following description of steps S701 to S703.

[0241] S701: The electronic device displays a first interface, which includes a first area, a second area, and a video processing control, wherein the first area displays a first image in a first video being played, and the second area is used to edit recorded information.

[0242] It is understandable that the first area can be the area involved in the aforementioned content that displays a video in playback state (for example, video S). The second area can be the area involved in the aforementioned content for editing and recording information (for example, a note interface). For example, the second area can be an initialization interface involved after creating a new note. The video processing control is used to trigger the electronic device to process the first video in the first area (for example, capturing the picture in the first video, collecting the sound of the first video and converting it into text, extracting the text in the image contained in the first video, etc.), and automatically display the corresponding processing status (for example, the captured image, the converted text, the extracted text, etc.) in the second area.

[0243] It should be noted that the second area may include several editing options (e.g., a list option, a style option, an add option, a recording option, and a handwriting option). These editing options can be used to record information in the second area and edit recorded information. For example, the style option can be used to change the style of information recorded in the first area, and can also change the style for subsequent recording of information.

[0244] In a possible implementation, the first interface may be the user interface 104 shown in FIG. 1D in the aforementioned content. The first area may be the video playback area shown in FIG. 1D . The second area may be the floating window 1042 .

[0245] In another possible implementation, the first interface may be user interface 105 shown in FIG. 1E in the aforementioned content. The first area may be area 1. The first area may also be a video playback area (e.g., video playback area 20211), i.e., an area where a video image is displayed. The second area may be area 2. The first video may be the video currently playing in area 1 (i.e., video S). The first image may be an image displayed in the video playback area in area 1.

[0246] It can be understood that the video processing controls may include any one or more of the start recording control 10411, the screenshot control 10412, the audio-to-text control 10413, and the text extraction control 10414 in the aforementioned content.

[0247] It is understandable that the relevant description of the first interface can refer to the previous description of Figures 1D and 1E, and will not be repeated here.

[0248] S702: In response to an operation on a video processing control, the electronic device processes the first video.

[0249] It is understandable that when the video processing controls are different controls, the specific content of the first video processing performed by the electronic device may be different.

[0250] For example, when the video processing control includes the start recording control 10411 , the electronic device processing the first video may include: the electronic device recording the image displayed in the video playback area 20211 .

[0251] For example, when the video processing control includes the screenshot control 10412 , the electronic device processing the first video may include: the electronic device capturing the image displayed in the video playback area 20211 .

[0252] For example, when the video processing control includes the audio-to-text control 10413, the electronic device processing the first video may include: the electronic device collecting the sound information of the video S in the video playback area 20211 and converting the sound signal into text.

[0253] For example, when the video processing control includes a text extraction control 10414, the electronic device processing the first video may include: the electronic device extracting text from the image displayed in the video playback area 20211 and displaying it in an editable form on the video playback area 20211.

[0254] It should be noted that the video processing control may include multiple controls, and the processing of the first video by the electronic device may include multiple contents.

[0255] S703: After the electronic device generates a processing result for the first video, the processing result is automatically displayed in the second area.

[0256] It is understood that after the electronic device generates the processing result of the first video, the processing result can be automatically displayed in the second area. During the process of the electronic device processing the first video, the current processing status can be automatically displayed in the second area, or it can not be automatically displayed in the second area.

[0257] The relevant contents involved in step S702 and step S703 can refer to the description of the relevant contents of function 1 to function 4 in the above text, and will not be repeated here. The exemplary interfaces involved in step S702 and step S703 can refer to the description of the relevant contents of Figures 2A to 2S and Figures 4A to 4G in the above text, and will not be repeated here.

[0258] The following describes the device involved in the embodiments of the present application.

[0259] FIG8 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0260] The electronic device may include a processor 110 , an external memory interface 120 , an internal memory 121 , an audio module 130 , a speaker 130A, a receiver 130B, a microphone 130C, an earphone interface 130D, a display 140 , a camera 150 , and a touch sensor 160 .

[0261] The structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the modules illustrated in the embodiments of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device.

[0262] The processor 110 may include one or more processing units, for example, an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The processor 110 may also include a memory for storing instructions and data.

[0263] The electronic device implements display functions through a GPU, a display screen 140 , and an application processor.

[0264] The GPU is a microprocessor for image processing that connects the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information. Display screen 140 is used to display images, videos, and the like. In some embodiments, the electronic device may include one or N display screens 140, where N is a positive integer greater than one.

[0265] In an embodiment of the present application, the ability of the electronic device to display the user interfaces shown in Figures 1A-1L, 2A-2S, 3A-3L, 4A-4G, 5A-5C, and 6A-6F depends on the display functions provided by the above-mentioned GPU, display screen 140, and application processor.

[0266] The camera 150 is used to capture still images or videos. The ISP is used to process data fed back by the camera 150. Light is transmitted to the camera's photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera's photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The electronic device may include 1 or N cameras 150, where N is a positive integer greater than 1. The video codec is used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device can play or record videos in multiple encoding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0267] The internal memory 121 may include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. The NVM can also store executable programs and user and application data, and can be pre-loaded into the RAM for direct reading and writing by the processor 110.

[0268] In the embodiment of the present application, the code for implementing the information processing method described in the embodiment of the present application may be stored in a non-volatile memory. When running the camera application, the electronic device may load the executable code stored in the non-volatile memory into the random access memory.

[0269] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device.

[0270] The electronic device can implement audio functions through the audio module 130, the speaker 130A, the receiver 130B, the microphone 130C, the headphone jack 130D, and the application processor.

[0271] The audio module 130 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The speaker 130A, also known as a "speaker," is used to convert audio electrical signals into sound signals. The receiver 130B, also known as a "handset," is used to convert audio electrical signals into sound signals. The microphone 130C, also known as a "microphone," is used to convert sound signals into electrical signals. The headphone jack 130D is used to connect a wired headset.

[0272] In the embodiment of the present application, when the speech-to-text function is turned on, the electronic device can enable the microphone 130C to collect sound signals and convert the sound signals into corresponding text.

[0273] Touch sensor 160, also known as a "touch device," can be disposed on display screen 140. The touch sensor 160 and display screen 140 form a touch screen, also known as a "touch screen." Touch sensor 160 is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 140. In other embodiments, touch sensor 160 can also be disposed on the surface of the electronic device, at a location different from that of display screen 140.

[0274] In an embodiment of the present application, the electronic device can use the touch sensor 160 to detect the user's click, slide and other operations on the display screen 140 to implement the information processing method shown in Figures 1A-1L, Figures 2A-2S, Figures 3A-3L, Figures 4A-4G, Figures 5A-5C and Figures 6A-6F.

[0275] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An information processing method, characterized in that: The method comprises: The electronic device displays a first interface, the first interface including a first area, a second area, and a video processing control; the first area displays a first image in a first video in a playing state; the second area is used for editing recorded information; In response to an operation on the video processing control, the electronic device processes the first video; After the electronic device generates a processing result for the first video, the processing result is automatically displayed in the second area.

2. The method according to claim 1, wherein After the electronic device generates a processing result for the first video and before the processing result is automatically displayed in the second area, the method further includes: When the electronic device processes the first video, the current processing status is automatically displayed in the second area.

3. The method according to claim 2, wherein The video processing control includes a first control in a first state; and in response to an operation on the video processing control, the electronic device processes the first video, specifically comprising: in response to the operation on the first control in the first state, the electronic device switches the state of the first control to a second state, and records the image in the first video displayed in the first area; The automatically displaying the current processing status in the second area during the process of the electronic device processing the first video specifically includes: automatically displaying a first card in the second area during the process of the electronic device recording an image in the first video displayed in the first area; The electronic device generates a processing result of the first video, specifically comprising: in response to an operation on the first control in the second state, the electronic device switches the state of the first control to the first state, stops recording the image in the first area, and generates the second video; Automatically displaying the processing result in the second area specifically includes: automatically displaying the second video in the first card.

4. The method according to claim 1, wherein The video processing control includes a first control in a first state; and in response to an operation on the video processing control, the electronic device processes the first video, specifically comprising: in response to the operation on the first control in the first state, the electronic device switches the state of the first control to a second state, and records the image in the first video displayed in the first area; The electronic device generates a processing result of the first video, specifically comprising: in response to an operation on the first control in the second state, the electronic device switches the state of the first control to the first state, stops recording the image in the first area, and generates the second video; Automatically displaying the processing result in the second area specifically includes: automatically displaying the second video in the first card in the first area.

5. The method according to claim 3 or 4, wherein: The method further comprises: In response to an operation on the first control in the first state, the electronic device displays a second control in a third state; In the process of recording the image in the first video displayed in the first area, in response to the In response to an operation on the second control in the third state, the electronic device switches the state of the second control to the fourth state and displays a plurality of color options. In response to an operation on the image in the first video displayed in the first area, graffiti traces in a first color are displayed on the image in the first video; the first color is a default color option among the plurality of color options. The second video includes an image containing graffiti traces of the first color.

6. The method according to any one of claims 3 to 5, characterized in that The method further comprises: In response to an operation on the first control in the first state, the electronic device displays a third control; At the first moment in the process of recording the image in the first video displayed in the first area, in response to the operation of the third control, the electronic device adds a first time label and a first text adding area in the first card; the first moment is displayed on the first time label; and the first text adding area is used to enter text.

7. The method according to any one of claims 3 to 6, wherein: The method further comprises: In response to an operation on the first control in the first state, the electronic device displays a fourth control; At a second moment in the process of recording the image in the first video displayed in the first area, the first area displays a second image. In response to the operation of the fourth control, the electronic device captures the second image and automatically adds the second image to the first card.

8. The method according to claim 7, wherein The method further comprises: At the second moment in the process of recording the image in the first video displayed in the first area, in response to the operation of the fourth control, the electronic device adds a second time label and a second text adding area in the first card; the second moment is displayed on the second time label; and the second text adding area is used to enter text.

9. The method according to any one of claims 3 to 8, wherein: The method further comprises: During the process of recording the image in the first video displayed in the first area, the electronic device displays a fifth control in a fifth state; In response to an operation on a fifth control in the fifth state, the electronic device switches the state of the fifth control to a sixth state; When the electronic device displays the fifth control in the sixth state, the electronic device collects a first voice, and displays text obtained by converting the first voice in the first card.

10. The method according to any one of claims 3 to 9, characterized in that The method further comprises: During the process of recording the image in the first video displayed in the first area, the electronic device displays a sixth control in a seventh state; At a third moment, the first area displays a third image in the first video. In response to an operation of a sixth control in the seventh state, the electronic device switches the state of the sixth control to an eighth state, extracts text from the third image, and displays a first text area on the first area; the first text area includes the text from the third image extracted by the electronic device. At the fourth moment, when the electronic device displays the sixth control in the eighth state, the first area displays the fourth image in the first video, the first area displays the first text area, and in response to the operation on the first text area, the electronic device displays several editing options; the several editing options are used to modify the first text area. The text in the text area is edited; the fourth time is later than the third time.

11. The method according to claim 1 or any one of claims 3 to 10, wherein: The video processing control includes a fourth control; in response to an operation on the video processing control, the electronic device processes the first video; After the electronic device generates a processing result for the first video, automatically displaying the processing result in the second area specifically includes: At the fifth moment, the first area displays the fifth image in the first video. In response to the operation on the fourth control, the electronic device captures the fifth image and automatically adds the fifth image to the non-card area in the second area.

12. The method according to any one of claims 2 to 11, wherein: The video processing control includes a fifth control in a fifth state; and in response to an operation on the video processing control, the electronic device processes the first video, specifically comprising: in response to an operation on the fifth control in the fifth state, the electronic device switches the state of the fifth control to a sixth state, and collects the voice of the first video and converts it into text; The automatically displaying the current processing status in the second area during the process of the electronic device processing the first video specifically includes: automatically displaying a second card in the second area during the process of collecting the voice of the first video and converting it into text; the second card displays the text currently converted by the electronic device; The electronic device generates a processing result of the first video, specifically comprising: in response to an operation on the fifth control in the sixth state, the electronic device switches the state of the fifth control to the fifth state, stops collecting the voice of the first video, and generates a first text; Automatically displaying the processing result in the second area specifically includes: automatically displaying the first text in the second card; the first text is a text obtained by converting the voice of the first video collected by the electronic device.

13. The method according to claim 1 or any one of claims 3 to 11, wherein: The video processing control includes a fifth control in a fifth state; and in response to an operation on the video processing control, the electronic device processes the first video, specifically comprising: in response to an operation on the fifth control in the fifth state, the electronic device switches the state of the fifth control to a sixth state, and collects the voice of the first video and converts it into text; The electronic device generates a processing result of the first video, specifically comprising: in response to an operation on the fifth control in the sixth state, the electronic device switches the state of the fifth control to the fifth state, and generates a first text; the first text is a text obtained by converting the collected speech of the first video; Automatically displaying the processing result in the second area specifically includes: automatically displaying the first text in a second card in the second area.

14. The method according to claim 1 or any one of claims 3 to 13, wherein: The video processing control includes a sixth control in a seventh state; and in response to an operation on the video processing control, the electronic device processes the first video, specifically comprising: At a sixth moment, the first area displays a sixth image in the first video. In response to an operation on a sixth control in the seventh state, the electronic device switches the state of the sixth control to an eighth state, extracts text from the sixth image, and automatically displays a second text area on the first area. The electronic device generates a processing result for the first video, specifically comprising: in response to an operation on the second text area, the electronic device determines the text to be inserted; the second text area includes the text extracted by the electronic device the text in the sixth image; Automatically displaying the processing result in the second area specifically includes: automatically displaying the text to be inserted in the second area.

15. The method according to claim 14, wherein After automatically displaying the second text area on the first area, the method further includes: At the seventh moment, when the electronic device displays the sixth control in the eighth state, the first area displays the seventh image in the first video, and the second text area is displayed on the first area; the seventh moment is later than the sixth moment.

16. The method according to any one of claims 3 to 15, wherein: The video processing control includes a sixth control in a seventh state, and the method includes: At an eighth moment, the first area displays an eighth image in the first video. In response to an operation of a sixth control in the seventh state, the electronic device switches the state of the sixth control to an eighth state, extracts text from the eighth image, and automatically displays a third text area on the first area; the third text area includes the text from the eighth image extracted by the electronic device. In response to an operation on the third text area, the electronic device displays a plurality of editing options; the plurality of editing options are used to edit the text in the third text area.

17. The method according to claim 6, wherein The method further comprises: In response to the operation on the first time tag, the second video in the first card jumps to display the ninth image; the ninth image is the image displayed by the first video at the first moment; the second video is a video obtained by recording the image in the first video displayed in the first area.

18. The method according to claim 8, wherein The method further comprises: In response to the operation on the second time tag, the second video in the first card jumps to display the second image; the second image is the image displayed by the first video at the second moment; the second video is a video obtained by recording the image in the first video displayed in the first area.

19. The method according to any one of claims 1 to 18, wherein: The electronic device displays a first interface, specifically including: In response to an operation on the second interface, the electronic device displays the first interface; The first area and the second interface display the screen of the first video in the first application.

20. The method according to any one of claims 1 to 18, wherein Before the electronic device displays the first interface, the method includes: In response to an operation on a seventh control in the third interface, the electronic device displays a fourth interface; the third interface and the second area display content of a second application; the fourth interface includes a third area and the second area; the third area displays content of a first application; The electronic device displays a first interface, specifically including: In response to an operation on a first play entry in the third area, the electronic device displays the first interface.

21. An information processing method, characterized in that: The method comprises: The electronic device displays the first webpage; In response to the operation on the first web page, the electronic device extracts the text in the first web page and automatically The extracted text from the first webpage is saved in a second application.

22. An electronic device comprising one or more memories and one or more processors, characterized in that: The memory is used to store a computer program; the processor is used to call the computer program, so that the electronic device executes the method according to any one of claims 1 to 20.

23. An electronic device comprising one or more memories and one or more processors, characterized in that: The memory is used to store a computer program; the processor is used to call the computer program so that the electronic device executes the method according to claim 21.

24. A computer storage medium, characterized in that include: Computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 20.

25. A computer storage medium, characterized in that include: Computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method of claim 21.

Images