Stenography method and device, terminal and storage medium

Abstract

The embodiment of the invention discloses a shorthand method and device, a terminal and a storage medium, and the method comprises the steps: receiving an image selection instruction, and determining a selected target image which is a picture file or a video file; identifying the target image to obtain a character label corresponding to the target image; and storing the target image and the text tag as a shorthand entry in a shorthand application.

Description

[0001] This application is a divisional application of the patent application with application number 201880096301.5, application date August 22, 2018, and invention name “A shorthand method and device, terminal, and storage medium”. Technical Field

[0002] The embodiments of the present invention relate to electronic technology, and relate to but are not limited to a shorthand method and device, a terminal, and a storage medium. Background Art

[0003] As the pace of life accelerates, people need to handle a lot of tasks in their daily life and work. Especially for multitaskers, forgetful people, and mobile office workers, there is an urgent need for a fast and good way to temporarily record some to-do items, memos, inspirations, etc. In order to meet the above needs, various shorthand applications and tools have appeared on the market.

[0004] However, when users use these shorthand applications or tools to take shorthand notes on to-do items, memos, or inspirations, these shorthand applications or tools cannot fully meet the needs of users in any scenario. Summary of the invention

[0005] In view of this, embodiments of the present invention provide a shorthand method and device, a terminal, and a storage medium to solve at least one problem existing in the related art.

[0006] The technical solution of the embodiment of the present invention is achieved as follows:

[0007] In a first aspect, an embodiment of the present invention provides a shorthand method, comprising: receiving an image selection instruction, determining a selected target image, wherein the target image is a picture file or a video file; identifying the target image, and obtaining a text label corresponding to the target image; and saving the target image and the text label as a shorthand entry in a shorthand application.

[0008] In a second aspect, an embodiment of the present invention provides a shorthand device, comprising: a receiving module, configured to receive an image selection instruction; a target image determination module, configured to determine a selected target image, wherein the target image is a picture file or a video file; an image recognition module, configured to recognize the target image and obtain a text label corresponding to the target image; and a saving module, configured to save the target image and the text label as a shorthand entry in a shorthand application.

[0009] In a third aspect, an embodiment of the present invention provides a terminal, including a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor implements the steps in the above-mentioned shorthand method when executing the program.

[0010] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which implements the steps in the above-mentioned shorthand method when executed by a processor.

[0011] In an embodiment of the present invention, the user can quickly record inspirations, memos, to-do items, etc. by directly selecting the target image to be recorded without inputting voice or text, thereby breaking through the singleness and limitations brought by voice shorthand and text shorthand, and expanding the application scenarios of shorthand. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A schematic diagram of the implementation flow of a shorthand method according to an embodiment of the present invention;

[0013] Figure 2A A schematic diagram of the implementation flow of another shorthand method according to an embodiment of the present invention;

[0014] Figure 2B An interface diagram for displaying a target image according to an embodiment of the present invention;

[0015] Figure 3A A schematic diagram of a process flow of implementing another shorthand method according to an embodiment of the present invention;

[0016] Figure 3B This is an interface diagram of an icon of a shorthand application according to an embodiment of the present invention;

[0017] Figure 4A A schematic diagram of a method for obtaining a text label according to an embodiment of the present invention;

[0018] Figure 4B A schematic diagram of the implementation process of saving target images and text labels according to an embodiment of the present invention;

[0019] Figure 4C is a schematic diagram showing a first shorthand interface according to an embodiment of the present invention;

[0020] Figure 4D A schematic diagram of the implementation flow of recording text labels input by a user according to an embodiment of the present invention;

[0021] Figure 4E A schematic diagram of the implementation flow of the operation on the response shorthand card according to an embodiment of the present invention;

[0022] Figure 4F is a schematic diagram showing a second shorthand interface according to an embodiment of the present invention;

[0023] Figure 5 A schematic diagram of a process flow of implementing yet another shorthand method according to an embodiment of the present invention;

[0024] Fig. 6A A schematic diagram of the structure of a shorthand device according to an embodiment of the present invention;

[0025] Figure 6B A schematic diagram of the structure of another shorthand device according to an embodiment of the present invention;

[0026] Figure 6C A schematic diagram of the structure of another shorthand device according to an embodiment of the present invention;

[0027] Fig.6D A schematic diagram of the structure of another shorthand device according to an embodiment of the present invention;

[0028] Fig. 6E A schematic diagram of the structure of another shorthand device according to an embodiment of the present invention;

[0029] Fig. 6F A schematic diagram of the structure of another shorthand device according to an embodiment of the present invention;

[0030] Figure 7 FIG. 4 is another schematic diagram of a hardware entity of a terminal according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] The technical solution of the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.

[0032] This embodiment provides a shorthand method, which is applied to a terminal. Figure 1 FIG. 1 is a schematic diagram of a shorthand method for implementing an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0033] S101, receiving an image selection instruction, and determining a selected target image, wherein the target image is a picture file or a video file;

[0034] It can be understood that the target image can be a stored picture or video, for example, a picture or video stored in the terminal's photo album, which usually includes pictures or videos taken by the user through the terminal, pictures obtained by screenshots, pictures or videos downloaded when using other applications, etc. It can also be a picture or video not stored in the terminal, for example, a picture or video that the user is browsing in a browser and has not downloaded, a picture or video sent by a friend that the user is viewing when chatting with friends using an instant messaging application, and a picture or video in the photo album of other applications.

[0035] S102, identifying the target image to obtain a text label corresponding to the target image;

[0036] S103: Save the target image and the text label as a shorthand entry in a shorthand application.

[0037] In an embodiment of the present invention, the user can quickly record inspirations, memos, to-do items, etc. by directly selecting the target image to be recorded without inputting voice or text, thereby breaking through the singleness and limitations brought by voice shorthand and text shorthand, and greatly expanding the application scenarios of shorthand applications.

[0038] The embodiment of the present invention provides another shorthand method. Figure 2A FIG. 1 is a schematic diagram of the implementation flow of another shorthand method of an embodiment of the present invention, such as Figure 2A As shown, the method may include the following steps:

[0039] S201, receiving an image selection instruction, and determining a selected target image, wherein the target image is a picture file or a video file;

[0040] S202, enlarging and displaying the target image;

[0041] S203, when it is detected that the target image after the enlarged display receives a touch operation, it is detected whether the touch duration corresponding to the touch operation is less than a preset time threshold; if so, execute step S204; otherwise, execute step S205;

[0042] There are two ways to call out the image shorthand function. One is when the duration of the target image after the user touches and enlarges the display is less than the preset time threshold, such as Figure 2B As shown, a button 22 for starting the shorthand function is directly called out on the interface 20 that enlarges and displays the target image 21, and when the button 21 receives an operation instruction, the process proceeds to step S205. Another method is that when the time length of the user touching the enlarged target image is greater than or equal to a preset time threshold, it is determined that the user wants to take shorthand notes on the target image, and the process proceeds to step S205.

[0043] S204, displaying the shorthand button, if the shorthand button receives an operation instruction, proceeding to step S205;

[0044] S205, identifying the target image to obtain a text label corresponding to the target image;

[0045] S206: Save the target image and text label in the shorthand application as a shorthand entry.

[0046] In an embodiment of the present invention, the above-mentioned shorthand method can provide users with two convenient ways to record fleeting inspirations, that is, users can take shorthand of images when viewing and browsing images, and the method can take shorthand of pictures or videos, thereby breaking through the singleness and limitations brought by voice shorthand and text shorthand, and greatly expanding the application scenarios of shorthand applications.

[0047] The embodiment of the present invention provides another shorthand method. Figure 3A FIG. 1 is a schematic diagram of a process flow of implementing another shorthand method of an embodiment of the present invention, such as Figure 3A As shown, the method may include the following steps:

[0048] S301, receiving a start instruction, where the start instruction is used to instruct to start the shorthand application;

[0049] Here, there is no restriction on the input method of the start-up instruction, and the start-up of the shorthand application can be globally activated. Users can activate the shorthand application anytime and anywhere to quickly record inspiration. For example, when the terminal is in the lock screen state, the user activates the shorthand application by pressing the volume up key and the power key at the same time. That is, when the terminal receives the operation instruction sent by the volume up key and the operation instruction sent by the power key respectively within a preset time (such as 20 milliseconds), it is determined that the received instruction is the start-up instruction. For another example, the user wakes up the terminal to activate the shorthand application by saying "Xiaoou, open shorthand". That is, when the terminal detects through voice recognition technology that the received voice content is related to the start-up of the shorthand application, it is determined that the received instruction is the start-up instruction of the shorthand application. For another example, the user activates the shorthand application with one click using the control center key. For another example, when a non-shorthand application is running in the foreground of the terminal, the user presses the non-shorthand application interface for a long time to call out a function button for starting the shorthand application. That is, if the terminal detects that the user's touch time on the non-shorthand application interface exceeds a preset time threshold, a shorthand function button is displayed on the non-shorthand application interface. When the function button receives an operation instruction, it determines that the received instruction is a start instruction for the shorthand application. Figure 3B As shown, an icon 31 of a shorthand application is displayed on a terminal screen 30. When the icon 31 receives an operation instruction, it determines that the received instruction is a start instruction of the shorthand application, and displays a shorthand mode.

[0050] S302, starting the shorthand application according to the start instruction, and displaying one or more shorthand modes of the shorthand application, wherein the one or more shorthand modes include an image shorthand mode;

[0051] In other embodiments, the shorthand mode may also include one of the following: a preset shorthand mode such as a voice shorthand mode and a text shorthand mode.

[0052] S303, receiving a selection instruction, wherein the selection instruction is used to instruct to select the image shorthand mode;

[0053] S304, displaying a pre-stored image set according to the selection instruction;

[0054] It can be understood that when a selection instruction is received, a pre-stored image set is displayed so that the user can select a shorthand picture or video from it. The image set can be an image set in the terminal's photo album or an image set in an album in other applications (such as an instant messaging application).

[0055] S305, receiving an image selection instruction, and determining a selected target image, wherein the target image is a picture file or a video file;

[0056] S306, identifying the target image to obtain a text label corresponding to the target image;

[0057] S307: Save the target image and the text label as a shorthand entry in a shorthand application.

[0058] In the embodiment of the present invention, the user can not only take shorthand by voice or text, but also take shorthand by selecting images in the image set, thereby making up for the shortcomings of voice shorthand and text shorthand, expanding the use scenarios of shorthand applications, and improving user experience.

[0059] In other embodiments, for any of step S102, step S205, and step S306 in the above embodiments: identifying the target image to obtain a text label corresponding to the target image, such as Figure 4A As shown, the following steps may be included:

[0060] S401, determining the file type of the target image; if the target image is a video file, executing step S402; if the target image is a picture file, executing step S404;

[0061] Generally speaking, the file type of the target image can be determined by reading the file suffix of the target image. For example, if the file suffix of the target image belongs to a preset video suffix set, the target image is determined to be a video file, and the video suffix set includes but is not limited to MP4, AVI, DAT, FLV, etc.; for another example, if the file suffix of the target image belongs to a preset picture suffix set, the target image is determined to be a picture file, and the picture suffix set includes but is not limited to BMP, JPG, JPEG, PNG, GIF, etc. In other embodiments, the terminal can also determine the file type of the target image according to other attributes of the target image, such as determining it according to the file size of the target image.

[0062] S402, extracting feature data of the video file, wherein the feature data includes frame images, text data, and voice data;

[0063] It can be understood that when the video file is too large, N images can be extracted from the frame image set at equal intervals as feature data of the video file.

[0064] S403, analyzing the feature data to obtain a text label corresponding to the video file;

[0065] In other embodiments, if the feature data is voice data, the voice data is recognized using voice recognition technology to obtain text content corresponding to the voice data, and then semantic recognition is performed on the text content to obtain text labels corresponding to the voice data.

[0066] S404: Analyze the image file to obtain a text label corresponding to the image file.

[0067] In other embodiments, for step S103, step S206, and step S307 in any of the above embodiments: saving the target image and the text label as a shorthand entry in a shorthand application, such as Figure 4B As shown, the following steps may be included:

[0068] S405, displaying the target image and the text label on the first shorthand interface;

[0069] It should be noted that in order to increase the flexibility of the shorthand function, such as Figure 4C As shown, in the first shorthand interface 41, in addition to displaying the target image 411 and the text label "a certain brand 6SUV" 412, a function button 413 for adding a text label, a function button 414 for deleting the text label content, a function button 415 for replacing the target image 411, and a function button 416 for saving the target image and the text label are also displayed. The user can achieve the desired shorthand effect by operating these function buttons. For example, when the function button 415 receives an operation instruction, an image set is displayed for the user to reselect the target image to be shorthanded.

[0070] S406: When a save instruction is received in the first shorthand interface, the target image, the text label and the save time are recorded in a shorthand card, and the shorthand card is saved.

[0071] For example, when the function button 416 receives an operation instruction, the target image, text label and save time are recorded in the shorthand card, and the save time is usually the time of the last received save instruction.

[0072] In other embodiments, Figure 4DAs shown, the method may further include the following steps:

[0073] S407: when a label editing instruction or a label adding instruction is received in the first shorthand interface, obtaining a text label input by the user;

[0074] Generally speaking, when the area displaying the text label receives an operation instruction, it is determined that a label editing instruction has been received, that is, the user can edit the text label by touching the text label. When there are two or more text labels on the first shorthand interface, the user can slide left or right or up and down along the arrangement direction of the text labels to view and browse all the text labels on the interface.

[0075] S408: Record the text label input by the user in the shorthand card.

[0076] In other embodiments, Figure 4E As shown, the method may further include the following steps:

[0077] S409, displaying the shorthand card on the second shorthand interface;

[0078] It should be noted that the second shorthand interface can be called out and displayed in any working state of the terminal screen. For example, if the terminal receives a touch instruction that meets the preset conditions in the lock screen state, the second shorthand interface is called out; for another example, if the terminal detects that the user's touch time on the non-shorthand application interface exceeds the preset time threshold, a function button for shorthand is displayed on the non-shorthand application interface, and when the function button receives an operation instruction, the second shorthand interface is directly called out. In fact, the method of triggering the display of the second shorthand interface here is the same as the method of triggering the display of the shorthand mode mentioned above, so no further examples are given here.

[0079] S410. When an operation instruction is received on the shorthand card, respond to the operation instruction; wherein the operation instruction includes at least one of the following: expanding or collapsing the shorthand card, changing the color identification of the card level, deleting the shorthand card, forwarding the shorthand card, adding attachments (for example, adding pictures, web links, etc.), editing the text labels in the shorthand card, and zooming in or out the target image.

[0080] In practical applications, such as Figure 4FAs shown, in addition to displaying the shorthand card 421, the second shorthand interface 42 also displays the contents of the historical shorthand cards 422 to 42N, a function button 423 for viewing the shorthand cards 421 to 42N up and down, a function button 424 for searching the shorthand cards 421 to 42N, a function button 425 for editing the shorthand cards 421 to 42N (such as deleting a shorthand card, adding a new shorthand card, etc.), and a function button 426 for the user to select a shorthand mode;

[0081] Displayed on the shorthand card 421: the last saved time 4211 of the shorthand card 421, a function button 4212 for expanding or collapsing the shorthand card 421, a thumbnail 4213 of the target image, a text label "a certain brand 6SUV" 4214 corresponding to the target image, a color mark 4215 for representing the card level (for example, red indicates that the content of the card is the first-level processing content; yellow indicates that the content of the card is the second-level processing content, and the priority of the yellow mark is not as high as the red mark), a function button 4216 for changing the color mark 4125, a function button 4217 for deleting the shorthand card 421, a function button 4218 for adding an attachment, and a function button 4219 for forwarding the shorthand card 421;

[0082] It should be noted that the user can view the content of the target image by clicking on thumbnail 4213. When thumbnail 4213 receives a touch operation, thumbnail 4213 is enlarged and displayed. If thumbnail 4213 is a video file, then after the enlarged display, the user can control the playback and stop playback of the video file by clicking the play button on the enlarged thumbnail 4213.

[0083] The contents of the historical shorthand cards 422 to 42N are displayed in a collapsed state, and the user can expand and view all the contents recorded in the touched shorthand cards by touching the area where other historical shorthand cards 422 to 42N are located. That is, when a historical shorthand card receives an operation instruction, all the contents of the historical shorthand card receiving the operation instruction are expanded;

[0084] The function button 426 includes at least one of the following: a function button 4261 for invoking a text shorthand mode, a function button 4262 for invoking a voice shorthand mode, and a function button 4263 for invoking an image shorthand mode.

[0085] The embodiment of the present invention provides another shorthand method. Figure 5 FIG. 1 is a schematic diagram of a process flow of implementing another shorthand method of an embodiment of the present invention, such as Figure 5 As shown, the method may include the following steps:

[0086] S501, when starting the shorthand application, calling out the option of the image shorthand mode;

[0087] S502: If the image shorthand mode receives a selection instruction, display an image set in the album; the image set includes N pictures or M videos;

[0088] S503, determining the selected target image;

[0089] S504, analyzing the target image to obtain a text label;

[0090] S505: Record the target image and the text label in a shorthand capsule.

[0091] It should be noted that the shorthand capsule is the product name of the shorthand application described in the above embodiment, which is actually a shorthand application. In other embodiments, there is no function of selecting photos from the album for shorthand, and only taking photos can be done. However, for users, there are many scenes and times for users to take photos. If the user wants to use the photos taken before to save shorthand, it is not supported; and in other embodiments, shorthand of videos cannot be supported.

[0092] Based on the foregoing embodiments, an embodiment of the present invention provides a shorthand device, which includes the modules included and the units included in the modules, which can be implemented by a processor in a terminal; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0093] Fig. 6A FIG. 1 is a schematic diagram of the structure of a shorthand device according to an embodiment of the present invention. Fig. 6A As shown, the device 600 includes a receiving module 601, a target image determination module 602, an image recognition module 603 and a saving module 604, wherein: the receiving module 601 is configured to receive an image selection instruction; the target image determination module 602 is configured to determine the selected target image, and the target image is a picture file or a video file; the image recognition module 603 is configured to recognize the target image and obtain a text label corresponding to the target image; the saving module 604 is configured to save the target image and the text label as a shorthand entry in the shorthand application.

[0094] In other embodiments, Figure 6BAs shown, the device also includes: a display module 605, configured to enlarge and display the target image, and when it is detected that the enlarged and displayed target image receives a touch operation, if the touch duration corresponding to the touch operation is greater than or equal to a preset time threshold, the image recognition module 603 is triggered.

[0095] In other embodiments, the display module 605 is further configured to display a shorthand button if the touch duration corresponding to the touch operation is less than a preset time threshold, and to trigger the image recognition module 603 if the shorthand button receives an operation instruction.

[0096] In other embodiments, the receiving module 601 is further configured to receive a start instruction, wherein the start instruction is used to instruct the start of the shorthand application; the display module 605 is further configured to start the shorthand application according to the start instruction, and display one or more shorthand modes of the shorthand application, wherein the one or more shorthand modes include an image shorthand mode; the receiving module 601 is further configured to receive a selection instruction, wherein the selection instruction is used to instruct the selection of the image shorthand mode; the display module 605 is further configured to display a pre-stored image set according to the selection instruction, and trigger the receiving module 601.

[0097] In other embodiments, Figure 6C As shown, the image recognition module 603 includes: a type determination unit 6031, configured to determine the file type of the target image; a feature extraction unit 6032, configured to extract feature data of the video file if the target image is a video file, the feature data being frame images, text data, and voice data; a feature analysis unit 6033, configured to analyze the feature data to obtain a text label corresponding to the video file. In other embodiments, the feature analysis unit 6033 is further configured to analyze the picture file to obtain a text label corresponding to the picture file if the target image is a picture file.

[0098] In other embodiments, Fig.6D As shown, the saving module 604 includes: a display unit 6041, configured to display the target image and the text label on the first shorthand interface; a saving unit 6042, configured to record the target image, the text label and the saving time in a shorthand card when a saving instruction is received on the first shorthand interface, and save the shorthand card.

[0099] In other embodiments, Fig. 6EAs shown, the device also includes: a label acquisition module 611, configured to acquire the text label input by the user when a label editing instruction or a label adding instruction is received in the first shorthand interface; a label recording module 612, configured to record the text label input by the user in the shorthand card.

[0100] In other embodiments, Fig. 6F As shown, the device also includes: a display module 605, configured to display the shorthand card on a second shorthand interface; a response module 614, configured to respond to the operation instruction when an operation instruction is received on the shorthand card; wherein the operation instruction includes at least one of the following: expanding or collapsing the shorthand card, changing the color identification of the card level, deleting the shorthand card, forwarding the shorthand card, adding an attachment, editing the text label in the shorthand card, and zooming in or out the target image.

[0101] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present invention, please refer to the description of the method embodiment of the present invention for understanding.

[0102] It should be noted that, in the embodiment of the present invention, if the above-mentioned shorthand method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable a terminal (which can be a mobile phone, tablet computer, desktop computer, personal digital assistant, navigator, digital phone, video phone, television, sensor device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present invention is not limited to any specific combination of hardware and software.

[0103] Correspondingly, an embodiment of the present invention provides a terminal, Figure 7 FIG. 1 is a schematic diagram of a hardware entity of a terminal according to an embodiment of the present invention. Figure 7 As shown, it includes a memory 701 and a processor 702, wherein the memory 701 stores a computer program that can be run on the processor 702, and when the processor 702 executes the program, the steps in the shorthand method provided in the above embodiment are implemented.

[0104] The memory 701 is configured to store instructions and applications executable by the processor 702, and can also cache data to be processed or processed by the processor 702 and each module in the terminal 700 (for example, image data, audio data, voice communication data, and video communication data), which can be implemented by flash memory (FLASH) or random access memory (Random Access Memory, RAM);

[0105] In other embodiments, the terminal 700 further includes a communication interface, which enables the terminal 700 to communicate with other terminals or servers through a network.

[0106] Correspondingly, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, characterized in that when the computer program is executed by a processor, the steps in the shorthand method provided in the above embodiment are implemented.

[0107] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present invention, please refer to the description of the method embodiments of the present invention for understanding.

[0108] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the serial number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention. The serial numbers of the above-mentioned embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments.

[0109] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0110] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0111] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0112] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0113] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0114] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable the terminal (which can be a mobile phone, tablet computer, desktop computer, personal digital assistant, navigator, digital phone, video phone, television, sensor device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, magnetic disks or optical disks.

[0115] The above is only an embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

[0116] Industrial Applicability

[0117] In the embodiment of the present invention, after receiving the image selection instruction and determining the selected target image, the target image is identified to obtain a text label corresponding to the target image, and the target image and the text label are saved as a shorthand entry in the shorthand application, thereby helping users to quickly record inspirations, memos, to-do items, etc. Using the shorthand method provided by the embodiment of the present invention, users can quickly record inspirations, memos, to-do items, etc. by directly selecting the target image to be recorded without voice or text input, thereby breaking through the singleness and limitations brought by voice shorthand and text shorthand, and greatly expanding the application scenarios of shorthand applications.

Claims

1. A shorthand method, characterized in that: The method comprises: Receiving an image selection instruction and determining a selected target image, wherein the target image is a picture file or a video file; Recognize the target image to obtain a text label corresponding to the target image; saving the target image and the text label as a shorthand entry in a shorthand application; Before receiving the image selection instruction and determining the selected target image, the method further includes: receiving a start instruction, wherein the start instruction is used to instruct to start the shorthand application; Starting the shorthand application according to the start instruction, and displaying one or more shorthand modes of the shorthand application, wherein the one or more shorthand modes include an image shorthand mode; receiving a selection instruction, wherein the selection instruction is used to instruct to select the image shorthand mode; According to the selection instruction, the image set in the album is displayed, and the step of receiving the image selection instruction and determining the selected target image is triggered.

2. The method according to claim 1, characterized in that After determining the selected target image, the method further includes: Enlarging and displaying the target image; When it is detected that the target image after the enlarged display receives a touch operation, if the touch duration corresponding to the touch operation is greater than or equal to a preset time threshold, the step of identifying the target image and obtaining a text label corresponding to the target image is triggered.

3. The method according to claim 2, characterized in that The method further comprises: If the touch duration corresponding to the touch operation is less than a preset time threshold, display a shorthand button; If the shorthand button receives an operation instruction, the step of identifying the target image and obtaining a text label corresponding to the target image is triggered.

4. The method according to any one of claims 1 to 3, characterized in that: The step of identifying the target image to obtain a text label corresponding to the target image includes: Determine the file type of the target image; If the target image is a video file, extracting feature data of the video file, wherein the feature data includes frame images, text data, and voice data; The feature data is analyzed to obtain a text label corresponding to the video file.

5. The method according to claim 4, characterized in that The method further comprises: If the target image is a picture file, the picture file is analyzed to obtain a text label corresponding to the picture file.

6. The method according to claim 5, characterized in that The step of saving the target image and the text label as a shorthand entry in a shorthand application includes: Displaying the target image and the text label on a first shorthand interface; When a save instruction is received in the first shorthand interface, the target image, the text label and the save time are recorded in a shorthand card, and the shorthand card is saved.

7. The method according to claim 6, characterized in that The method further comprises: When a label editing instruction or a label adding instruction is received in the first shorthand interface, obtaining a text label input by the user; The text label input by the user is recorded in the shorthand card.

8. The method according to claim 7, characterized in that The method further comprises: Displaying the shorthand card on the second shorthand interface; When receiving an operation instruction on the shorthand card, responding to the operation instruction; The operation instruction includes at least one of the following: Expand or collapse the shorthand card, change the color identification of the card level, delete the shorthand card, forward the shorthand card, add attachments, edit the text label in the shorthand card, and enlarge or reduce the target image.

9. A shorthand device, characterized in that: The device comprises: A receiving module is configured to receive an image selection instruction; wherein, before receiving the image selection instruction, the receiving module is further configured to: receive a start instruction, the start instruction is used to instruct to start the shorthand application; start the shorthand application according to the start instruction, and display one or more shorthand modes of the shorthand application, the one or more shorthand modes including an image shorthand mode; receive a selection instruction, the selection instruction is used to instruct to select the image shorthand mode; according to the selection instruction, display the image set in the album, and trigger the step of receiving the image selection instruction and determining the selected target image; A target image determination module, configured to determine a selected target image, wherein the target image is a picture file or a video file; An image recognition module, configured to recognize the target image and obtain a text label corresponding to the target image; The saving module is configured to save the target image and the text label as a shorthand entry in a shorthand application.

10. A terminal comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the program, the steps of the shorthand method according to any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the shorthand method according to any one of claims 1 to 8 are implemented.

Images