Method, device and electronic device for collecting additional task information
By switching to the task additional information collection mode in the task display mode, using pre-stored data to match and determine image information, the problem of cumbersome collection of task additional information in the prior art is solved, and an efficient and simplified information collection process is achieved.
Patent Information
- Application Number
- CN202110379612.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-08
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2041-04-08
AI Technical Summary
The existing method of collecting additional information for task is cumbersome, and users need to find courses repeatedly to take photos and upload homework, resulting in a cumbersome collection process.
In the task display mode, switch to the task additional information collection mode through user input, and match and judge the pre-stored target data to treat the judgment image information. If the preset conditions are met, it is stored as additional information and displays prompt information, which simplifies the collection process and Improve efficiency.
It realizes efficient collection of task additional information, reduces duplicate operations, improves user experience and collection efficiency, and avoids missed collection or repeated collection.
Smart Images

Figure CN112966143B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology, and in particular to a method, device, electronic device and storage medium for collecting additional task information. Background Art
[0002] As people's living standards improve, various electronic devices (such as mobile phones and tablet computers) have become an indispensable part of people's lives. Electronic devices can enable users to understand the corresponding tasks by displaying the display information of tasks (such as courses). In actual use, in addition to displaying various tasks, electronic devices can also be used to collect additional information of tasks (such as homework) so that a third party (such as a teacher) can understand the relevant information of users (such as students) through the collected additional information.
[0003] However, the existing method of collecting additional task information is rather cumbersome. For example, in the process of collecting user homework for a course, the user needs to first find the corresponding course, and then take a photo and upload the homework under the corresponding course. If the user wants to collect homework for other courses, the user needs to find the corresponding course again and repeat the corresponding actions, resulting in a rather cumbersome process for collecting homework. Summary of the invention
[0004] The embodiments of the present disclosure at least provide a method, device, electronic device and storage medium for collecting additional task information.
[0005] In a first aspect, an embodiment of the present disclosure provides a method for collecting additional task information, including:
[0006] In the task display mode, at least one of the information to be displayed of the first task needs to be displayed, and the information to be displayed includes at least one of a picture, text, and a video;
[0007] The electronic device is operated in the task presentation mode to receive a first input from a user;
[0008] In response to receiving the first input, executing the first task, wherein the executing the first task includes ending the presentation of the first task, so that the first task is in a presentation completion state;
[0009] When the first task is in the display completion state, receiving a second input from a user;
[0010] In response to receiving the second input, controlling the electronic device to enter a task additional information collection mode, in which additional information of at least one of the first tasks is collected; the additional information includes image information corresponding to the first task;
[0011] The collecting of at least one additional information of the first task includes:
[0012] Obtaining image information to be determined;
[0013] Determine the image information to be determined based on pre-stored target data; the target data is associated with the information to be displayed;
[0014] If the image information to be determined meets the preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on the display interface of the electronic device;
[0015] The electronic device is controlled to enter the task additional information collection mode again.
[0016] In the disclosed embodiment, after entering the task additional information collection mode, the image information to be determined is obtained, and the image information to be determined is determined based on the pre-stored target data; if the image information to be determined meets the preset conditions, the image information to be determined is stored as the additional information, and the first prompt information is displayed on the display interface of the electronic device, so that while the additional information collection is realized, the first prompt information is also displayed to remind the user so that the user can clearly understand the current collection status of the additional information. In addition, after the current additional information is collected, the task additional information collection mode is entered again to collect the subsequent additional information, which simplifies the collection process of the additional information and improves the collection efficiency of the additional information.
[0017] According to the first aspect, in a possible implementation manner, the target data includes a plurality of target image information, and the determining the image information to be determined based on the pre-stored target data includes:
[0018] The image information to be determined is matched with the multiple target image information. If the similarity between the image information to be determined and one of the multiple target image information is greater than a preset threshold and / or greater than the similarity with other target image information in the target image, it is determined that the image information to be determined meets the preset condition.
[0019] In the disclosed embodiment, by matching the image information to be determined with the plurality of target image information, it is determined whether the image information to be determined meets the preset conditions, thereby improving the matching accuracy and efficiency.
[0020] According to the first aspect, in a possible implementation manner, the target data includes a plurality of target identifiers, and the determining the image information to be determined based on the pre-stored target data includes:
[0021] Extracting the identification to be determined from the image information to be determined;
[0022] The identification to be determined is matched with the multiple target identifications. If the identification to be determined matches one of the multiple target identifications, it is determined that the image information to be determined meets the preset condition.
[0023] In the disclosed embodiment, by extracting the identifier to be determined in the image information to be determined, and then matching the extracted identifier to be determined with the multiple target identifiers to determine whether the image meets the preset conditions, the matching accuracy and efficiency can be improved.
[0024] According to the first aspect, in a possible implementation, the first prompt information includes text prompt information; and displaying the prompt information on a display interface of the electronic device includes:
[0025] Based on the image information to be determined, the text prompt information is displayed.
[0026] In the disclosed embodiment, by displaying the text prompt information, the user can clearly understand the collection result of the image information to be determined, thereby avoiding repeated collection of the same additional information.
[0027] According to the first aspect, in a possible implementation manner, the first prompt information includes image prompt information; and displaying the first prompt information on a display interface of the electronic device includes:
[0028] Based on the image information to be determined, image prompt information indicating that the status of the mark to be determined has changed is displayed on the display interface.
[0029] In the disclosed embodiment, by displaying the image prompt information of the change in the status of the to-be-determined mark on the display interface, not only can the user clearly understand the collection results of the to-be-determined image information, thereby avoiding repeated collection of the same additional information, but also the prompt information display is diversified, giving the user a different experience.
[0030] According to the first aspect, in a possible implementation, after displaying the first prompt information on the display interface of the electronic device, the method further includes:
[0031] Based on the stored additional information and the target data, determining whether the additional information of the first task has been collected;
[0032] If the collection of the additional information of the first task is not completed, a second prompt message is displayed on the display interface of the electronic device; the second prompt message is used to instruct the user to continue collecting the additional information.
[0033] In the disclosed embodiment, after the electronic device enters the task additional information collection mode again, it can also automatically prompt the user to collect other additional information, which facilitates the user's operation and avoids repeated collection or missed collection.
[0034] According to the first aspect, in a possible implementation, if the additional information collection of the first task is completed, a third prompt message is displayed on the display interface of the electronic device, and the third prompt message is used to instruct the user to exit the task additional information collection mode; or, the electronic device is controlled to exit the task additional information collection mode.
[0035] In the embodiment of the present disclosure, if the additional information collection of the first task is completed, the task additional information collection mode can be directly exited, or the user can be reminded that the current additional information collection is completed and the task additional information collection mode can be exited. This not only avoids the occurrence of missed collection, but also facilitates user operation.
[0036] According to the first aspect, in a possible implementation manner, judging whether the additional information of the first task has been collected based on the stored additional information and the target data includes:
[0037] Determine whether the user's exit operation is received;
[0038] If an exit operation of the user is received, it is determined whether the collection of the additional information of the first task is complete based on the stored additional information and the target data.
[0039] In the embodiment of the present disclosure, when the user's exit operation is detected, a corresponding prompt is given to the user based on whether the collection of additional information has been completed. This can avoid the situation where the user exits the task additional information collection mode due to accidental touch or misjudgment, resulting in the attachment information not being collected.
[0040] In a second aspect, an embodiment of the present disclosure provides a device for collecting additional task information, including:
[0041] A task display module, used to display information to be displayed of at least one first task in a task display mode, wherein the information to be displayed includes at least one of a picture, text, and video;
[0042] A first receiving module, used to receive a first input from a user;
[0043] a task execution module, configured to execute the first task in response to receiving the first input, wherein the executing the first task includes ending the display of the first task so that the first task is in a display completion state;
[0044] A second receiving module, configured to receive a second input from a user when the first task is in the display completion state;
[0045] a task collection module, configured to control the electronic device to enter a task additional information collection mode in response to receiving the second input, wherein additional information of at least one of the first tasks is collected in the task additional information collection mode; the additional information includes image information corresponding to the first task;
[0046] The task collection module is specifically used for:
[0047] Obtaining image information to be determined;
[0048] Determine the image information to be determined based on pre-stored target data; the target data is associated with the information to be displayed;
[0049] If the image information to be determined meets the preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on the display interface of the electronic device;
[0050] The electronic device is controlled to enter the task additional information collection mode again.
[0051] According to the second aspect, in a possible implementation manner, the target data includes a plurality of target image information, and the task collection module is specifically used to:
[0052] The image information to be determined is matched with the multiple target image information. If the similarity between the image information to be determined and one of the multiple target image information is greater than a preset threshold and / or greater than the similarity with other target image information in the target image, it is determined that the image information to be determined meets the preset condition.
[0053] According to the second aspect, in a possible implementation manner, the target data includes multiple target identifiers, and the task collection module is specifically used to:
[0054] Extracting the identification to be determined from the image information to be determined;
[0055] The identification to be determined is matched with the multiple target identifications. If the identification to be determined matches one of the multiple target identifications, it is determined that the image information to be determined meets the preset condition.
[0056] According to the second aspect, in a possible implementation manner, the first prompt information includes text prompt information; and the task collection module is specifically configured to:
[0057] Based on the image information to be determined, the text prompt information is displayed.
[0058] According to the second aspect, in a possible implementation manner, the first prompt information includes image prompt information; and the task collection module is specifically configured to:
[0059] Based on the image information to be determined, image prompt information indicating that the status of the mark to be determined has changed is displayed on the display interface.
[0060] According to the second aspect, in a possible implementation, after the first prompt information is displayed on the display interface of the electronic device, the task collection module is further used to:
[0061] Based on the stored additional information and the target data, determining whether the additional information of the first task has been collected;
[0062] If the collection of the additional information of the first task is not completed, a second prompt message is displayed on the display interface of the electronic device; the second prompt message is used to instruct the user to continue collecting the additional information.
[0063] According to the second aspect, in a possible implementation manner, the task collection module is further used to:
[0064] If the additional information collection of the first task is completed, a third prompt message is displayed on the display interface of the electronic device, and the third prompt message is used to instruct the user to exit the task additional information collection mode; or, the electronic device is controlled to exit the task additional information collection mode.
[0065] According to the second aspect, in a possible implementation manner, the task collection module is specifically used to:
[0066] Determine whether the user's exit operation is received;
[0067] If an exit operation of the user is received, it is determined whether the collection of the additional information of the first task is complete based on the stored additional information and the target data.
[0068] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the method for collecting additional task information as described in the first aspect is performed.
[0069] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method for collecting additional task information as described in the first aspect is executed.
[0070] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0071] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.
[0072] Figure 1 A schematic diagram showing an execution subject of a method for collecting additional task information provided by an embodiment of the present disclosure;
[0073] Figure 2 A flow chart of a method for switching an electronic device from a task display mode to a task additional information collection mode provided by an embodiment of the present disclosure is shown;
[0074] Figure 3a A schematic diagram of a mode switching interface provided by an embodiment of the present disclosure is shown;
[0075] Figure 3b A schematic diagram showing a first task collection interface provided by an embodiment of the present disclosure is shown;
[0076] Figure 4 A flowchart showing a method for collecting additional task information provided by an embodiment of the present disclosure is shown;
[0077] Figure 5 A schematic diagram of an interface of image information to be determined provided by an embodiment of the present disclosure is shown;
[0078] Figure 6 Another schematic diagram of an interface of image information to be determined provided by an embodiment of the present disclosure is shown;
[0079] Figure 7 A flowchart showing another method for collecting additional task information provided by an embodiment of the present disclosure;
[0080] Figure 8A schematic diagram showing a second task collection interface provided by an embodiment of the present disclosure is shown;
[0081] Fig. 9 A schematic diagram showing a third task collection interface provided by an embodiment of the present disclosure;
[0082] Fig.10 A schematic diagram showing the structure of a device for collecting additional task information provided by an embodiment of the present disclosure is shown;
[0083] Fig.11 A schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0084] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.
[0085] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0086] The term "and / or" herein only describes an association relationship, indicating that three relationships may exist. For example, A and / or B may represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C may represent including any one or more elements selected from the set consisting of A, B, and C.
[0087] As people's living standards improve, various electronic devices (such as mobile phones and tablet computers) have become an indispensable part of people's lives. Electronic devices can enable users to understand the corresponding tasks by displaying the display information of tasks (such as courses). In actual use, in addition to displaying various tasks, electronic devices can also be used to collect additional information of tasks (such as homework) so that a third party (such as a teacher) can understand the relevant information of users (such as students) through the collected additional information.
[0088] Research has found that the existing method of collecting additional task information is rather cumbersome. For example, in the process of collecting users' homework for a course, the user needs to first find the corresponding course, and then take a photo and upload the homework under the corresponding course. If the user wants to collect homework for other classes, the user needs to find the corresponding course again and repeat the corresponding actions, which makes the homework collection process rather cumbersome.
[0089] The present disclosure provides a method for collecting additional task information, including:
[0090] In the task display mode, at least one of the information to be displayed of the first task needs to be displayed, and the information to be displayed includes at least one of a picture, text, and a video;
[0091] The electronic device is operated in the task presentation mode to receive a first input from a user;
[0092] In response to receiving the first input, executing the first task, wherein the executing the first task includes ending the presentation of the first task, so that the first task is in a presentation completion state;
[0093] When the first task is in the display completion state, receiving a second input from a user;
[0094] In response to receiving the second input, controlling the electronic device to enter a task additional information collection mode, in which additional information of at least one of the first tasks is collected; the additional information includes image information corresponding to the first task;
[0095] The collecting of at least one additional information of the first task includes:
[0096] Obtaining image information to be determined;
[0097] Determine the image information to be determined based on pre-stored target data; the target data is associated with the information to be displayed;
[0098] If the image information to be determined meets the preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on the display interface of the electronic device;
[0099] The electronic device is controlled to enter the task additional information collection mode again.
[0100] In the disclosed embodiment, after entering the task additional information collection mode, the image information to be determined is obtained, and the image information to be determined is determined based on the pre-stored target data; if the image information to be determined meets the preset conditions, the image information to be determined is stored as the additional information, and the first prompt information is displayed on the display interface of the electronic device, so that while the additional information collection is realized, the first prompt information is also displayed to remind the user so that the user can clearly understand the current collection status of the additional information. In addition, after the current additional information is collected, the task additional information collection mode is entered again to collect the subsequent additional information, which simplifies the collection process of the additional information and improves the collection efficiency of the additional information.
[0101] See also Figure 1 , which is a schematic diagram of an execution subject of the method for collecting additional task information provided by an embodiment of the present disclosure, wherein the execution subject of the method is an electronic device 100, wherein the electronic device 100 may include a terminal and a server. For example, the method may be applied to a terminal, and the terminal may be Figure 1 The smart phone 10, desktop computer 20, notebook computer 30, etc. shown in FIG. Figure 1 The method can also be applied to the server 40, or can be applied to the implementation environment composed of the terminal and the server 40. The server 40 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud storage, big data and artificial intelligence platforms.
[0102] In other embodiments, the electronic device 100 may also include an AR (Augmented Reality) device, a VR (Virtual Reality) device, an MR (Mixed Reality) device, etc. For example, the AR device may be a mobile phone or tablet computer with AR function, or may be AR glasses, which are not limited here.
[0103] It should be noted that, in some embodiments, the server 40 can communicate with the smart phone 10, the desktop computer 20 and the laptop computer 30 respectively through the network 50. The network 50 can include various connection types, such as wired, wireless communication links or optical fiber cables, etc.
[0104] In addition, the method for collecting additional task information may also be software running in a terminal or server, such as an application with a function of collecting additional task information, etc. In some possible implementations, the method for collecting additional task information may be implemented by a processor calling computer-readable instructions stored in a memory.
[0105] In the embodiment of the present disclosure, the electronic device may operate in a task display mode or a task additional information collection mode. In the task display mode, information to be displayed of at least one first task needs to be displayed, and the information to be displayed includes at least one of a picture, text, and a video.
[0106] Exemplarily, tasks include but are not limited to course study and questionnaire surveys. For example, in the case where the task is course study, if the electronic device is in task display mode, the content of at least one course (information to be displayed) can be displayed to the user in the form of pictures, text or video, so that the user (such as a student) can learn relevant knowledge through the displayed content; if the electronic device is in task additional information collection mode, homework information (additional information) related to the course can be collected, which can be the homework completed by the student in the homework book corresponding to the course. The homework contains multiple pages, and these homework need to be collected and uploaded.
[0107] It should be noted that the users in different steps may be the same or different, and this is not limited here.
[0108] For another example, when the task is a questionnaire survey, if the electronic device is in the task display mode, at least one relevant content about the questionnaire survey (information to be displayed) can be displayed in the form of pictures, text or videos, so that the user can understand the relevant content of the questionnaire survey and how to fill in the questionnaire; if the electronic device is in the task additional information collection mode, the questionnaire (additional information) filled in by the user can be collected. Specifically, the user can answer on a paper questionnaire, which includes multiple pages, and these questionnaires need to be collected and uploaded.
[0109] See also Figure 2 As shown, it is a flow chart of a method for an electronic device to switch from a task display mode to a task additional information collection mode provided by an embodiment of the present disclosure. The method for an electronic device to switch from a task display mode to a task additional information collection mode includes the following S101 to S103:
[0110] S101, the electronic device is operated in the task display mode, receives a first input from a user, and executes the first task in response to the received first input, wherein the execution of the first task includes ending the display of the first task, so that the first task is in a display completion state.
[0111] It is understandable that during the task presentation process, the user can operate the electronic device according to his or her own needs. For example, the user can pause, repeat, fast forward, rewind or end the display. This operation or a combination of these operations is also called the user's first input.
[0112] In addition, the type of the first input may include touch operation, voice control operation, gesture control and viewing operation on the electronic device. As an example, for example, the user can make the electronic device pause the display of the current task by touching the "pause icon" on the electronic device; the user can also make the electronic device pause the current display task by inputting the voice of "please pause the display"; the user can also make the electronic device pause the current display task by inputting the "pause gesture", wherein the gesture operation can be a specific gesture operation applied to the screen of the electronic device (such as up and down sliding gestures, left and right sliding gestures), or a specific gesture displayed without the electronic device, for example, if the user shows an OK gesture operation in front of the electronic device, the camera of the electronic device captures the gesture and the current task can be displayed; it can also be a viewing operation, that is, the device automatically plays related content, such as video content, and the user does not prevent the playback from proceeding, but waits for the device's playback action to continue to the end, so that the task is in a display completion state.
[0113] For example, when the task is course learning, executing the first task includes: continuing to display the current learning content until the current course display is completed, pausing the display of the current learning content, quickly displaying the current learning content, or ending the display of the current learning content, etc.
[0114] When the task is to apply for a credit card, executing the first task includes: continuing to display the relevant content on how to apply for a credit card, pausing the display of the relevant content on how to apply for a credit card, fast-forwarding the currently displayed content on how to apply for a credit card, or ending the display of the currently displayed content on how to apply for a credit card, etc.
[0115] In some implementations, the first task can be in a display completion state in response to the first input of the user. The first task being in a processing completion state can be when the user finishes learning the current course and the current course display is automatically ended, or when the user actively terminates learning during the learning process and the current course display is ended.
[0116] S102: When the first task is in the display completion state, receive a second input from a user.
[0117] Exemplarily, the second input is similar to the first input, and may also include a touch operation, a voice control operation, a gesture control operation, etc. on the electronic device. Figure 3aAs shown, the first task is course learning as an example for explanation. In some embodiments, when the course learning is in the display completion state, the corresponding mode switching interface C can be displayed, and the mode switching interface C displays at least one course in a completed state, such as Tuesday's course, Friday's course, and today's course, etc. In addition, a mode switching icon T is displayed, and corresponding text prompt information is displayed on the mode switching icon T to prompt the user of the function of the mode switching icon T. In this embodiment, the second input is a touch operation input. For example, when the user touches the switching icon T, the task additional information collection mode can be entered.
[0118] It should be noted that the mode switching interface C may be automatically displayed after any first task is in a completed state, or may be displayed in response to a corresponding operation of the user, which is not limited here.
[0119] S103, in response to receiving the second input, controlling the electronic device to enter a task additional information collection mode, in which additional information of at least one of the first tasks is collected; the additional information includes image information corresponding to the first task.
[0120] See also Figure 3b As shown, it is a schematic diagram of an interface of a task additional information collection mode provided by an embodiment of the present disclosure. In the task additional information collection mode, a task collection interface D is displayed, and a shooting icon T1 and an album icon T2 are also displayed on the task collection interface D. The shooting icon T1 can be used to take a photo of the text to be photographed, and the album icon T2 can be used to obtain photos of the text that has been photographed from the album. It can be understood that in some implementations, the album can also be called a gallery, which is used to store photos taken by the camera of the electronic device.
[0121] It should be noted that in this embodiment, the text refers to a paper text, and the content recorded in the text is related to the course content. For example, the content recorded in the text is the exercises corresponding to the course learning, and the user can deepen the understanding and mastery of the course content by answering the exercises. Therefore, in the task additional information collection mode, the image information of the homework exercises of at least one course can be collected. In this way, the teacher can review the exercises done by the students through the collected image information and further understand the students' mastery of the current course knowledge.
[0122] In some embodiments, see Figure 4 As shown, it is a flowchart of a method for collecting additional task information provided by an embodiment of the present disclosure. For the above step S103, when collecting additional information of at least one of the first tasks, it includes the following S1031-1034:
[0123] S1031, obtaining image information to be determined.
[0124] Please refer again Figure 3b The document can be photographed in real time through the shooting icon T1 to obtain the image to be determined, or the document photo that has been taken can be selected from the album through the album icon T2 as the image information to be determined.
[0125] In this embodiment, the document contains exercises related to the course learning content. Figure 5 As shown, after the shooting icon T1 is triggered, the electronic device can shoot the text W in real time, and then obtain the image information to be determined.
[0126] S1032, judging the image information to be judged based on pre-stored target data; the target data is associated with the information to be displayed.
[0127] In order to realize the recognition and determination of the image information to be determined, target data that is associated with the information to be displayed can be stored in advance. The target data that is associated with the information to be displayed means that the target data is directly associated with the information to be displayed, for example, the target data is part of the information to be displayed, or the target data is indirectly associated with the information to be displayed, for example, the target data can be derived from the information to be displayed by deduction. There is no specific limitation here, as long as the target data is associated with the information to be displayed.
[0128] It is understandable that the target data can be pre-stored locally or in the cloud, and can be stored in the form of a database or in the form of a table. In addition, it should be noted that the process of determining the image information to be determined based on the pre-stored target data can be determined locally or in the cloud. For example, after the terminal (mobile phone) obtains the image information to be determined, it can send the image information to the cloud. After the determination is made in the cloud, the determination result data is sent back to the terminal.
[0129] In some implementations, the target data includes multiple target image information, for example, each page of the exercise content in the aforementioned text may be photographed in advance to obtain multiple target image information. The image information to be determined should be one or more of the multiple target image information.
[0130] Therefore, in this embodiment, the image information to be determined based on the pre-stored target data includes: matching the image information to be determined with the multiple target image information; if the similarity between the image information to be determined and one of the multiple target image information is greater than a preset threshold and / or greater than the similarity with other target image information in the target image, it is determined that the image information to be determined meets the preset conditions.
[0131] Exemplarily, if the similarity between the image information to be determined and a certain target image information among the multiple target image information is greater than a preset threshold and / or greater than the similarity with other target image information in the target image, it means that the text corresponding to the image information to be determined is one of the multiple target data and is the additional information that needs to be collected. The preset threshold can be 70%, 80% or 90%, without limitation.
[0132] For example, if you need to collect Figure 3a In the text, if there is additional information about Tuesday's courses and Friday's courses, the exercise pages corresponding to Tuesday's courses and Friday's courses in the text can be photographed and stored in advance. For example, photos of exercises on pages 2-8 (corresponding to Tuesday's courses) and pages 16-19 (corresponding to Friday's courses) are stored in advance. After judgment, it is found that the similarity between the acquired image information to be determined and the pre-stored photo of the exercises on page 8 is greater than a preset threshold, or the similarity with the pre-stored photo of the exercises on page 8 is greater than the similarity with the photos of exercises on other pages, then it is determined that the current image information to be determined is the additional information that needs to be collected and meets the preset conditions.
[0133] In this implementation manner, by matching the image information to be determined with the plurality of target image information, it is determined whether the image information to be determined meets the preset conditions, thereby improving the matching accuracy and efficiency.
[0134] In some other embodiments, the target data includes multiple target identifiers, including but not limited to numbers, letters, patterns, or combinations thereof. That is, the target identifiers of each page in the text can be pre-stored. For example, in the case where the target identifier is a page number, if it is necessary to collect Figure 3a In the additional information of Tuesday courses and Friday courses, the page numbers corresponding to Tuesday courses (such as 2, 3, 4, 5) and the exercise page numbers corresponding to Friday courses (such as 11, 12, 13) can be stored in the text.
[0135] Therefore, in this embodiment, the determining of the image information to be determined based on the pre-stored target data includes the following:
[0136] (a) extracting the identification mark to be determined from the image information to be determined;
[0137] (b) matching the identifier to be determined with the multiple target identifiers, and if the identifier to be determined matches one of the multiple target identifiers, determining that the image information to be determined meets the preset condition.
[0138] Exemplarily, since the target data in this embodiment is a target identifier, the identifier to be determined in the image information to be determined must be extracted first, and then the identifier to be determined is matched with the multiple target identifiers. If the identifier to be determined is 3 and matches 3 in the target identifier, it is determined that the current image information to be determined is additional information that needs to be collected and meets the preset conditions.
[0139] In the disclosed embodiment, by extracting the identifier to be determined in the image information to be determined, and then matching the extracted identifier to be determined with the multiple target identifiers to determine whether the image meets the preset conditions, the matching accuracy and efficiency can be improved.
[0140] Also, please refer again to Figure 5 In some implementations, the mark to be determined may be a pattern X, wherein the pattern X may also include a corresponding page number. In this implementation, the pattern X is a little fox, and in other implementations, the pattern X may also be other animal images, plant images, etc., without limitation.
[0141] In addition, it should be noted that, in the process of photographing the text, it is also possible to determine whether the currently photographed image information to be determined meets the target requirements according to the position of the marker to be determined on the display interface of the electronic device. Figure 6 As shown, if the position of the pattern X on the display interface exceeds the edge of the display interface, it is determined that the currently captured image does not meet the target requirements, and some subjects may not be captured. At this time, a prompt message can be displayed on the display interface to remind the user to adjust the shooting angle and / or shooting distance, so as to obtain the image information to be determined that meets the target requirements.
[0142] S1033: If the image information to be determined meets a preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on a display interface of the electronic device.
[0143] For example, if the image information to be determined meets the preset conditions, it means that the image information to be determined is additional information that needs to be collected, and then the image information to be determined can be stored, thereby realizing the collection of additional information. In the process of storing the image information to be determined, it can be directly stored locally, or sent to the cloud for storage in real time, or multiple image information to be determined can be cached locally and then packaged and stored in the cloud, which is not limited here.
[0144] Exemplarily, the display interface may be a two-dimensional display interface, or an AR virtual interface, a VR virtual interface, or an MR virtual interface, which is not limited here. Among them, the virtual interface may include at least one virtual object. The virtual object specifically refers to virtual information generated by computer simulation, which may be a virtual three-dimensional object, such as a virtual animal, a virtual plant, other virtual objects, etc., or a virtual plane object, such as a virtual indicator arrow, virtual text, and a virtual picture.
[0145] In some implementations, the first prompt information includes text prompt information; and displaying the prompt information on the display interface of the electronic device includes: displaying the text prompt information based on the image to be determined.
[0146] For details, please refer again to Figure 5 If the image information to be determined meets the preset conditions, the first prompt information for prompting the user is displayed based on the image information to be determined, such as the prompt information "This page has been uploaded, please turn to the next page"; in addition, if the image information to be determined does not meet the preset conditions, there is no need to store the image information to be determined, and other text prompt information can be displayed based on the image information to be determined, such as the prompt information "This page does not need to be uploaded, please turn to the next page". In this way, in the process of collecting additional information, the user can be reminded in real time, so that the user can clearly know the current collection status of the additional information, and the prompt information guides the user to take the next step, thereby improving the efficiency of collecting additional information.
[0147] In some other embodiments, the first prompt information includes image prompt information; and the displaying of the first prompt information on the display interface of the electronic device includes: based on the image information to be determined, displaying image prompt information indicating that the state of the mark to be determined has changed. The change in the state of the mark to be determined includes a change in the color, size and / or position of the mark to be determined. Figure 5 As shown, the image to be determined is identified as a fox image. If the image information to be determined meets the preset conditions, the fox image changes from grayscale display to color display to prompt the user that the current image information to be determined is successfully collected.
[0148] S1034, controlling the electronic device to enter the task additional information collection mode again.
[0149] For example, after the image information to be determined is successfully collected, the electronic device is controlled to enter Figure 3b The task mode shown, the user can then take a photo of the exercises on the next page and upload it.
[0150] In this embodiment, after collecting the current attachment information, the electronic device is controlled to enter the task additional information collection mode again, so that the user can continue to collect the next additional information without other additional operations, thereby simplifying the task collection process and improving the user experience.
[0151] See also Figure 7 FIG. 1 is a flowchart of another method for collecting additional task information provided by an embodiment of the present disclosure. The difference from the collection method in FIG. 3 is that after displaying the first prompt information on the display interface of the electronic device (step S1033), the following steps S1035 to S1037 are also included:
[0152] S1035, based on the additional information and the target data that have been stored, determine whether the additional information of the first task has been collected; if so, execute step S1037; if not, execute step S1036.
[0153] In some implementations, after the first prompt information is displayed on the display interface of the electronic device, it can be determined whether the additional information of the first task has been collected based on the stored additional information and the target data. For example, if the target data includes pages 2-8, and the stored additional information also includes pages 2-8, it indicates that the additional information has been collected; and if the stored additional information only includes pages 2-6, it means that pages 7 and 8 have not been collected, and in this case, it indicates that the additional information has not been collected.
[0154] S1036, displaying a second prompt message on the display interface of the electronic device; the second prompt message is used to instruct the user to continue collecting the additional information.
[0155] See also Figure 8 As shown, if the additional information has not been collected, a second prompt message can be displayed based on the display interface of the electronic device, such as displaying a prompt message "You still have pages 7 and 8 to upload" to remind the user in real time that there is clear additional information that has not been collected, thereby avoiding the occurrence of additional information being missed.
[0156] S1037, displaying a third prompt message on the display interface of the electronic device, wherein the third prompt message is used to instruct the user to exit the task additional information collection mode; or, controlling the electronic device to exit the task additional information collection mode.
[0157] For example, see Fig. 9As shown, if the additional information has not been collected, a third prompt message may be displayed on the display interface of the electronic device, such as a third prompt message that "Additional information collection is complete, you can exit the task additional information collection mode." In this way, the user can clearly know that the additional information has been collected, and can apply corresponding operations to the electronic device to make the electronic device exit the task additional information collection mode. Of course, when it is determined that the additional information has not been collected, the electronic device can be directly controlled to exit the task additional information collection mode without user operation, which further simplifies the additional information collection process and improves the user experience.
[0158] In other embodiments, for S1035, after displaying the first prompt information on the display interface of the electronic device, it is determined whether the user's exit operation is received. If the user's exit operation is received, it is determined whether the additional information of the first task is collected. At this time, if it is determined that the additional information has been collected, the electronic device can be directly controlled to exit the task additional information collection mode; and if it is determined that the additional information has not been collected, the second prompt information can be displayed on the display interface of the electronic device. In this way, it can be avoided that the user exits the task additional information collection mode due to accidental touch or misjudgment, resulting in the occurrence of the situation where the attachment information is not collected. Among them, the exit operation includes but is not limited to touch operation, voice operation and gesture operation.
[0159] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.
[0160] Based on the same technical concept, the embodiment of the present disclosure also provides a device for collecting additional task information corresponding to the method for collecting additional task information. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the method for collecting additional task information in the above-mentioned embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.
[0161] Reference Fig.10 FIG. 5 is a schematic diagram of a device 500 for collecting additional task information provided by an embodiment of the present disclosure, wherein the device comprises:
[0162] A task display module, used to display information to be displayed of at least one first task in a task display mode, wherein the information to be displayed includes at least one of a picture, text, and video;
[0163] A first receiving module 501, configured to receive a first input from a user;
[0164] A task execution module 502, configured to execute the first task in response to the received first input, wherein the executing the first task includes ending the display of the first task so that the first task is in a display completion state;
[0165] A second receiving module 503, configured to receive a second input from a user when the first task is in the display completion state;
[0166] A task collection module 504, configured to control the electronic device to enter a task additional information collection mode in response to receiving the second input, wherein additional information of at least one of the first tasks is collected in the task additional information collection mode; the additional information includes image information corresponding to the first task;
[0167] The task collection module 504 is specifically used for:
[0168] Obtaining image information to be determined;
[0169] Determine the image information to be determined based on pre-stored target data; the target data is associated with the information to be displayed;
[0170] If the image information to be determined meets the preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on the display interface of the electronic device;
[0171] The electronic device is controlled to enter the task additional information collection mode again.
[0172] In a possible implementation, the target data includes a plurality of target image information, and the task collection module 504 is specifically used to:
[0173] The image information to be determined is matched with the multiple target image information. If the similarity between the image information to be determined and one of the multiple target image information is greater than a preset threshold and / or greater than the similarity with other target image information in the target image, it is determined that the image information to be determined meets the preset condition.
[0174] In a possible implementation manner, the target data includes multiple target identifiers, and the task collection module 504 is specifically used to:
[0175] Extracting the identification to be determined from the image information to be determined;
[0176] The identification to be determined is matched with the multiple target identifications. If the identification to be determined matches one of the multiple target identifications, it is determined that the image information to be determined meets the preset condition.
[0177] In a possible implementation manner, the first prompt information includes text prompt information; and the task collection module 504 is specifically configured to:
[0178] Based on the image information to be determined, the text prompt information is displayed.
[0179] In a possible implementation manner, the first prompt information includes image prompt information; and the task collection module 504 is specifically configured to:
[0180] Based on the image information to be determined, image prompt information indicating that the status of the mark to be determined has changed is displayed on the display interface.
[0181] In a possible implementation, after the first prompt information is displayed on the display interface of the electronic device, the task collection module 504 is further configured to:
[0182] Based on the stored additional information and the target data, determining whether the additional information of the first task has been collected;
[0183] If the collection of the additional information of the first task is not completed, a second prompt message is displayed on the display interface of the electronic device; the second prompt message is used to instruct the user to continue collecting the additional information.
[0184] In a possible implementation, the task collection module 504 is further configured to:
[0185] If the additional information collection of the first task is completed, a third prompt message is displayed on the display interface of the electronic device, and the third prompt message is used to instruct the user to exit the task additional information collection mode; or, the electronic device is controlled to exit the task additional information collection mode.
[0186] In a possible implementation, the task collection module 504 is specifically used to:
[0187] Determine whether the user's exit operation is received;
[0188] If an exit operation of the user is received, it is determined whether the collection of the additional information of the first task is complete based on the stored additional information and the target data.
[0189] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.
[0190] Based on the same technical concept, the embodiment of the present disclosure also provides an electronic device. Fig.11, which is a schematic diagram of the structure of an electronic device 700 provided in an embodiment of the present disclosure, including a processor 701, a memory 702, and a bus 703. The memory 702 is used to store execution instructions, including a memory 7021 and an external memory 7022; the memory 7021 is also called an internal memory, which is used to temporarily store the operation data in the processor 701 and the data exchanged with the external memory 7022 such as a hard disk. The processor 701 exchanges data with the external memory 7022 through the memory 7021.
[0191] In the embodiment of the present application, the memory 702 is specifically used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 701. That is, when the electronic device 700 is running, the processor 701 communicates with the memory 702 through the bus 703, so that the processor 701 executes the application code stored in the memory 702, and then executes the method described in any of the above embodiments.
[0192] Among them, the memory 702 can be, but is not limited to, random access memory (Random Access Memory, RAM), read only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable read-only memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.
[0193] The processor 701 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The disclosed methods, steps and logic block diagrams in the embodiments of the present invention may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0194] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 700. In other embodiments of the present application, the electronic device 700 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0195] The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method for collecting additional task information in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.
[0196] The present disclosure also provides a computer program product that carries a program code. The program code includes instructions that can be used to execute the steps of the method for collecting additional task information in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.
[0197] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).
[0198] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.
[0199] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0200] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0201] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0202] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. A method for collecting additional task information, characterized in that: include: In the task display mode, at least one of the information to be displayed of the first task needs to be displayed, and the information to be displayed includes at least one of a picture, text, and a video; The electronic device is operated in the task presentation mode to receive a first input from a user; In response to receiving the first input, executing the first task, wherein the executing the first task includes ending the presentation of the first task, so that the first task is in a presentation completion state; When the first task is in the display completion state, receiving a second input from a user; In response to receiving the second input, controlling the electronic device to enter a task additional information collection mode, in which additional information of at least one of the first tasks is collected; The additional information includes image information corresponding to the first task; The collecting of at least one additional information of the first task includes: Obtaining image information to be determined; Determine the image information to be determined based on pre-stored target data; the target data is associated with the information to be displayed; If the image information to be determined meets the preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on the display interface of the electronic device; The electronic device is controlled to enter the task additional information collection mode again.
2. The method according to claim 1, characterized in that The target data includes a plurality of target image information, and the determining the image information to be determined based on the pre-stored target data includes: The image information to be determined is matched with the multiple target image information. If the similarity between the image information to be determined and one of the multiple target image information is greater than a preset threshold and / or greater than the similarity with other target image information in the target image, it is determined that the image information to be determined meets the preset condition.
3. The method according to claim 1, characterized in that: The target data includes a plurality of target identifiers, and the determining of the image information to be determined based on the pre-stored target data includes: Extracting the identification to be determined from the image information to be determined; The identification to be determined is matched with the multiple target identifications. If the identification to be determined matches one of the multiple target identifications, it is determined that the image information to be determined meets the preset condition.
4. The method according to any one of claims 1 to 3, characterized in that: The first prompt information includes text prompt information; and the displaying of the prompt information on the display interface of the electronic device includes: Based on the image information to be determined, the text prompt information is displayed.
5. The method according to claim 3, characterized in that: The first prompt information includes image prompt information; and displaying the first prompt information on the display interface of the electronic device includes: Based on the image information to be determined, image prompt information indicating that the status of the mark to be determined has changed is displayed on the display interface.
6. The method according to claim 1, characterized in that After displaying the first prompt information on the display interface of the electronic device, the method further includes: Based on the stored additional information and the target data, determining whether the additional information of the first task has been collected; If the collection of the additional information of the first task is not completed, a second prompt message is displayed on the display interface of the electronic device; the second prompt message is used to instruct the user to continue collecting the additional information.
7. The method according to claim 6, characterized in that The method further comprises: If the additional information collection of the first task is completed, a third prompt message is displayed on the display interface of the electronic device, and the third prompt message is used to instruct the user to exit the task additional information collection mode; or, the electronic device is controlled to exit the task additional information collection mode.
8. The method according to claim 6, characterized in that The determining, based on the stored additional information and the target data, whether the additional information of the first task has been collected includes: Determine whether the user's exit operation is received; If an exit operation of the user is received, it is determined whether the collection of the additional information of the first task is complete based on the stored additional information and the target data.
9. A device for collecting additional task information, characterized in that: include: A task display module, used to display information to be displayed of at least one first task in a task display mode, wherein the information to be displayed includes at least one of a picture, text, and video; A first receiving module, used to receive a first input from a user; a task execution module, configured to execute the first task in response to receiving the first input, wherein the executing the first task includes ending the display of the first task so that the first task is in a display completion state; A second receiving module, configured to receive a second input from a user when the first task is in the display completion state; a task collection module, configured to control the electronic device to enter a task additional information collection mode in response to receiving the second input, wherein additional information of at least one of the first tasks is collected in the task additional information collection mode; the additional information includes image information corresponding to the first task; The task collection module is specifically used for: Obtaining image information to be determined; Determine the image information to be determined based on pre-stored target data; the target data is associated with the information to be displayed; If the image information to be determined meets the preset condition, the image information to be determined is stored as the additional information, and first prompt information is displayed on the display interface of the electronic device; The electronic device is controlled to enter the task additional information collection mode again.
10. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the method for collecting additional task information as described in any one of claims 1-8 is performed.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for collecting additional task information as described in any one of claims 1 to 8 is executed.
Citation Information
Patent Citations
Prompt information display method and device, computer equipment and storage medium
CN112308979A