Result display method and device

Abstract

The embodiment of the invention discloses a result display method and device. The method comprises the steps that a first server receives a control mode sent by a first device; receiving a first picture sent by a second device, wherein the first picture comprises a first question; obtaining a first answer of the first question according to the first picture; and sending a first result to the second device according to the first answer and the management and control mode, so that the second device displays the first result, and displaying a question searching result according to the management and control mode, thereby effectively preventing a phenomenon that students complete homework through question searching without thinking by themselves. And positive influence on learning habits and academic records of students is facilitated.

Description

Technical Field

[0001] The present invention relates to the field of communications, and in particular, to a result display method and an electronic device. Background Art

[0002] Searching for answers to questions is an efficient learning method. Students and parents can easily obtain the answers to questions by taking pictures of the questions with an electronic device, efficiently solve the difficult problems encountered in learning, and improve learning efficiency. However, searching for answers to questions easily allows some students to complete their homework by searching for answers without thinking on their own, which has a negative impact on the students' learning habits and academic performance. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a result display method and an electronic device, which display the question-searching result according to the control mode, effectively prevent the phenomenon that students complete their homework by searching for answers without thinking on their own, and are beneficial to having a positive impact on the students' learning habits and academic performance.

[0004] In a first aspect, embodiments of the present invention provide a result display method, which is applied to a first server. The method includes:

[0005] Receiving a control mode sent by a first device;

[0006] Receiving a first picture sent by a second device, where the first picture includes a first question;

[0007] Obtaining a first answer to the first question according to the first picture;

[0008] Sending a first result to the second device according to the first answer and the control mode, so that the second device displays the first result. Embodiments of the present invention return a first result to the second device according to the control mode sent by the first device and the first answer to the first question in the first picture uploaded by the second device, so that the second device displays the first result, thereby providing a controlled method for taking pictures and searching for answers. The question-searching result is displayed according to the control mode, so that students can use taking pictures to answer questions for efficient learning, and at the same time, effectively prevent the phenomenon that students complete their homework by searching for answers without thinking on their own, which is beneficial to having a positive impact on the students' learning habits and academic performance.

[0009] In combination with the first aspect, in some implementation manners of the first aspect, the obtaining a first answer to the first question according to the first picture includes:

[0010] Obtaining a first area where the first question is located in the first picture according to the first picture;

[0011] Obtaining the stem text in the first area according to the first area;

[0012] According to the said stem text, search for the said first answer corresponding to the stem text from the question bank. In the embodiment of the present application, the first server uses a stem detection model to detect the stem of the first picture, and detects the first area where the first question is located; then, the first server uses an optical character recognition (OCR) model to recognize the stem text in the first area; then, the first server searches for the first answer corresponding to the stem text from the question bank according to the stem text.

[0013] Combined with the first aspect, in some implementation manners of the first aspect, the control mode is the first mode, and the first result is the first answer. Exemplarily, the first mode is the free Q&A mode. In the free Q&A mode, student users can take pictures and ask questions freely without restrictions. Therefore, the first server directly sends the first answer to the second device.

[0014] Combined with the first aspect, in some implementation manners of the first aspect, the control mode is the second mode, and sending the first result to the second device according to the first answer and the control mode includes:

[0015] According to the second mode, detect whether there is answer information in the first picture;

[0016] If it is detected that there is answer information in the first picture, determine the second area where the answer information is located in the first picture;

[0017] According to the second area, obtain the answer text in the second area;

[0018] According to the first answer and the answer text, obtain the relevant result between the first answer and the answer text;

[0019] If the relevant result is relevant, send the first result to the second device, and the first result is the first answer. Exemplarily, the second mode is the homework self-check mode. In the embodiment of the present invention, in the second mode, the first server uses a handwritten answer detection model to detect whether there is answer information in the first picture. If it is detected that there is answer information in the first picture, the handwritten answer detection model is used to determine the second area where the answer information is located in the first picture; then the first server performs answer recognition on the second area to recognize the answer text in the second area; then the first server performs a relevance detection on the first answer and the answer text to obtain a relevant result; if the relevant result is relevant, send the first answer to the second device. Therefore, in the homework inspection mode, after the student user takes a picture and uploads it using the second device, the first server will detect and recognize the answer area, and if the answer text is relevant to the first answer, a detailed answer can be returned.

[0020] In combination with the first aspect, in some implementations of the first aspect, the control mode is the third mode. The step of sending the first result to the second device according to the first answer and the control mode includes:

[0021] According to the third mode, detect whether there are marking traces in the first picture;

[0022] If it is detected that the first picture has the marking traces, send the first result to the second device, and the first result is the first answer.

[0023] If it is detected that the first picture does not have the marking traces, detect whether there is answer information in the first picture;

[0024] If it is detected that there is the answer information in the first picture, determine the second area where the answer information is located in the first picture;

[0025] According to the second area, obtain the answer text in the second area;

[0026] According to the first answer and the answer text, obtain the relevant result between the first answer and the answer text;

[0027] If the relevant result is relevant, send the first result to the second device, and the first result is the first answer. Exemplarily, the third mode is the test paper correction mode. In the embodiments of the present invention, in the third mode, the first server uses a marking trace detection model to detect whether there are marking traces in the first picture. If the first server detects that there are marking traces in the first question, it returns a detailed answer; if the first server detects that there are no marking traces in the first question, it executes the operation inspection mode process to determine whether to return a detailed answer.

[0028] In combination with the first aspect, in some implementations of the first aspect, the step of sending the first result to the second device according to the first answer and the control mode further includes:

[0029] If there is no answer information in the first picture or the relevant result is irrelevant, obtain the solution idea of the first question according to the first answer, and send the first result to the second device, and the first result is the solution idea. In the embodiments of the present invention, in the second mode or the third mode, if there is no answer information in the first picture or the relevant result between the first answer and the answer information is irrelevant, the first server extracts the solution idea from the first answer and returns the solution idea as the first result to the second device.

[0030] In summary, in the embodiments of the present invention, the second user inputs the question area into the second device by means of photographing, scanning, etc., and then the picture is uploaded to the first server by wire or wirelessly; the first server completes functions such as recognition and question searching; the first user sets the control mode to the first server through the first device, and the first server completes operations such as answer recognition detection, marking trace detection, and extraction of problem-solving ideas, and returns content that conforms to the current control mode in cooperation with the question searching ability, and transmits the content from the first server back to the second device, and the second user views the question answers or problem-solving ideas on the second device.

[0031] The embodiments of the present invention include three control modes, namely, free Q&A mode, homework self-check mode, and test paper correction mode. Among them, the free Q&A mode has no restrictions and belongs to normal photo Q&A. The second user takes a picture of the question and uploads it to the first server, that is, the cloud. The cloud completes the OCR recognition of the question, and then retrieves the question answer through the question bank and returns it to the second user. In the homework self-check mode, the cloud will detect and recognize the answer information of the question picture taken by the user. When answer information is recognized and the answer information is related to the question answer, the detailed answer is returned to the user, otherwise only the problem-solving idea is returned. In the test paper correction mode, taking the marking trace as a measurement condition, the cloud performs marking trace detection on the user picture. If there is a marking trace, it directly goes through the normal question searching process and returns the detailed answer, otherwise it goes through the homework self-check mode process and selects to return the detailed answer or the problem-solving idea according to the answer content.

[0032] In combination with the first aspect, in some implementation manners of the first aspect, after sending the first result to the second device according to the first answer and the control mode, it further includes:

[0033] Receiving a first message sent by the second device, the first message includes first information for indicating an application for obtaining the permission of the first answer;

[0034] According to the first message, sending a second message to the first device, the second message includes the first information and second information for indicating the first question and its problem-solving idea, so that the first device displays the first question and its problem-solving idea according to the second information and displays a second prompt message according to the first information;

[0035] Receiving a third message sent by the first device, the third message includes option information indicating that the first user performs a fourth operation on the second prompt message;

[0036] If the option information includes an approval option, send a fourth message to the second device, where the fourth message includes the first answer. In an embodiment of the present application, if the first result is the solution idea for the first question, the second device may further send a first message to the first server to apply for the permission to obtain the first answer; after receiving the first message sent by the second device, the first server sends a first information indicating the application for the permission to obtain the first answer and a second information indicating the first question and its solution idea to the first device according to the first message, so that the first device displays the first question, its solution idea, and a second prompt message; after the first user performs an approval operation on the second prompt message, the first device sends the option information including the approval option to the first server; the first server sends the first answer to the second device according to the option information including the approval option. Therefore, when the first result is the solution idea, the student can apply for the permission to obtain the detailed answer through the second device, and after the parent approves the student's application for the permission to obtain the detailed answer by operating the first device, the first server sends the detailed answer of the question to the second device.

[0037] In combination with the first aspect, in some implementation manners of the first aspect, after receiving the third message sent by the first device, it further includes:

[0038] If the option information includes a disapproval option, send a fifth message to the second device, where the fifth message includes the option information. In an embodiment of the present application, when the first result is the solution idea, after the cloud receives the option information of the parent terminal, if the option information is disapproval, only the option information of the parent terminal is sent to the student terminal.

[0039] In summary, the embodiments of the present application combine the answer information and the marking traces to realize the scenario-based photo-taking learning under the control mode set by the parent, which is generally divided into three scenarios, namely, the free Q&A scenario, the homework self-check scenario, and the test paper correction scenario.

[0040] Among them, in the free Q&A scenario, the second user can freely take photos and ask questions without restrictions.

[0041] Among them, in the homework inspection scenario, after the second user takes a photo and uploads it to the first server, the first server will detect and identify the answer area. If the answer information is related to the detailed answer of the question stem, the detailed answer can be returned; if there is no answer or it is completely irrelevant, a prompt will be given to the user and only the solution idea will be returned, and at the same time, the choice of applying for the detailed answer to the control end will be reported to the user.

[0042] Among them, in the test paper correction scenario, the first server detects whether there is a marking trace for the test paper question. If not, the process of the homework inspection scenario is executed to determine whether to return the detailed answer. If there is a marking trace, the detailed answer is returned.

[0043] Through the above-mentioned photo-taking and question-answering method for different scenarios, it can be ensured that students can learn in the most efficient way under the control of their parents.

[0044] In the embodiments of the present application, different control modes are set for different scenarios. Among them, the free question-answering scenario corresponds to the first mode, the homework self-check scenario corresponds to the second mode, and the test paper modification scenario corresponds to the third mode.

[0045] In the embodiments of the present application, through the photo-taking and question-answering method under different control modes, the degree of freedom in different scenarios is improved, preventing students from copying homework through photo-taking and question-answering, achieving efficient learning, and ensuring that students can learn in the most efficient way under the control of their parents.

[0046] In a second aspect, an embodiment of the present invention provides a result display method, which is applied to a first device. The method includes:

[0047] In response to a first operation of a first user, send a control mode to a first server, so that the first server obtains a first answer to a first question in the first picture according to the first picture and sends a first result to a second device according to the first answer and the control mode. The first result is used for the second device to display the first result. In the embodiments of the present application, the first user can set the control mode of question-searching and photo-taking through operating the first device, and send the control mode set by the first user to the first server, so that the first server feeds back the question-searching result to the second device according to the control mode, enabling students to use photo-taking and question-answering for efficient learning while effectively preventing the phenomenon that students complete their homework through question-searching without thinking by themselves, which is beneficial to having a positive impact on students' learning habits and academic performance.

[0048] In combination with the second aspect, in some implementation manners of the second aspect, the control mode includes a first mode, a second mode, or a third mode.

[0049] Exemplarily, the first mode is a free question-answering mode.

[0050] Exemplarily, the second mode is a homework self-check mode.

[0051] Exemplarily, the third mode is a test paper correction mode.

[0052] In combination with the second aspect, in some implementation manners of the second aspect, the first result includes the first answer or the solution idea of the first question. In the embodiments of the present application, the detailed answer or solution idea of the question is displayed according to the control mode, enabling students to use photo-taking and question-answering for efficient learning while effectively preventing the phenomenon that students complete their homework through question-searching without thinking by themselves, which is beneficial to having a positive impact on students' learning habits and academic performance.

[0053] In combination with the second aspect, in some implementations of the second aspect, the first result is the solution idea for the first question. After sending the control mode to the first server, the following steps are further included:

[0054] Receive a second message sent by the first server. The second message includes first information for indicating an application to obtain the permission to the first answer and second information for indicating the first question and its solution idea.

[0055] Display the first question and its solution idea according to the second information, and display second prompt information according to the first information. The second prompt information is used to prompt whether to agree that the second user obtains the first answer.

[0056] In response to a fourth operation of the first user on the second prompt information, send a third message to the first server. The third message includes option information indicating the fourth operation of the first user on the second prompt information. In the embodiments of the present application, if the first result is the solution idea for the first question, the second device may also send a first message to the first server to apply for the permission to obtain the first answer. After receiving the first message sent by the second device, the first server sends the first information for indicating an application to obtain the permission to the first answer and the second information for indicating the first question and its solution idea to the first device according to the first message, so that the first device displays the first question and its solution idea and the second prompt information. After the first user operates on the second prompt information, the first device sends the option information including the fourth operation of the first user on the second prompt information to the first server.

[0057] In a third aspect, an embodiment of the present invention provides a result display method applied to a second device. The method includes:

[0058] In response to a second operation of a second user, obtain a first picture, where the first picture includes a first question.

[0059] In response to a third operation of the second user, send the first picture to the first server, so that the first server obtains a first answer to the first question according to the first picture and obtains a first result according to the first answer and the control mode.

[0060] Receive the first result sent by the first server.

[0061] Display the first result. In the embodiments of the present application, the second user operates the second device to enable the second device to obtain a picture of the question, and then the second user operates the second device to upload the picture of the question to the cloud, so that the cloud returns the question search result according to the control mode.

[0062] In combination with the third aspect, in some implementation manners of the third aspect, the first result is the first answer. In the embodiments of the present application, the question search result may be the detailed answer to the question.

[0063] In combination with the third aspect, in some implementation manners of the third aspect, the first result is the solution idea of the first question. After receiving the first result sent by the first server, the method further includes:

[0064] Displaying a first prompt message for prompting whether to apply for the permission to obtain the first answer;

[0065] In response to the application operation of the second user on the first prompt message, sending a first message to the first server, where the first message includes first information indicating an application for obtaining the permission to obtain the first answer;

[0066] Receiving a fourth message sent by the first server, where the fourth message includes the first answer;

[0067] Displaying the first answer. In the embodiments of the present application, the question search result may be the solution idea of the question. When the question search result is the solution idea of the question, the second device may further prompt the second user whether to need to obtain the detailed answer to the question. The second user may apply for the detailed answer by operating the prompt message. After the first user agrees, the first server returns the detailed answer to the second device.

[0068] In combination with the third aspect, in some implementation manners of the third aspect, after sending the first message to the first server, it further includes:

[0069] Receiving a fifth message sent by the first server, where the fifth message includes option information of a fourth operation of the first user on a second prompt message, and the option information is a disagree option;

[0070] According to the fifth message, displaying that the authorization is not agreed. In the embodiments of the present application, the question search result may be the solution idea of the question. When the question search result is the solution idea of the question, the second user may apply for the detailed answer by operating the prompt message. When the first user disagrees, the first server returns the disagree option to the second device, and the second device displays that the authorization is not agreed.

[0071] Fourth aspect, an embodiment of the present invention provides a first server, including a processor and a memory. The memory is used to store a program. When the processor runs the program, the first server is enabled to execute the steps involved in the first server in the above method.

[0072] Fifth aspect, an embodiment of the present invention provides a first device, including a processor and a memory. The memory is used to store a program. When the processor runs the program, the first device is caused to execute the steps involved by the first device in the above method.

[0073] Sixth aspect, an embodiment of the present invention provides a second device, including a processor and a memory. The memory is used to store a program. When the processor runs the program, the second device is caused to execute the steps involved by the second device in the above method.

[0074] Seventh aspect, an embodiment of the present invention provides a result display system, which includes the above first server, the above first device, and the above second device.

[0075] Eighth aspect, an embodiment of the present invention provides a readable storage medium, which stores a program. When the program is run by the first server, the first server is caused to execute the method described in the first aspect above; or when the program is run by the first device, the first device is caused to execute the method described in the second aspect above; or when the program is run by the second device, the second device is caused to execute the method described in the third aspect above.

[0076] Ninth aspect, an embodiment of the present invention provides a program product, which includes a program. When the program product runs on a device or any at least one processor, the device is caused to execute the functions / steps in the method described in the first aspect, second aspect, or third aspect above.

[0077] In the technical solutions of the result display method and the electronic device provided by the embodiments of the present invention, the method includes: the first server receives the control mode sent by the first device; receives the first picture sent by the second device, where the first picture includes the first question; obtains the first answer to the first question according to the first picture; and sends the first result to the second device according to the first answer and the control mode, so that the second device displays the first result, and displays the question search result according to the control mode, effectively preventing the phenomenon that students complete their homework by searching for answers without thinking by themselves, which is beneficial to having a positive impact on students' learning habits and academic performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 It is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;

[0079] Figure 2 It is a software structural block diagram of the electronic device 100 according to an embodiment of the present invention;

[0080] Figure 3a It is a schematic diagram of the display of the question search result after adult authentication;

[0081] Figure 3b Schematic diagram of the search question result display that has not passed the adult authentication

[0082] Figure 4 Architecture diagram of a result display system provided by an embodiment of the present invention;

[0083] Figure 5 Signaling interaction diagram of a result display method provided by an embodiment of the present invention;

[0084] Figure 6 Schematic diagram of the control options in an embodiment of the present invention;

[0085] Figure 7 For Figure 5 Signaling interaction diagram in which the first server obtains the first answer to the first question according to the first picture;

[0086] Figure 8 Schematic diagram of obtaining the first answer according to the first picture in an embodiment of the present invention;

[0087] Figure 9 Schematic diagram of the first picture in an embodiment of the present invention;

[0088] Figure 10 For Figure 9 Schematic diagram of the first area of the first picture;

[0089] Figure 11 For Figure 5 Signaling interaction diagram in which the first server sends the first result to the second device according to the first answer and the control mode;

[0090] Figure 12 For Figure 9 Schematic diagram of the second area of the first picture;

[0091] Figure 13 Another schematic diagram of the first picture in an embodiment of the present invention;

[0092] Figure 14 For Figure 13 Schematic diagram of the second area of the first picture;

[0093] Figure 15 Schematic diagram of the execution process of the first server when the first answer is related to the answer text in an embodiment of the present invention;

[0094] Figure 16 Another schematic diagram of the first picture in an embodiment of the present invention;

[0095] Figure 17Schematic diagram of the execution process of the first server when the first answer and the answer text are not relevant in the embodiments of the present invention;

[0096] Figure 18 Schematic diagram of the execution process of the first server when there is no answer information in the first picture in the embodiments of the present invention;

[0097] Figure 19 For Figure 5 Another signaling interaction diagram in which the first server sends the first result to the second device according to the first answer and the control mode in

[0098] Figure 20 Another schematic diagram of the first picture in the embodiments of the present invention;

[0099] Figure 21 For Figure 20 Schematic diagram of the third area of the first picture in

[0100] Figure 22 Another schematic diagram of the first picture in the embodiments of the present invention;

[0101] Figure 23 Schematic diagram of the execution process of the first server when there are correction marks on the first picture in the embodiments of the present invention;

[0102] Figure 24 Schematic diagram of the execution process of the first server when there are no correction marks on the first picture in the embodiments of the present invention;

[0103] Figure 25 Schematic diagram of the second device displaying the first answer in the embodiments of the present invention;

[0104] Figure 26 Schematic diagram of the second device displaying the solution idea in the embodiments of the present invention;

[0105] Figure 27 Signaling interaction diagram of another result display method provided in the embodiments of the present invention;

[0106] Figure 28 A schematic diagram of the second device displaying the first prompt information in the embodiments of the present invention;

[0107] Figure 29 Another schematic diagram of the second device displaying the first prompt information in the embodiments of the present invention;

[0108] Figure 30 Schematic diagram of the first device displaying the first question, its solution idea and the second prompt information in the embodiments of the present invention;

[0109] Figure 31 Schematic diagram of the second device displaying non - consent to authorization in the embodiments of the present invention;

[0110] Figure 32 Flow chart of a result display method provided by an embodiment of the present invention;

[0111] Figure 33 Flow chart of another result display method provided by an embodiment of the present invention;

[0112] Figure 34 Schematic structural diagram of a device provided by an embodiment of the present invention. Detailed implementation manners

[0113] For a better understanding of the technical solution of the present invention, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0114] It should be clear that the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0115] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0116] It should be understood that the term " / and / " used herein is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, a / or b can represent: a exists alone, a and b exist simultaneously, and b exists alone. In addition, the character " / " herein generally represents an "or" relationship between the associated objects before and after.

[0117] Figure 1 Shows the schematic structural diagram of device 100.

[0118] Device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a sensor module 180, a button 190, an indicator 192, etc.

[0119] It can be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the device 100. In other embodiments of the present application, the device 100 may include more or fewer components than shown in the figures, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0120] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0121] The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0122] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0123] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0124] The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through the wireless charging coil of the device 100. While charging the battery 142, the charging management module 140 may also supply power to the device through the power management module 141.

[0125] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives the inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 may also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may also be disposed in the same device.

[0126] The wireless communication function of the device 100 may be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0127] Antenna 1 and Antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0128] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through Antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through Antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be disposed in the same device.

[0129] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor can be an independent device. In some other embodiments, the modulation and demodulation processor can be independent of the processor 110 and be disposed in the same device as the mobile communication module 150 or other functional modules.

[0130] The wireless communication module 160 may provide solutions for wireless communications applied to the device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0131] In some embodiments, antenna 1 of device 100 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, such that device 100 can communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0132] Device 100 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0133] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0134] The NPU is a computing processor for neural networks (NN). By drawing on the structure of biological neural networks, such as the transmission pattern between human brain neurons, it can quickly process input information and can also continuously learn on its own. Through the NPU, applications such as intelligent cognition of device 100 can be realized, such as image recognition, face recognition, speech recognition, text understanding, etc.

[0135] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.

[0136] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, image playback function, etc.). The data storage area can store the data created during the use of device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0137] The button 190 includes a power-on button, etc. The button 190 can be a mechanical button or a touch button. Device 100 can receive button inputs and generate key signal inputs related to the user settings and function controls of device 100.

[0138] The indicator 192 can be an indicator light and can be used to indicate the charging status, power change, etc.

[0139] The software system of device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservices architecture, or cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of device 100.

[0140] Figure 2 It is the software structure block diagram of device 100 in the embodiment of the present invention.

[0141] The layered architecture divides software into several layers, and each layer has clear roles and divisions of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0142] The application layer may include a series of application packages.

[0143] As Figure 2 shown, the application packages may include applications such as the camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0144] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0145] As Figure 2 shown, the application framework layer may include the window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0146] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0147] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone book, etc.

[0148] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.

[0149] The phone manager is used to provide the communication function of the device 100. For example, the management of call states (including connection, disconnection, etc.).

[0150] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0151] The notification manager enables an application to display notification information in the status bar. It can be used to convey messages of the notification type, and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to inform that a download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or a scroll bar text, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialogue window. For example, it can prompt text information in the status bar, emit a prompt sound, vibrate the device, blink the indicator light, etc.

[0152] The Android Runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0153] The core libraries consist of two parts: one part is the functional functions that the Java language needs to call, and the other part is the core libraries of Android.

[0154] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of object life cycles, stack management, thread management, security and exception management, and garbage collection.

[0155] The system libraries can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing libraries (such as: OpenGL ES), 2D graphics engine (such as: SGL), etc.

[0156] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0157] The media libraries support the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media libraries can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0158] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0159] The 2D graphics engine is a graphics engine for 2D drawing.

[0160] The kernel layer is the layer between the hardware and the software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

[0161] Figure 3a It is a schematic diagram showing the search question results after adult authentication. Figure 3bIt is a schematic diagram showing the search question result display that has not passed the adult authentication. The electronic device determines whether to display the detailed answer to the photo search question based on whether the user has passed the adult authentication. For example, Figure 3a as shown, when the user passes the adult authentication, the electronic device will display the detailed answer to the photo search question. For example, Figure 3b as shown, when the user fails to pass the adult authentication, the electronic device does not display the detailed answer to the photo search question, but displays "Adult authentication not passed". Among them, the adult authentication can be face recognition or password verification, etc.

[0162] Figure 3a and Figure 3b The search question result display scheme shown only allows searching questions after adult authentication, and the student group cannot use it; moreover, the restriction method is single and cannot meet the many learning scenarios of students.

[0163] Another search question result display scheme is to have no restrictions. When anyone uses the electronic device to take a photo and search for questions in any scenario, answers will be returned. Although it can be used by the student group, it is easy for some students with poor self-control to complete their homework by searching for questions without thinking on their own, which has a negative impact on the students' learning habits and academic performance and goes against the original intention of learning.

[0164] Based on the above technical problems, the embodiments of the present invention provide a result display system. Figure 4 It is an architecture diagram of a result display system provided by an embodiment of the present invention.

[0165] For example, Figure 4 as shown, the result display system includes a first device 200, a first server 300, and a second device 400. The first device 200 and the first server 300 are connected by wire or wirelessly, and the first server 300 is also connected to the second device 400 by wire or wirelessly.

[0166] Among them, for the hardware structure and software structure of the first device 200, the first server 300, and the second device 400 provided by the embodiments of the present invention, reference can be made to the relevant descriptions of the device 100 in Figure 1 and Figure 2 Exemplarily, the first device 200 includes a terminal device with functions such as display and shooting. The user of the first device 200 is the first user. For example, the first user is the parent of a student.

[0167] Exemplarily, the first server 300 includes a server with functions such as computing and storage.

[0168] Exemplarily, the second device 400 includes a terminal device with functions such as display. The user of the second device 400 is the second user. For example, the second user is a student.

[0169] ​

[0170] As shown Figure 4 in FIG. 1, the first server 300 includes a first module 301, a question bank 302, and a second module 303.

[0171] Exemplarily, the first module 301 has functions such as question stem detection, question stem recognition, and searching for questions from the question bank 302.

[0172] Exemplarily, the second module 303 has functions such as answer detection, answer recognition, answer relevance detection, marking trace detection, and solution idea extraction.

[0173] Based on Figure 4 the result display system shown in FIG. 2, an embodiment of the present invention provides a result display method, which is also a controlled photo-based question search method, enabling students to use photo-based question answering for efficient learning while avoiding phenomena such as copying homework through question search that violate the original intention of learning. To achieve controlled photo-based question search, the core problems to be solved are: 1) How to divide the scenarios of photo-based question search, improve the freedom in different scenarios, and achieve efficient learning; 2) On the side of the first server, how to design a control mode or business execution logic based on the test question pictures obtained by taking photos according to different scenarios to prevent students from completing their homework through photo-based question answering without thinking, which is beneficial to having a positive impact on students' learning habits and academic performance.

[0174] Figure 5 FIG. 3 is a signaling interaction diagram of a result display method provided by an embodiment of the present invention. As shown Figure 5 in FIG. 3, the method includes:

[0175] Step 502, the first device sends a control mode to the first server in response to a first operation of a first user.

[0176] In this step, the first device sends a control mode to the first server in response to an operation of the first user selecting a control mode from the control options.

[0177] Exemplarily, the control mode includes a first mode, a second mode, or a third mode.

[0178] Exemplarily, the first mode is a free question answering mode.

[0179] Exemplarily, the second mode is a homework self-check mode.

[0180] Exemplarily, the third mode is a test paper correction mode.

[0181] For example, Figure 6 FIG. 4 is a schematic diagram of control options in an embodiment of the present invention. As shown Figure 6As shown, the control options include three control modes, namely, the free Q&A mode, the homework self-check mode, and the test paper correction mode. After the parent selects a control mode on the first device, the first device uploads the control mode to the first server, and subsequently, the first server will perform relevant question-searching processes under this control mode.

[0182] Step 504: In response to a second operation of the second user, the second device acquires a first picture, and the first picture includes a first question.

[0183] For example, the second operation may be a photographing operation. In response to the photographing operation of the second user, the second device photographs the first picture, and the first picture includes the first question.

[0184] For example, the second operation may be a scanning operation. In response to the scanning operation of the second user, the second device scans the first picture, and the first picture includes the first question.

[0185] Step 506: In response to a third operation of the second user, the second device sends the first picture to the first server.

[0186] In this step, the third operation is an upload operation, a sending operation, a confirmation operation, etc. of the second user for the first picture.

[0187] Step 508: The first server obtains a first answer to the first question based on the first picture.

[0188] Exemplarily, the first answer is a detailed answer to the first question.

[0189] In some possible embodiments, as Figure 7 shown, step 508 specifically includes:

[0190] Step 5082: The first module obtains a first area in the first picture where the first question is located based on the first picture, obtains the stem text in the first area according to the first area, and searches for a first answer corresponding to the stem text from the question bank according to the stem text.

[0191] In this step, Figure 8 is a schematic diagram of obtaining the first answer according to the first picture in an embodiment of the present invention. As Figure 8 shown, the first module of the first server performs stem detection on the first picture by using a stem detection model, and detects a first area where the first question is located; then, the first module of the first server performs stem recognition on the first area by using an Optical Character Recognition (OCR) model, and recognizes the stem text in the first area; then, the first module of the first server searches for a first answer corresponding to the stem text from the question bank according to the stem text.

[0192] For example,Figure 9 This is a schematic diagram of the first picture in the embodiment of the present invention. As Figure 9 shown, the first question in the first picture is a mathematical geometry question. Figure 10 For Figure 9 a schematic diagram of the first area of the first picture in Figure 10 shown, the first server performs stem detection on the first picture to obtain the first area where the first question is located, that is, Figure 10 the area within the rectangular wireframe in

[0193] "23. (12 points) As shown in the figure, cut out the largest sector CAB with a central angle of 90...^o from a circular iron sheet with a diameter of 1 cm. (1) What is the area of the shaded part that is cut off? \((2)\) If the remaining sector iron sheet is used to form a cone, what is the radius of the bottom circle of the cone (the result can be expressed in a square root)?"

[0194] Then, based on the recognized stem text, the first server retrieves the detailed answer of the question corresponding to the stem text from the question bank, as shown below:

[0195] "Solution: (1) Connect AB and CO. Then AB is the diameter of \(\bigodot O\), so OC = OA = \(\frac{1}{2}\) \(\therefore\) it can be obtained that AC = BC = \(\frac{\sqrt{2}}{2}\) (obtained according to the Pythagorean theorem), \(\therefore\) \(S_{shadow}=S_{\bigodot O}-S_{sector ABC}=\pi\cdot(\frac{1}{2})^2-\frac{1}{4}\pi\cdot(\frac{\sqrt{2}}{2})^2=\frac{\pi}{8}(cm^2)\). \((2)\) Let the radius of the bottom circle of the cone formed be r cm, then \(2\pi r=\frac{90\pi\cdot\frac{\sqrt{2}}{2}}{180}\), \(\therefore\) \(r = \frac{\sqrt{2}}{8}(cm)\)."

[0196] Step 5084: The first module sends the first answer to the second module.

[0197] In this step, the first module of the first server sends the first answer of the first question to the second module of the first server.

[0198] Step 510: The first server sends the first result to the second device according to the first answer and the control mode.

[0199] In some possible embodiments, the control mode is the first mode, and the first result is the first answer. Step 510 specifically includes: The second module sends the first answer to the second device according to the first answer and the first mode. In the free Q&A mode, the student user can take pictures and ask questions freely without restrictions. Therefore, the first server directly sends the first answer to the second device.

[0200] In some possible embodiments, the control mode is the second mode. As Figure 11 shown, step 510 specifically includes:

[0201] Step 510a: The second module detects whether there is answering information in the first picture according to the second mode. If so, execute step 510b; if not, execute step 510d.

[0202] In this step, the second module of the first server uses the handwritten answer detection model to detect whether there is answering information in the first picture according to the second mode.

[0203] Step 510b: The second module determines the second area where the answering information is located in the first picture, obtains the answering text in the second area according to the second area, and obtains the relevant result between the first answer and the answering text; continue to execute step 510c or step 510d.

[0204] In this step, if the second module of the first server detects that there is answering information in the first picture, it uses the handwritten answer detection model to determine the second area where the answering information is located in the first picture; then the second module of the first server performs answer recognition on the second area to recognize the answering text in the second area; then the second module of the first server performs correlation detection on the first answer and the answering text to obtain the relevant result.

[0205] For example, as Figure 9 shown, the first question in the first picture is a mathematical geometry question. Figure 12 is Figure 9 a schematic diagram of the second area of the first picture in Figure 12 shown. As Figure 12 shown, the first server performs answer detection on the first picture to obtain the second area where the answering information is located, that is,

[0206] "Solution: (1) Connect AB\\\Because\\\angle ACB = 90^o,\\\So AB is the diameter.\\\Because AC = BC\\\So in the right triangle ACB, let AC be x, and we get x^2 + x^2 = 1\\\So

[0207] x = \frac{\sqrt{2}}{2}\\\therefore S_{shaded} = S_{circle} - S_{sector}\\=\pi\times\frac{1}{4}-\frac{\pi\times\frac{1}{2}}{360}\times

[0208] 90^o\\=\frac{\pi}{4}-\frac{\pi}{8}\\=\frac{\pi}{8}\\(2)

[0209] The length of arc \(\overset{\LARGE{\frown}}{AB}\) is \(\frac{2\pi\times

[0210] \frac{\sqrt{2}}{2}}{360}\times

[0211] 90\\=\frac{\sqrt{2}\pi}{4}\\\frac{\sqrt{2}\pi}{4} = 2\pi

[0212] r\\\therefore r=\frac{\sqrt{2}}{8}.”

[0213] For example, Figure 13 is another schematic diagram of the first picture in the embodiment of the present invention. As Figure 13 shown, the first question in the first picture is a mathematical geometry question, and there is answer information in the first picture. Figure 14 is Figure 13 a schematic diagram of the second area of the first picture in Figure 14 shown. The first server performs answer detection on the first picture to obtain the second area where the answer information is located, that is, Figure 14 the area within the rectangular wireframe in

[0214] “(1) The diameter of the circle is 10 cm\\(2) ABCD.”

[0215] Step 510c: If the correlation result is relevant, the second module sends the first result to the second device, and the first result is the first answer; and continue to execute step 512.

[0216] In this step, if the correlation result between the first answer and the answer text is relevant, for example Figure 9The answer text shown is related to the detailed answer of the first question. The second module of the first server sends the first result to the second device, and the first result is the first answer.

[0217] Figure 15 It is a schematic diagram of the execution process of the first server when the first answer is related to the answer text in the embodiment of the present invention. As Figure 15 shown, there is answer information in the first picture and the answer information is related to the first answer. The second module of the first server performs answer detection on the first picture according to the second mode, using the handwritten answer detection model, and detects that there is answer information in the first picture; then the second module of the first server performs answer recognition on the second area and recognizes the answer text in the second area; then the second module of the first server performs relevance detection on the first answer and the answer text to obtain a relevant result that the first answer and the answer text are related, and then takes the first answer as the first result.

[0218] Step 510d: The relevant result is irrelevant. The second module obtains the solution idea of the first question according to the first answer.

[0219] In this step, if the relevant result between the first answer and the answer text is irrelevant, for example Figure 14 shown, the answer text shown is not related to the detailed answer of the first question. The second module of the first server obtains the solution idea of the first question according to the first answer.

[0220] Specifically, the second module of the first server extracts the solution idea from the first answer.

[0221] For example, Figure 16 It is another schematic diagram of the first picture in the embodiment of the present invention. As Figure 16 shown, the first question in the first picture is a mathematical geometry question, and there is no answer information in the first picture. The second module of the first server performs answer detection on the first picture and does not detect answer information. The solution idea of the first question obtained according to the first answer is as follows:

[0222] “(1) Use the Pythagorean theorem to find the radius of the sector, and then solve according to the sector area formula;

[0223] (2) The radius of the circle can be obtained according to the circumference of the bottom circle being equal to the arc length of the unfolded diagram.”

[0224] Step 510e: The second module sends the first result to the second device, and the first result is the solution idea; and continues to execute step 512.

[0225] In this step, the second module of the first server sends the first result to the second device, and the first result is the solution idea.

[0226] Figure 17Schematic diagram of the execution process of the first server when the first answer and the response text are not relevant in the embodiments of the present invention, as Figure 17 shown, there is response information in the first picture and the response information is not relevant to the first answer. The second module of the first server detects the response information in the first picture using the handwritten response detection model according to the second mode; then the second module of the first server performs response recognition on the second area and recognizes the response text in the second area; then the second module of the first server performs relevance detection on the first answer and the response text, obtains the relevant result that the first answer and the response text are not relevant, and then extracts the solution idea from the first answer and uses the solution idea as the first result.

[0227] Figure 18 Schematic diagram of the execution process of the first server when there is no response information in the first picture in the embodiments of the present invention, as Figure 18 shown, the second module of the first server detects that there is no response information in the first picture using the handwritten response detection model according to the second mode; then the second module of the first server extracts the solution idea from the first answer and uses the solution idea as the first result.

[0228] In the homework inspection mode, after the student user takes a photo and uploads it using the second device, the first server will detect and recognize the response area. If the response text is relevant to the first answer, a detailed solution can be returned. If there is no response or the response text is completely irrelevant to the first answer, the solution idea will be returned.

[0229] In some possible embodiments, the control mode is the third mode. As Figure 19 shown, step 510 specifically includes:

[0230] Step 510A: The second module detects whether there are marking traces in the first picture according to the third mode. If so, execute step 510B; if not, continue to execute step 510a.

[0231] In this step, the second module of the first server detects whether there are marking traces in the first picture and determines the third area where the marking traces are located using the marking trace detection model according to the third mode.

[0232] For example, Figure 20 Another schematic diagram of the first picture in the embodiments of the present invention, as Figure 20 shown, the first question in the first picture is a chemistry question. Figure 21 is Figure 20 a schematic diagram of the third area of the first picture in Figure 21 shown. The second module of the first server detects that there are a total of 4 marking traces in the first picture, that is, Figure 21 the marking traces within the 4 oval wireframes in

[0233] For example, Figure 22 is another schematic diagram of the first picture in the embodiment of the present invention. As Figure 22 shown, the first question in the first picture is a chemistry question. The second module of the first server detects that there is no marking trace on the first picture.

[0234] Step 510B: The second module sends the first result to the second device. The first result is the first answer; and then continue to execute step 512.

[0235] In this step, the second module of the first server sends the first result to the second device, and the first result is the first answer.

[0236] Figure 23 is a schematic diagram of the execution process of the first server when there is a marking trace on the first picture in the embodiment of the present invention. As Figure 23 shown, in the test paper correction mode, when the first server detects that there is a marking trace on the first question, it returns the detailed answer.

[0237] Figure 24 is a schematic diagram of the execution process of the first server when there is no marking trace on the first picture in the embodiment of the present invention. As Figure 24 shown, in the test paper correction mode, when the first server detects that there is no marking trace on the first question, it executes the process of the homework inspection mode to determine whether to return the detailed answer.

[0238] Step 512: The second device displays the first result.

[0239] In this step, the second device receives the first result sent by the second module of the first server and displays the first result.

[0240] Optionally, when the second device displays the first result, it also displays the solution idea.

[0241] For example, Figure 25 is a schematic diagram of the second device displaying the first answer in the embodiment of the present invention. The first result is the first answer to the first question in the first picture. As Figure 25 shown, the second device displays the solution idea and the first answer.

[0242] For example, Figure 26 is a schematic diagram of the second device displaying the solution idea in the embodiment of the present invention. The first result is the solution idea of the first question in the first picture. As Figure 26 shown, the second device displays the solution idea.

[0243] In the embodiment of the present invention, the second user inputs the question area into the second device by means of photographing, scanning, etc., and then uploads the picture to the first server by wire or wirelessly; the first server completes functions such as recognition and question searching; the first user sets the control mode to the first server through the first device, and the first server completes operations such as answer recognition detection, correction trace detection, and problem-solving idea extraction, and returns the content that meets the current control mode in cooperation with the question searching ability, and transmits the content from the first server back to the second device, and the second user views the question answer or problem-solving idea on the second device.

[0244] In summary, the embodiment of the present invention includes three control modes, namely, free Q&A mode, homework self-check mode, and test paper correction mode. Among them, the free Q&A mode has no restrictions and belongs to normal photo Q&A. The second user takes a picture of the question and uploads it to the first server, that is, the cloud. The cloud completes the OCR recognition of the question, and then retrieves the question answer from the question bank and returns it to the second user. In the homework self-check mode, the cloud will detect and recognize the answer information of the question picture taken by the user. When answer information is recognized and the answer information is related to the question answer, the detailed answer will be returned to the user, otherwise only the problem-solving idea will be returned. In the test paper correction mode, taking the correction trace as a measurement condition, the cloud detects the correction trace of the user picture. If there is a correction trace, it will directly go through the normal question searching process and return the detailed answer, otherwise it will go through the homework self-check mode process and select to return the detailed answer or the problem-solving idea according to the answer content.

[0245] In the technical solution of the result display method provided by the embodiment of the present invention, the method includes: the first server receives the control mode sent by the first device; receives the first picture sent by the second device, where the first picture includes the first question; obtains the first answer of the first question according to the first picture; and sends a first result to the second device according to the first answer and the control mode, so that the second device displays the first result, and displays the question searching result according to the control mode, which effectively prevents the phenomenon that students complete their homework by searching questions without thinking by themselves, and is beneficial to having a positive impact on students' learning habits and academic performance.

[0246] Figure 27 It is a signaling interaction diagram of another result display method provided by the embodiment of the present invention. Compared with Figure 5 the result display method shown, when the first result is the problem-solving idea, as Figure 27 shown, after step 510, the method further includes:

[0247] Step 514, the second device displays a first prompt message, and the first prompt message is used to prompt whether to apply for the permission to obtain the first answer.

[0248] In this step, when the first result is the solution idea, in addition to displaying the solution idea, the second device also displays a first prompt message, which is used to prompt whether to apply for the permission to obtain the first answer. Therefore, when the student terminal displays the solution idea, it simultaneously prompts that the permission can be applied to the parent terminal to obtain the detailed answer, and the student terminal can choose to apply to the parent terminal to view the detailed answer.

[0249] It should be understood that step 514 can be executed simultaneously with step 512, or can be executed after step 512.

[0250] Optionally, when the control mode is the second mode, the first prompt message can also be used to prompt that the second user has not answered the question.

[0251] For example, Figure 28 is a schematic diagram of the second device displaying the first prompt message in an embodiment of the present invention. As Figure 28 shown, the second device simultaneously displays the solution idea and the first prompt message. The first prompt message includes a first prompt text, an "Apply" option, and a "Give up" option. Among them, the first prompt text is "You haven't answered the question yet. Do you need to apply to your parent for the detailed answer?"

[0252] Optionally, when the control mode is the third mode, the first prompt message can also be used to prompt that the second user has not answered the question and has not been graded.

[0253] For example, Figure 29 is another schematic diagram of the second device displaying the first prompt message in an embodiment of the present invention. As Figure 29 shown, the first prompt text of the first prompt message is "Your test paper has not been answered and graded yet. Do you need to apply to your parent for the detailed answer?"

[0254] Step 516: In response to the application operation of the second user on the first prompt message, the second device sends a first message to the first server.

[0255] In this step, in response to the application operation of the second user on the first prompt message, the second device sends a first message to the first server.

[0256] For example, as Figure 28 and Figure 29 shown, the application operation of the second user on the first prompt message is the operation on the "Apply" option. The student terminal clicks the button to apply for the detailed answer to this math geometry question, triggering the student terminal to send the information of applying for the detailed answer to this math geometry question to the cloud.

[0257] Among them, the first message contains a first piece of information used to represent the application for the permission to obtain the first answer.

[0258] Step 518: The first server sends a second message to the first device according to the first message.

[0259] Among them, the second message includes the first information and the second information for representing the first question and its solution idea.

[0260] Step 520: The first device displays the first question, its solution idea, and the second prompt information according to the second message.

[0261] In this step, the first device displays the first question and its solution idea according to the second information and displays the second prompt information according to the first information.

[0262] Among them, the second prompt information is used to prompt whether to agree that the second user obtains the first answer.

[0263] For example, Figure 30 is a schematic diagram of the first device displaying the first question, its solution idea, and the second prompt information in an embodiment of the present invention. As Figure 30 shown, the second device displays the first question, its solution idea, and the second prompt information. The second prompt information includes a second prompt text, an "Agree" option, and a "Disagree" option. Among them, the second prompt text is "Xiaoming applies to you for the detailed answer to this question. Do you agree?"

[0264] Step 522: In response to the fourth operation of the first user on the second prompt information, the first device sends a third message to the first server and continues to execute step 524 or step 528.

[0265] In this step, in response to the fourth operation of the first user on the second prompt information, the first device sends a third message to the first server.

[0266] For example, as Figure 30 shown, the fourth operation of the first user on the second prompt information is an operation on the "Agree" option or the "Disagree" option.

[0267] Among them, the third message includes option information indicating the fourth operation of the first user on the second prompt information.

[0268] For example, as Figure 30 shown, if the fourth operation of the first user on the second prompt information is an operation on the "Agree" option, the option information is the agree option; if the fourth operation of the first user on the second prompt information is an operation on the "Disagree" option, the option information is the disagree option

[0269] Step 524: When the option information includes the agree option, the first server sends a fourth message to the second device, and the fourth message includes the first answer.

[0270] In this step, the option information includes an agreement option, and the first server sends the first answer to the second device. After the cloud receives the option information from the parent terminal, if the option information is agreement, the detailed answer to the question is sent to the student terminal.

[0271] Optionally, the fourth message may further include option information of the parent terminal.

[0272] Step 526: The second device displays the first answer. The process ends.

[0273] In this step, after receiving the fourth message, the second device displays the first answer. After receiving the fourth message, if the student terminal chooses to agree, the detailed answer to the first question is displayed.

[0274] Step 528: The option information includes a disagreement option, and the first server sends a fifth message to the second device, where the fifth message includes the option information.

[0275] In this step, if the option information includes a disagree option, the first server sends the disagree option to the second device. After the cloud receives the option information from the parent terminal, if the option information is disagree, it only sends the option information of the parent terminal to the student terminal.

[0276] Step 530: The second device displays a message indicating that it does not agree to the authorization based on the option information. The process ends.

[0277] In this step, after the second device receives the fifth message, it displays that the authorization is not agreed according to the option information. After the student terminal receives the fifth message, if the option is not agreed, it will display that the parent terminal does not agree to the authorization.

[0278] In this step, the option information includes a disagreement option, and the second device displays a disagreement to the authorization based on the option information. The embodiment of the present application does not specifically limit the form in which the second device displays a disagreement to the authorization.

[0279] For example, Figure 31 FIG. 1 is a schematic diagram showing that the second device does not agree to the authorization in an embodiment of the present invention. Figure 31 As shown, the second device displays the message "Parents recommend that you try to resolve this issue independently first."

[0280] In summary, the embodiment of the present application combines answer information and correction traces to realize scene-based photo-taking learning under the control mode set by parents. The overall scenario is divided into three scenarios, namely, free question-answering scenario, homework self-checking scenario and test paper modification scenario.

[0281] In the free question-and-answer scenario, the second user can take photos and answer questions freely without restrictions.

[0282] Among them, in the scenario of homework inspection, after the second user takes a photo and uploads it to the first server, the first server will detect and identify the answering area. If the answering information is related to the detailed answer of the question stem, the detailed answer can be returned. If there is no answer or it is completely irrelevant, a prompt will be given to the user and only the solution idea will be returned. At the same time, a selection to apply for the detailed answer to the control terminal will be reported to the user.

[0283] Among them, in the scenario of test paper correction, the first server detects whether there are correction marks on the test paper questions. If not, the process of the homework inspection scenario will be executed to determine whether to return the detailed answer. If there are correction marks, the detailed answer will be returned.

[0284] Through the above-mentioned photo-taking question-answering method for different scenarios, it can be ensured that students can learn in the most efficient way under the control of their parents.

[0285] The embodiments of the present application set different control modes for different scenarios. Among them, the free question-answering scenario corresponds to the first mode, the homework self-check scenario corresponds to the second mode, and the test paper modification scenario corresponds to the third mode.

[0286] The embodiments of the present application improve the degree of freedom in different scenarios through the photo-taking question-answering method under different control modes, prevent students from copying homework through photo-taking question-answering, realize efficient learning, and ensure that students can learn in the most efficient way under the control of their parents.

[0287] Compared with Figure 3a and Figure 3b the question-searching result display scheme shown, the embodiments of the present invention combine the answering information and the correction marks to realize the photo-taking learning in different scenarios under the control mode set by the parents. It is generally divided into three scenarios, namely the free question-answering scenario, the homework self-check scenario, and the test paper modification scenario, to ensure that students can learn in the most efficient way under the control of their parents. The control effects that can be achieved are as follows:

[0288] 1) Control whether to return the detailed answer according to the answering situation;

[0289] 2) Control whether to return the detailed answer according to the correction information;

[0290] 3) Display relevant prompts to enable interaction between students and parents.

[0291] In the technical solution of the result display method provided by the embodiments of the present invention, the method includes: a first server receives a control mode sent by a first device; receives a first picture sent by a second device, where the first picture includes a first question; obtains a first answer to the first question according to the first picture; and sends a first result to the second device according to the first answer and the control mode, so that the second device displays the first result. Displaying the question-searching result according to the control mode can effectively prevent students from completing their homework by searching for answers without thinking on their own, which is beneficial to having a positive impact on students' learning habits and academic performance.

[0292] Figure 32 It is a flowchart of a result display method provided by an embodiment of the present invention. As Figure 32 shown, the method includes:

[0293] Step 602: In response to a first operation of a first user, a first device sends a control mode to a first server.

[0294] Step 604: In response to a second operation of a second user, a second device obtains a first picture, where the first picture includes a first question; and in response to a third operation of the second user, sends the first picture to the first server.

[0295] Step 606: The first server obtains a first answer to the first question according to the first picture; and sends a first result to the second device according to the first answer and the control mode.

[0296] In some possible embodiments, the first server obtaining a first answer to the first question according to the first picture includes: the first server obtaining a first area in the first picture where the first question is located according to the first picture; obtaining the stem text in the first area according to the first area; and searching for a first answer corresponding to the stem text from a question bank according to the stem text.

[0297] In some possible embodiments, the control mode is a first mode, and the first result is the first answer.

[0298] In some possible embodiments, the control mode is the second mode; the first server sends a first result to the second device according to the first answer and the control mode, including: the first server detects whether there is answer information in the first picture according to the second mode; if it detects that there is answer information in the first picture, it determines a second area where the answer information is located in the first picture; according to the second area, it obtains the answer text in the second area; according to the first answer and the answer text, it obtains a correlation result between the first answer and the answer text; if the correlation result is relevant, it sends the first result to the second device, and the first result is the first answer; if there is no answer information in the first picture or the correlation result is irrelevant, it obtains the solution idea of the first question according to the first answer and sends the first result to the second device, and the first result is the solution idea.

[0299] In some possible embodiments, the control mode is the third mode; the first server sends a first result to the second device according to the first answer and the control mode, including: the first server detects whether there is a marking trace in the first picture according to the third mode; if it detects that there is a marking trace in the first picture, it sends the first result to the second device, and the first result is the first answer; if it detects that there is no marking trace in the first picture, it detects whether there is answer information in the first picture; if it detects that there is answer information in the first picture, it determines a second area where the answer information is located in the first picture; according to the second area, it obtains the answer text in the second area; according to the first answer and the answer text, it obtains a correlation result between the first answer and the answer text; if the correlation result is relevant, it sends the first result to the second device, and the first result is the first answer; if there is no answer information in the first picture or the correlation result is irrelevant, it obtains the solution idea of the first question according to the first answer and sends the first result to the second device, and the first result is the solution idea.

[0300] Step 608, the second device displays the first result.

[0301] In the technical solution of the result display method provided by the embodiments of the present invention, the method includes: the first server receives the control mode sent by the first device; receives the first picture sent by the second device, and the first picture includes the first question; obtains the first answer of the first question according to the first picture; sends the first result to the second device according to the first answer and the control mode, so that the second device displays the first result, and displays the search result according to the control mode, effectively preventing the phenomenon that students complete their homework by searching questions without thinking by themselves, which is beneficial to having a positive impact on students' learning habits and academic performance.

[0302] Figure 33 It is a flowchart of another result display method provided by the embodiments of the present invention. Compared with Figure 32 the result display method shown, when the first result is the solution idea, such asFigure 33 As shown, after step 606, the method further includes:

[0303] Step 610, the second device displays a first prompt message for prompting whether to apply for permission to obtain the first answer.

[0304] It should be understood that step 610 can be executed simultaneously with step 608 or after step 608.

[0305] Step 612, in response to the second user's application operation on the first prompt message, the second device sends a first message to the first server, and the first message includes first information indicating an application for permission to obtain the first answer.

[0306] Step 614, according to the first message, the first server sends a second message to the first device, and the second message includes the first information and second information for indicating the first question and its solution idea.

[0307] Step 616, the first device displays the first question and its solution idea according to the second information, and displays a second prompt message according to the first information, and the second prompt message is used to prompt whether to agree that the second user obtains the first answer.

[0308] Step 618, in response to the first user's fourth operation on the second prompt message, the first device sends a third message to the first server, and the third message includes option information indicating the first user's fourth operation on the second prompt message, and then proceeds to execute step 620 or step 624.

[0309] Step 620, if the option information includes an approval option, the first server sends a fourth message to the second device, and the fourth message includes the first answer.

[0310] Step 622, the second device displays the first answer. The process ends.

[0311] Step 624, if the option information includes a disapproval option, the first server sends a fifth message to the second device, and the fifth message includes the option information.

[0312] Step 626, the second device displays "not authorized" according to the fifth message. The process ends.

[0313] In the technical solution of the result display method provided by the embodiments of the present invention, the method includes: a first server receives a control mode sent by a first device; receives a first picture sent by a second device, where the first picture includes a first question; obtains a first answer to the first question according to the first picture; and sends a first result to the second device according to the first answer and the control mode, so that the second device displays the first result. Displaying the result of searching for questions according to the control mode can effectively prevent the phenomenon that students complete their homework by searching for questions without thinking by themselves, which is beneficial to having a positive impact on students' learning habits and academic performance.

[0314] Figure 34 FIG. 4 is a schematic structural diagram of a device provided by an embodiment of the present invention. It should be understood that the device 700 can execute each step in the above method embodiment. To avoid repetition, details are not described herein again. The device 700 includes: a processor 701 and a memory 702.

[0315] An embodiment of the present application further provides a first server, including at least one processor 701 and at least one memory 702. Among them, the at least one memory 702 is used to store at least one program. When the at least one processor 701 runs the at least one program, the first server is enabled to perform the operations related to the first server in the above method embodiment.

[0316] An embodiment of the present application further provides a first device, including at least one processor 701 and at least one memory 702. Among them, the at least one memory 702 is used to store at least one program. When the at least one processor 701 runs the at least one program, the first device is enabled to perform the operations related to the first device in the above method embodiment. [[ID=ID=11]]

[0317] An embodiment of the present application further provides a second device, including at least one processor 701 and at least one memory 702. Among them, the at least one memory 702 is used to store at least one program. When the at least one processor 701 runs the at least one program, the second device is enabled to perform the operations related to the second device in the above method embodiment.

[0318] An embodiment of the present application further provides a readable storage medium. The readable storage medium stores a program. When the program is run by the first server, the first server is enabled to perform the operations related to the first server in the above method embodiment.

[0319] An embodiment of the present application further provides a readable storage medium. The readable storage medium stores a program. When the program is run by the first device, the first device is enabled to perform the operations related to the first device in the above method embodiment.

[0320] An embodiment of the present application further provides a readable storage medium storing a program, which, when run on a second device, causes the second device to perform the operations involved by the second device in the foregoing method embodiment.

[0321] An embodiment of the present application further provides a program product, which, when run on a first server or at least one processor, causes the first server to perform the operations involved by the first server in the foregoing method embodiment.

[0322] An embodiment of the present application further provides a program product, which, when run on a first device or at least one processor, causes the first device to perform the operations involved by the first device in the foregoing method embodiment.

[0323] An embodiment of the present application further provides a program product, which, when run on a second device or at least one processor, causes the second device to perform the operations involved by the second device in the foregoing method embodiment.

[0324] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0325] In several embodiments provided by the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art or a part of this technical solution, can be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (which may be a first server, a first device, a second device, a terminal device, a computer, or a server, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disc.

[0326] The above are only specific embodiments of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present application, and all should be covered by the protection scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A result display method, characterized in that, Applied to a first server, the method includes: Receiving a management and control mode sent by a first device; Receiving a first picture sent by a second device, the first picture including a first question; Obtaining a first answer to the first question according to the first picture; Sending a first result to the second device according to the first answer and the management and control mode, so that the second device displays the first result.

2. The method according to claim 1, wherein The obtaining the first answer to the first question according to the first picture includes: Obtaining a first area in the first picture where the first question is located according to the first picture; Obtaining the question stem text in the first area according to the first area; Searching for the first answer corresponding to the question stem text from a question bank according to the question stem text.

3. The method according to claim 1 or 2, characterized in that, The management and control mode is a first mode, and the first result is the first answer.

4. The method according to claim 1 or 2, characterized in that, The management and control mode is a second mode. The sending the first result to the second device according to the first answer and the management and control mode includes: Detecting whether there is answering information in the first picture according to the second mode; If it is detected that there is the answering information in the first picture, determining a second area in the first picture where the answering information is located; Obtaining the answering text in the second area according to the second area; Obtaining a relevant result between the first answer and the answering text according to the first answer and the answering text; If the relevant result is relevant, sending the first result to the second device, and the first result is the first answer.

5. The method according to claim 1 or 2, characterized in that The management and control mode is a third mode. The sending the first result to the second device according to the first answer and the management and control mode includes: Detecting whether there is a marking trace in the first picture according to the third mode; If it is detected that there is the marking trace in the first picture, sending the first result to the second device, and the first result is the first answer; If it is detected that there is no marking trace in the first picture, detecting whether there is answering information in the first picture; If it is detected that there is the answering information in the first picture, determining a second area in the first picture where the answering information is located; Obtaining the answering text in the second area according to the second area; Obtaining a relevant result between the first answer and the answering text according to the first answer and the answering text; If the relevant result is relevant, sending the first result to the second device, and the first result is the first answer.

6. The method according to claim 4 or 5, characterized in that, The sending the first result to the second device according to the first answer and the management and control mode further includes: If there is no answering information in the first picture or the relevant result is irrelevant, obtaining a solution idea for the first question according to the first answer, and sending the first result to the second device, and the first result is the solution idea.

7. The method according to claim 6, characterized in that After the sending the first result to the second device according to the first answer and the management and control mode, it further includes: Receive a first message sent by the second device, where the first message includes first information for indicating an application to obtain the permission for the first answer; According to the first message, send a second message to the first device, where the second message includes the first information and second information for indicating the first question and its solution idea, so that the first device displays the first question and its solution idea according to the second information and displays second prompt information according to the first information; Receive a third message sent by the first device, where the third message includes option information indicating that a first user performs a fourth operation on the second prompt information; If the option information includes an approval option, send a fourth message to the second device, where the fourth message includes the first answer; 8. The method according to claim 7, wherein After receiving the third message sent by the first device, it further includes: If the option information includes a disapproval option, send a fifth message to the second device, where the fifth message includes the option information; 9. A result display method, characterized in that Applied to the first device, the method includes: In response to a first operation of a first user, send a control mode to a first server, so that the first server obtains a first answer to a first question in the first picture according to the first picture and sends a first result to the second device according to the first answer and the control mode, where the first result is used for the second device to display the first result; 10. The method according to claim 9, wherein The control mode includes a first mode, a second mode or a third mode; 11. The method according to claim 9 or 10, characterized in that, The first result includes the first answer or the solution idea of the first question; 12. The method according to any one of claims 9-11, characterized in that, When the first result is the solution idea of the first question, after sending the control mode to the first server, it further includes: Receive a second message sent by the first server, where the second message includes first information for indicating an application to obtain the permission for the first answer and second information for indicating the first question and its solution idea; Display the first question and its solution idea according to the second information, and display second prompt information according to the first information, where the second prompt information is used to prompt whether to approve a second user to obtain the first answer; In response to the fourth operation of the first user on the second prompt information, send a third message to the first server, where the third message includes option information indicating that the first user performs the fourth operation on the second prompt information; 13. A result display method, characterized in that, Applied to the second device, the method includes: In response to a second operation of a second user, obtain a first picture, where the first picture includes a first question; In response to the third operation of the second user, send the first picture to the first server, so that the first server obtains a first answer to the first question according to the first picture and obtains a first result according to the first answer and the control mode; Receive the first result sent by the first server; Display the first result; 14. The method according to claim 13, wherein The first result is the first answer; 15. The method according to claim 13, wherein When the first result is the solution idea of the first question, after receiving the first result sent by the first server, the method further includes: Display a first prompt message for prompting whether to apply for permission to obtain the first answer; In response to the application operation of the second user on the first prompt message, send a first message to the first server, where the first message includes first information indicating an application for permission to obtain the first answer; Receive a fourth message sent by the first server, where the fourth message includes the first answer; Display the first answer.

16. The method according to claim 15, wherein After sending the first message to the first server, it further includes: Receive a fifth message sent by the first server, where the fifth message includes option information of a fourth operation of the first user on a second prompt message, and the option information is a disagree option; According to the fifth message, display that authorization is not granted.

17. A first server, characterized in that, It includes a processor and a memory. Among them, the memory is used to store a program. When the processor runs the program, the first server is caused to execute the steps of the method according to any one of claims 1-8.

18. A first device, characterized in that, It includes a processor and a memory. Among them, the memory is used to store a program. When the processor runs the program, the first device is caused to execute the steps of the method according to any one of claims 9-12.

19. A second device, characterized in that, It includes a processor and a memory. Among them, the memory is used to store a program. When the processor runs the program, the second device is caused to execute the steps of the method according to any one of claims 13-16.

20. A result display system, characterized in that, It includes: The first server according to claim 17, the first device according to claim 18, and the second device according to claim 19.

21. A readable storage medium, characterized in that, The readable storage medium stores a program. When the program is run by the first server, the first server is caused to execute the method according to any one of claims 1-8, or when the program is run by the first device, the first device is caused to execute the method according to any one of claims 9-12, or when the program is run by the second device, the second device is caused to execute the method according to any one of claims 13-16.

Images