Multi-device cooperation method and device, medium and electronic device

Abstract

The invention provides a multi-device cooperation method and device, a medium and electronic device.The method comprises the steps that an identifier and / or a placeholder of a target equation on an answering device are / is recognized, and after the identifier and / or the placeholder of the target equation are / is recognized, the target equation on the answering device is recognized; the answering device obtains a calculation result which is written on a draft device and aims at the target equation; and supplementing the calculation result behind the identifier or replacing the placeholder. According to the invention, the efficiency and accuracy of performing calculation practice by using equipment such as a learning machine can be improved.

Description

Technical Field

[0001] The present application relates to the field of smart device technology, and in particular to a multi-device collaboration method, apparatus, medium and electronic device. Background Art

[0002] With the development of network technology, learning with learning machines has become a popular learning mode. Users use learning machines to watch teaching videos, practice calculations, answer questions online, etc. A typical scenario is that when students are doing exercises, they check the questions through the vertical tablet learning machine in front of them, and use the draft paper or handwriting ink screen or another tablet (the above three types of devices are collectively referred to as draft devices below) to do draft calculations. In the current scenario, after students calculate the results using the draft device, they need to manually copy them to the learning machine. Manual copying not only affects the efficiency of answering questions, but is also prone to errors. There is currently no relevant solution to this problem. Summary of the invention

[0003] In view of this, the present application provides a multi-device collaboration method, apparatus, medium and electronic device, the main purpose of which is to improve learning efficiency and accuracy in the scenario of using a learning machine.

[0004] According to one aspect of the present application, a multi-device collaboration method is provided and applied to a question answering device to control the question answering device to synchronize the answers of a draft device to a local device, the method comprising:

[0005] Identify the identifier and / or placeholder of the target equation on the answering device,

[0006] After identifying the identifier and / or placeholder of the target equation, the answering device obtains the calculation result for the target equation written on the draft device;

[0007] The calculation result is added after the identifier or replaces the placeholder.

[0008] In one implementation, identifying the identifier and / or placeholder of the target equation on the question answering device includes:

[0009] Writing or inputting the target equation on the answering device, or calling the target equation of the teaching service;

[0010] Optical character recognition is performed on the target equation to identify an identifier and / or a placeholder of the target equation.

[0011] In one implementation, the answering device obtains the calculation result for the target formula written on the draft device, including:

[0012] After the answering device recognizes the identifier and / or placeholder of the target equation, the answering device is triggered to perform optical character recognition on the display content of the draft device to obtain the calculation result written on the draft device; and

[0013] The answering device performs pattern matching on the calculation result written on the draft device and the target formula, and determines that the calculation result is a calculation result for the target formula.

[0014] In one implementation, the answering device obtains the calculation result for the target formula written on the draft device, including:

[0015] The draft device determines that the user has completed the calculation according to the user's calculation steps based on optical character recognition, and reports the calculation result written on the draft device to the answering device based on the communication connection method established between the draft device and the answering device;

[0016] The answering device performs pattern matching on the calculation result written on the draft device and the target formula, and determines that the calculation result is a calculation result for the target formula.

[0017] In one implementation, the answering device obtains the calculation result for the target formula written on the draft device, including:

[0018] Based on the communication connection mode established between the answering device and the draft device, the answering device inquires the draft device whether the calculation for the target formula has been completed;

[0019] The draft device performs pattern matching on the calculation result written on the draft device and the target formula, and after the pattern matching is successful, the calculation result for the target formula is sent to the answering device.

[0020] In one implementation, pattern matching the calculation result written on the draft device with the target formula includes:

[0021] Optical character recognition is performed on the target formula to identify a formula pattern of the target formula; and based on the formula pattern, it is determined whether the calculation result matches the target formula.

[0022] In one implementation, the method further includes:

[0023] The answering device updates and obtains the content of the draft device;

[0024] When it is recognized that the user modifies the calculation result on the draft device or erases the answer, the updated calculation result is synchronized behind the identifier or replaces the placeholder.

[0025] In one implementation, when it is recognized that the user modifies the calculation result or erases the answer on the draft device, the method further includes:

[0026] The answering device is triggered to start an erasing animation plug-in to keep a blank space on the identifier or the placeholder.

[0027] According to one aspect of the present application, a multi-device collaboration apparatus is provided, which is applied to a question answering device to control the question answering device to synchronize the answers of a draft device to a local device, and the apparatus includes:

[0028] an equation symbol recognition unit, used to recognize an identifier and / or a placeholder of a target equation on the answering device,

[0029] A calculation result acquisition unit, configured to enable the answering device to acquire a calculation result for the target formula written on the draft device after identifying the identifier and / or placeholder of the target formula;

[0030] A result synchronization unit is used to add the calculation result to the end of the identifier or replace the placeholder.

[0031] According to one aspect of the present application, a storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned multi-device collaboration method when running.

[0032] According to one aspect of the present application, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the above-mentioned multi-device collaboration method.

[0033] By means of the above technical solution, the present application provides a multi-device collaboration method, apparatus, medium and device, which can control the answering device to synchronize the answers of the draft device to the local device, wherein when the identifier and / or placeholder of the target formula on the answering device is identified, the answering device is triggered to obtain the calculation result for the target formula written on the draft device, and automatically supplement or replace the calculation result to the appropriate position of the target formula. It can be seen that the present application uses the collaborative work of the answering device and the draft device, and the answering device automatically fills in the corresponding position after obtaining the calculation result of the draft device, thereby overcoming the inefficiency and error-prone problems of existing users having to manually copy answers, and improving the learning efficiency and accuracy of the learning machine learning scenario.

[0034] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0036] Figure 1 A schematic diagram of an application scenario of a multi-device collaboration method provided in an embodiment of the present application is shown;

[0037] Figure 2 A schematic diagram of the internal structure of an electronic device for executing a multi-device collaboration method provided in an embodiment of the present application is shown;

[0038] Figure 3 A flowchart of a multi-device collaboration method provided by an embodiment of the present application is shown;

[0039] Figure 4 A flowchart of a multi-device collaboration method embodiment 1 provided in an embodiment of the present application is shown;

[0040] Figure 5 A flowchart of a second embodiment of a multi-device collaboration method provided by an embodiment of the present application is shown;

[0041] Figure 6 A flowchart of a third embodiment of a multi-device collaboration method provided by an embodiment of the present application is shown;

[0042] Figure 7 A schematic diagram of the structure of a multi-device collaboration apparatus provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0043] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only embodiments of a part of the present application, not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present application. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0044] As analyzed above, a typical scenario of using a learning machine for learning is: when doing exercises, students check questions through a standing tablet learning machine in front of them, and use a draft paper or handwriting ink screen or another tablet (the above three types of devices are collectively referred to as draft devices below) to do draft calculations. In the current scenario, after students use the draft device to calculate the results, they need to manually copy them to the learning machine, which not only affects the efficiency of answering questions, but is also prone to errors.

[0045] It can be seen that when using a tablet as a learning device to view questions, it is usually placed on the desktop in a vertical form. This form is not convenient for long-form writing, so draft paper / device is usually used for long-form written calculations. When the calculation answers are manually copied from the draft paper / device to the learning tablet as formal answers, the efficiency of students' answering will be reduced; at the same time, manually copying answers cannot guarantee correctness. There may be a situation where the calculation on the draft paper / device is correct, but the answer is copied incorrectly on the answering device. Therefore, the embodiment of the present application provides a multi-device collaborative method, through the collaborative work between the answering device and the draft device, the answering device obtains the calculation results of the draft device, and automatically synchronizes the calculation results to the appropriate position of the formula, thereby improving the efficiency and accuracy of learning using a learning machine.

[0046] The embodiments of the present application can be applied in the application scenario of multi-device collaboration, see Figure 1 . Figure 1 An application scenario of the multi-device collaboration method provided in an embodiment of the present application, in which there are multiple devices, for example, answering devices and drafting devices. It is understandable that answering devices include but are not limited to electronic devices such as learning machines, tablet computers, smart screens, large-screen devices, televisions, notebooks, etc., and drafting devices include but are not limited to draft paper, handwriting ink screens, tablet devices, etc. Among them, the answering device is generally a device, which is generally placed upright on the table (for example, directly in front of the user); the drafting device may be one or more, generally placed flat on the table for easy writing. In this application scenario, the answering device and the drafting device may be in the same network, and the same network may be a wireless network or a wired network. Taking wireless network (Wireless Fidelity, Wi-Fi) as an example, the answering device and the drafting device are both connected to the same Wi-Fi indoors, and the answering device and the drafting device in the same Wi-Fi can communicate based on the Wi-Fi.

[0047] An embodiment of the present application provides a multi-device collaboration method. The electronic device that executes the multi-device collaboration method may be a question-answering device, such as the learning machine, tablet computer, smart screen, large-screen device, television, notebook and other electronic devices mentioned above.

[0048] Figure 2The electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295. The sensor module 280 may include a pressure sensor 280A, a gyroscope sensor 280B, an air pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, etc.

[0049] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0050] As an example, when the electronic device 200 is a learning machine, it may include all the components shown in the figure, or may include only some of the components shown in the figure.

[0051] See also Figure 3 , is a multi-device collaboration method provided in an embodiment of the present application, and the multi-device collaboration method is applied to a question answering device to control the question answering device to synchronize the answers of the draft device to the local device. The method includes the following steps S301-S303.

[0052] S301: Identify the identifier and / or placeholder of the target equation on the answering device.

[0053] The answering device can be used to answer questions or perform calculations in various subjects, such as mathematics, physics, chemistry, Chinese, English, etc., especially when more complex calculations or reasoning are required, which often require a calculation process. For convenience, the following uses mathematical calculations on the answering device as an example to illustrate the embodiments of the present application, but it can be understood that this example does not constitute a limitation on the embodiments of the present application.

[0054] In order to automatically obtain the calculation results on the draft device on the answering device, it is necessary to determine the timing of triggering the acquisition of the calculation results. The inventor of the present application found that the formula generally ends with an identifier or a placeholder. By identifying various types of identifiers or placeholders, and subsequently supplementing or replacing the identifiers or placeholders according to the calculation results of the draft device, the corresponding calculation results can be synchronized to the answering device.

[0055] For example, the target formula is:

[0056] 12+34=

[0057] The "=" is an identifier.

[0058] For example, the target formula is:

[0059] 12+34=?

[0060] The "?" is a placeholder.

[0061] For example, the target formula is:

[0062] 12+34=()

[0063] The “(” (the first half of “()”) is an identifier.

[0064] In actual operation, the target formula can be written by the user on the answering device or input by the keyboard, or it can be the target formula displayed by the answering device calling the teaching service; wherein, the identifier and / or placeholder of the target formula is identified by performing optical character recognition (OCR) on the target formula.

[0065] S302: After identifying the identifier and / or placeholder of the target equation, the answering device obtains the calculation result for the target equation written on the draft device.

[0066] When the identifier and / or placeholder of the target formula is identified, the time to obtain the calculation result on the draft device is met. In specific operations, there are multiple ways to obtain the calculation result of the draft device: the answering device recognizes the writing content of the draft device through OCR, or the answering device establishes a communication connection with the draft device to obtain the writing content of the draft device (which further includes two methods: the draft device actively reports and the answering device inquires the draft device).

[0067] Among them, there may be multiple calculation processes and results of formulas on the draft device. In order to ensure that the obtained calculation result corresponds to the current target formula, it is necessary to ensure that the obtained calculation result is for the target formula (regardless of whether the result is correct or not, it is the calculation result for the current target formula). Therefore, in the embodiment of the present application, in order to achieve the acquisition of the calculation result for the target formula written on the draft device, the target formula and the calculation result can be pattern matched, so as to match the answer to the corresponding question, further improving the learning efficiency and accuracy of the learning machine learning scenario.

[0068] In a specific implementation, the target formula can be subjected to OCR to identify the formula mode of the target formula; based on the formula mode, it is determined whether the calculation result matches the target formula. The formula mode can be one or more combinations of equation calculation mode, vertical calculation mode, addition calculation mode, subtraction calculation mode, multiplication calculation mode, division calculation mode, square root calculation mode, power operation mode, derivative calculation mode, etc.

[0069] For example, for the two equations:

[0070] Formula 1: 12+34=

[0071] Formula 2: 56×78=

[0072] The answering device uses OCR to recognize the equations and answers written by the user on the draft paper / device. For example, the following is written on the draft device:

[0073]

[0074] Then, the answer "46" will be automatically synchronized to the answering device, as follows:

[0075] Formula 1: 12 + 34 = 46

[0076] Formula 2: 56×78=

[0077] That is, through pattern matching, the vertical addition calculation result 56 is automatically added to the equation 1, and is not added to the multiplication equation 2.

[0078] It should be noted that even if the answer is wrong (for example, the wrong vertical calculation result is 56), the answer will be automatically synchronized after the calculation is completed. And after the user modifies the answer, it will also be automatically synchronized.

[0079] In particular, if the draft device includes multiple contents with the same formula pattern, such as the vertical calculation process and result of formula 1 "12+34", and the vertical calculation process and result of formula 3 "24+45", since the formula patterns of these two formulas are the same (both are addition vertical formula patterns), they can be further distinguished by formula ID or formula content recognition. For example, the formula IDs corresponding to the above formulas 1 and 3 are: ID_1001 and ID_1003 respectively. The draft device can first check the formula ID and then perform pattern matching (corresponding to the following Figure 6 Related embodiments), so as to ensure that the feedback is the calculation result of the current formula. For another example, the answering device can also identify the calculation process and content through OCR, so as to obtain the corresponding result. For example, for the above formula 1 and formula 3, through OCR recognition, the vertical calculation process and result of the current formula "12+34" are identified, so as to locate the calculation result of the current formula.

[0080] S303: Add the calculation result to the end of the identifier or replace the placeholder.

[0081] As in the previous example, when the user calculates 12+34=46 on the draft paper / device, 46 will be automatically synchronized to the end of "12+34=" on the answering device, or 46 will be used to replace the "?".

[0082] In addition, when the answering device recognizes that the user has modified the answer on the draft device or erased the answer, it can trigger the synchronization of the new answer to the corresponding position. At this time, an erasing animation (correction animation) can be added to improve the user experience. Therefore, in one implementation, the above method also includes: the answering device updates and obtains the content of the draft device; when it is recognized that the user has modified the calculation result on the draft device or erased the answer, the updated calculation result is synchronized to the back of the identifier or replaces the placeholder. Among them, it can also trigger the start of the erasing animation plug-in on the answering device to keep a blank space in the identifier or the placeholder.

[0083] In summary, the multi-device collaboration method provided in the embodiment of the present application can control the answering device to synchronize the answers of the draft device to the local computer, wherein, when the identifier and / or placeholder of the target formula on the answering device is identified, the answering device is triggered to obtain the calculation result for the target formula written on the draft device, and automatically supplement or replace the calculation result to the appropriate position of the target formula. It can be seen that the present application uses the collaborative work of the answering device and the draft device, and the answering device automatically fills in the corresponding position after obtaining the calculation result of the draft device, thereby overcoming the inefficiency and error-prone problems of existing users having to manually copy answers, and improving the learning efficiency and accuracy of the learning machine learning scenario.

[0084] The following is an exemplary introduction to the embodiments of the present application with respect to different collaboration modes (different modes of obtaining calculation results) between the answering device and the draft device.

[0085] See also Figure 4 , showing a flow chart of a first embodiment of a multi-device collaboration method provided in an embodiment of the present application.

[0086] In the first method, when using paper or handwriting ink screen or tablet as a draft device, the camera of the vertical answering device automatically recognizes the text on the draft device through image recognition, text recognition and other artificial intelligence OCR (optical character recognition) technologies, and automatically transcribes the calculation results to the vertical tablet. This method requires that the tablet camera can clearly capture the text on the draft device, such as through direct shooting, mirror reflection, automatic or manual adjustment of the camera angle, etc.

[0087] Therefore, in this method, the above step S302 may further include:

[0088] S302-41: After the answering device recognizes the identifier and / or placeholder of the target equation, the answering device is triggered to perform optical character recognition on the display content of the draft device to obtain the calculation result written on the draft device; and

[0089] S302-42: The answering device performs pattern matching on the calculation result written on the draft device and the target formula, and determines that the calculation result is a calculation result for the target formula.

[0090] See also Figure 4 , the first method includes the following steps:

[0091] Step 1: The answering device uses image recognition (or direct keyboard input) to determine the placeholder or hint symbol of the target equation.

[0092] The answering device determines the content based on the user's handwritten input, and the recognized content is a specific formula and a placeholder / prompt. A placeholder is, for example, a question mark "12+34=?"; a prompt is, for example, an equal sign.

[0093] For example, the formula could be:

[0094] Formula 1: 12+34=

[0095] Formula 2: 56×78=

[0096] Step 2: The answering device recognizes the content on the draft device.

[0097] The answering device recognizes the equation and answer written by the user on the draft device through OCR.

[0098]

[0099] Step 3: The answering device synchronizes the answers to the corresponding location.

[0100] For example, the answer "46" will be automatically synchronized to the answering device, as follows:

[0101] Formula 1: 12 + 34 = 46

[0102] Formula 2: 56×78=

[0103] Note: Even if the answer is wrong, the answer will be automatically synchronized after the calculation is completed; and it will also be automatically synchronized after the user modifies the answer.

[0104] Step 4: The answering device recognizes that the user modifies the answer on the draft device or erases the answer, and synchronizes the new answer to the corresponding position. At this time, an erasing animation (correction animation) can be added.

[0105] See also Figure 5 , showing a flow chart of a second embodiment of a multi-device collaboration method provided in an embodiment of the present application.

[0106] In the second method, the communication capability (such as wireless communication or distributed communication capability) between the answering device and the draft device is used to synchronize the results. The communication method can be but not limited to WI-FI or WI-FIP2P or BR or BLE. Both devices can act as active communication parties (or passive communication parties) during communication. In this method, the answering device transmits the question that the user is about to calculate to the draft device in the form of bytes. After the draft device recognizes that the user has completed the calculation, it transmits the answer to the tablet.

[0107] Therefore, in this method, the above step S302 may further include:

[0108] S302-51: The draft device determines that the user has completed the calculation based on the user's calculation steps based on optical character recognition, and reports the calculation result written on the draft device to the answering device based on the communication connection mode established between the draft device and the answering device;

[0109] S302-52: The answering device performs pattern matching on the calculation result written on the draft device and the target formula, and determines that the calculation result is a calculation result for the target formula.

[0110] See also Figure 5 , the second method comprises the following steps:

[0111] Step 1: The answering device uses image recognition (or direct keyboard input) to determine the placeholder or hint symbol of the target equation.

[0112] The answering device determines the content based on the user's handwritten input, and the recognized content is a specific formula and a placeholder / prompt. A placeholder is, for example, a question mark "12+34=?"; a prompt is, for example, an equal sign.

[0113] For example, the formula could be:

[0114] Formula 1: 12+34=

[0115] Formula 2: 56×78=

[0116] Step 2: Draft device image recognition calculation results.

[0117] The draft device determines whether the user has completed the calculation based on the user's calculation steps, such as the completion of the vertical calculation.

[0118] Step 3: The draft device actively reports the calculation results to the answering device via wireless communication.

[0119] The draft device establishes a wireless communication connection with the answering device. After completing step 2, the formula and result are reported to the answering device. The wireless communication media and protocol are not limited. The media can be but not limited to WI-FI, WI-FIP2P, BR, BLE, and the protocol can be but not limited to TCP and UDP.

[0120] Step 4: The answer device displays the answer.

[0121] The answering device receives the draft device message, performs pattern matching on the current page according to the formula, and determines whether there is a corresponding formula. If not, it is discarded; if so, the answer is displayed.

[0122] Step 5: If the draft device recognizes that the user modifies or erases the answer, steps 3 and 4 are repeated.

[0123] See also Figure 6 , showing a flow chart of a third embodiment of a multi-device collaboration method provided in an embodiment of the present application.

[0124] In the third method, the communication capability (such as wireless communication or distributed communication capability) between the answering device and the draft device is used to synchronize the results. The communication method can be but not limited to WI-FI or WI-FIP2P or BR or BLE. Both devices can act as active communication parties (or passive communication parties) during communication. In this method, after the draft device determines that the user has finished writing, it actively transmits the question and answer to the answering device, and the answering device recognizes and adds the answer to the correct position.

[0125] Therefore, in this method, the above step S302 may further include:

[0126] S302-61: Based on the communication connection mode established between the answering device and the draft device, the answering device inquires whether the draft device has completed the calculation for the target formula;

[0127] S302-62: The draft device performs pattern matching on the calculation result written on the draft device and the target formula. After the pattern matching is successful, the calculation result for the target formula is sent to the answering device.

[0128] See also Figure 6 , the third method includes the following steps:

[0129] Step 1: The answering device uses image recognition (or direct keyboard input) to determine the placeholder or hint symbol of the target equation.

[0130] The answering device determines the content based on the user's handwritten input, and the recognized content is a specific formula and a placeholder / prompt. A placeholder is, for example, a question mark "12+34=?"; a prompt is, for example, an equal sign.

[0131] For example, the formula could be:

[0132] Formula 1: 12+34=

[0133] Formula 2: 56×78=

[0134] Step 2: The answering device asks the draft device whether it has any calculation results.

[0135] The answering device, as the active party, sends the user's formula and formula ID to the draft device and inquires about the result.

[0136] Step 3: Draft device image recognition calculation results.

[0137] The draft device determines whether the user has completed the calculation based on the user's calculation steps, such as the completion of the vertical calculation.

[0138] Step 4: The draft device replies to the answer device.

[0139] The draft device performs pattern matching to determine whether there is a formula on the answering device that matches the formula on the draft device. If not, no operation is performed. If so, the draft device transmits the formula ID and the formula result to the answering device via wireless communication.

[0140] Step 5: The answering device displays the result.

[0141] The answering device displays the answer at the correct position according to the equation ID.

[0142] Step 6: The draft device recognizes that the user has modified or erased the answer and performs pattern matching. If there is a match, steps 4 and 5 are repeated.

[0143] In addition, the embodiment of the present application also provides a multi-device collaboration device, which is applied to the answering device to control the answering device to synchronize the answers of the draft device to the local device. Figure 7 , the device comprises:

[0144] The equation symbol recognition unit 701 is used to recognize the identifier and / or placeholder of the target equation on the answering device.

[0145] A calculation result acquisition unit 702, configured to, after identifying the identifier and / or placeholder of the target equation, enable the answering device to acquire the calculation result for the target equation written on the draft device;

[0146] The result synchronization unit 703 is used to add the calculation result to the end of the identifier or replace the placeholder.

[0147] In one implementation,

[0148] The equation symbol recognition unit 701 is specifically used to perform optical character recognition on the target equation based on writing or keyboard input of the target equation on the answering device or calling the target equation of the teaching service, and identify the identifier and / or placeholder of the target equation.

[0149] In one implementation,

[0150] The calculation result acquisition unit 702 is specifically used to, after identifying the identifier and / or placeholder of the target formula, trigger the answering device to perform optical character recognition on the display content of the draft device to obtain the calculation result written on the draft device; and, perform pattern matching on the calculation result written on the draft device and the target formula to determine that the calculation result is a calculation result for the target formula.

[0151] In one implementation,

[0152] The calculation result acquisition unit 702 is specifically used to receive the calculation result reported to the answering device by the draft device based on the communication connection established between the draft device and the answering device, wherein the draft device determines that the user has completed the calculation based on the user's calculation steps based on optical character recognition, and performs pattern matching on the calculation result written on the draft device and the target formula to determine that the calculation result is the calculation result for the target formula.

[0153] In one implementation,

[0154] The calculation result acquisition unit 702 is specifically used to, based on the communication connection method established between the answering device and the draft device, inquire the draft device whether the calculation for the target formula has been completed; and, perform pattern matching on the calculation result written on the draft device and the target formula. After the pattern matching is successful, the calculation result for the target formula is sent to the answering device.

[0155] In one implementation,

[0156] The calculation result acquisition unit 702 is further used to: perform optical character recognition on the target formula to identify the formula pattern of the target formula; and determine whether the calculation result matches the target formula based on the formula pattern.

[0157] In one implementation, the method further includes:

[0158] The result updating unit 704 is used to update and obtain the content of the draft device; and when it is recognized that the user has modified the calculation result on the draft device or erased the answer, synchronize the updated calculation result to the back of the identifier or replace the placeholder.

[0159] In one implementation,

[0160] The result updating unit 704 is also used to trigger the answering device to start an erasing animation plug-in to keep a blank space in the identifier or the placeholder.

[0161] An embodiment of the present application further provides a storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0162] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0163] Identify the identifier and / or placeholder of the target equation on the answering device,

[0164] After identifying the identifier and / or placeholder of the target equation, the answering device obtains the calculation result for the target equation written on the draft device;

[0165] The calculation result is added after the identifier or replaces the placeholder.

[0166] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.

[0167] An embodiment of the present application further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0168] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0169] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0170] Identify the identifier and / or placeholder of the target equation on the answering device,

[0171] After identifying the identifier and / or placeholder of the target equation, the answering device obtains the calculation result for the target equation written on the draft device;

[0172] The calculation result is added after the identifier or replaces the placeholder.

[0173] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation modes, and this embodiment will not be described in detail here.

[0174] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0175] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0176] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0177] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0178] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0179] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0180] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A multi-device collaboration method, characterized in that: The method is applied to a question answering device to control the question answering device to synchronize the answers of the draft device to the local device, and the method includes: Identify the identifier and / or placeholder of the target equation on the answering device, After identifying the identifier and / or placeholder of the target equation, the answering device obtains the calculation result for the target equation written on the draft device; The calculation result is added after the identifier or replaces the placeholder.

2. The method according to claim 1, characterized in that: The identifying the identifier and / or placeholder of the target equation on the answering device includes: Writing or inputting the target equation on the answering device, or calling the target equation of the teaching service; Optical character recognition is performed on the target equation to identify an identifier and / or a placeholder of the target equation.

3. The method according to claim 1, characterized in that: The answering device obtains the calculation result for the target formula written on the draft device, including: After the answering device recognizes the identifier and / or placeholder of the target equation, the answering device is triggered to perform optical character recognition on the display content of the draft device to obtain the calculation result written on the draft device; and The answering device performs pattern matching on the calculation result written on the draft device and the target formula, and determines that the calculation result is a calculation result for the target formula.

4. The method according to claim 1, characterized in that: The answering device obtains the calculation result for the target formula written on the draft device, including: The draft device determines that the user has completed the calculation according to the user's calculation steps based on optical character recognition, and reports the calculation result written on the draft device to the answering device based on the communication connection method established between the draft device and the answering device; The answering device performs pattern matching on the calculation result written on the draft device and the target formula, and determines that the calculation result is a calculation result for the target formula.

5. The method according to claim 1, characterized in that The answering device obtains the calculation result for the target formula written on the draft device, including: Based on the communication connection mode established between the answering device and the draft device, the answering device inquires the draft device whether the calculation for the target formula has been completed; The draft device performs pattern matching on the calculation result written on the draft device and the target formula, and after the pattern matching is successful, the calculation result for the target formula is sent to the answering device.

6. The method according to claim 3, 4 or 5, characterized in that: The pattern matching of the calculation result written on the draft device with the target formula includes: Optical character recognition is performed on the target formula to identify a formula pattern of the target formula; and based on the formula pattern, it is determined whether the calculation result matches the target formula.

7. The method according to claim 1, characterized in that Also includes: The answering device updates and obtains the content of the draft device; When it is recognized that the user modifies the calculation result on the draft device or erases the answer, the updated calculation result is synchronized behind the identifier or replaces the placeholder.

8. The method according to claim 7, characterized in that When it is recognized that the user modifies the calculation result or erases the answer on the draft device, the method further includes: The answering device is triggered to start an erasing animation plug-in to keep a blank space on the identifier or the placeholder.

9. A multi-device collaboration device, characterized in that: Applied to a question answering device to control the question answering device to synchronize the answers of the draft device to the local device, the device comprises: an equation symbol recognition unit, used to recognize an identifier and / or a placeholder of a target equation on the answering device, A calculation result acquisition unit, configured to enable the answering device to acquire a calculation result for the target formula written on the draft device after identifying the identifier and / or placeholder of the target formula; A result synchronization unit is used to add the calculation result to the end of the identifier or replace the placeholder.

10. A storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the method according to any one of claims 1 to 8 when executed.

11. A learning machine device, comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 8.

Images