A content display method, a terminal device, and a storage medium

Abstract

Embodiments of the present application disclose a content display method, a terminal device and a storage medium, which are applied to the technical field of content display and can solve the problem of increased hardware cost and convenience caused by the need for an electronic pen or special material paper. The terminal device is provided with a camera, and the method comprises the following steps: establishing at least one screen index corresponding to a to-be-filled test question according to the to-be-filled test question displayed by the terminal device, each screen index corresponding to an answer filling area of the to-be-filled test question; collecting a writing picture of a user through the camera; in the case that the writing picture includes a target writing index matching a target screen index, displaying writing content corresponding to the target writing index in the writing picture to an answer filling area corresponding to the target screen index; wherein the target screen index is any one of the at least one screen index.

Description

Technical Field

[0001] The present invention relates to the field of content display technology, and in particular to a content display method, terminal device and storage medium. Background Technology

[0002] With the development of electronic devices, users can now typically write directly on the screen, or the device can simultaneously display content written elsewhere on the screen. However, these methods still require an electronic pen or special paper, which increases hardware costs and reduces convenience. Summary of the Invention

[0003] This invention provides a content display method, a terminal device, and a storage medium to solve the problems in the prior art where the need for electronic pens or special paper materials increases hardware costs and reduces convenience.

[0004] In a first aspect, a content display method is provided, wherein a terminal device is equipped with a camera, the method includes: based on a test question to be filled displayed on the terminal device, establishing at least one screen index corresponding to the test question to be filled, wherein each screen index corresponds to an answer filling area of ​​the test question to be filled;

[0005] The camera captures the user's writing action.

[0006] If the writing screen includes a target writing index that matches the target screen index, the writing content in the writing screen corresponding to the target writing index will be displayed in the answer filling area corresponding to the target screen index.

[0007] The target screen index is any one of the at least one screen index.

[0008] As an optional implementation, in a first aspect of the present invention, when the writing screen includes a target writing index that matches the target screen index, displaying the writing content corresponding to the target writing index in the writing screen onto the answer filling area corresponding to the target screen index includes:

[0009] The writing screen is indexed and identified;

[0010] If at least one writing index is detected on the writing screen, the at least one writing index is matched with the at least one screen index;

[0011] If the target writing index is detected to match the target screen index, the writing content corresponding to the target writing index in the writing screen is displayed in the answer filling area corresponding to the target screen index.

[0012] As an optional implementation, in a first aspect of the present invention, the method further includes:

[0013] If the writing index is not detected on the writing screen, a first prompt message is output, which is used to prompt the user that the writing index has not been detected.

[0014] or,

[0015] If it is detected that the target writing index does not match any of the at least one screen index, a second prompt message is output. The second prompt message is used to inform the user that the writing index and the screen index have failed to match.

[0016] As an optional implementation, in a first aspect of the present invention, displaying the written content corresponding to the target writing index in the writing screen onto the answer filling area corresponding to the target screen index includes:

[0017] Centered on the location of the target writing index, the content recognition area is determined according to preset size adjustment parameters;

[0018] The content recognition area is identified by a character recognition algorithm to obtain the writing content corresponding to the target writing index;

[0019] The written content is displayed in the answer-filled area corresponding to the target screen index.

[0020] As an optional implementation, in a first aspect of the present invention, before determining the content recognition region centered on the position of the target written index and adjusting parameters according to a preset size, the method further includes:

[0021] Obtain multiple historical writing indices, and the content recognition region corresponding to each historical writing index;

[0022] The preset size adjustment parameter is determined based on the ratio between the size of each historical writing index and the size of the corresponding content recognition region.

[0023] As an optional implementation, in a first aspect of the present invention, the method further includes:

[0024] If no writing content corresponding to the target writing index is recognized in the content recognition area, a third prompt message is output, which is used to prompt the user that no writing content corresponding to the target writing index has been recognized.

[0025] As an optional implementation, in a first aspect of the present invention, when the writing screen includes a target writing index that matches the target screen index, displaying the writing content corresponding to the target writing index in the writing screen onto the answer filling area corresponding to the target screen index includes:

[0026] If the writing screen includes a target writing index that matches the target screen index, the writing content corresponding to the target writing index is displayed;

[0027] In response to the user's confirmation, the written content is displayed in the answer-filling area corresponding to the target screen index.

[0028] In a second aspect, a terminal device is provided, the terminal device is equipped with a camera, the terminal device includes: a processing module, used to establish at least one screen index corresponding to the test question to be filled in based on the test question to be filled in displayed by the terminal device, each screen index corresponding to an answer filling area of ​​the test question to be filled in;

[0029] The acquisition module is used to capture the user's writing image through the camera;

[0030] The display module is used to display the writing content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index when the writing screen includes a target writing index that matches the target screen index.

[0031] The target screen index is any one of the at least one screen index.

[0032] Thirdly, a terminal device is provided, the terminal device being equipped with a camera, the terminal device comprising:

[0033] Memory containing executable program code;

[0034] A processor coupled to the memory;

[0035] The processor calls the executable program code stored in the memory to execute the content display method in the first aspect of the present invention.

[0036] Fourthly, a computer-readable storage medium is provided that stores a computer program, which causes a computer to execute the content display method of the first aspect of the present invention. The computer-readable storage medium includes ROM / RAM, a magnetic disk, or an optical disk, etc.

[0037] Fifthly, a computer program product is provided that, when the computer program product is run on a computer, causes the computer to perform some or all of the steps of any of the methods of the first aspect.

[0038] In a sixth aspect, an application publishing platform is provided for publishing computer program products, wherein when the computer program products are run on a computer, the computer performs some or all of the steps of any of the methods of the first aspect.

[0039] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0040] In this embodiment of the invention, the terminal device is equipped with a camera. The terminal device can establish at least one screen index corresponding to the questions to be filled in, based on the questions displayed on the terminal device. Each screen index corresponds to an answer filling area for the question. The camera captures the user's writing screen. If the writing screen includes a target writing index that matches the target screen index, the writing content corresponding to the target writing index is displayed in the answer filling area corresponding to the target screen index. The target screen index can be any one of at least one screen index. This solution allows users to write freely on ordinary paper. The terminal device only needs to match the screen index and the writing index to display the writing content corresponding to the target writing index in the answer filling area. Throughout this process, the terminal device does not require any additional hardware and has no requirements regarding the pen or paper used by the user, reducing equipment costs and improving the portability and intelligence of the terminal device. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a flowchart illustrating a content display method provided in an embodiment of the present invention. Figure 1 ;

[0043] Figure 2This is a display illustration of a content display method provided in an embodiment of the present invention. Figure 2 ;

[0044] Figure 3(a) is a scene illustration of a content display method provided in an embodiment of the present invention. Figure 1 ;

[0045] Figure 3(b) is a scene illustration of a content display method provided in an embodiment of the present invention. Figure 2 ;

[0046] Figure 4 This is a schematic diagram of a scenario for a content display method provided in an embodiment of the present invention;

[0047] Figure 5 This is a flowchart illustrating a content display method provided in an embodiment of the present invention. Figure 2 ;

[0048] Figure 6 This is a display illustration of a content display method provided in an embodiment of the present invention. Figure 2 ;

[0049] Figure 7 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. Figure 1 ;

[0050] Figure 8 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. Figure 2 . Detailed Implementation

[0051] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0052] The terms "first" and "second," etc., used in the specification and claims of this invention are used to distinguish different objects, not to describe a specific order of objects. For example, "first prompt information" and "second prompt information," etc., are used to distinguish different prompt information, not to describe a specific order of prompt information.

[0053] The terms “comprising” and “having” and any variations thereof in this invention are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product or device.

[0054] It should be noted that in the embodiments of the present invention, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0055] In related technologies, with the development of electronic devices, users can typically write directly on the screen of an electronic device, or the electronic device can simultaneously display content written by the user in other locations on the screen. However, these methods all require an electronic pen or special paper, which increases hardware costs and reduces convenience.

[0056] To address the aforementioned problems, embodiments of the present invention provide a content display method, a terminal device, and a storage medium. The terminal device is equipped with a camera. Based on the test questions displayed on the terminal device, the terminal device establishes at least one screen index corresponding to the test questions to be filled in, with each screen index corresponding to an answer filling area for the test question. The camera captures the user's writing image. If the writing image includes a target writing index that matches the target screen index, the writing content corresponding to the target writing index is displayed in the answer filling area corresponding to the target screen index. The target screen index can be any one of at least one screen index. This solution allows users to write freely on ordinary paper. The terminal device only needs to match the screen index and the writing index to display the writing content corresponding to the target writing index in the answer filling area. Throughout the process, the terminal device does not require any additional hardware and has no requirements regarding the pen and paper used by the user, reducing equipment costs and improving the portability and intelligence of the terminal device.

[0057] The terminal devices involved in the embodiments of this invention can be mobile phones, tablet computers, laptops, PDAs, in-vehicle terminal devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc. Among them, wearable devices can be smartwatches, smart bracelets, watch phones, etc., and the embodiments of this invention are not limited thereto.

[0058] The execution subject of the content display method provided in this embodiment of the invention can be the aforementioned terminal device, or it can be a functional module and / or functional entity within the terminal device capable of implementing the content display method. The specific implementation can be determined according to actual usage requirements, and this embodiment of the invention does not impose any limitations. The following uses a terminal device as an example to executively describe the content display method provided in this embodiment of the invention.

[0059] Example 1

[0060] like Figure 1 As shown, an embodiment of the present invention provides a content display method, which may include the following steps:

[0061] 101. Based on the questions to be filled in displayed on the terminal device, establish at least one screen index corresponding to the questions to be filled in.

[0062] In this embodiment of the invention, the terminal device's display screen can show the questions that the user needs to fill in, and a screen index corresponding to the questions can be established based on the questions to be filled in.

[0063] It should be noted that the screen index can be understood as a marker, with each screen index corresponding to an answer filling area for the question to be filled in.

[0064] Optionally, based on the questions to be filled displayed on the terminal device, at least one screen index corresponding to the questions to be filled can be established. Specifically, this may include: the terminal device detecting the questions to be filled, determining at least one answer filling area corresponding to the questions to be filled, and creating a screen index for each answer filling area.

[0065] It should be noted that the answer fill area is the area where the user needs to fill in the answer to the question.

[0066] For example, such as Figure 2 As shown, the terminal device's screen displays a test question to be filled in, which includes three answer-filling areas, namely... Figure 2 The first answer fill area is 21, the second answer fill area is 23, and the third answer fill area is 25. The terminal device creates screen indexes for these three answer fill areas, namely... Figure 2 The first screen index is 22, the second screen index is 24, and the third screen index is 26. According to... Figure 2 As can be seen, the first screen index 22 corresponds to the first answer filling area 21 and displays the index identifier "①" on the display screen; the second screen index 24 corresponds to the second answer filling area 23 and displays the index identifier "②" on the display screen; the third screen index 26 corresponds to the third answer filling area 25 and displays the index identifier "③" on the display screen.

[0067] 102. Capture the user's writing screen using a camera.

[0068] In this embodiment of the invention, a camera may be provided on the terminal device, which can capture the user's writing screen through the camera.

[0069] It should be noted that users can write on paper, but the writing area must be within the field of view of the terminal device's camera, meaning the terminal device can capture the user's writing through its camera.

[0070] Optionally, in this embodiment of the invention, there are no requirements regarding the color or material of the paper the user writes on, or the color of the handwriting.

[0071] Optionally, the camera on the terminal device can be a front-facing camera, allowing the user to place paper between their body and the terminal device and write in the direction of the terminal device's display screen.

[0072] For example, as shown in Figure 3(a), a front-facing camera 32 is provided on the terminal device 31. The front-facing camera 32 can capture the first desktop area 33 on the desktop. At this time, the user can place paper on the first desktop area 33 and write on the paper. At this time, the front-facing camera 32 can capture the user's writing screen.

[0073] Optionally, the camera on the terminal device can be a rear-facing camera, allowing the user to place the terminal device between their body and the paper and write in the opposite direction of the terminal device from the display screen.

[0074] For example, as shown in Figure 3(b), a rear camera 34 is provided on the terminal device 31. The rear camera 34 can capture the second desktop area 35 on the desktop. At this time, the user can place paper on the second desktop area 35 and write on the paper. At this time, the rear camera 34 can capture the user's writing screen.

[0075] 103. Display the writing content corresponding to the target writing index in the writing screen and fill it into the answer area corresponding to the target screen index.

[0076] In this embodiment of the invention, if the writing screen includes a target writing index that matches the target screen index, the terminal device can display the writing content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index.

[0077] The target screen index can be any one of at least one screen index. That is, as long as the writing screen includes the writing index corresponding to any screen index, the terminal device can display the writing content corresponding to the writing index in the answer filling area corresponding to the screen index.

[0078] It should be noted that this writing index is an index written by the user on paper. The terminal device can capture the written content through the camera, thereby detecting the writing index written by the user.

[0079] It should be noted that the format of the writing index is the same as that of the screen index. That is, after the terminal device creates at least one screen index corresponding to the question to be filled in, it will mark the at least one screen index in the corresponding answer filling area. In this way, after the user sees the screen index displayed on the terminal device, he or she can write the writing index according to the format of the screen index when writing.

[0080] Optionally, the writing content corresponding to the target writing index in the writing screen can be displayed in the answer filling area corresponding to the target screen index. Specifically, this can include: performing index recognition on the writing screen; matching the at least one writing index with at least one screen index if at least one writing index is detected in the writing screen; and displaying the writing content corresponding to the target writing index in the writing screen in the answer filling area corresponding to the target screen index if the target writing index is detected to match the target screen index.

[0081] In this embodiment of the invention, after the terminal device collects the user's writing screen, it can use image recognition technology to detect whether there is a writing index in the writing screen. If there is at least one writing index, then the at least one writing index is matched with at least one screen index. When the target writing index is detected to match the target screen index, the writing content in the writing screen corresponding to the target writing index can be identified and displayed in the answer filling area corresponding to the target screen index.

[0082] For example, such as Figure 4 As shown, after the terminal device captures the writing screen, it detects two writing indices in the writing screen, namely the first writing index 41 and the second writing index 42. At this point, the terminal device can then combine these two writing indices... Figure 2 The three screen indices displayed on the screen are matched. After matching, it can be seen that the first writing index 41 is the same as the first screen index 22, and the second writing index 42 is the same as the second screen index 24. Then the terminal device can display the first writing content 43 corresponding to the first writing index 41 in the first answer filling area 21 corresponding to the first screen index 22, and display the second writing content 44 corresponding to the second writing index 42 in the second answer filling area 23 corresponding to the second screen index 24.

[0083] With this optional implementation, the terminal device can capture the writing image through the camera after the user finishes writing, and match the writing index included in the writing image, so that the writing content of the user can be displayed in the corresponding position on the screen. In this way, the user can complete the answering of questions on the terminal device by writing as usual, which improves the intelligence level of the terminal device.

[0084] As an alternative implementation, the terminal device can collect images at preset time intervals. When a hand holding a pen is detected in the image, the user's writing screen is captured in real time. Based on the handwriting data in the captured writing screen, the writing index and writing content are determined. If the writing index matches the target screen index, the writing content is displayed in the answer filling area corresponding to the target screen index.

[0085] In this embodiment of the invention, the terminal device can first capture an image at regular intervals. If a hand holding a pen is detected in the image at a certain moment, it means that the user has started writing. At this time, the terminal device starts to capture images in real time to determine the user's handwriting. When the user writes the writing index, the writing index can be determined and matched with the screen index on the display screen. If the match is successful, the writing content is detected and displayed in the answer filling area corresponding to the screen index.

[0086] With this optional implementation, the terminal device can capture the user's writing screen in real time. After the user writes the writing index and the writing content, the terminal device can directly display the writing content in the answer filling area corresponding to the screen index, without having to wait until the user has finished writing before performing index recognition and other operations. This not only shortens the index detection time but also improves the synchronization of content display on the terminal device, thereby enhancing the intelligence level of the terminal device.

[0087] Furthermore, if a writing index is detected as not existing on the writing screen, a first prompt message is output to inform the user that no writing index has been detected; or, if the target writing index is detected as not matching at least one screen index, a second prompt message is output to inform the user that the writing index and screen index have failed to match.

[0088] In this embodiment of the invention, when the terminal device performs index recognition, it may fail to recognize the written index. In this case, the terminal device will output a first prompt message to the user, which is used to prompt the user that the written index has not been detected.

[0089] It should be noted that the terminal device may not detect the writing index for several reasons. These reasons could be: the user did not write a writing index but directly wrote the content, thus the terminal device cannot detect the writing index; the format of the index written by the user may be different from the format of the screen index, and the terminal device does not detect an index with the same format as the screen index, therefore the terminal device considers that there is no writing index in the current writing screen; or the terminal device may be malfunctioning in detecting the index, thus the terminal device cannot detect the writing index. This embodiment of the invention does not limit these possibilities.

[0090] In this embodiment of the invention, when the terminal device performs index matching, it may not be able to match the screen index. In this case, the terminal device will output a second prompt message to the user, which is used to prompt the user that the written index and the screen index failed to match.

[0091] It should be noted that the failure to match the written index with the screen index may be because neither the written index nor the screen index corresponds to the written index, so the terminal device cannot detect the screen index corresponding to the written index; or it may be due to a fault in the index matching of the terminal device, so the index matching of the terminal device fails; the embodiments of the present invention do not limit this.

[0092] With this optional implementation, the terminal device can output different prompts to the user when the index cannot be recognized or the index cannot be matched, so as to inform the user of the situation and allow the user to check the written index and written content, thereby avoiding the recurrence of errors.

[0093] This invention provides a content display method. A terminal device equipped with a camera can establish at least one screen index corresponding to a question to be filled in, based on the question displayed on the terminal device. Each screen index corresponds to an answer filling area for the question. The camera captures the user's writing image. If the writing image includes a target writing index that matches the target screen index, the writing content corresponding to the target writing index is displayed in the answer filling area corresponding to the target screen index. The target screen index can be any one of at least one screen index. This method allows users to write freely on ordinary paper. The terminal device only needs to match the screen index and the writing index to display the writing content corresponding to the target writing index in the answer filling area. Throughout the process, the terminal device does not require any additional hardware and has no requirements regarding the pen or paper used by the user, reducing equipment costs and improving the portability and intelligence of the terminal device.

[0094] Example 2

[0095] like Figure 5As shown in the figure, an embodiment of the present invention provides a content display method, which may further include the following steps:

[0096] 501. Based on the questions to be filled in displayed on the terminal device, establish at least one screen index corresponding to the questions to be filled in.

[0097] 502. Capture the user's writing screen using a camera.

[0098] In this embodiment of the invention, for the description of steps 501 to 502, please refer to the detailed description of steps 101 to 102 in Embodiment 1. This embodiment of the invention will not repeat the description.

[0099] 503. Using the location of the target writing index as the center, adjust the parameters according to the preset size to determine the content recognition area.

[0100] In this embodiment of the invention, after the terminal device captures the user's writing screen, it needs to recognize the writing screen. In order to avoid increasing power consumption by recognizing the entire writing screen, the terminal device can first determine the content recognition area. The content recognition area is the area obtained by enlarging the target writing index with the position of the target writing index as the center and adjusting the target writing index according to the preset size adjustment parameters.

[0101] It should be noted that the terminal device can first determine the position of the writing index through the index recognition algorithm, and then determine the content recognition area by combining the preset size adjustment parameters. The preset size adjustment parameters are the size relationship between the target writing index and the content recognition area that are set in advance.

[0102] It should be noted that only one writing index can exist in each content-aware region.

[0103] Optionally, before determining the content recognition region centered on the target writing index and according to preset size adjustment parameters, the process may further include: acquiring multiple historical writing indices and the content recognition region corresponding to each historical writing index; and determining preset size adjustment parameters based on the ratio between the size of each historical writing index and the size of the corresponding content recognition region.

[0104] In this embodiment of the invention, the terminal device can first obtain multiple historical writing indices and content recognition regions corresponding to each historical writing index. The historical writing index and the corresponding content recognition region are both writing indices and content recognition regions determined by the terminal device when executing the content display method at a historical moment. Then, the terminal device can determine a preset size adjustment parameter based on the ratio between the size of each historical writing index and the size of the corresponding content recognition region. The preset size adjustment parameter can be the average value of the ratio between the size of each historical writing index and the size of the corresponding content recognition region.

[0105] With this optional implementation, the terminal device can determine the preset size adjustment parameters based on the ratio between the historical writing index and the size of the corresponding content recognition area. In this way, the terminal device can determine the current area based on the previous content recognition area, improve the accuracy of the content recognition area, avoid the situation where some written content cannot be recognized, and improve the intelligence level of the terminal device.

[0106] 504. The content recognition area is identified by a character recognition algorithm to obtain the writing content corresponding to the target writing index.

[0107] In this embodiment of the invention, the terminal device can perform character recognition on the content recognition area to obtain the writing content corresponding to the target writing index. Character recognition can be achieved through a character recognition algorithm.

[0108] Optionally, if no writing content corresponding to the target writing index is recognized in the content recognition area, a third prompt message is output to inform the user that no writing content corresponding to the target writing index has been recognized.

[0109] In this embodiment of the invention, when the terminal device performs content recognition, it may fail to recognize the written content. In this case, the terminal device will output a third prompt message to the user, which is used to prompt the user that the written content corresponding to the target writing index has not been recognized.

[0110] It should be noted that if the terminal device fails to recognize the written content, it may be because the user did not write any content, and therefore the terminal device cannot recognize the written content; it may also be because the written content is not in the content recognition area, and therefore the terminal device cannot recognize the written content in the content recognition area; or it may be because the character recognition algorithm of the terminal device is malfunctioning, and therefore the terminal device cannot recognize the written content; the embodiments of the present invention do not limit this.

[0111] With this optional implementation, the terminal device can output a prompt message to the user when it fails to recognize the written content. This allows the user to make improvements based on the specific reason why the terminal device cannot recognize the content, thereby avoiding the situation where the written content cannot be recognized again.

[0112] 505. Display the written content in the answer fill area corresponding to the target screen index.

[0113] In this embodiment of the invention, after the terminal device obtains the written content through a character recognition algorithm, it can display the written content in the answer filling area corresponding to the target screen index.

[0114] Optionally, the written content can be displayed in the answer fill area corresponding to the target screen index. Specifically, this may include: displaying the written content corresponding to the target writing index; and responding to the user's confirmation operation by displaying the written content in the answer fill area corresponding to the target screen index.

[0115] In this embodiment of the invention, after the terminal device obtains the written content through the character recognition algorithm, it can first display the recognized written content on the display screen. The user can then check the written content and confirm it. The terminal device responds to the user's confirmation operation and then displays the written content in the answer filling area corresponding to the target screen index.

[0116] It should be noted that users can confirm the written content in various ways, including by using a confirmation button on the touchscreen, by voice, or by gestures.

[0117] For example, such as Figure 6 As shown, a pop-up window 61 for answer confirmation will be displayed on the terminal device's screen. This pop-up window 61 includes an answer display area 62, a confirmation button 63, and a re-identification button 64. The user can check the answer displayed in the answer display area 62. If the answer is the same as the written content on the paper, the user can touch the confirmation button 63, and the terminal device will then display the answer in the answer filling area. If the answer is different from the written content on the paper, the user can touch the re-identification button 64, and the terminal device will then re-identify the content recognition area.

[0118] For example, the terminal device can be equipped with a microphone to collect the user's voice data. When the user confirms via voice, such as saying "Answer confirmed," the terminal device, after collecting the user's voice through the microphone, considers that the user's confirmed answer is the same as the written content on the paper, and then displays the answer in the answer filling area. When the user confirms via gesture, such as nodding, the terminal device, after collecting the user's nodding gesture through a camera, considers that the user's confirmed answer is the same as the written content on the paper, and then displays the answer in the answer filling area.

[0119] With this optional implementation, the terminal device can display the recognized writing content on the screen for user confirmation. Only after user confirmation will the terminal device display the writing content in the answer filling area. This can avoid the situation where the writing content recognized by the terminal device is different from the writing content written by the user, thereby improving the accuracy of the terminal device in recognizing the writing content.

[0120] This invention provides a content display method. A terminal device equipped with a camera can establish at least one screen index corresponding to a question to be filled in, based on the question displayed on the terminal device. Each screen index corresponds to an answer filling area for the question. The camera captures the user's writing image. If the writing image includes a target writing index that matches the target screen index, a content recognition area corresponding to the target screen index is determined, and character recognition is performed on this content recognition area to obtain the writing content corresponding to the target writing index, which is then displayed in the answer filling area corresponding to the target screen index. This method allows users to write freely on ordinary paper. The terminal device only needs to match the screen index and the writing index, perform character recognition on the area including the target writing index, and display the writing content corresponding to the target writing index in the answer filling area. Throughout this process, the terminal device does not require any additional hardware and has no requirements regarding the pen or paper used by the user, reducing equipment costs and improving the portability and intelligence of the terminal device.

[0121] Example 3

[0122] like Figure 7 As shown, an embodiment of the present invention provides a terminal device, which is equipped with a camera, and the terminal device includes:

[0123] The processing module 701 is used to establish at least one screen index corresponding to the test questions to be filled in based on the test questions to be filled in displayed on the terminal device, and each screen index corresponds to an answer filling area of ​​the test questions to be filled in.

[0124] The acquisition module 702 is used to capture the user's writing image through a camera;

[0125] The display module 703 is used to display the writing content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index when the writing screen includes a target writing index that matches the target screen index.

[0126] The target screen index is any one of at least one screen index.

[0127] Optionally, the processing module 701 is specifically used for index recognition of the writing screen;

[0128] The processing module 701 is specifically used to match at least one writing index with at least one screen index when at least one writing index is detected on the writing screen.

[0129] The display module 703 is specifically used to display the writing content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index if a match between the target writing index and the target screen index is detected.

[0130] Optionally, the processing module 701 is also used to output a first prompt message when it is detected that there is no writing index on the writing screen. The first prompt message is used to prompt the user that no writing index has been detected.

[0131] or,

[0132] The processing module 701 is further configured to output a second prompt message if it is detected that the target writing index does not match at least one screen index. The second prompt message is used to prompt the user that the writing index and the screen index have failed to match.

[0133] Optionally, the processing module 701 is specifically used to determine the content recognition area by adjusting parameters according to preset size, with the position of the target writing index as the center;

[0134] The processing module 701 is specifically used to identify the content recognition area through a character recognition algorithm to obtain the writing content corresponding to the target writing index;

[0135] Display module 703 is specifically used to display the written content in the answer-filling area corresponding to the target screen index.

[0136] Optionally, the acquisition module 702 is also used to acquire multiple historical writing indices and the content recognition area corresponding to each historical writing index;

[0137] The processing module 701 is also used to determine preset size adjustment parameters based on the ratio between the size of each historical writing index and the size of the corresponding content recognition area.

[0138] Optionally, the processing module 701 is further configured to output a third prompt message if no writing content corresponding to the target writing index is recognized in the content recognition area. The third prompt message is used to prompt the user that no writing content corresponding to the target writing index has been recognized.

[0139] Optionally, the display module 703 is specifically used to display the writing content corresponding to the target writing index when the writing screen includes a target writing index that matches the target screen index;

[0140] The display module 703 is specifically used to respond to the user's confirmation operation and display the written content in the answer fill area corresponding to the target screen index.

[0141] In this embodiment of the invention, each module can implement the content display method provided in the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0142] like Figure 8 As shown, embodiments of the present invention also provide a terminal device, which may include:

[0143] Memory 801 storing executable program code;

[0144] Processor 802 coupled to memory 801;

[0145] In this process, the processor 802 calls the executable program code stored in the memory 801 to execute the content display method executed by the terminal device in the above method embodiments.

[0146] This invention provides a computer-readable storage medium storing a computer program that causes a computer to perform some or all of the steps of the methods described in the above embodiments.

[0147] This invention also provides a computer program product, wherein when the computer program product is run on a computer, the computer performs some or all of the steps of the methods described in the above method embodiments.

[0148] This invention also provides an application publishing platform, which is used to publish computer program products. When the computer program products are run on a computer, the computer performs some or all of the steps of the methods described in the above method embodiments.

[0149] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Those skilled in the art should also recognize that the embodiments described in the specification are optional embodiments, and the actions and modules involved are not necessarily essential to the invention.

[0150] In various embodiments of the present invention, it should be understood that the sequence number of each process does not necessarily imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0151] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; they can be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0152] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0153] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several requests to cause a computer device (which can be a personal computer, server, or network device, specifically a processor in the computer device) to execute some or all of the steps of the methods described in the various embodiments of the present invention.

[0154] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

Claims

1. A content display method, characterized in that, Applied to a terminal device equipped with a camera, the method includes: Based on the questions to be filled in displayed on the terminal device, at least one screen index corresponding to the questions to be filled in is established, and each screen index corresponds to an answer filling area for the questions to be filled in; The camera captures the user's writing action. If the writing screen includes a target writing index that matches the target screen index, the writing content in the writing screen corresponding to the target writing index will be displayed in the answer filling area corresponding to the target screen index. Wherein, the target screen index is any one of the at least one screen index; When the writing screen includes a target writing index that matches the target screen index, displaying the writing content corresponding to the target writing index in the writing screen onto the answer filling area corresponding to the target screen index includes: The writing screen is indexed and identified; If at least one writing index is detected on the writing screen, the at least one writing index is matched with the at least one screen index; If the target writing index is detected to match the target screen index, the writing content corresponding to the target writing index in the writing screen is displayed in the answer filling area corresponding to the target screen index.

2. The method according to claim 1, characterized in that, The method further includes: If the writing index is not detected on the writing screen, a first prompt message is output, which is used to prompt the user that the writing index has not been detected. or, If it is detected that the target writing index does not match any of the at least one screen index, a second prompt message is output. The second prompt message is used to inform the user that the writing index and the screen index have failed to match.

3. The method according to claim 1, characterized in that, The step of displaying the written content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index includes: Centered on the location of the target writing index, the content recognition area is determined according to preset size adjustment parameters; The content recognition area is identified by a character recognition algorithm to obtain the writing content corresponding to the target writing index; The written content is displayed in the answer-filled area corresponding to the target screen index.

4. The method according to claim 3, characterized in that, Before determining the content recognition region by adjusting parameters according to a preset size, with the target writing index as the center, the method further includes: Obtain multiple historical writing indices, and the content recognition region corresponding to each historical writing index; The preset size adjustment parameter is determined based on the ratio between the size of each historical writing index and the size of the corresponding content recognition region.

5. The method according to claim 3, characterized in that, The method further includes: If no writing content corresponding to the target writing index is recognized in the content recognition area, a third prompt message is output, which is used to prompt the user that no writing content corresponding to the target writing index has been recognized.

6. The method according to any one of claims 1 to 5, characterized in that, When the writing screen includes a target writing index that matches the target screen index, displaying the writing content corresponding to the target writing index in the writing screen onto the answer filling area corresponding to the target screen index includes: If the writing screen includes a target writing index that matches the target screen index, the writing content corresponding to the target writing index is displayed; In response to the user's confirmation, the written content is displayed in the answer-filling area corresponding to the target screen index.

7. A terminal device, characterized in that, The terminal device is equipped with a camera, and the terminal device includes: The processing module is used to establish at least one screen index corresponding to the test questions to be filled in based on the test questions to be filled in displayed on the terminal device, and each screen index corresponds to an answer filling area of ​​the test questions to be filled in; The acquisition module is used to capture the user's writing image through the camera; The display module is used to display the writing content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index when the writing screen includes a target writing index that matches the target screen index. Wherein, the target screen index is any one of the at least one screen index; The processing module is specifically used to perform index recognition on the writing screen; The processing module is specifically used to match the at least one writing index with the at least one screen index when it is detected that there is at least one writing index on the writing screen; The display module is specifically used to display the writing content corresponding to the target writing index in the writing screen to the answer filling area corresponding to the target screen index if it detects that the target writing index matches the target screen index.

8. A terminal device, characterized in that, The terminal device is equipped with a camera, and the terminal device includes: Memory containing executable program code; and the processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the content display method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, include: The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the content display method as described in any one of claims 1 to 6.

Images