Display device and interaction method

Abstract

A display device and an interaction method. Handwriting strokes are used as user verification information to securely and efficiently save handwritten content while the display device in an access-controlled state. The display device comprises a display unit and a control circuit. The display unit is configured to display content. The control circuit comprises a processor and a memory, the memory is used to save a program executable by the processor, and the processor is used to read the program in the memory and perform the following steps: in an access-controlled state of the display device, starting handwriting software and displaying a handwriting interface of the handwriting software (step 100); in response to a first handwriting operation performed by a user on the handwriting interface, displaying handwriting strokes on the handwriting interface (step 101); and, determining user verification information on the basis of the handwriting strokes and saving target content on the basis of the user verification information, wherein the target content is determined on the basis of at least part of the handwriting strokes on the handwriting interface (step 102).

Description

Display device and interaction method TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of display devices, and in particular to a display device and an interaction method. BACKGROUND

[0002] With the popularization of display devices and the rapid development of information technology, the use scenarios and needs of display devices by users are increasingly diversified. In many application scenarios, such as security authentication, signature confirmation, creative drawing, and the like, handwriting input, as a natural and intuitive interaction method, still has an irreplaceable role. However, the traditional handwriting input method has certain limitations in the access control state of the display device, and in particular, under the premise of ensuring information security, how to efficiently and conveniently save and verify the handwriting content has become a problem to be solved. At present, although there are some handwriting software on the market that can provide a handwriting interface for users to perform writing operations and display handwriting traces on the interface, they often lack an effective user verification mechanism. This leads to the fact that the security of the user's handwriting content cannot be fully guaranteed in the access control state. In addition, the process of saving handwriting content in the prior art is often independent of the user verification process, which not only increases the complexity of the operation, but also reduces the user experience.

[0003] SUMMARY

[0004] The present disclosure provides a display device and an interaction method, which use handwriting traces as user verification information to achieve safe and efficient saving of handwriting content in the access control state of the display device.

[0005] In a first aspect, an embodiment of the present disclosure provides a display device, wherein the display device comprises a display unit and a control circuit, wherein: the display unit is configured to display content; the control circuit comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps:

[0006] starting handwriting software and displaying a handwriting interface of the handwriting software in an access control state of the display device;

[0007] displaying handwriting traces in the handwriting interface in response to a first handwriting operation of a user on the handwriting interface;

[0008] determining user verification information according to the handwriting traces, and saving target content based on the user verification information, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0009] Optionally, the processor is specifically configured to perform:

[0010] The target content is saved when the comparison result is consistent.

[0011] Optionally, the handwriting includes a first handwriting; and the processor is specifically configured to perform:

[0012] The user authentication information is determined according to the first handwriting.

[0013] Optionally, the processor is specifically configured to perform:

[0014] The target content is determined according to at least part of the handwriting other than the first handwriting.

[0015] Optionally, the processor is specifically configured to perform:

[0016] The first handwriting is subjected to character and / or figure recognition, and the user authentication information is determined according to the recognition result of the first handwriting.

[0017] Optionally, the processor is specifically configured to perform:

[0018] The style of the handwriting is subjected to recognition, and the user authentication information is determined according to the style recognition result.

[0019] Optionally, the handwriting area of the handwriting interface includes an authentication area; and the processor is specifically further configured to perform:

[0020] The handwriting included in the authentication area is determined as the first handwriting.

[0021] Optionally, the processor is specifically configured to perform:

[0022] A preset area of the handwriting area of the handwriting interface is determined as the authentication area; or, in response to user inputted sign handwriting information, the authentication area is determined according to the position of the sign handwriting information.

[0023] Optionally, the processor is specifically further configured to perform:

[0024] The first handwriting is determined according to the receiving time of the handwriting.

[0025] Optionally, the processor is specifically configured to perform:

[0026] The handwriting corresponding to a specified arrangement order is determined as the first handwriting according to the arrangement order of the receiving time of the handwriting.

[0027] Optionally, the handwriting is divided into a plurality of groups of sub-handwriting; and the processor is specifically configured to perform:

[0028] The plurality of groups of sub-handwriting traces are processed iteratively, and a plurality of groups of verification results obtained by the iterative processing are verified, and in the case of passing the verification, the iteration is stopped and the target content is saved, and the user verification information includes the plurality of groups of verification results.

[0029] Optionally, the processor is specifically configured to execute:

[0030] When verifying the plurality of groups of verification results, each group of verification results is compared with pre-stored check information, and when it is detected that any group of verification results is consistent with the pre-stored check information, the iteration is stopped and the target content is saved.

[0031] Optionally, the processor is specifically further configured to execute:

[0032] The target content is classified and saved.

[0033] Optionally, the user verification information includes label information; and the processor is specifically configured to execute:

[0034] According to the label information, the target content is classified and saved.

[0035] Optionally, the processor is specifically configured to execute:

[0036] In an access control state of a display device, in response to a first operation of a user, handwriting software is started and a handwriting interface of the handwriting software is displayed;

[0037] The first operation represents an operation of a user on a handwriting pen bound to the display device, or a gesture operation of the user on the display device.

[0038] Optionally, the processor is specifically further configured to execute:

[0039] Text recognition is performed on at least part of handwriting traces of the handwriting interface to determine the target content.

[0040] Optionally, the processor is specifically further configured to execute:

[0041] Based on the user verification information, the access control state is released, and the target content is saved.

[0042] Optionally, the processor is specifically further configured to execute:

[0043] The access control state of the display device is access control to a screen of the display device or access control to the handwriting software in the display device.

[0044] Optionally, the embodiment provides a display device, wherein the display device comprises a display unit and a control circuit, wherein: the display unit is configured to display content; the control circuit comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps:

[0045] In the access control state of the display device, start the handwriting software and display the handwriting interface of the handwriting software;

[0046] In response to a first handwriting operation of a user on the handwriting interface, display handwriting traces on the handwriting interface;

[0047] Collect user verification information, and save target content when the user verification information passes, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0048] Optionally, the user verification information comprises face information; and the processor is specifically configured to perform:

[0049] When the handwriting operation is detected, collect face information through a camera of the display device;

[0050] Verify the face information by using pre-stored verification information, and save the target content when the verification passes.

[0051] Optionally, the user verification information comprises fingerprint information; and the processor is specifically configured to perform:

[0052] When the handwriting operation is detected, collect fingerprint information through a stylus bound to the display device;

[0053] Verify the fingerprint information by using pre-stored verification information, and save the target content when the verification passes.

[0054] In a second aspect, the embodiment of the present disclosure further provides an interaction method, wherein the method comprises:

[0055] In the access control state of the display device, start the handwriting software and display the handwriting interface of the handwriting software;

[0056] In response to a first handwriting operation of a user on the handwriting interface, display handwriting traces on the handwriting interface;

[0057] Determine user verification information according to the handwriting traces, and save target content based on the user verification information, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0058] In a third aspect, the embodiments of the present disclosure further provide an interaction device, comprising:

[0059] The starting module is configured to start the handwriting software and display a handwriting interface of the handwriting software in the access control state of the display device.

[0060] The handwriting module is configured to display handwriting traces in the handwriting interface in response to a first handwriting operation of the user in the handwriting interface.

[0061] The saving module is configured to determine user verification information according to the handwriting traces and save target content based on the user verification information, wherein the target content is determined based on at least part of the handwriting traces in the handwriting interface.

[0062] In a fourth aspect, the embodiments of the present disclosure further provide a computer storage medium having a computer program stored thereon, which, when executed by a processor, is configured to implement the steps of the method in any one of the first aspect or the second aspect.

[0063] In a fifth aspect, the present disclosure provides a computer program product, which comprises computer program code, when the computer program code is executed on a computer, causes the computer to execute the method in any one of the second aspect.

[0064] The display device and the interaction method provided in the embodiments of the present disclosure have at least the following technical effects or advantages:

[0065] The method for user verification based on handwriting traces and saving target content in the access control state of the display device provided in the embodiments of the present disclosure starts the handwriting software and displays a handwriting interface of the handwriting software in the access control state of the display device, displays handwriting traces in the handwriting interface in response to a first handwriting operation of the user in the handwriting interface, determines user verification information according to the handwriting traces, and saves target content based on the user verification information, wherein the target content is determined based on at least part of the handwriting traces in the handwriting interface. Thus, the user is allowed to use personalized handwriting traces as verification information, which makes the saving of the handwriting trace content more secure and difficult to copy, thereby effectively improving the security of accessing the display device. The use of the handwriting interface makes the user verification process more intuitive and convenient, and the user can directly write verification information on the handwriting software interface, which makes the operation more intuitive and enhances the user experience. The present disclosure is not limited to a specific handwriting trace or pattern, and the user can select different types for verification according to his own habits, which improves the diversity and complexity of the verification information. By saving the target content based on the user verification information of the handwriting traces, the present disclosure provides an additional protection layer for data, which ensures that only the verified user can access or modify these data.

[0066] The present disclosure combines the handwriting and the user verification information, ensures the security and reliability of the handwriting content, simplifies the operation process, and improves the user experience.

[0067] These aspects or other aspects of the present disclosure will be made clearer in the following description of embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0068] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can also be obtained by those skilled in the art without creative labor under the premise of the drawings.

[0069] FIG. 1 is a structural schematic diagram of a display device provided by an embodiment of the present disclosure;

[0070] FIG. 2 is a schematic diagram of a first handwriting provided by an embodiment of the present disclosure;

[0071] FIG. 3 is a schematic diagram of handwriting styles of different handwriting provided by an embodiment of the present disclosure;

[0072] FIG. 4 is a schematic diagram of determining a verification region based on a preset region provided by an embodiment of the present disclosure;

[0073] FIG. 5 is a schematic diagram of determining a verification region based on sign handwriting information provided by an embodiment of the present disclosure;

[0074] FIG. 6 is a schematic diagram of handwriting traversal processing provided by an embodiment of the present disclosure;

[0075] FIG. 7 is a schematic diagram of classification and storage based on label information provided by an embodiment of the present disclosure;

[0076] FIG. 8 is an exemplary flowchart of an interaction method provided by an embodiment of the present disclosure;

[0077] FIG. 9 is an exemplary flowchart of another interaction method provided by an embodiment of the present disclosure;

[0078] FIG. 10 is a structural schematic diagram of a display device provided by an embodiment of the present disclosure;

[0079] FIG. 11 is an exemplary flowchart of another interaction method provided by an embodiment of the present disclosure;

[0080] FIG. 12 is an exemplary flowchart of another interaction method provided by an embodiment of the present disclosure;

[0081] FIG. 13 is a structural schematic diagram of an interaction device provided by an embodiment of the present disclosure;

[0082] FIG. 14 is a structural schematic diagram of another interactive device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0083] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present disclosure.

[0084] In the embodiments of the present disclosure, the term "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone. The character " / " generally represents that the associated objects before and after it are in an "or" relationship.

[0085] The application scenarios described in the embodiments of the present disclosure are used to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. Those of ordinary skill in the art can know that, as new application scenarios appear, the technical solutions provided by the embodiments of the present disclosure are also applicable to similar technical problems. In the description of the present disclosure, unless otherwise specified, the meaning of "multiple" is two or more.

[0086] Before introducing the interactive method provided by the embodiments of the present disclosure, in order to facilitate understanding, first, the technical background of the embodiments of the present disclosure is introduced in detail.

[0087] With the rapid development of science and technology, display devices have become an important tool in people's daily life and work. Display devices make notes or meeting records instead of traditional paper and pen records have become a popular trend. When using a display device to make notes, handwriting software needs to be used. However, the existing technology requires unlocking the display device in advance, then opening the handwriting software for recording and saving. When encountering an emergency note-taking situation or wanting to make a simple note temporarily, unlocking the display device in advance may cause a delay in recording and omission of important information. Therefore, the present disclosure proposes a display device and an interaction method, which can enable a user to directly trigger a handwriting interface of handwriting software to make notes in an access control state of the display device, and can directly unlock the access control state of the display device and save target content through input verification information in the handwriting interface, thereby improving the efficiency of note-taking, simplifying the process of using handwriting software and saving, and improving the user experience. On the other hand, the existing unlocking actions of the access control state of the display device mainly include password, pattern unlocking, fingerprint recognition, and face recognition. However, these methods have certain limitations, such as password cracking, simple pattern unlocking, and high cost of biometric recognition technology.

[0088] The present disclosure inputs verification information directly on the handwriting software. The verification information can be various forms set by the user, and can also be combined with the user's handwriting. The handwriting serves as a unique personal feature, which is difficult to copy and imitate, thereby increasing the complexity and accuracy of the verification information. The saving of the target content is associated with the user verification information, which ensures that only the verified user can access or save the recorded note content, thereby improving the security of using the display device and accessing the notes. The method has high security, convenience, and practicality, and is expected to be widely used in the field of display devices.

[0089] The user verification and content saving method of the handwriting in the embodiments of the present disclosure will be described below with reference to the specific drawings.

[0090] It should be noted that the display device in the present embodiment refers to a large-size (generally more than 50 inches) intelligent interactive display device with touch handwriting function. On the display device, an electronic whiteboard or other writing program is installed, and the user can use fingers, active pens, or passive pens to write on the display device. The display device can include a liquid crystal display (LCD), an organic electroluminescence display (OLED), an electronic ink display module, and can display the writing in real time.

[0091] Referring to FIG. 1, the display device in the present embodiment is introduced.

[0092] The display device 100 in the embodiment includes a display unit 1040, a processor 1080, and a memory 1020, wherein the display unit 1040 includes a display panel 1041, which is configured to display information input by a user or information provided to the user and various operation interfaces of applications, etc., and is mainly configured to display interfaces of clients installed in the display device 100, shortcut windows, three-dimensional menu models, menu information of menu items, etc. in the embodiment of the present disclosure.

[0093] Optionally, the display panel 1041 can be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED).

[0094] The processor 1080 is configured to read a computer program and then execute a method defined by the computer program, for example, the processor 1080 reads an application, etc., so as to run the application on the display device 100 and display an interface of the application on the display unit 1040. The processor 1080 can include one or more general-purpose processors and also can include one or more digital signal processors (DSPs) configured to perform related operations to implement the technical solutions provided by the embodiments of the present disclosure.

[0095] The memory 1020 generally includes an internal memory and an external memory, the internal memory can be a random access memory (RAM), a read-only memory (ROM), and a cache (CACHE), etc., and the external memory can be a hard disk, an optical disk, a USB disk, a floppy disk, or a tape drive, etc. The memory 1020 is configured to store a computer program and other data, the computer program includes an application corresponding to a client, etc., and the other data can include data generated after an operating system or an application is run, which includes system data (for example, configuration parameters of the operating system) and user data. In the embodiment of the present disclosure, program instructions are stored in the memory 1020, and the processor 1080 executes the program instructions in the memory 1020 to implement any one of the methods for displaying a three-dimensional menu provided by the present disclosure.

[0096] In addition, the display device 100 can further include a touch unit 1100 for receiving input digital information, word information or contact touch operation or non-contact gesture, and generating signal input related to user settings and function control of the display device 100, etc. The touch unit 1100 includes but is not limited to an infrared touch unit, a capacitive touch unit, an electromagnetic touch unit, a camera acquisition unit, etc., wherein the camera acquisition unit is used to acquire the gesture of the user without contacting the display unit. When the touch unit 1100 includes an infrared touch unit or an electromagnetic touch unit, the touch unit 1100 and the display unit 1040 can be arranged in a stacked manner. For example, the user performs a touch operation on the touch screen, and the touch unit 1100 can collect the touch operation of the user thereon or therearound (such as the user using a finger, a stylus or any suitable object or accessory on the display panel 1041), and drive the corresponding connection device according to the pre-set program.

[0097] Optionally, the touch unit 1100 can include two parts of a touch detection device and a touch processor. Among them, the touch detection device detects the touch position of the user, and detects the signal brought by the touch operation, and transmits the signal to the touch processor; the touch processor receives the touch information from the touch detection device, and converts it into touch coordinates, and then sends it to the processor 1080, and can receive the command from the processor 1080 and execute it. In the embodiment of the present disclosure, if the user clicks the application, the touch detection device in the touch unit 1100 detects the touch operation, and then sends the signal corresponding to the detected touch operation to the touch processor, and the touch processor converts the signal into touch coordinates and sends it to the processor 1080, and the processor 1080 determines the operation required by the user according to the received touch coordinates.

[0098] Among them, the display panel 1041 can be implemented in various types such as LCD, OLED, etc. In addition to the display unit 1040 and the touch unit 1100, the display device 100 can further include an input unit 1030, which can include an image input device 1031 and other input devices 1032. The other input devices 1032 can include but are not limited to one or more of a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, etc.

[0099] In addition to the above, the display device 100 can further include a power supply 1090 for supplying power to other modules, an audio circuit 1060, a near field communication module 1070 and an RF circuit 1010. The display device 100 can further include one or more sensors 1050, such as an acceleration sensor, a light sensor, a pressure sensor, etc. The audio circuit 1060 specifically includes a speaker 1061 and a microphone 1062, etc. For example, the display device 100 can collect the user's voice through the microphone 1062, and perform corresponding operations, etc.

[0100] As an embodiment, the number of processors 1080 can be one or more, and the processor 1080 and the memory 1020 can be coupled or relatively independent.

[0101] As an embodiment, the processor 1080 is configured to perform the following steps:

[0102] S11, starting a handwriting software and displaying a handwriting interface of the handwriting software in an access control state of a display device;

[0103] In this step, the display device can be a smart phone, a tablet computer, or the like device with a touch screen. The access control state can be a state of locking the display device or separately locking the handwriting software. When the display device is in the access control state, the user can only call the handwriting software and cannot control other functions of the display device. In addition, in the access control state, the user cannot store the handwriting content in the handwriting software, and these operations need to be used when the display device is unlocked. If the display device wants to cancel the access control state, it needs to meet the verification conditions set by the display device. If the verification is passed, the display device can be unlocked to use its functions, and the handwriting content in the handwriting software can be stored. The display device is installed with a handwriting software application, which can be a built-in application program of the display device or downloaded from an application store / network. The handwriting interface includes elements such as a handwriting area, a toolbar, a cancel / rewrite button, and the like.

[0104] S12: displaying handwriting traces in the handwriting interface in response to a first handwriting operation of a user in the handwriting interface;

[0105] In this step, the user uses a finger or a handwriting pen to perform a first handwriting operation in the handwriting area. The handwriting software captures the handwriting trajectory of the user and displays it in real time on the handwriting interface to form handwriting traces.

[0106] S13: determining user verification information according to the handwriting traces, and saving target content based on the user verification information, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0107] In this step, the user verification information is part of the handwriting, and the handwriting "a082", "patent training", "inventor" and a curve are displayed in the handwriting area of the handwriting interface shown in FIG. 2, which can be used as user verification information for subsequent verification operation steps. If the preset verification information is "a082", the handwriting "a082" is detected, and the verification is passed, and the target content is saved by the display device. The user verification information is displayed on the handwriting interface, which is used to verify the display device in the locked state. The user verification information is determined according to the handwriting, including the following ways: 1. determining the user verification information according to the handwriting style of the handwriting; 2. determining the user verification information according to the verification area; 3. determining the user verification information according to the receiving time of the handwriting; 4. determining the user verification information by grouping and traversing the handwriting. The verification result is obtained according to the user verification information, and the operation of whether to save the target content is performed according to the verification result. Alternatively, after determining the user verification information, the target content is saved directly, and the display device does not need to be unlocked to save the target content, which simplifies the data saving process and improves the operation convenience; or, the user verification information is verified first, and the display device is unlocked and the corresponding target content is saved when the verification is passed. In addition, there is a temporary saving method, which needs to use the user verification information, but the user verification information can only be used for saving, not necessarily for verification operation, and the display device does not need to be unlocked. In the case of temporary saving, the handwriting content is saved in a temporary directory, and the content of this directory is invisible to the user (i.e. this content cannot be opened by other applications: such as the file manager APP cannot see this file), and the last written content is automatically opened or the user is prompted to open the last saved temporary content when the handwriting software is opened next time. This content can be modified and overwritten. The target content can be the entire handwriting content, such as all the handwriting in the handwriting area in FIG. 2, or part of the handwriting content, such as the handwriting content in the handwriting area except the user verification information. If the preset verification information is "a082", the handwriting "a082" is not saved, and the handwriting "patent training", "inventor" and a curve are saved, or the user manually selects part of the handwriting content, i.e. the user can select the handwriting content to be saved in the handwriting area, and only the selected handwriting content is saved. Alternatively, the target content can also be to identify at least part of the handwriting, and convert the handwriting into corresponding printed matter; it can also be the content after adjusting the handwriting, and the adjustment operation includes but is not limited to changing the font size, color, theme, etc. of the printed matter, and typesetting, labeling, highlighting, etc. of the handwriting. The target content is saved to a specified location, such as local storage, cloud server, etc.

[0108] According to the embodiments of the present disclosure, the security of the display device in the access control state is improved by verifying the user through the handwriting interface. Meanwhile, the user can directly save the target content according to the handwriting, which is convenient and fast.

[0109] In one example, saving the target content according to the user verification information includes: the pre-stored verification information is information stored in the display device in advance, or information stored in the system after being collected by the display device, or default verification information provided in the display device system or verification information set by the user in advance, and the verification information is stored in the local or a cloud server, etc. Optionally, the verification information includes at least one of text information and graphic information. When the verification step is performed, the user verification information needs to be processed, and the steps include: extracting feature data of the user verification information, wherein the feature data includes but is not limited to: text features such as vocabulary and syntax structure, and image features such as color, shape and texture, etc. The text verification information can be analyzed by using natural language processing (NLP) technology to analyze the vocabulary and syntax structure, and the graphic verification information can be analyzed by using image processing technology to analyze the color, shape and texture, etc.; the feature data is processed by using an encryption algorithm (such as a hash function) to generate comparison data; the generated comparison data is compared with the pre-stored verification information; when the comparison result is consistent, it indicates that the user verification information is verified successfully, and the display device is allowed to perform subsequent operations, such as automatically saving the target content, or the user can manually save the target content, etc. If the comparison result is inconsistent, it indicates that the user verification information is verified unsuccessfully, and the display device will refuse to perform the saving operation.

[0110] According to the embodiments of the present disclosure, by comparing the pre-stored verification information with the user verification information, it is ensured that only the user who has passed the verification can save the target content, thereby improving the security and the protection level of the data of the display device in the access control state. In addition, the method simplifies the user operation process and improves the user experience. The information and the user verification information are compared, and the target content is saved when the comparison result is consistent.

[0111] In one example, the user verification information can be determined according to the first handwriting. Here, the first handwriting is a part of the handwriting and is displayed on the handwriting interface.

[0112] In one example, the target content is determined according to at least part of the handwriting other than the first handwriting. The handwriting includes the first handwriting and other handwriting, and the step of determining the target content includes: the handwriting software capturing and recording all handwriting of the user; and the handwriting software analyzing at least part of the handwriting other than the first handwriting to determine the target content. This process can include the following steps: extracting features of the other handwriting, such as the shape of the handwriting, the stroke order, the connection between strokes, and the like; converting the extracted handwriting features into a recognizable data format, such as text, graphics, or code; and determining the target content according to the handwriting features and the conversion results.

[0113] In one example, the first handwriting is subjected to character and / or graphic recognition, and the user verification information is determined according to the recognition result of the first handwriting. Here, the first handwriting can be one or a combination of multiple forms such as text, numbers, graphics, tables, and the like. When the first handwriting is in the form of text, a character recognition algorithm is applied to the first handwriting for character recognition, which can include the following steps: using optical character recognition (OCR) technology to recognize the text in the handwriting; comparing the recognition result with preset text verification information; and if the comparison result is consistent, the user verification information is correct, and the access control state of the display device is unlocked. When the first handwriting is in the form of graphics, a graphic recognition algorithm is applied to the first handwriting for graphic recognition, where the graphics include the type of numbers, and the process can include the following steps: using graphic recognition technology to analyze the graphic features in the handwriting, such as lines, angles, shapes, and the like; comparing the recognition result with preset graphic verification information; and if the comparison result is consistent, the user verification information is correct, and the access control state of the display device is unlocked.

[0114] According to embodiments of the present disclosure, a method for determining user verification information by character and / or graphic of first handwriting on a display device is provided. This method not only improves the accuracy of user identity verification, but also increases the security of the system. The password form of the conventional display device unlocking is usually a single number password or a graphic password, and the present embodiment can allow the user to select multiple forms when setting the verification information, and the combination of text / numbers / graphics makes the verification information more complex, while greatly improving the security of device use.

[0115] In one example, the user verification information is determined according to the style recognition result of the handwriting style of the handwriting.

[0116] The user authentication information includes the handwriting style of the handwritten text. The handwriting style of the user's handwritten text is compared with the pre-stored handwriting style. When the comparison result is consistent, the target content is saved. The handwriting style of the handwritten text refers to the unique writing characteristics and styles demonstrated by an individual during the writing process. It includes personalized expressions in aspects such as the shape, strength, speed, continuity of strokes, and overall layout. Different people's writing of the same text content shows distinguishable differences. Figure 3 shows the character "hao" written by different users, and it can be seen that different handwriting styles are presented. Therefore, the handwriting style can be used as a way of user authentication information. The input handwritten text is analyzed using a handwriting style recognition algorithm. This process may include the following steps: analyzing the dynamic characteristics of the handwriting, such as writing speed, pressure, acceleration, etc.; identifying the static characteristics of the handwriting, such as the shape, size, inclination of strokes, etc.; and integrating the dynamic and static characteristics to construct a handwriting style model of the user. Optionally, when determining the user authentication information, the authentication information can be determined only by the handwriting style and the target content is saved when the authentication is passed; or the two authentication methods of handwriting style and password are combined. When both the password and the handwriting style are verified correctly, the target content is saved. Here, the password in this patent is actually the first handwriting, and the first handwriting can be in the form of text, graphics, etc., that is, the password can be in the form of text, graphics, etc.

[0117] According to an embodiment of the present disclosure, a method for determining user authentication information by recognizing the handwriting style of a user's handwritten text on a display device is provided. This method utilizes the uniqueness of the user's handwriting, which not only improves the accuracy of user authentication but also enhances the security of the system because even if the handwriting content is the same, different handwriting styles can effectively distinguish different users.

[0118] In one example, the handwritten text included in the verification area is determined as the first handwriting. The handwriting interface includes a verification area, and the verification area contains a part of the handwritten text among all the handwritten texts. This part of the handwritten text is the first handwriting, and the user authentication information is determined based on the first handwriting in the verification area.

[0119] In one example, a preset area of the handwriting area of the handwriting interface is determined as the verification area.

[0120] The handwriting area can include a verification area, a toolbar and a handwriting area other than the verification area, the verification area and the handwriting area both have handwriting function, the verification area is a part of the handwriting area and is used for the user to write password thereon, and other part of the handwriting area is used for the user to write content. A preset area is designed on the handwriting interface, which can be a frame, a line or other graphical indication on the handwriting interface, and explicitly indicates the user to perform input operation of the user verification information in the area, or can be a fixed area by default of the system, such as a left, right, top or bottom area, the verification area can be distinguished from other handwriting areas by different background colors or not. The position, size and shape of the verification area can be displayed in a default form or adjusted by the user for the convenience of user operation. The handwriting software monitors the input activity in the verification area, and ensures that only the handwriting in the area is recognized as the first handwriting. If the user performs handwriting operation in other areas outside the verification area, the handwriting software will not process the handwriting as the first handwriting. The handwriting software analyzes the first handwriting in the verification area to determine the user verification information. The user verification information in the verification area is compared with the pre-stored check information, and if the comparison result is consistent, the verification is passed and the target content is saved. FIG. 4 shows that a verification area is preset on the handwriting interface, and the handwriting "a082" in the verification area is the first handwriting (input password), and when the verification is performed, only the handwriting in the verification area is compared with the preset check information, and if the comparison is consistent, the verification is passed and the target content is saved.

[0121] According to an embodiment of the present disclosure, a method for setting a preset verification area in a handwriting interface on a display device to determine first handwriting is provided, thereby providing an explicit input space for input of user verification information, and improving user experience and system security.

[0122] In one example, in response to the user inputting the mark handwriting information, the verification area is determined according to the position of the mark handwriting information.

[0123] The user inputs one or more mark handwriting information on the handwriting interface using a finger or a stylus. The mark handwriting information can be a special symbol, a figure, a character or a number, etc. set by the user in advance, which is used to indicate the location of the verification area. Here, the input of the mark handwriting information and the input of the handwriting information other than the mark handwriting information are not limited in the order of time. The handwriting information other than the mark handwriting information can be input first, and then the mark handwriting information can be input, or the mark handwriting information can be input first, and then the handwriting information other than the mark handwriting information can be input. The handwriting software captures and records the mark handwriting information input by the user, analyzes the location of the mark handwriting information to determine the specific location of the mark handwriting information on the handwriting interface, and determines a verification area on the handwriting interface according to the location of the mark handwriting information. The verification area can be an area around the mark handwriting information, or a specific area indicated by the mark handwriting information, etc. As shown in FIG. 5, the handwriting interface displays handwriting, the user draws a curved line below the handwriting, and the curved line is the mark handwriting information set in advance. Then, the area above the curved line can be determined as the verification area, and the handwriting in the verification area is the first handwriting (the input password). When verification is performed, only the handwriting in the verification area is compared with the preset check information, and if the comparison is consistent, the verification is passed and the target content is saved.

[0124] According to an embodiment of the present disclosure, a method for determining a verification area in a handwriting interface on a display device according to mark handwriting information input by a user is provided. This method enables the user to autonomously select a verification area, and improves the flexibility of the system and the user experience.

[0125] In one example, the first handwriting is determined according to the receiving time of the handwriting. The user inputs a plurality of handwriting on the handwriting interface using a finger or a stylus, which can include mark handwriting information, characters, numbers, figures, symbols, etc. The handwriting software records the receiving time of each handwriting, i.e. the time point when the user starts to input the handwriting, and the receiving time is used to determine the order and importance of the handwriting. According to the receiving time, the handwriting software determines the first / last handwriting input by the user as the first handwriting, or the user can set the handwriting corresponding to a specified time as the first handwriting.

[0126] In one example, the handwriting corresponding to a specified arrangement order of the receiving time of the handwriting is determined as the first handwriting.

[0127] Each handwriting input corresponds to a timestamp, and the handwriting software timestamps each input handwriting with a precision of milliseconds for subsequent time sorting. After the user finishes inputting, the handwriting software sorts the handwriting according to the timestamps to form a time sequence. The order of arrangement can be pre-set by the user, who selects a specific time sequence as the order of arrangement according to needs. The order of arrangement can be the order of handwriting input or a specific arrangement combination, etc. The first handwriting is determined according to the order of arrangement of the received time: the handwriting software finds the corresponding handwriting in the time sequence according to the order of arrangement specified by the user, and determines the handwriting corresponding to the specified order of arrangement as the first handwriting. For example, if the user specifies the order of arrangement as "1-2-3", the handwriting software identifies the earliest handwriting in the time sequence as the first handwriting. The handwriting software analyzes the first handwriting to determine the user verification information. The analysis result is compared with the user's pre-set verification information, and if the comparison is consistent, the verification is passed and the target content is saved.

[0128] According to an embodiment of the present disclosure, a method for determining a first handwriting according to the order of arrangement of the received time in a handwriting interface on a display device is provided. This method allows the user to specify a specific order of arrangement, thereby improving the flexibility of the system and the user experience.

[0129] In one example, determining the verification information according to the handwriting can take an iterative approach to the handwriting, which can include the following steps: dividing the handwriting on the handwriting interface into multiple groups of sub-handwriting, which is a part of the handwriting. The handwriting can be divided into multiple groups of sub-handwriting according to the distribution of the handwriting on the handwriting interface, paragraph markers, text annotations, etc. The handwriting interface can be divided into multiple handwriting areas, which can be the result of a computer-virtual action that the human eye cannot see, or the outlines of the divided handwriting areas can be directly displayed on the handwriting interface. The handwriting can be divided into multiple groups of sub-handwriting according to different handwriting areas. The multiple groups of sub-handwriting are iteratively processed, which can include text and / or graphic recognition, handwriting style recognition, etc. After the multiple groups of sub-handwriting are iteratively processed, multiple groups of verification results are obtained, and the user verification information includes the multiple groups of verification results. The multiple groups of verification results are verified, which can include comparison with the user's pre-stored verification information, etc. If the verification is passed, the iteration is stopped and the target content is saved.

[0130] In one example, when verifying the multiple groups of to-be-verified results, each group of to-be-verified results is compared with the pre-stored verification information, and when it is detected that any group of to-be-verified results is consistent with the pre-stored verification information, the traversal is stopped and the target content is saved. If one of the multiple groups of to-be-verified results obtained through the traversal processing is consistent with the user's pre-stored verification information, the handwriting software stops the traversal processing and does not continue the traversal processing on other sub-handwritten traces that have not completed the traversal processing. The handwriting software allows the target content to be saved to the display device. The user verification information can be a group of to-be-verified results or a combination of multiple groups of to-be-verified results. For example, the user verification information can include the verification result of the first group of sub-handwritten traces, the verification result of the second group of sub-handwritten traces, and the like. When one of the multiple groups of to-be-verified results is consistent with the user's pre-stored verification information, the verification is passed and the target content is saved. Here, "consistent" means completely consistent. For example, in FIG. 6, the handwriting interface has three groups of handwritten traces, one group is "123", another group is "123456", and the third group is "date 20240829", and the user's pre-stored verification information is "123". Although "123" is included in the group of sub-handwritten traces "123456", the to-be-verified result of this group of handwritten traces is incorrect, and only when the to-be-verified result of the group of sub-handwritten traces "123" is detected, the verification is passed and the target content is saved. For another example, the handwriting interface has two groups of handwritten traces, one group of handwritten traces is "today is a good weather", and the other group of handwritten traces is "today go dancing", and the user's pre-stored verification information is "weather". When the two groups of sub-handwritten traces of the handwriting interface are traversed to determine the user verification information, the to-be-verified results of the two groups of sub-handwritten traces are both verified to be incorrect, and the display device cannot save the current target content.

[0131] According to an embodiment of the present disclosure, a method for grouping handwritten traces in a handwriting interface on a display device, traversing the obtained multiple groups of sub-handwritten traces to determine user verification information and save target content is provided. This method can stop the traversal of other groups of sub-handwritten traces when the verification result is verified to be correct during the traversal process, saving time, computing power and resource waste.

[0132] In one example, the target content is classified and saved. The input target content is identified and classified, which can be automatically divided according to the type, theme, etc. of the target content, or the user manually classifies the handwriting that the user wants to save in the handwriting interface. The type of target content can be according to text, table, drawing, etc. If the target content is text, it can be classified according to the theme of the content; if the target content contains both text and table, the text and table are saved separately. The classified target content is saved to a designated storage location. When saving, the target content can be saved in different folders or files according to the classification results. When classifying and saving, the user can pre-set the classified folders in the display device, such as a folder specifically storing text, a folder specifically storing tables, a folder of commonly used text themes, etc. Alternatively, the user can select the part of the handwriting to be saved in the handwriting interface, and then create a new folder for saving. Different saving strategies can be developed for different types of target content, and different settings can be made for different files or folders, such as regular backup, encrypted storage, etc.

[0133] In one example, the user verification information includes label information, and the target content is classified and saved according to the label information. Here, the label information is part of the handwriting, displayed on the handwriting area, and at the same time, the display device has a folder in the storage target content named with the label information. The user pre-sets the label information, which can include determining the theme, attribute, keyword, etc. of the target content. The label can be defined according to the type, theme, importance, etc. of the target content. For example, if the target content is about the theme of patent training, a label information such as "patent training" can be defined, and a folder named "patent training" can be established in the storage space of the display device. First is the label information identification stage, using OCR (Optical Character Recognition) to identify the handwriting in the handwriting area, to determine the pre-set label information contained in the handwriting, such as "patent training" in FIG. 7, and to use the label information as user verification information. The verification information is verified and the target content is saved, and the target content is saved in the pre-set folder named with the label information. Here, the target content corresponding to the label information can be the handwriting in the area near the label information, or the handwriting selected by the user, such as the target content corresponding to the label information "patent training" in FIG. 7, which is the handwriting "1, technical learning 2, inventor" below. When the label information is consistent with the pre-set label information, the verification is passed and the corresponding target content is saved.

[0134] In one example, in the access control state of the display device, in response to the first operation of the user, the handwriting software is started and the handwriting interface of the handwriting software is displayed; the first operation represents the operation of the user to the handwriting pen bound to the display device, or the gesture operation performed by the user to the display device. When the system detects that the first operation of the user meets the trigger condition of the access control state, the system will automatically respond and open the handwriting software. This can be realized by the shortcut in the device or the access control option in the system setting. For example, the user can select to automatically start the handwriting software in the access control state in the device setting. After the handwriting software is started, the system will automatically load and display the handwriting interface. The handwriting interface includes handwriting area, toolbar, undo / redo button and other elements, so that the user can conveniently perform handwriting operation. Here, the first operation that triggers the display device to open the handwriting software can be an operation related to the handwriting pen or an operation related to the gesture of the person, such as: detecting that the handwriting pen leaves the device, or triggering by single click, double click or combination of keys of the handwriting pen, or triggering by gesture, etc. The gesture trigger can be a gesture set in advance to start the handwriting interface of the display device, which can be, for example, opening fingers in front of the display screen of the display device, or sliding to the right, etc. The user takes the handwriting pen off the handwriting device, and the Hall sensor of the handwriting device senses the change of the electromagnetic field when the handwriting pen leaves the device. The sensing information of the Hall sensor is transmitted to the handwriting module through the system layer of the handwriting device, through the hardware interface of the handwriting device -> driver layer -> system -> handwriting module, and the handwriting module is called through the above link to open the handwriting application.

[0135] In one example, the handwriting strokes of at least part of the handwriting interface are subjected to character recognition to determine the target content. In the handwriting software, at least part of the handwriting strokes of the handwriting interface are subjected to character recognition processing. The handwriting strokes are converted into editable text format through optical character recognition (OCR) technology. According to the result of the character recognition processing, the handwriting software determines the target content. The target content can be the text, graphics, symbols, etc. input by the user. For example, if the user inputs text, the handwriting software will take the recognized text as the target content. In the handwriting software, the recognized target content is displayed on the handwriting interface. The user can view, edit or share the target content and save the target content, or the user can save it first and then reopen it for further editing.

[0136] In one example, the access control state is released based on user authentication information, and the target content is saved. First, the user needs to be authenticated to release the access control state. This can be achieved in various ways, such as fingerprint recognition, facial recognition, password input, etc. The user authentication information is a credential used to verify the user's identity, such as a preset password, biometric data, etc. After the user inputs the authentication information, the system will compare it. If the comparison result is consistent with the preset authentication information, the system will release the access control state and allow the user to continue operating. During the user's operation, the system can continuously monitor the access control state. If the user triggers the access control state again, the system will require the user to re-authenticate.

[0137] In one example, the access control state of the display device is the access control of the display device screen or the access control of the handwriting software in the display device. In some cases, it can be that the device is set with a password in the lock screen state; in some cases, it can be that only the handwriting software app is set with a password. The access control state of the display device is for both of these cases where the password is set.

[0138] In one example, the processor 1080 is configured to perform the following steps:

[0139] S21, starting the handwriting software and displaying the handwriting interface of the handwriting software in the access control state of the display device;

[0140] The implementation details of this step can be referred to the implementation details of step S11 in the foregoing, and the repeated parts will not be described again.

[0141] S22, in response to the first handwriting operation of the user on the handwriting interface, displaying the handwriting traces on the handwriting interface;

[0142] The implementation details of this step can be referred to the implementation details of step S12 in the foregoing, and the repeated parts will not be described again.

[0143] S23, collecting user authentication information, and saving the target content in the case that the user authentication information is passed, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0144] Here the user authentication information can be fingerprint information, facial information, or other biometric information, or external authentication information such as a password. The user's authentication information is collected during the user's handwriting operation, and the authentication information collection process can use encrypted transmission to ensure the security of the user's information. After successful collection of the authentication information, the system automatically performs authentication. After authentication is passed, the system automatically saves at least part of the handwriting of the handwriting interface; the system determines at least part of the handwriting of the handwriting interface as target content; the target content can be saved as a picture, a PDF or other formats, for easy viewing, sharing and printing by the user; the saved target content can be set to be encrypted and stored in advance to prevent unauthorized access, or the file is encrypted after being saved; the system provides a history function for the user to facilitate the user to view and manage the saved handwriting content.

[0145] In one example, the user verification information includes facial information, and when the handwriting operation is detected, the facial information is collected through the camera of the display device; the facial information is verified using the pre-stored verification information, and when the verification is passed, the target content is saved. The display device is configured with a high-resolution front camera for collecting the facial information of the user; an ambient light sensor for automatically adjusting the exposure and focus of the camera; a processor with sufficient computing power to run the facial recognition algorithm. Detecting handwriting operation: when the user performs handwriting operation on the handwriting interface, the handwriting software triggers the camera device start signal; the camera device automatically starts and prepares to collect facial information. Collecting facial information: the camera device captures the user's facial image in real time; the image processing module pre-processes the collected image, such as gray scale conversion, noise removal, size adjustment, etc.; the position and size of the face in the image are determined through the face detection algorithm. Face information verification process: feature extraction, using face feature extraction algorithm to extract key feature points from the collected facial image; the feature points include the position and shape of the key parts such as facial contour, eyes, nose, mouth, etc. Feature comparison, compare the extracted face features with the user face template pre-stored in the device security area; the face template is reliable feature data formed by multiple collection and verification when the user registers. Verification decision, the comparison result is judged by threshold whether to reach the verification standard; if the comparison score exceeds the preset threshold, it is considered that the verification is passed; if the comparison score does not reach the threshold, the user is required to re-verify or take other security measures. Target content saving process: verification response, once the face verification is passed, the system can issue a verification success prompt to the user; at the same time, the handwriting software is ready to save the handwriting content to the storage system of the device. Content saving, the system converts the handwriting strokes of the handwriting interface into a specified format (such as PNG, PDF, etc.), and stores the target content in the security area of the device or the specified cloud storage service. During the whole collection, verification and saving process, all data are transmitted and stored by encryption; the device and server side comply with strict data protection policies and standards; the user's facial information and other verification data are only used for identity verification purposes and are not used for any other purposes.

[0146] In one example, the user verification information includes fingerprint information. Upon detecting a handwriting operation, the fingerprint information is collected by a stylus bound to the display device; the fingerprint information is verified using pre-stored verification information, and when the verification is passed, the target content is saved. The fingerprint collection and identification system architecture: the stylus is configured, integrated with a high-precision fingerprint sensor, for collecting the user's fingerprint information; the sensor has a live detection function to prevent fake fingerprints; a wireless transmission module is configured to transmit the fingerprint data to the display device. The display device is configured to have the function of receiving the data transmitted by the stylus; a built-in fingerprint identification processing module is configured to process and verify the fingerprint information; a secure storage area is configured to store the user's fingerprint template and verification information. The fingerprint information collection process: detecting a handwriting operation, when the user starts to write on the handwriting interface, the handwriting software detects the handwriting operation through the sensor of the stylus; the stylus activates the fingerprint sensor to prepare to collect the fingerprint information. Collecting fingerprint information, the user places his finger on the fingerprint sensor of the stylus; the sensor collects the fingerprint image when the user presses to ensure the image quality; the collection process may include multiple attempts to ensure that a clear fingerprint image is obtained. The fingerprint information verification process: image preprocessing, the collected fingerprint image is preprocessed, including denoising, enhancement, binarization and other steps to improve the image quality; the preprocessed image is used for feature extraction. Feature extraction, fingerprint feature points such as ridge end points and bifurcation points are extracted from the preprocessed image using fingerprint recognition algorithms; the feature points form fingerprint feature data for subsequent comparison and verification. Feature comparison, the extracted fingerprint feature data is compared with the user's fingerprint template pre-stored in the device's secure area; the fingerprint template is reliable feature data formed by multiple collections and verifications during user registration. Verification decision, the comparison result is judged by a threshold value whether it meets the verification standard; if the comparison score exceeds the preset threshold value, it is considered that the verification is passed; if the comparison score does not reach the threshold value, the user is required to reposition the finger for verification. Target content saving process: verification response, once the fingerprint verification is passed, the system can prompt the user that the verification is successful; at the same time, the handwriting software is ready to save the handwriting content to the storage system of the device. The system converts the handwriting strokes of the handwriting interface into a specified format (such as PNG, PDF, etc.), and stores the target content in the secure area of the device or the designated cloud storage service. During the entire collection, verification and saving process, all data is transmitted and stored using encryption; the device and the server side comply with strict data protection policies and standards; the user's fingerprint information and other verification data are only used for identity verification purposes and are not used for any other purposes.

[0147] As an embodiment, the processor 1080 is configured to perform the steps shown in FIG. 8.

[0148] S101, determining that the display device is in an access control state;

[0149] S102, start the handwriting software and display a handwriting interface of the handwriting software;

[0150] S103, a user performs a first handwriting operation on the handwriting interface, and handwriting strokes are displayed on the handwriting interface;

[0151] S104, determine the first strokes according to a preset area of the handwriting area of the handwriting interface or a position of user-inputted mark stroke information;

[0152] S105, perform character and / or graphics recognition on the first strokes of the handwriting strokes, and determine user verification information according to a recognition result of the first strokes;

[0153] S106, determine target content according to at least part of the handwriting strokes other than the first strokes in the handwriting strokes;

[0154] S107, compare the pre-stored verification information with the user verification information, and save the target content when the comparison result is consistent.

[0155] As an embodiment, the processor 1080 is configured to perform the steps shown in FIG. 9.

[0156] S201, determine that a display device is in an access control state;

[0157] S202, start the handwriting software and display a handwriting interface of the handwriting software;

[0158] S203, a user performs a first handwriting operation on the handwriting interface, and handwriting strokes are displayed on the handwriting interface;

[0159] S204, perform handwriting style recognition on the handwriting strokes, and determine user verification information according to a style recognition result;

[0160] S205, determine target content according to at least part of the handwriting strokes;

[0161] S206, compare the pre-stored verification information with the user verification information, and save the target content when the comparison result is consistent.

[0162] Based on the same inventive concept, the embodiments of the present disclosure further provide another display device. Since the display device is the display device in the method of the embodiments of the present disclosure, and the display device has a similar problem-solving principle as the method, the implementation of the display device can be referred to the implementation of the method, and the repeated parts will not be described here.

[0163] As shown in FIG. 10, the display device includes a display unit 100 and a control circuit 101, wherein:

[0164] The display unit is configured to display content.

[0165] The control circuit includes a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps:

[0166] In the access control state of the display device, start the handwriting software and display the handwriting interface of the handwriting software;

[0167] In response to a first handwriting operation of the user on the handwriting interface, display handwriting traces on the handwriting interface;

[0168] Collect user verification information, and save the target content when the user verification information passes, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0169] As an optional implementation, the user verification information includes face information; the processor is specifically configured to perform:

[0170] When the handwriting operation is detected, collect face information through the camera of the display device;

[0171] Verify the face information by using pre-stored verification information, and save the target content when the verification passes.

[0172] As an optional implementation, the user verification information includes fingerprint information; the processor is specifically configured to perform:

[0173] When the handwriting operation is detected, collect fingerprint information through the handwriting pen bound to the display device;

[0174] Verify the fingerprint information by using pre-stored verification information, and save the target content when the verification passes.

[0175] As an optional implementation, the processor is specifically configured to perform:

[0176] Release the access control state based on the user verification information, and save the target content.

[0177] As an optional implementation, the processor is specifically configured to perform:

[0178] The access control state of the display device is access control to the screen of the display device or access control to the handwriting software in the display device.

[0179] Based on the same inventive concept, the embodiment of the disclosure also provides an interaction method, as shown in FIG. 11, and the specific implementation process of the method is as follows:

[0180] Step 100, starting handwriting software and displaying a handwriting interface of the handwriting software in an access control state of a display device;

[0181] Step 101, in response to a first handwriting operation of a user on the handwriting interface, displaying handwriting traces on the handwriting interface;

[0182] Step 102, determining user authentication information according to the handwriting traces, and saving target content based on the user authentication information, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0183] As an optional implementation, the saving of the target content based on the user authentication information comprises:

[0184] Comparing the pre-stored verification information with the user authentication information, and saving the target content when the comparison result is consistent.

[0185] As an optional implementation, the handwriting traces comprise first handwriting traces; and the determining of the user authentication information according to the handwriting traces comprises:

[0186] Determining the user authentication information according to the first handwriting traces.

[0187] As an optional implementation, the target content is determined according to at least part of the handwriting traces other than the first handwriting traces.

[0188] As an optional implementation, the determining of the user authentication information according to the first handwriting traces comprises:

[0189] Text and / or figure recognition of the first handwriting traces, and determining the user authentication information according to the recognition result of the first handwriting traces.

[0190] As an optional implementation, the determining of the user authentication information according to the handwriting traces comprises:

[0191] Style recognition of the handwriting traces, and determining the user authentication information according to the style recognition result.

[0192] As an optional implementation, a handwriting area of the handwriting interface comprises an authentication area; and the interaction method further comprises:

[0193] Determining the handwriting traces contained in the authentication area as the first handwriting traces.

[0194] As an optional implementation, the verification area is determined by the following manner:

[0195] A preset area of the handwriting area of the handwriting interface is determined as the verification area; or,

[0196] In response to the user inputted sign handwriting information, the verification area is determined according to the position of the sign handwriting information.

[0197] As an optional implementation, the interaction method further comprises:

[0198] The first handwriting is determined according to the receiving time of the handwriting.

[0199] As an optional implementation, the first handwriting is determined according to the receiving time of the handwriting, comprising:

[0200] The handwriting corresponding to a specified arrangement order of the receiving time of the handwriting is determined as the first handwriting according to the arrangement order.

[0201] As an optional implementation, the handwriting is divided into a plurality of groups of sub-handwritings.

[0202] The user verification information is determined according to the handwriting, and the target content is saved based on the user verification information, comprising:

[0203] The plurality of groups of sub-handwritings are processed by iteration, and the plurality of groups of to-be-verified results obtained by processing the iteration results are verified, and in the case of passing the verification, the iteration is stopped and the target content is saved, and the user verification information comprises the plurality of groups of to-be-verified results.

[0204] As an optional implementation, the interaction method comprises:

[0205] When the plurality of groups of to-be-verified results are verified, each group of to-be-verified results is compared with the pre-stored check information, and when it is detected that any one group of to-be-verified results is consistent with the pre-stored check information, the iteration is stopped and the target content is saved.

[0206] As an optional implementation, the target content is saved, further comprising:

[0207] The target content is saved by classification.

[0208] As an optional implementation, the user verification information comprises label information, and the target content is saved by classification, comprising:

[0209] The target content is saved by classification according to the label information.

[0210] As an optional implementation, the starting the handwriting software and displaying the handwriting interface of the handwriting software in the access control state of the display device comprises:

[0211] In the access control state of the display device, the handwriting software is started and the handwriting interface of the handwriting software is displayed in response to a first operation of a user.

[0212] The first operation represents an operation of a stylus bound to the display device by the user, or a gesture operation performed by the user on the display device.

[0213] As an optional implementation, the interaction method further comprises:

[0214] Text recognition is performed on at least part of the handwriting in the handwriting interface to determine the target content.

[0215] As an optional implementation, the method further comprises:

[0216] The access control state is released based on the user verification information, and the target content is saved.

[0217] As an optional implementation, the method further comprises:

[0218] The access control state of the display device is access control to a screen of the display device or access control to the handwriting software in the display device.

[0219] Based on the same inventive concept, the embodiments of the present disclosure also provide another interaction method, as shown in FIG. 12, and the specific implementation process of the method is as follows:

[0220] Step 200, starting the handwriting software and displaying the handwriting interface of the handwriting software in the access control state of the display device.

[0221] Step 201, displaying handwriting in the handwriting interface in response to a first handwriting operation of a user in the handwriting interface.

[0222] Step 202, collecting user verification information, and saving target content in the case that the user verification information is passed, wherein the target content is determined based on at least part of the handwriting in the handwriting interface.

[0223] As an optional implementation, the user verification information comprises face information; and the method further comprises:

[0224] Face information is collected by a camera of the display device when the handwriting operation is detected.

[0225] Verify the face information by using the pre-stored verification information, and save the target content when the verification is passed.

[0226] As an optional implementation, the user verification information includes fingerprint information; and the method further includes:

[0227] When the handwriting operation is detected, collect the fingerprint information by a handwriting pen bound with the display device;

[0228] Verify the fingerprint information by using the pre-stored verification information, and save the target content when the verification is passed.

[0229] As an optional implementation, the method further includes:

[0230] Release the access control state based on the user verification information, and save the target content.

[0231] As an optional implementation, the method further includes:

[0232] The access control state of the display device is access control to a screen of the display device or access control to the handwriting software in the display device.

[0233] Based on the same inventive concept, the embodiments of the present disclosure further provide an interactive device. Since the device is the device in the method in the embodiments of the present disclosure, and the principle of solving problems of the device is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0234] As shown in FIG. 13, the device includes:

[0235] The starting module 1000 is configured to start the handwriting software and display a handwriting interface of the handwriting software in an access control state of a display device.

[0236] The handwriting module 1001 is configured to display handwriting traces in the handwriting interface in response to a first handwriting operation of a user in the handwriting interface.

[0237] The saving module 1002 is configured to determine user verification information according to the handwriting traces, and save a target content based on the user verification information, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

[0238] Based on the same inventive concept, the embodiments of the present disclosure further provide another interactive device. Since the device is the device in the method in the embodiments of the present disclosure, and the principle of solving problems of the device is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0239] As shown in FIG. 14, the apparatus includes:

[0240] The starting module 2000 is configured to start the handwriting software and display a handwriting interface of the handwriting software in an access control state of the display device.

[0241] The handwriting module 2001 is configured to display handwriting traces on the handwriting interface in response to a first handwriting operation of a user on the handwriting interface.

[0242] The saving module 2002 is configured to collect user verification information, and save target content in a case where the user verification information is passed, wherein the target content is determined based on at least part of the handwriting traces on the handwriting interface.

[0243] Based on the same inventive concept, the embodiments of the present disclosure provide a computer storage medium, which includes computer program codes, and when the computer program codes are run on a computer, the computer is caused to perform the interaction method according to any one of the foregoing. Since the principle of the computer storage medium for solving the problem is similar to the interaction method, the implementation of the computer storage medium can be referred to the implementation of the method, and the repeated parts will not be described here.

[0244] In the specific implementation process, the computer storage medium can include a universal serial bus flash drive (USB, Universal Serial Bus Flash Drive), a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various storage media that can store program codes.

[0245] Based on the same inventive concept, the embodiments of the present disclosure further provide a computer program product, which includes computer program codes, and when the computer program codes are run on a computer, the computer is caused to perform the interaction method according to any one of the foregoing. Since the principle of the computer program product for solving the problem is similar to the interaction method, the implementation of the computer program product can be referred to the implementation of the method, and the repeated parts will not be described here.

[0246] The computer program product can employ any combination of one or more computer-readable media or storage media. The computer-readable media can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include the following: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0247] Those skilled in the art will appreciate that embodiments of the disclosure can be supplied as a method, a system, or a computer program product. Thus, the disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the disclosure can take the form of a computer program product on one or more computer-readable storage media (including, but not limited to, disk storage and optical storage) embodying computer-readable program code.

[0248] The disclosure is described in reference to the flow diagrams and / or block diagrams of the methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each block of the flow diagrams and / or block diagrams, and combinations of blocks in the flow diagrams and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flow diagrams and / or block diagrams.

[0249] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the functions specified in the flow diagrams and / or block diagrams.

[0250] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in the flow diagrams and / or block diagrams.

[0251] It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed disclosure without departing from the spirit or scope of the disclosure. Thus, it is intended that the disclosure cover the modifications and variations of this disclosure provided they come within the scope of the appended claims and their equivalents.

Claims

1. A display device, wherein, The display device comprises a display unit and a control circuit, wherein: The display unit is configured to display content; The control circuit comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps: In the access control state of the display device, starting handwriting software and displaying a handwriting interface of the handwriting software; In response to a first handwriting operation of a user on the handwriting interface, displaying handwriting traces on the handwriting interface; Determining user authentication information according to the handwriting traces, and saving target content based on the user authentication information, wherein the target content is determined based on at least part of the handwriting traces of the handwriting interface.

2. The display device of claim 1, wherein, The processor is specifically configured to perform: Comparing the user authentication information with pre-stored verification information, and saving the target content when the comparison result is consistent.

3. The display device of claim 1, wherein, The handwriting traces comprise first traces; the processor is specifically configured to perform: Determining the user authentication information according to the first traces.

4. The display device of claim 3, wherein, The processor is specifically configured to perform: The target content is determined according to at least part of the handwriting traces other than the first traces.

5. The display device of claim 3, wherein, The processor is specifically configured to perform: Performing character and / or graphic recognition on the first traces, and determining user authentication information according to the recognition result of the first traces.

6. The display device according to any one of claims 1-5, wherein, The processor is specifically configured to perform: Performing style recognition on the handwriting traces, and determining the user authentication information according to the style recognition result.

7. The display device of claim 3, wherein, The handwriting area of the handwriting interface comprises a verification area; the processor is specifically further configured to perform: Determining the handwriting traces contained in the verification area as the first traces.

8. The display device of claim 7, wherein, The processor is specifically configured to perform: Determining a preset area of the handwriting area of the handwriting interface as the verification area; or, In response to user-inputted sign trace information, determining the verification area according to the position of the sign trace information.

9. The display device of claim 3, wherein, The processor is specifically further configured to perform: Determining the first traces according to the receiving time of the handwriting traces.

10. The display device of claim 9, wherein, The processor is specifically configured to perform: Determining the handwriting traces corresponding to a specified arrangement order as the first traces according to the arrangement order of the receiving time of the handwriting traces.

11. The display device according to any one of claims 1-5, 7-10, wherein, Dividing the handwriting traces into multiple groups of sub-handwriting traces; the processor is specifically configured to perform: Performing traversal processing on the multiple groups of sub-handwriting traces, verifying multiple groups of to-be-verified results obtained by the traversal processing result, and stopping the traversal and saving the target content when the verification is passed, wherein the user authentication information comprises the multiple groups of to-be-verified results.

12. The display device of claim 11, wherein, The processor is specifically configured to perform: When verifying the multiple groups of to-be-verified results, comparing each group of to-be-verified results with pre-stored verification information, and stopping the traversal and saving the target content when it is detected that any group of to-be-verified results is consistent with the pre-stored verification information.

13. The display device of claim 1, wherein, The processor is specifically further configured to perform: Classifying and saving the target content.

14. The display device of claim 13, wherein, The user verification information includes label information; and the processor is specifically configured to perform: According to the label information, the target content is classified and saved.

15. The display device of claim 1, wherein, The processor is specifically configured to perform: In the access control state of the display device, in response to a first operation of a user, starting handwriting software and displaying a handwriting interface of the handwriting software; The first operation represents an operation of a user on a stylus bound to the display device, or a gesture operation performed by the user on the display device.

16. The display device of claim 1, wherein, The processor is specifically further configured to perform: Text recognition is performed on at least part of the handwriting of the handwriting interface, and the target content is determined.

17. The display device of any of claims 1-5, 7-10, 12-16, wherein, The processor is specifically further configured to perform: The access control state of the display device is released based on the user verification information, and the target content is saved.

18. The display device of any of claims 1-5, 7-10, 12-16, wherein, The processor is specifically further configured to perform: The access control state of the display device is access control to a screen of the display device or access control to the handwriting software in the display device.

19. A display device, wherein, The display device includes a display unit and a control circuit, wherein: The display unit is configured to display content; The control circuit includes a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps: In the access control state of the display device, starting handwriting software and displaying a handwriting interface of the handwriting software; In response to a first handwriting operation of a user on the handwriting interface, displaying handwriting on the handwriting interface; User verification information is collected, and in a case where the user verification information passes, target content is saved, wherein the target content is determined based on at least part of the handwriting of the handwriting interface.

20. The display device of claim 19, wherein, The user verification information includes face information; and the processor is specifically configured to perform: When the handwriting operation is detected, face information is collected by a camera of the display device; The face information is verified by using pre-stored verification information, and when the verification passes, the target content is saved.

21. The display device of claim 19, wherein, The user verification information includes fingerprint information; and the processor is specifically configured to perform: When the handwriting operation is detected, fingerprint information is collected by a stylus bound to the display device; The fingerprint information is verified by using pre-stored verification information, and when the verification passes, the target content is saved.

22. The display device of any of claims 19-21, wherein, The processor is specifically configured to perform: The access control state of the display device is released based on the user verification information, and the target content is saved.

23. The display device of any of claims 19-21, wherein, The processor is specifically configured to perform: The access control state of the display device is access control to a screen of the display device or access control to the handwriting software in the display device.

24. An interaction method, wherein, The method includes: In the access control state of the display device, starting handwriting software and displaying a handwriting interface of the handwriting software; In response to a first handwriting operation of a user on the handwriting interface, displaying handwriting on the handwriting interface; User verification information is determined according to the handwriting, and target content is saved based on the user verification information, wherein the target content is determined based on at least part of the handwriting of the handwriting interface.

25. The method of claim 24, wherein, The target content is saved based on the user authentication information. The pre-stored verification information is compared with the user authentication information, and the target content is saved when the comparison result is consistent.

26. The method of claim 24, wherein, The handwriting includes a first handwriting; The user authentication information is determined according to the handwriting. The user authentication information is determined according to the first handwriting.

27. The method of claim 26, wherein The target content is determined according to at least part of the handwriting other than the first handwriting.

28. The method of claim 26, wherein, The user authentication information is determined according to the first handwriting. The first handwriting is subjected to character and / or figure recognition, and the user authentication information is determined according to the recognition result of the first handwriting.

29. The method of any one of claims 24-28, wherein, The user authentication information is determined according to the handwriting style of the handwriting. The handwriting area of the handwriting interface includes a verification area, and the method further includes:

30. The method of claim 26, wherein, The handwriting in the verification area is determined as the first handwriting. The verification area is determined in the following manner:

31. The method of claim 30, wherein, A preset area of the handwriting area of the handwriting interface is determined as the verification area; or In response to user input of sign handwriting information, the verification area is determined according to the position of the sign handwriting information. The method further includes:

32. The method of claim 26, wherein, The first handwriting is determined according to the receiving time of the handwriting. The first handwriting is determined according to the receiving time of the handwriting in the following manner:

33. The method of claim 32, wherein, The handwriting corresponding to a specified arrangement order of the receiving time of the handwriting is determined as the first handwriting. The handwriting is divided into a plurality of groups of sub-handwriting.

34. The method of any one of claims 24-28, 30-32, wherein, The user authentication information is determined according to the handwriting, and the target content is saved based on the user authentication information, including: The plurality of groups of sub-handwriting are subjected to traversal processing, and a plurality of groups of to-be-verified results obtained through the traversal processing are verified, and in the case of verification passing, the traversal is stopped and the target content is saved, and the user authentication information includes the plurality of groups of to-be-verified results. The method includes:

35. The method of claim 34, wherein, When the plurality of groups of to-be-verified results are verified, each group of the to-be-verified results is compared with pre-stored verification information, and when it is detected that any one of the groups of to-be-verified results is consistent with the pre-stored verification information, the traversal is stopped and the target content is saved. The target content is saved, and further includes:

36. The method of claim 24, wherein, The target content is classified and saved. The user authentication information includes label information, and the target content is classified and saved in the following manner:

37. The method of claim 36, wherein, The target content is classified and saved according to the label information.

38. The method of claim 24, wherein the handwriting software is started and the handwriting interface of the handwriting software is displayed in the access control state of the display device in the following manner: The handwriting software is started and the handwriting interface of the handwriting software is displayed in the access control state of the display device in response to a first operation of a user; The first operation represents an operation of a handwriting pen bound to the display device by the user, or a gesture operation performed by the user on the display device. ​ 39. The method of claim 24, wherein the interaction method further comprises: performing character recognition on at least part of the handwriting of the handwriting interface to determine the target content.

40. The method of any one of claims 24-28, 30-33, 35-39, wherein the method further comprises: releasing the access control state based on the user verification information and saving the target content.

41. The method of any one of claims 24-28, 30-33, 35-39, wherein the method further comprises: the access control state of the display device is access control to the screen of the display device or access control to the handwriting software in the display device.

42. An interactive method, wherein, the method comprises: starting the handwriting software and displaying the handwriting interface of the handwriting software in the access control state of the display device; displaying handwriting in the handwriting interface in response to a first handwriting operation of the user in the handwriting interface; collecting user verification information, and saving the target content when the user verification information passes, wherein the target content is determined based on at least part of the handwriting of the handwriting interface.

43. The method of claim 42, wherein, the user verification information includes face information; the method further comprises: collecting face information through the camera of the display device when the handwriting operation is detected; verifying the face information using pre-stored verification information, and saving the target content when the verification passes.

44. The method of claim 42, wherein, the user verification information includes fingerprint information; the method further comprises: collecting fingerprint information through the handwriting pen bound to the display device when the handwriting operation is detected; verifying the fingerprint information using pre-stored verification information, and saving the target content when the verification passes.

45. The method of any one of claims 42-44, wherein the method further comprises: releasing the access control state based on the user verification information and saving the target content.

46. The method of any one of claims 42-44, wherein the method further comprises: the access control state of the display device is access control to the screen of the display device or access control to the handwriting software in the display device.

47. A computer storage medium having stored thereon a computer program, wherein, the program is executed by a processor to implement the steps of the method of any one of claims 24-46.

48. A computer program product, the computer program product comprising: computer program code which, when run on a computer, causes the computer to perform the method of any one of claims 24-46.

Images