Control method of ink screen device, storage medium and program product

Abstract

The embodiment of the invention provides a control method of ink screen equipment, a storage medium and a program product, intelligent cooperative linkage of a first ink screen and a second ink screen can be realized, double-screen display content is automatically acquired and matched with an adaptive processing tool, a user does not need to manually call the tool and switch an interface, and the user experience is improved. The operation processes of information selection, transmission and processing are effectively simplified, and the operation cost of a user is greatly reduced; meanwhile, after the user selects the target information in the first content, the target information can be directly displayed and processed in the tool of the second ink screen, the processing result is synchronously displayed on the tool interface, closed-loop efficient operation of information processing is achieved, the multi-screen bearing and cooperation advantages of double-ink-screen equipment are fully played, and the user experience is improved. The information processing efficiency and the user operation convenience are remarkably improved, and the use experience of the multi-ink-screen equipment is further optimized.

Description

Technical Field

[0001] This application relates to the field of electronic display technology, and in particular to a control method, storage medium and program product for an e-ink screen device. Background Technology

[0002] With the popularization of e-reading, mobile office and other scenarios, e-ink screens have been widely used in products such as e-book readers, e-notebooks and smart office terminals due to their core advantages such as low power consumption, paper-like display effect and eye protection.

[0003] In existing technologies, the core structure of e-ink screen devices typically includes an e-ink screen, control components, and a storage module. When users need to process the displayed content, they must manually call up the tools through physical buttons, touch operations, or other means.

[0004] However, existing e-ink devices have poor interoperability and low automation in tool access and information processing, resulting in cumbersome user operations and low processing efficiency. Summary of the Invention

[0005] This application provides a control method, storage medium, and program product for an e-ink screen device to improve user operating efficiency.

[0006] In a first aspect, embodiments of this application provide a control method for an e-ink screen device, including:

[0007] Obtain the first content displayed on the first e-ink screen and the second content displayed on the second e-ink screen;

[0008] Based on the first content and the second content, a first tool is determined from a preset tool library and displayed on a second ink screen;

[0009] In response to the user's first instruction regarding the first content, the user selects the first information within the first content and displays the first information in the first tool;

[0010] The first information is processed using the first tool to obtain the processing result, and the processing result is displayed in the first tool.

[0011] Secondly, embodiments of this application provide a control device for an e-ink screen device, comprising:

[0012] The acquisition module is used to acquire the first content displayed on the first e-ink screen and the second content displayed on the second e-ink screen;

[0013] The determining module is used to determine a first tool from a preset tool library based on the first content and the second content, and to display the first tool on the second ink screen;

[0014] The display module is used to respond to a user's first instruction on the first content, select first information from the first content, and display the first information in the first tool;

[0015] The display module is also used to process the first information according to the first tool, obtain the processing result of the first information, and display the processing result in the first tool.

[0016] Thirdly, embodiments of this application provide an e-ink screen device, including: a memory and a processor;

[0017] The memory stores the instructions that the computer executes;

[0018] The processor executes computer execution instructions stored in memory, causing the processor to perform the first aspect and / or various alternative implementations of the first aspect as described above.

[0019] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the first aspect and / or various optional implementations of the first aspect.

[0020] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the first aspect and / or various optional implementations of the first aspect.

[0021] The control method, storage medium, and program product for the e-ink device provided in this application embodiment can realize intelligent collaborative linkage between the first and second e-ink screens. By automatically acquiring the content displayed on both screens and matching the appropriate processing tools, the user does not need to manually call up tools or switch interfaces, effectively simplifying the operation process of information selection, transmission, and processing, and significantly reducing user operating costs. At the same time, after the user selects the target information in the first content, it can be directly displayed and processed in the tool on the second e-ink screen. The processing results are synchronously displayed on the tool interface, realizing the closed-loop efficient operation of information processing, giving full play to the multi-screen carrying and collaborative advantages of the dual e-ink device, significantly improving information processing efficiency and user operation convenience, and further optimizing the user experience of the multi-e-ink device. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0023] Figure 1 This is a display example diagram of a dual e-ink screen device provided in an embodiment of this application;

[0024] Figure 2A flowchart illustrating the control method for the e-ink screen device provided in the embodiments of this application. Figure 1 ;

[0025] Figure 3 A flowchart illustrating the control method for the e-ink screen device provided in the embodiments of this application. Figure 2 ;

[0026] Figure 4 This is a schematic diagram of the control device for the e-ink screen device provided in the embodiments of this application;

[0027] Figure 5 This is a schematic diagram of the structure of the e-ink screen device provided in the embodiments of this application.

[0028] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0029] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0030] To address the technical problems of poor interoperability and low automation in tool invocation and information processing in existing e-ink devices, which lead to cumbersome user operations and low processing efficiency, the following technical concept is proposed: Based on multiple e-ink screens and control components, a closed-loop control logic for multi-screen content perception, tool matching, and information processing is constructed. Specifically, the control component acquires the content displayed on each screen, matches and adapts the tool, and displays it on one of the screens, eliminating the need for manual switching. In response to user actions on one screen, the selected information is synchronized to the tool on another screen for automatic processing and result display. This improves multi-screen interoperability and the level of information processing automation, simplifying user operations.

[0031] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0032] Figure 1 This is a display example diagram of a dual-e-ink screen device provided in an embodiment of this application. For example... Figure 1 As shown, the dual-ink screen device includes two independently controlled ink screens, namely the first ink screen and the second ink screen, which are connected by a physical link.

[0033] The first e-ink screen displays the first content, and the second e-ink screen displays the second content. The user can activate and display the first tool on the second e-ink screen by touch or physical buttons, so that the user can use the first tool to process any information in the first or second content.

[0034] like Figure 1 As shown, this method allows users to select the display area they want to process (e.g., ...). Figure 1 The "1+1" in the middle enables the automatic startup of the first tool and its automatic processing to obtain the corresponding results (such as...). Figure 1 (1+1=2 in the equation).

[0035] Figure 2 A flowchart illustrating the control method for the e-ink screen device provided in the embodiments of this application. Figure 1 The method described above in this application embodiment can be applied to any e-ink screen device. For example... Figure 2 As shown, the method includes:

[0036] S201, Obtain the first content displayed on the first e-ink screen and the second content displayed on the second e-ink screen.

[0037] The first e-ink screen refers to the main display screen in the e-ink screen device, which is mainly used to display core information content (i.e., the first content). It is the core interactive carrier for users to view and select information, and its displayed content is usually information such as documents, pictures, and data that users pay close attention to.

[0038] The second e-ink screen is an auxiliary display screen in the e-ink screen device. Its core function is to carry tool-type content (i.e., the first tool) and provide supporting processing functions for the core content of the first e-ink screen, realizing a dual-screen collaborative mode of "viewing content on the main screen and adjusting tools on the secondary screen" without occupying the display space of the main screen.

[0039] The first content is the core set of information currently displayed on the first e-ink screen. It can be any information format that can be displayed on the e-ink screen, such as documents, pictures, tables, web page content, and notes. It is the object that the user selects and processes for information later.

[0040] The second content is what is currently displayed on the second e-ink screen. Its form can be flexibly adapted to the scene. It can be the initial default blank interface, device status information, or the residual interface of historical tools, auxiliary prompts, etc., to provide scene reference for the control component matching tool.

[0041] Specifically, the control component actively initiates a data reading operation. On one hand, it reads the current display cache data of the first e-ink screen through the e-ink screen driver circuit, and parses it to obtain the specific information of the first content (including content type, format, core data, etc.). On the other hand, it simultaneously reads the display cache data of the second e-ink screen, and parses it to obtain the current state of the second content (such as whether it is blank, whether it displays history tools, etc.). This operation can be triggered in real time (such as when the content displayed on both screens changes) or on demand (such as when the user initiates a tool call request). The control component will temporarily store the acquired content for quick retrieval in subsequent steps.

[0042] S202. Based on the first content and the second content, determine the first tool in the preset tool library and display the first tool on the second ink screen.

[0043] The preset tool library is a collection of tools pre-stored in the control component. It includes a variety of functional tools that can process information, such as text extraction tools, translation tools, annotation tools, format conversion tools, data calculation tools, and information retrieval tools. Each tool corresponds to a specific information processing scenario and is associated with content matching rules for tool calls.

[0044] The first tool is a target tool matched from a preset tool library and adapted to the current first and second content. It has the ability to perform targeted processing on specific information (first information) in the first content, and its display medium is a second e-ink screen.

[0045] Specifically, based on the acquired first and second content, the control component combines the adaptation rules of each tool in the preset tool library (such as adapting text content to translation / annotation tools, table content to calculation / extraction tools, and prioritizing the display of commonly used tools on a blank second screen) to perform tool matching and filtering. It determines the unique or optimal adapted tool (i.e., the first tool) from the tool library, excluding tools irrelevant to the current scene. Next, the control component sends display instructions to the second e-ink screen, driving it to render the interface of the first tool (such as tool icons, operation buttons, input areas, etc.), completing the visual display of the first tool. If the second e-ink screen currently displays a historical tool (the second content is the interface of a historical tool), the control component will first clear that historical content before rendering the first tool, ensuring the uniqueness and accuracy of the tool display.

[0046] S203. In response to the user's first instruction on the first content, select the first information in the first content and display the first information in the first tool.

[0047] The first instruction is an interactive instruction initiated by the user for the first content on the first e-ink screen. The core purpose is to select specific information in the first content. The instruction can be triggered by e-ink screen touch operation (such as click, long press, box selection), physical button operation, voice command, external device trigger (such as stylus click), etc.

[0048] The first piece of information is a specific information fragment selected by the user from the first content through the first instruction. It can be a text fragment (such as a word, sentence, or paragraph), a local area in an image, cell data in a table, or other information units that can be processed by the tool.

[0049] Specifically, the control component monitors user interactions in real time. When it receives a first instruction from the user regarding the first content (such as selecting text with a touch or clicking a portion of an image with a stylus), it immediately parses the type, location, and target of the instruction and completes the instruction response. Secondly, based on the instruction parsing results, it accurately locates and extracts the user-specified information fragment (i.e., the first information) from the first content, enabling information selection. Finally, the control component synchronizes the extracted first information to the first tool interface on the second e-ink screen, driving the first tool to load and display the first information (such as displaying the selected text in the translation tool's input box or the selected image area in the annotation tool). When responding to instructions, the control component verifies the validity of the instruction (such as whether valid information is selected or whether the operation location is within the first content area), and only performs subsequent selection and synchronization operations on valid instructions. The display format of the first information in the first tool must be adapted to the tool type to ensure that the user can clearly view the information to be processed.

[0050] S204. Based on the first tool, process the first information to obtain the processing result of the first information, and display the processing result in the first tool.

[0051] The processing result is the output information generated by the first tool after performing specified processing on the first information. Its form corresponds to the function of the first tool, such as the translation output by the translation tool, the annotation content generated by the annotation tool, the plain text output by the extraction tool, and the numerical result obtained by the calculation tool.

[0052] Specifically, the control component invokes the core processing functions of the first tool, performing targeted processing operations on the first information synchronized to the tool according to the tool's preset logic (such as the language conversion rules of the translation tool, the marking rules of the annotation tool, and the calculation rules of the calculation tool). Secondly, after processing, a corresponding processing result is generated. The control component captures this result and standardizes its format (ensuring compatibility with the display requirements of the second e-ink screen). Finally, the control component drives the first tool interface on the second e-ink screen to display the processing result in a designated area (such as displaying the translation in the output box of the translation tool, and displaying annotation marks and content in the annotation tool), completing the closed loop of the entire information processing flow. During processing, the control component verifies the validity of the processing result. If processing fails (e.g., the information format is not supported, or the network-dependent tool has no network), a prompt message will be displayed in the first tool. The processing result allows for further user operations (such as secondary editing, saving, and synchronizing to the first content).

[0053] The control method for the e-ink screen device provided in this application embodiment can realize intelligent collaborative linkage between the first e-ink screen and the second e-ink screen. By automatically acquiring the content displayed on both screens and matching the appropriate processing tools, the user does not need to manually call up tools and switch interfaces, which effectively simplifies the operation process of information selection, transmission and processing, and greatly reduces the user's operating costs. At the same time, after the user selects the target information in the first content, it can be directly displayed and processed in the tool on the second e-ink screen. The processing results are synchronously displayed on the tool interface, realizing the closed-loop efficient operation of information processing, giving full play to the multi-screen carrying and collaborative advantages of the dual e-ink screen device, significantly improving information processing efficiency and user operation convenience, and further optimizing the user experience of the multi-e-ink screen device.

[0054] Figure 3 A flowchart illustrating the control method for the e-ink screen device provided in the embodiments of this application. Figure 2 .like Figure 3 As shown, the method includes:

[0055] S301, Obtain the first content displayed on the first e-ink screen and the second content displayed on the second e-ink screen.

[0056] S302. Based on the first content and the second content, determine the first tool in the preset tool library and display the first tool on the second ink screen.

[0057] In one alternative implementation, when the first content is related to calculation and the second content is scratch paper or notebook, the first tool is determined to be a calculator; when the first content is related to reading and the second content is notebook, the first tool is determined to be a dictionary; when the first content is related to drawing and the second content is scratch paper or notebook, the first tool is determined to be a drawing tool.

[0058] Among them, the content related to calculation is the information form containing calculable data, formulas, and tables in the first content, such as documents containing mathematical formulas, shopping lists (including price data), statistical reports, etc. The core feature is the existence of numerical information that needs to be calculated and statistically analyzed.

[0059] The content associated with reading is primarily textual information used by users to acquire knowledge, such as ebooks, articles, papers, web page texts, and notes. Its core characteristic is the presence of a large amount of textual content, which may include obscure words, technical terms, and other information that requires searching.

[0060] The content associated with drawing is information in the form of graphics, lines, sketches, or supplementary graphics that need to be drawn, such as hand-drawn sketches, design drawings, schematic diagrams, blank drawing pages, etc. The core feature is that it requires line drawing and graphic editing operations.

[0061] Draft paper is one of the specific forms of the second content. It simulates the blank interface of physical draft paper or the interface with grids / horizontal lines. It is used as an auxiliary display for temporary writing, calculation, and drawing. It has no preset fixed content and has erasable and writable characteristics.

[0062] A notebook is one of the specific forms of secondary content. It is an interface used to record and store information. It can include historical notes and blank notebook pages, and has text input and content saving functions, making it suitable for scenarios of information recording and organization.

[0063] Calculators are a specific type of primary tool, possessing functions such as numerical operations (addition, subtraction, multiplication, division, squaring, square root, etc.), formula calculation, and data statistics, adapting to information processing needs related to calculation.

[0064] A dictionary is a specific type of primary tool that features word lookup, definitions, pronunciation, and example sentences. It can include Chinese dictionaries, English dictionaries, and specialized dictionaries, and is adapted to the need for looking up unfamiliar words and terms in reading scenarios.

[0065] The drawing tools are a specific type of the first tool, with functions such as line drawing, graphic generation (circles, rectangles, etc.), color adjustment, graphic erasure, and line thickness setting, adapting to the graphic editing needs of drawing scenarios.

[0066] Specifically, the control component analyzes the type of the first content to determine whether it is related to calculation, reading, or drawing (this can be identified by keywords, format, and data features in the content; for example, if it contains "=" or "×", it is determined to be calculation-related content; if it contains a large amount of text paragraphs, it is determined to be reading-related content). The control component analyzes the type of the second content to determine whether it is scratch paper or notebook (this can be identified by interface features; for example, a blank / grid interface indicates scratch paper, and an interface containing note entries / save buttons indicates a notebook).

[0067] If the first content is "calculation-related content" and the second content is "scratch paper / notebook": the control component matches the calculator tool in the preset tool library and determines it as the first tool;

[0068] If the first content is "read related content" and the second content is "notebook": the control component matches the dictionary tool in the tool library and determines it as the first tool;

[0069] If the first content is "drawing-related content" and the second content is "scratch paper / notebook": the control component matches the drawing tools in the tool library and determines it as the first tool.

[0070] Optionally, this method can be compatible with more "dual-screen content-tool" matching scenarios, such as: when the first content is "document editing content" and the second content is "notebook", it matches "annotation tool"; when the first content is "image content" and the second content is "scratch paper", it matches "image cropping tool"; when the first content is "foreign language text" and the second content is "notebook", it matches "translation tool", thus enriching the applicable scenarios of the method.

[0071] When the first content belongs to multiple types (such as a document containing text and formulas), or the second content meets multiple conditions (such as an interface that combines the functions of a draft paper and a notebook), the control component can prioritize matching the user's frequently used tools in the past, or display a tool list on the second e-ink screen for the user to select manually; if no corresponding tool is matched, a "No compatible tool" prompt can be displayed, and popular tools in the tool library can be recommended to improve matching flexibility.

[0072] In one alternative implementation, a first window is displayed, the first window including a prompt message to prompt the user whether to launch the first tool; when the user selects to launch the first tool, the first tool is displayed on a second e-ink screen.

[0073] The first window is a temporary interactive window that pops up in the second e-ink screen. It is used to display tool launch prompts and operation options. The window style can be preset (such as rectangle or rounded rectangle), and includes a prompt text area and an operation button area. It does not obscure the core content of the second e-ink screen (or only partially obscures it). The prompt information is the text displayed in the first window, which informs the user of the first matched tool and launch options, such as "A calculator tool has been matched for you. Do you want to launch it?". The language is concise and easy to understand, allowing users to quickly comprehend it.

[0074] Specifically, the control component sends a window display command to the second e-ink screen, causing it to pop up the first window. This window displays prompts (including the name of the first tool and a startup prompt) and operation options (such as "Start" and "Cancel" buttons), ensuring the user can clearly see and operate it. The control component listens for user commands regarding the first window in real time, receiving the user's selection signal (Start or Cancel). If the user selects "Start," the control component responds by closing the first window and simultaneously drives the second e-ink screen to render the complete interface of the first tool (including tool function buttons, input areas, etc.), completing the display of the first tool. If the user selects "Cancel," the control component responds by closing the first window, retaining the current content on the second e-ink screen, but not displaying the first tool.

[0075] Optionally, the first window can be equipped with more functional options, such as "Start and set as default tool" (automatically start the tool in the same scenario without confirmation), "View tool introduction" (display the function description of the first tool), and "Switch tool" (jump to the tool library to select other tools), enriching the window's interactive functions and meeting diverse user needs.

[0076] If the user does not interact with the first window within a preset time (e.g., 3 seconds, 5 seconds), the control component can automatically execute the default action (e.g., automatically start the tool, automatically close the window). The default action can be customized by the user in the device settings. At the same time, the display position and size of the first window can be adjusted by the user (e.g., drag the window, resize it) to suit the operating habits of different users.

[0077] S303, In response to a user’s first instruction on the first content, select the first information in the first content and display the first information in the first tool.

[0078] In one optional implementation, the first instruction includes at least one of the following: adding an underline below the first information; circling the first information; highlighting the first information; and providing a voice selection instruction for the first information.

[0079] Adding an underline is one of the specific operation forms of the first instruction. The user draws a horizontal line mark below the first information on the first e-ink screen through a specific interactive action. The core purpose is to select the information. At the same time, the underline can serve as a visual prompt of the selected state. The mark can be retained or automatically cleared after the operation is completed.

[0080] Enclosing the first piece of information is one of the specific operational forms of the first instruction. Users can draw closed shapes (such as circles or rectangles) on the first e-ink screen using touch, stylus, or other means to enclose the target first piece of information, thereby selecting the information. The selection trajectory can serve as a selection status prompt, adapting to selection scenarios of irregular information fragments.

[0081] Highlighting is one of the specific operational forms of the first instruction. Through interactive operation, the user sets the display area of ​​the first information to a preset highlight color (such as gray or light black). The target information is highlighted through color contrast, which not only achieves information selection, but also makes it easy for the user to quickly locate the selected content, which is suitable for the selection of key information in long documents.

[0082] Voice selection commands are one of the specific operation forms of the first command. Users initiate information selection commands through voice input. The command content can include information features (such as "select the current paragraph" or "select the keyword 'e-ink screen'"), eliminating the need for manual touch operation and adapting to scenarios where it is inconvenient to operate with both hands.

[0083] Specifically, based on their own operating habits and scenario needs, users can choose any one or more command formats to initiate the first command:

[0084] If "Add Underline" is selected, the user can slide the pen or finger under the first information to trigger a touch signal. After receiving the signal, the control component will parse the operation trajectory into an underline mark, and simultaneously locate the first information corresponding to the mark to complete the selection.

[0085] If "Encircle the first information" is selected, the user draws a closed trajectory around the first information, the control component analyzes the closure of the trajectory, identifies the information area enclosed by the trajectory, determines the information within the area as the first information, and completes the selection;

[0086] If "highlight mark" is selected, the user can long press the first information area and select the highlight function, or trigger the highlight by using a shortcut key. After receiving the instruction, the control component will render the target area with the highlight color and locate the information within the highlighted area as the first information.

[0087] If "voice selection command" is selected, the user inputs a voice command through the device's microphone. The control component calls the voice recognition module to convert the voice into a text command, parses the information features in the command, matches the corresponding information in the first content, and selects it as the first information.

[0088] Optionally, the first instruction may also include "double-click to select" (double-clicking the target information to trigger selection), "shortcut key selection" (triggered by a combination of physical buttons on the device), "external device selection" (such as selection via Bluetooth keyboard shortcuts or handwriting tablet operation), etc., which can be flexibly added according to the device hardware configuration to improve adaptability; at the same time, it supports multiple instruction combinations (such as "circle selection + highlight"), which can both select information and mark key points.

[0089] After receiving the first instruction, the control component can add a "selection confirmation" step, that is, a confirmation window pops up on the first e-ink screen to prompt the user "whether to select this information", thus avoiding accidental operation; for voice selection instructions, if recognition fails (such as unclear voice or no matching information), the control component can prompt the user "please re-enter the voice instruction" through the second e-ink screen and provide alternative information for the user to choose from, thereby improving the success rate of instruction execution.

[0090] S304. Determine the user's intention to process the first information.

[0091] Among them, the processing intent is the specific operation purpose that the user wants to perform on the first piece of information through the first tool after selecting the first piece of information. For example, after selecting text, the user wants to "look up the definition", "translate" or "copy"; after selecting a number, the user wants to "calculate the sum" or "convert units". This is the core demand of the user's operation behavior.

[0092] Specifically, by analyzing user behavior, primary information characteristics, and contextual information, the user's processing intent can be determined. For example, if a user selects text and long-presses to bring up the "Search" option, the processing intent can be determined to be "Search for definitions"; if a user selects multiple values ​​and clicks the calculator tool, the processing intent can be determined to be "Calculate the sum of the values".

[0093] Optionally, the processing intent can be compatible with multiple types depending on the tool type. For example, for dictionary tools, intents may include "look up definition", "look up pronunciation", "look up example sentence", and "look up synonyms"; for calculator tools, intents may include "sum", "product", "difference", "unit conversion", and "tax rate calculation"; for translation tools, intents may include "Chinese to English", "English to Chinese", "translate sentence", and "translate paragraph", covering the core functional scenarios of different tools.

[0094] If a user has multiple processing intentions (such as wanting to both "look up the definition" and "translate" after selecting text), the control component can prioritize executing the intention explicitly triggered by the user (such as the user clicking the "translate" option), or process them sequentially according to the priority of the intentions; after processing, it can ask the user "whether to perform other operations", supporting the user to initiate secondary processing intentions and improving the continuity of processing.

[0095] In one optional implementation, the first information is subjected to intent recognition processing; if the intent corresponding to the first information can be recognized, the intent corresponding to the first information is determined as the processing intent; if the intent corresponding to the first information cannot be recognized, the context information corresponding to the first information is obtained, and the processing intent is determined based on the context information.

[0096] Specifically, the control component extracts features from the first piece of information (such as text type, numerical features, and keywords), combines this with the user's initial action (such as long-pressing or clicking a tool button), and analyzes the user's possible processing intent using preset rules or algorithms. If the recognition is successful (e.g., selecting the word "apple" indicates an intent to "look up the definition"; selecting "10+20" indicates an intent to "calculate the result"), the recognized intent is directly determined as the user's processing intent. If the recognition fails (e.g., the selected information features are unclear, the action has no obvious direction, and the user's intent cannot be determined), the control component further obtains contextual information from the first piece of information, including the context surrounding the information, the user's recent operation records, and the current dual-screen display scenario. Intent is deduced based on contextual information: the control component analyzes contextual information and mines related requests. For example, if a user selects text while reading a foreign language document, combined with frequently used translation functions in past operations, the intent is deduced to be "translate"; if a numerical value is selected and the context contains the keyword "total price," the intent is deduced to be "calculate the sum," ultimately determining the processing intent.

[0097] Optionally, intent recognition processing can be implemented by combining multiple technologies, such as keyword matching technology (matching keywords such as "price" and "total" to correspond to calculation intent), user profiling technology (accurately identifying intent based on users' historical operation habits), and deep learning models (training through a large amount of scenario data to improve the recognition accuracy in complex scenarios), adapting to recognition scenarios of different complexities.

[0098] If the processing intent cannot be determined through contextual information, the control component can pop up an intent selection window through the second e-ink screen, displaying multiple optional intent options (such as "You may need: query definition / translate / copy") for the user to manually select; at the same time, the user's selection record is synchronized to the historical operation to optimize the accuracy of subsequent intent recognition and achieve the effect of "becoming more accurate with use".

[0099] S305. Based on the processing intent and the first tool, process the first information to obtain the processing result of the first information, and display the processing result in the first tool.

[0100] Specifically, the control component analyzes the core functions of the first tool (such as the "sum" and "product" functions of a calculator, and the "definition" and "example sentences" functions of a dictionary), and matches the determined processing intent with the functions of the first tool. If the processing intent matches the function of the first tool (e.g., the intent is "sum" and the tool is a calculator), the control component calls the corresponding function of the first tool to perform the processing operation on the first information (e.g., calculating the sum of the selected values); if the intent does not match the function of the tool (e.g., the intent is "translation" and the tool is a calculator), the user is prompted that "the current tool does not support this operation," and a compatible tool is recommended.

[0101] In one optional implementation, a page switching instruction is received for a first e-ink screen and a second e-ink screen; the content of the first e-ink screen is switched to be displayed on the second e-ink screen, and the content of the second e-ink screen is switched to be displayed on the first e-ink screen.

[0102] The page switching command is an interactive command initiated by the user to trigger the exchange of content between the first e-ink screen and the second e-ink screen. The triggering methods may include touch operation (such as two-finger swipe, clicking the switch button), physical button operation (such as the switch button on the side of the device), voice command (such as "switch dual screen content"), etc.

[0103] The content switching function synchronizes the first content currently displayed on the first e-ink screen to the second e-ink screen, and simultaneously synchronizes the second content currently displayed on the second e-ink screen (including the first tool, window, etc.) to the first e-ink screen, thus realizing bidirectional exchange of content between the two screens. After the exchange, the display format of the content is adapted to the resolution and size of the corresponding e-ink screen.

[0104] Specifically, the control component monitors user interactions in real time, receives page switching commands initiated by the user, and parses the validity of the commands (e.g., whether they are valid switching commands, and whether the device currently supports switching). If the command is valid, the control component immediately caches the first content data (including display position, selection state, etc.) of the first e-ink screen and the second content data (including tool interface, window state, etc.) of the second e-ink screen to prevent content loss. The control component synchronizes the cached first content data to the second e-ink screen, driving the second e-ink screen to render the content, ensuring that the display effect is consistent with the original first e-ink screen (adapting to the size and resolution of the second e-ink screen). At the same time, the control component synchronizes the cached second content data to the first e-ink screen, driving the first e-ink screen to render the content, completing the swap of content between the two screens. After the switch is completed, the control component retains the operation state of the content on both screens (e.g., the original selection state of the first information, the original startup state of the first tool), ensuring that the user can continue subsequent operations.

[0105] Optionally, in addition to bidirectional switching, it also includes a "one-way switching" function, such as switching only the first content to the second e-ink screen (the first e-ink screen retains the original content), or switching only the second content to the first e-ink screen (the second e-ink screen retains the original content); it also supports "multi-round switching memory", which records the user's recent switching records and supports quick restoration of historical switching states (such as "returning to the content before the last switch").

[0106] During the switching process, if the display formats of the content on the two screens are incompatible (such as the original content size not matching the target e-ink screen), the control component can automatically adjust the content format (such as scaling, line wrapping, cropping) and inform the user through a prompt message that "the content has been adapted to the current screen"; if the first tool is processing the first information (such as the calculator is performing calculations) when switching, the control component can pause processing and automatically resume processing after the switching is completed to ensure operation continuity.

[0107] By clearly defining various specific implementation forms of the first instruction, covering operation methods such as underlining, selection, highlighting, and voice selection, it can adapt to different users' operating habits (such as handwriting preference, voice operation preference) and diverse information selection scenarios (such as key information in long documents, irregular information fragments, and scenarios where two-handed operation is limited). This not only lowers the interaction threshold for users to select the first information, but also achieves accurate positioning of target information. At the same time, it improves the user's interactive experience and operating efficiency with e-ink screen devices by providing visual feedback on the selection status.

[0108] By defining precise matching rules for "dual-screen content-tools," the selection logic for the first tool in different scenarios is clarified, making the tool matching process of the control components clearer and more executable, effectively avoiding tool matching confusion or mismatch issues. Users do not need to manually search for suitable tools in the tool library; the system can automatically match target tools such as calculators, dictionaries, and drawing tools based on the current first and second content, greatly improving tool call efficiency and ensuring that tool functions accurately match the user's current scenario needs, further enhancing the practicality of dual-screen collaboration.

[0109] Adding a user confirmation step before displaying the first tool, by popping up a first window with prompts for the user to choose whether to launch the tool, effectively avoids accidental operation caused by the control component automatically launching the tool, and fully protects the user's autonomous control over the tool launch; at the same time, the prompts clearly inform the user of the currently matched tool type, helping the user quickly understand the tool's purpose, reducing unnecessary operational confusion, optimizing the interaction process of dual-screen tool access, and improving user satisfaction.

[0110] By introducing the user's processing intent dimension, and combining the processing intent with the primary tool to process the primary information in a targeted manner, the current situation of tools blindly processing information has been changed. It can accurately meet the core needs of users and avoid the problem of processing results not meeting user expectations. At the same time, through the matching and verification of processing intent and tool functions, users can be promptly notified of tool function incompatibility and recommended adapted tools, which improves the accuracy and effectiveness of information processing and further leverages the advantages of dual-screen collaborative information processing.

[0111] By providing a complete intent recognition solution for different scenarios, it can quickly identify user intent based on the first information itself, and can also use contextual information to assist in deduction when recognition fails, which greatly improves the success rate and reliability of intent recognition. Combining user history, scenario information and other contextual deductions make the recognition results more in line with user habits and actual needs, while providing accurate basis for subsequent information processing. Furthermore, by recording user selections to optimize subsequent recognition accuracy, it has achieved iterative optimization of intent recognition.

[0112] By adding a dual-screen content switching function, the content of the first and second e-ink screens can be interchanged in both directions, which can flexibly adapt to different user display needs (such as using the main screen to view the results of tool processing and using the secondary screen to display core content), greatly improving the flexibility of using dual-screen devices. During the switching process, the content of both screens is cached and the operation state (such as the information selection state and the tool startup state) is retained, ensuring that users can continue subsequent operations after switching, avoiding content loss or operation interruption, ensuring operation continuity, and further expanding the application scenarios of dual-screen collaboration.

[0113] Figure 4 This is a schematic diagram of the structure of the control device for the e-ink screen device provided in the embodiments of this application, as shown below. Figure 4 As shown, the control device 40 of the e-ink screen device provided in this embodiment includes an acquisition module 401, a determination module 402, and a display module 403.

[0114] The acquisition module 401 is used to acquire the first content displayed on the first e-ink screen and the second content displayed on the second e-ink screen;

[0115] The determining module 402 is used to determine a first tool in a preset tool library based on the first content and the second content, and to display the first tool on the second ink screen;

[0116] Display module 403 is used to respond to a user's first instruction on the first content, select first information in the first content, and display the first information in the first tool;

[0117] The display module 403 is also used to process the first information according to the first tool, obtain the processing result of the first information, and display the processing result in the first tool.

[0118] In one alternative implementation, the first instruction includes at least one of the following:

[0119] Add an underscore below the first piece of information;

[0120] Circle the first piece of information;

[0121] Highlight the first piece of information;

[0122] Voice selection command for the first piece of information.

[0123] In one alternative implementation, the determining module 402 is specifically used for:

[0124] When the first content is related to calculation and the second content is scratch paper or notebook, the first tool is determined to be a calculator.

[0125] When the first content is related to reading and the second content is a notebook, the first tool is determined to be a dictionary.

[0126] When the first content is related to drawing and the second content is draft paper or notebook, the first tool is determined to be a drawing tool.

[0127] In one alternative implementation, the display module 403 is specifically used for:

[0128] The first window is displayed, which includes a prompt message to ask the user whether to launch the first tool.

[0129] When the user selects to launch the first tool, the first tool is displayed on the second e-ink screen.

[0130] In one alternative implementation, the display module 403 is specifically used for:

[0131] Determine the user's intention to process the initial information;

[0132] The first information is processed according to the processing intent and the first tool.

[0133] In one alternative implementation, the display module 403 is specifically used for:

[0134] Perform intent recognition processing on the first piece of information;

[0135] If the intent corresponding to the first piece of information can be identified, then the intent corresponding to the first piece of information is determined as the processing intent;

[0136] If the intent corresponding to the first information cannot be identified, then the context information corresponding to the first information is obtained, and the processing intent is determined based on the context information.

[0137] In an alternative implementation, the display module 403 is further configured to:

[0138] Receive page switching instructions for the first and second e-ink screens;

[0139] Switch the content of the first e-ink screen to the second e-ink screen, and switch the content of the second e-ink screen to the first e-ink screen.

[0140] The control device for the e-ink screen device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0141] Figure 5 This is a schematic diagram of the structure of the e-ink screen device provided in an embodiment of this application. Figure 5 As shown, the e-ink display device 50 provided in this embodiment includes at least one processor 501 and a memory 502. Optionally, the e-ink display device 50 further includes a communication component 503. The processor 501, memory 502, and communication component 503 are connected via a bus.

[0142] In a specific implementation, at least one processor 501 executes computer execution instructions stored in memory 502, causing at least one processor 501 to perform the above-described method.

[0143] The specific implementation process of processor 501 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0144] In the above embodiments, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0145] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0146] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0147] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0148] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above-described method.

[0149] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0150] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0151] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0152] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0153] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0154] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0155] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0156] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A control method for an e-ink display device, characterized in that, An application to an e-ink display device, the e-ink display device including a first e-ink screen and a second e-ink screen, the e-ink display device including a control component, the control component being used to control the display of the first e-ink screen and the second e-ink screen, the method including: Obtain the first content displayed on the first e-ink screen and the second content displayed on the second e-ink screen; Based on the first content and the second content, a first tool is determined from a preset tool library and displayed on the second ink screen; In response to a user's first instruction regarding the first content, the user selects first information from the first content and displays the first information in the first tool; The first information is processed using the first tool to obtain a processing result, and the processing result is displayed in the first tool.

2. The method according to claim 1, characterized in that, The first instruction includes at least one of the following: Add an underscore below the first information; Circle the first piece of information; The first information is highlighted. Voice selection command based on the first information.

3. The method according to claim 1, characterized in that, Based on the first content and the second content, a first tool is determined from a preset tool library, including: When the first content is related to calculation and the second content is scratch paper or notebook, the first tool is determined to be a calculator. When the first content is related to reading and the second content is a notebook, the first tool is determined to be a dictionary; When the first content is related to drawing and the second content is draft paper or notebook, the first tool is determined to be a drawing tool.

4. The method according to any one of claims 1-3, characterized in that, The first tool is displayed on the second e-ink screen, including: Display a first window, the first window including a prompt message, the prompt message being used to prompt the user whether to launch the first tool; When the user selects to launch the first tool, the first tool is displayed on the second e-ink screen.

5. The method according to any one of claims 1-3, characterized in that, The first information is processed according to the first tool, including: Determine the user's intention to process the first information; The first information is processed according to the processing intent and the first tool.

6. The method according to claim 5, characterized in that, Determining the user's intention to process the first information includes: The first information is processed for intent recognition. If the intent corresponding to the first information can be identified, then the intent corresponding to the first information is determined as the processing intent; If the intent corresponding to the first information cannot be identified, then the context information corresponding to the first information is obtained, and the processing intent is determined based on the context information.

7. The method according to any one of claims 1-3, characterized in that, The method further includes: Receive page switching instructions for the first e-ink screen and the second e-ink screen; Switch the content of the first e-ink screen to the second e-ink screen, and switch the content of the second e-ink screen to the first e-ink screen.

8. An e-ink screen device, characterized in that, include: Memory, processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-7.

10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method described in any one of claims 1-7.

Images