Pen device, electronic device and control method thereof

Abstract

A pen device, an electronic device and a control method thereof relate to the field of electronic products. The control method of the electronic equipment comprises the steps that in response to a target trigger event, the electronic equipment is controlled to enter a first use mode, so that a target window is displayed in a target display area, and the target window is a window matched with an input area of a target input device of the electronic equipment; and controlling display of the target window based on input data acting on the input area.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic products, and in particular to a pen device, an electronic device and a control method thereof. Background Art

[0002] When handwriting input into a computer, an external digital tablet is generally required. The hand-drawn content on the digital tablet will be displayed synchronously on the computer monitor, thus completing the handwriting input.

[0003] A digital tablet generally requires a driver CD or a dedicated driver. When using it, you need to first install the dedicated driver, then connect a hand-drawn touchpad to the computer, and use the hand-drawn touchpad and drawing software to input handwriting to the computer.

[0004] Since digital tablets generally require special drivers, they have a narrow scope of application and are inconvenient to use. Summary of the invention

[0005] The present disclosure provides the following technical solutions:

[0006] A first aspect of the present disclosure provides a control method for an electronic device, comprising:

[0007] In response to the target trigger event, controlling the electronic device to enter a first usage mode to display a target window in a target display area, the target window being a window matching an input area of ​​a target input device of the electronic device; and,

[0008] Controls the display of the target window based on the input data applied to the input area.

[0009] In some modified implementations of the first aspect of the present disclosure, controlling the electronic device to enter the first usage mode to display the target window in the target display area includes:

[0010] Obtaining the type and / or source of a target triggering event;

[0011] controlling the target display area to display a target window matching a target input area of ​​a target input device based on the type and / or source;

[0012] The target display area belongs to or does not belong to the electronic device.

[0013] In some modified implementations of the first aspect of the present disclosure, the target triggering event is generated by at least one of the following:

[0014] An operation of configuring a switch state of a first control on a first target application interface of an electronic device;

[0015] A trigger operation acting on a target key of the electronic device, the target key comprising a single physical key or a combination of physical keys disposed on the body of the electronic device;

[0016] Target instruction data is collected and / or recognized by target sensors;

[0017] Detecting that the electronic device is running a second target application;

[0018] Identify the operational requirements or user profile information of the target user;

[0019] It is detected that the electronic device establishes a communication connection with an external target input / output device;

[0020] Detecting that a first positional relationship exists between a pen device disposed in a storage position of the electronic device and the electronic device;

[0021] Obtaining target intent through context information in a third target application;

[0022] The electronic device is detected to switch to the target device form.

[0023] In some modified implementations of the first aspect of the present disclosure, controlling the electronic device to enter the first usage mode to display the target window in the target display area includes at least one of the following:

[0024] In response to the electronic device entering the first use mode, the entire target display area of ​​the electronic device or a first area is used as a window area of ​​the target window, and a target mapping relationship exists between the window area and the input area of ​​the target input device;

[0025] In the case where the target trigger event is generated by a trigger operation acting on the electronic device, a first window matching the first input area of ​​the target input device is displayed in a second area of ​​the target display area, and the second area has a first mapping relationship with the first input area;

[0026] In the case where the target trigger event is generated from the obtained target instruction data or the running second target application, displaying a second window matching the second input area of ​​the target input device in a third area of ​​the target display area, the third area having a second mapping relationship with the second input area;

[0027] In the case where the target trigger event is generated from the identified operation requirement or user portrait information, a third window matching the third input area of ​​the target input device is displayed in a fourth area of ​​the target display area, and the fourth area has a third mapping relationship with the third input area;

[0028] In the case where the target trigger event is generated by the electronic device establishing a communication connection with the external input / output device, a fourth window matching the fourth input area of ​​the target input device is displayed in the fifth area of ​​the target display area, and the fifth area has a fourth mapping relationship with the fourth input area;

[0029] In the case where the target trigger event is generated from a first positional relationship between the electronic device and the pen device, a fifth window matching the fifth input area of ​​the target input device is displayed in a sixth area of ​​the target display area, and the sixth area has a fifth mapping relationship with the fifth input area;

[0030] When the electronic device is switched to the first device form, a sixth window matching the sixth input area of ​​the target input device is displayed in the seventh area of ​​the target display area, and the seventh area has a sixth mapping relationship with the sixth input area;

[0031] The first input area may include or exclude the second input area.

[0032] In some modified implementations of the first aspect of the present disclosure, controlling the display of the target window based on the input data acting on the input area includes at least one of the following:

[0033] Controlling display content and / or display parameters of the target window based on input content data and / or input behavior data acting on the first input area of ​​the target input device;

[0034] Controlling display content and / or display parameters of the target window based on input content data and / or input behavior data acting on a second input area of ​​the target input device;

[0035] controlling display content and / or display parameters of the target window based on input data acting on the input area and configuration information of the pen device generating the input data;

[0036] Controlling display content and / or display parameters of the target window based on the input data acting on the input area and the user profile information of the user of the generated input data;

[0037] The first input area of ​​the target input device may include or exclude the second input area.

[0038] In some modified implementations of the first aspect of the present disclosure, controlling the display of the target window based on the input data acting on the input area includes at least one of the following:

[0039] When a second position relationship is detected between the pen device and the touch panel of the electronic device, the target window is controlled to display a first icon indicating that the pen device is in a suspended state, wherein the second position relationship indicates that the pen device and the touch panel are in a contact and stationary state;

[0040] When it is detected that the pen device and the touch panel of the electronic device switch from the second position relationship to a relative motion state, control the pen device to switch from a suspended state to a writing state to output writing traces in the target window, wherein the relative motion state is a state in which the pen device moves on the surface of the touch panel;

[0041] After detecting that the pen device has moved out of the target window, displaying a cursor representing the position of the pen device in the target display area;

[0042] The display content and / or display parameters of the target window are controlled based on the pen device configuration mode information and the input content data and / or input behavior data acting on the input area.

[0043] In some modified implementations of the first aspect of the present disclosure, at least one of the following is also included:

[0044] Obtaining running application information of the electronic device, and performing corresponding processing on the display content of the target window based on the running application information, so as to provide the processed target data to the corresponding target application;

[0045] The relative position relationship between the application window of the target application and the target window is obtained, and the display content in the target window is given to the target application based on a processing method that matches the relative position relationship.

[0046] A second aspect of the present disclosure provides an electronic device, comprising a processor, a touch panel and a display screen connected to the processor signal, wherein the processor is capable of:

[0047] In response to the target trigger event, controlling the electronic device to enter a first usage mode so as to display a target window matching the touch area of ​​the touch pad on the display screen; and

[0048] The display parameters of the target window are controlled based on the touch data of the target pen device acting on the touch area.

[0049] A third aspect of the present disclosure provides a pen device, comprising a first body and a second body that are detachably connected;

[0050] The first body is provided with an audio module and a first power supply module for supplying power to the audio module, and the audio module can collect voice data of the first user;

[0051] The second body is provided with a writing part, which can perform a writing operation on the touch panel of the electronic device under the operation of the second user, and the writing operation can trigger the electronic device to obtain touch data;

[0052] The pen device is capable of sending voice data to the electronic device, and the first user object is the same as or different from the second user object.

[0053] In some modified implementations of the third aspect of the present disclosure, at least one of the following is also included:

[0054] At least one communication module is disposed in the first body, the at least one communication module is connected to the first power supply module, and is at least used to send audio data to the electronic device;

[0055] A second power supply module and a control circuit are provided in the second body, the second power supply module is used to supply power to the control circuit and the writing part, the control circuit can control the writing parameters of the writing part, and the first power supply module can supply power to the second power supply module;

[0056] The connection structure provided at the connection between the first body and the second body is used to realize a detachable connection between the first body and the second body. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] By reading the detailed description below with reference to the accompanying drawings, the above and other purposes, features and advantages of the exemplary embodiments of the present disclosure will become readily understood. In the accompanying drawings, several embodiments of the present disclosure are shown in an exemplary and non-limiting manner, and the same or corresponding reference numerals represent the same or corresponding parts, wherein:

[0058] Figure 1 The flowchart of the control method of the electronic device in Embodiment 1 is schematically shown;

[0059] Figure 2 The flowchart of the control method of the electronic device in the second embodiment is schematically shown;

[0060] Figure 3 The flowchart of the control method of the electronic device in the third embodiment is schematically shown;

[0061] Figure 4 Schematically shows a schematic diagram of the internal structure of a pen device;

[0062] Figure 5 A schematic diagram of the structure of a positioning block of a pen device is schematically shown;

[0063] Figure 6 Schematically shows a structural diagram of a first body of a pen device;

[0064] Figure 7 Schematically shows a structural diagram of a second body of a pen device;

[0065] Description of Figure Numbers:

[0066] 1. First body; 11. Audio module; 12. First power supply module; 13. First conductive connector; 14. Guide groove; 2. Second body; 21. Second power supply module; 22. Second conductive connector; 23. Positioning block; 24. Groove. DETAILED DESCRIPTION

[0067] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0068] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in the present disclosure should have the common meanings understood by those skilled in the art to which the present disclosure belongs.

[0069] Example 1

[0070] When handwriting input into a computer, an external digital tablet is generally required. The hand-drawn content on the digital tablet will be displayed synchronously on the computer monitor, thus completing the handwriting input.

[0071] A digital tablet generally requires a driver CD or a dedicated driver. When using it, you need to first install the dedicated driver, then connect a hand-drawn touchpad to the computer, and use the hand-drawn touchpad and drawing software to input handwriting to the computer.

[0072] Since digital tablets generally require dedicated drivers, they have a narrow scope of application and are inconvenient to use.

[0073] In order to solve the above technical problems, the present disclosure provides a control method of an electronic device, which can more conveniently perform handwriting input in the electronic device and improve the application scope of handwriting input.

[0074] like Figure 1 As shown, a control method of an electronic device comprises the following steps:

[0075] Step S110: responding to a target triggering event;

[0076] The target triggering event is an event that triggers the electronic device to enter the first usage mode. Specifically, the target triggering event is generated by at least one of the following:

[0077] An operation of configuring a switch state of a first control on a first target application interface of an electronic device;

[0078] A trigger operation acting on a target key of the electronic device, the target key comprising a single physical key or a combination of physical keys disposed on the body of the electronic device;

[0079] Target instruction data is collected and / or recognized by target sensors;

[0080] Detecting that the electronic device is running a second target application;

[0081] Identify the operational requirements or user profile information of the target user;

[0082] It is detected that the electronic device establishes a communication connection with an external target input / output device;

[0083] Detecting that a first positional relationship exists between a pen device disposed in a storage position of the electronic device and the electronic device;

[0084] Obtaining target intent through context information in a third target application;

[0085] The electronic device is detected to switch to the target device form.

[0086] More specifically, the operation of configuring the switch state of the first control acting on the first target application interface of the electronic device can be any event that triggers the electronic device to enter the first usage mode, such as turning on the first usage mode through a control switch or gesture in a smart note application or a drawing application, or triggering the first usage mode through voice control instructions, gesture control instructions, etc. in a smart note application or a drawing application, so as to facilitate the user to perform handwriting input after opening the application. More specifically, the gesture control instruction can be to draw along the diagonal line of the touchpad, or to draw a circle; more specifically, the first usage mode can also be exited through a gesture control instruction, for example, the entire palm can be pressed on the touchpad to exit the first usage mode, and the content in the writing box can be automatically saved after exiting the first usage mode. More specifically, you can handwrite in the input area, and the content in the input area is displayed in the target window, and then the text in the target window is converted into input text and entered into the smart note.

[0087] More specifically, the target key includes a single physical key or a combination of physical keys arranged on the body of the electronic device. Specifically, the target key can be used by the user to trigger the first use mode by pressing the keyboard combination 1, 2, 3 keys at the same time, or by using special physical keys such as hot keys and dedicated shortcut keys to trigger the first use mode, thereby adapting to the habits of users who like to control the computer with the keyboard.

[0088] More specifically, the target sensors include cameras, microphones, radars, and the like. More specifically, the first usage mode can be triggered by various voices such as "handwriting" and "entering handwriting mode" captured by the microphone; more specifically, the first usage mode can be triggered by a specific gesture on the notebook touchpad, for example, the first usage mode can be triggered by detecting a gesture sliding across the diagonal of the touchpad. More specifically, the first usage mode can be triggered by a user portrait captured by the camera or by a specific gesture. More specifically, the radar sensor can be a TOF (Time of Flight) sensor, which directly triggers the first usage mode after detecting a user portrait or a specific user gesture.

[0089] More specifically, the second target application includes smart note, drawing application, raw image application, etc. The opening of smart note, drawing application, raw image application, etc. indicates that the user needs to use drawing or handwriting input. After detecting that these applications are opened, the first use mode is directly triggered, and the user can directly draw or handwrite input, which is more convenient to use.

[0090] More specifically, identifying the operation needs or user profile information of the target user means that the first usage mode can be triggered when it is identified that the user is a child or an elderly person, or a person with a specific user profile is using the computer; children generally like to draw in handwriting mode, and the elderly are generally not used to keyboard input, but are used to handwriting input, and children and the elderly are generally not good at operating computers. By identifying that the user is a child or an elderly person, the first usage mode is triggered, which improves the convenience of operation for children or the elderly. Of course, there are other people who are used to handwriting operations, and the first usage mode can be triggered when the user is identified as a specific user profile.

[0091] More specifically, the target input / output device includes an external touch panel, a writing tablet, a drawing tablet, an external expansion screen, etc. When the connection with the external touch panel, writing tablet, drawing tablet or external expansion screen is for handwriting input of text or drawing, the connection with the external touch panel, writing tablet, drawing tablet or external expansion screen is detected, triggering the entry into the first use mode, which can facilitate writing detection to establish a communication connection between the electronic device and the external target input / output device.

[0092] More specifically, the detection of the first position relationship between the pen device disposed in the storage position of the electronic device and the electronic device may be the detection of the electronic device establishing a connection with the target pen device or the detection of the target pen device being taken out of its storage compartment; in addition, for the electronic device equipped with the first position sensing system, the first use mode may also be triggered when the pen tip touches the touch pad. The establishment of a connection with the target pen device, the taking out of the target pen device from its storage compartment, and the contact of the pen tip with the touch pad may all determine that the target pen device is about to be used for writing, and at this time the first use mode is entered for convenience of the user.

[0093] More specifically, obtaining the target intent through the context information in the third target application can be triggered based on the context information in the social application, that is, identifying the user intent to trigger the first usage mode; for example, the words "handwriting", "typing is too slow", and "I'll draw a picture for you" in the social application can be detected to identify that the user may want to perform handwriting input, and then enter the first usage mode for user convenience.

[0094] More specifically, the first usage mode is triggered when the electronic device is detected to be switched to the target device form. For example, the Lenovo Twist notebook (a Lenovo notebook model) has the back side A for handwriting, and the first usage mode is triggered after the A side is rotated 180 degrees, which is convenient for users to quickly write by hand.

[0095] Step S120: controlling the electronic device to enter the first usage mode to display the target window in the target display area;

[0096] The first usage mode is a touch pad pen mode, in which the target display area displays a target window, and the display of the target window is controlled based on input data acting on the input area.

[0097] The target display area is an area for displaying the target window. Specifically, the target display area can be a display screen and / or an external extended screen provided on the electronic device body. As long as the target display area can display the target window, the specific structure and type of the target display area are not limited.

[0098] The target window is a window that matches the input area of ​​the target input device of the electronic device. Specifically, the target window can be an application window, a pop-up window, an interface window, etc. More specifically, the target window can be an OSD (On-Screen Display, screen menu adjustment mode) pop-up window, and the OSD pop-up window will disappear automatically without the user manually closing it, which is more convenient for operators to use. More specifically, the target window can be a window that matches the entire input area of ​​the target input device, or a window that matches part of the input area. The target window can be a fixed window that does not determine the matching input area by type and / or source, that is, as long as the first use mode is entered, the preset target window is displayed, and the preset target window can be displayed at a specified position or a specified size; the target window can also be a window that determines the matching input area by type and / or source, which is more flexible to use. More specifically, the size of the target window can be set to the same size as the touchpad to facilitate writing. The size of the target window can also be in a set ratio with the touchpad; for example, the size of the target window can be enlarged twice in proportion to facilitate drawing detailed pictures. More specifically, the target window can be transparent and framed to avoid blocking the desktop content.

[0099] The target input device refers to the input device used by the user to interact with the electronic device. Specifically, the target input device can be a touchpad, keyboard, camera, radar, and TOF (Time of Flight) configured in the electronic device itself; it can also be an external touchpad, writing board, keyboard, camera, etc. For example, the camera can be used to collect the user's gestures and then display them in the target window; more specifically, the user can draw a circle facing the camera, and then the target window will display a circle; more specifically, the input area of ​​the target input device includes the operation area of ​​the touchpad, keyboard, writing board, the field of view angle area or detection area of ​​the camera, radar, TOF, etc.

[0100] Controlling the electronic device to enter a first usage mode to display a target window in a target display area includes:

[0101] Obtaining the type and / or source of a target triggering event;

[0102] controlling the target display area to display a target window matching a target input area of ​​a target input device based on the type and / or source;

[0103] The target display area belongs to or does not belong to the electronic device.

[0104] The type and / or source of the target trigger event refers to what kind of operation or what kind of change information the target trigger event is generated from, such as the user actively or the device passively receives the user's instruction to switch modes, that is, the operation event of entering the first use mode; or the device actively monitors or detects specific information changes, such as IO interface (input / output interface) information changes, device communication status changes, device operation object changes, etc.

[0105] Specifically, when the target display area is controlled based on type and / or source to display a target window that matches the target input area of ​​the target input device, the windows corresponding to different types or sources may be the same or different. More specifically, when the electronic device detects that it is connected to an external touch panel or drawing board, a larger target window may be opened to more clearly display the user's writing traces and facilitate the user's drawing; when the electronic device detects that the smart note is turned on to trigger the first usage mode, a smaller target window may be opened to avoid blocking the content in the smart note document; when the electronic device detects that the drawing software is turned on to trigger the first usage mode, the same target window as when the connection with the drawing board is detected may be opened to facilitate the user's drawing. That is, the target window can be selected according to the function required by the user, and target trigger events of different types and / or sources that implement the same function can select the same target window, so that the target window can be more flexibly adapted to various software that implement different functions.

[0106] Controlling the electronic device to enter the first usage mode to display the target window in the target display area also includes at least one of the following:

[0107] In response to the electronic device entering the first use mode, the entire target display area of ​​the electronic device or a first area is used as a window area of ​​the target window, and a target mapping relationship exists between the window area and the input area of ​​the target input device;

[0108] In the case where the target trigger event is generated by a trigger operation acting on the electronic device, a first window matching the first input area of ​​the target input device is displayed in a second area of ​​the target display area, and the second area has a first mapping relationship with the first input area;

[0109] In the case where the target trigger event is generated from the obtained target instruction data or the running second target application, displaying a second window matching the second input area of ​​the target input device in a third area of ​​the target display area, the third area having a second mapping relationship with the second input area;

[0110] In the case where the target trigger event is generated from the identified operation requirement or user portrait information, a third window matching the third input area of ​​the target input device is displayed in a fourth area of ​​the target display area, and the fourth area has a third mapping relationship with the third input area;

[0111] In the case where the target trigger event is generated by the electronic device establishing a communication connection with the external input / output device, a fourth window matching the fourth input area of ​​the target input device is displayed in the fifth area of ​​the target display area, and the fifth area has a fourth mapping relationship with the fourth input area;

[0112] In the case where the target trigger event is generated from a first positional relationship between the electronic device and the pen device, a fifth window matching the fifth input area of ​​the target input device is displayed in a sixth area of ​​the target display area, and the sixth area has a fifth mapping relationship with the fifth input area;

[0113] When the electronic device is switched to the first device form, a sixth window matching the sixth input area of ​​the target input device is displayed in the seventh area of ​​the target display area, and the seventh area has a sixth mapping relationship with the sixth input area;

[0114] The first input area may include or exclude the second input area.

[0115] Specifically, using the entire or first area of ​​the target display area of ​​the electronic device as the window area of ​​the target window means that the entire or part of the display screen can be used as a mapped display area for input devices such as a touchpad or writing board; for example, when the target window interacts with painting software, the entire display screen can be used as a mapped display area for input devices such as a touchpad, writing board or drawing board to more clearly display the painting pattern; when the target window interacts with text input software, part of the display screen can be used as a mapped display area for input devices such as a touchpad, writing board or drawing board to avoid blocking the document content.

[0116] Specifically, in the case where the target trigger event is generated by a trigger operation acting on the electronic device, displaying the first window matching the first input area of ​​the target input device in the second area of ​​the target display area means that when the switch state of the first control configured on the first target application interface of the electronic device and the trigger operation on the target key trigger the first use mode, the first window matching the first input area of ​​the target input device is displayed in the second area of ​​the target display area. For example, when the first use mode is turned on by a control switch or gesture in the smart note application, the first window can be displayed in the second area of ​​the display screen of the electronic device.

[0117] Specifically, the target trigger event is generated from the obtained target instruction data or the running second target application. The target sensor detects specific data, for example, the microphone collects specific voice, or detects the running of the second target application such as smart note, drawing application, raw image application, etc. At this time, the first usage mode is triggered, and the second window can be displayed in the third area of ​​the display screen of the electronic device.

[0118] The target trigger event is generated by the identified operation requirements or user portrait information. The case may be when it is identified that the device is used by a child or an elderly person, or a person with a specific user portrait. At this time, the first usage mode is triggered and the third window can be displayed in the fourth area of ​​the display screen of the electronic device.

[0119] The target trigger event is generated when the electronic device establishes a communication connection with an external input / output device. The target trigger event is generated when it is detected that the electronic device has established a communication connection with an external input / output device such as an external touch panel, writing tablet, drawing tablet and external expansion screen. At this time, the first usage mode is triggered, and the fourth window can be displayed in the fifth area of ​​the display screen of the electronic device.

[0120] The target trigger event is generated by the situation where the electronic device and the pen device have a first positional relationship, which can be detecting that the electronic device establishes a connection with the target pen device or detecting that the target pen device is taken out of its storage compartment. At this time, the first usage mode is triggered, and the fifth window can be displayed in the sixth area of ​​the display screen of the electronic device.

[0121] The electronic device switches to the first device form when the Lenovo Twist notebook rotates the A side 180 degrees, which triggers the first use mode, and the sixth window can be displayed in the seventh area of ​​the display screen of the electronic device. Different trigger events correspond to the same or different input areas and are displayed at different positions in the display area, which can facilitate users to select the position of their preferred target window through different trigger events, making it more convenient to use.

[0122] The first input area includes or does not include the second input area, which means that the first input area can be the entire input area of ​​the target input device, that is, including the second input area; it can also be a partial input area, which may not include the second input area, and the two can be two connected areas or two non-connected areas.

[0123] Step S130: controlling the display of the target window based on the input data acting on the input area;

[0124] Input data includes input content data and / or input behavior (operation) data. Specifically, input content data refers to the actual information provided by the user to the device through various input devices. These data directly reflect the specific content that the user wants to convey to the system. Input content data can be written strings, strokes, handwriting thickness, or even voice, etc. Input behavior (operation) data refers to the behavioral characteristics of the user when interacting with the device. These data usually do not directly reflect the input content, but focus on the process of how the user performs input, such as keystroke speed, click frequency, touch pressure, gesture recognition, movement trajectory, dwell time, suspension, pen drop, etc.

[0125] The display of the target window includes display content, display size, display refresh rate, display theme color, display position, etc.

[0126] Controlling the display of the target window based on the input data applied to the input area includes at least one of the following:

[0127] Controlling display content and / or display parameters of the target window based on input content data and / or input behavior data acting on the first input area of ​​the target input device;

[0128] Controlling display content and / or display parameters of the target window based on input content data and / or input behavior data acting on a second input area of ​​the target input device;

[0129] controlling display content and / or display parameters of the target window based on input data acting on the input area and configuration information of the pen device generating the input data;

[0130] Controlling display content and / or display parameters of the target window based on the input data acting on the input area and the user profile information of the user of the generated input data;

[0131] The first input area of ​​the target input device may include or exclude the second input area.

[0132] Specifically, the display content is the original content corresponding to the character string or writing trajectory or strokes, or the converted content, or the content generated based on the original input and the generation model; the display parameters mainly reflect the display position, display size, display color, style, refresh rate, transparency, etc.

[0133] Specifically, the configuration information of the pen device includes the type of the pen device and the configuration mode of the pen device; more specifically, the types of pen devices include active pens and passive pens. The active pen communicates by sending signals to the screen, and the passive pen is identified by changing the capacitive field on the screen. The configuration modes of the pen device include brush mode, pencil mode, fountain pen mode, paintbrush mode, recording pen mode, etc. Different display contents and / or display parameters of the target window can be controlled according to the type of pen and the configuration mode of the pen. In different pen modes, the display contents and display parameters of the target window can be different. Users can flexibly select different pen types and pen modes according to their needs, which is more functional and more convenient for users to use.

[0134] Specifically, based on the input data acting on the input area and the user portrait information of the user of the generated input data, the display content and / or display parameters of the target window can be controlled to control the window display according to the usage habits and preferences of different users. For example, the elderly have poor eyesight and are accustomed to using large window displays. A larger display window can be selected based on the portrait information of the elderly user; for example, if children like colors, colored handwriting can be selected based on the portrait information of the child user. Controlling the window display according to the usage habits and preferences of different users makes it more convenient for users to use.

[0135] The first input area includes or does not include the second input area, which also means that the first input area can be the entire input area of ​​the target input device, that is, including the second input area; it can also be a partial input area, which may not include the second input area, and the two can be two connected areas or two non-connected areas.

[0136] In some modified implementations of the first aspect of the present disclosure, controlling the display of the target window based on the input data acting on the input area includes at least one of the following:

[0137] When a second position relationship is detected between the pen device and the touch panel of the electronic device, the target window is controlled to display a first icon indicating that the pen device is in a suspended state, wherein the second position relationship indicates that the pen device and the touch panel are in a contact and stationary state;

[0138] When it is detected that the pen device and the touch panel of the electronic device switch from the second position relationship to a relative motion state, control the pen device to switch from a suspended state to a writing state to output writing traces in the target window, wherein the relative motion state is a state in which the pen device moves on the surface of the touch panel;

[0139] After detecting that the pen device has moved out of the target window, displaying a cursor representing the position of the pen device in the target display area;

[0140] The display content and / or display parameters of the target window are controlled based on the pen device configuration mode information and the input content data and / or input behavior data acting on the input area.

[0141] Specifically, the floating state is a state in which the icon is displayed in the target window but does not leave any trace in the target window. The first icon may be a circular icon or a triangular icon.

[0142] When the second position relationship is detected between the pen device and the touchpad of the electronic device, the target window is controlled to display the first icon of the pen device in a suspended state, and the second position relationship represents that the pen device and the touchpad are in contact and stationary state; that is, when the pen device and the touchpad are in contact and stationary state, the target window displays the first icon of the pen device in a suspended state, and at this time, only a flashing point is displayed in the target window without leaving any trace. When the second position relationship between the pen device and the touchpad of the electronic device is detected to switch to a relative motion state, the pen device is controlled to switch from the suspended state to the writing state, so as to output the writing traces in the target window. For example, when drawing, you can first make the pen device in contact with the touchpad and stationary. At this time, the target window displays the first icon of the pen device in a suspended state, and no trace will be left in the target window. If the point found is accurate, you can control the pen device to move on the surface of the touchpad, so as to switch the suspended state to the writing state to output the writing handwriting in the target window; if the point found is inaccurate, you can control the pen device to leave the control board, and at this time, no trace will be left in the target window; then you can control the pen device to be in contact with the touchpad and stationary again to find the accurate point position. By setting the suspended state, it is convenient for users to find the accurate point position in the target window position, so that users can draw relatively accurate drawings, avoid repeated point finding and repeated corrections, and improve user work efficiency.

[0143] After detecting that the pen device has moved out of the target window, a cursor representing the position of the pen device is displayed in the target display area. On the one hand, this allows the user to move the pen device back to the target window and find the exact position of the pen device after the user accidentally moves the pen out of the target window. On the other hand, the pen device becomes a cursor after detecting that it has moved out of the target window, which also allows the user to directly operate the mouse on the target input device.

[0144] The present disclosure controls the electronic device to enter the first use mode to display the target window in the target display area in response to the target trigger event, so that the display of the target window can be controlled based on the input data acting on the input area to realize handwriting input on the computer. Data can be input to the target window in various ways such as a touch pad, and the target window can be interactively used with multiple applications, and there is no need to install a special driver and a digital tablet, which gets rid of the limitation that the digital tablet can only be input through a specific driver, and improves the scope of application and convenience of handwriting input.

[0145] Example 2

[0146] like Figure 2 As shown, this embodiment is different from other embodiments in that it also includes:

[0147] Step S140: obtaining the running application information of the electronic device, and performing corresponding processing on the display content of the target window based on the running application information, so as to provide the processed target data to the corresponding target application;

[0148] The running application information of the electronic device refers to the type information of the running application. Specifically, the running application can be a document application, a drawing application, or a raw image application. The processing process can be a conversion process, saving the processing of the original data or not processing, or calling a large model for generative processing. The target data obtained after processing can be the original writing or drawing data, or it can be the converted data, which is processed according to the application type and requirements.

[0149] More specifically, if it is a document application, it may be necessary to perform graphics-to-text processing to give the processed text data to the corresponding document application; if it is a drawing application, it may not be processed or the original data may be saved, and then the original handwriting image may be directly given to the corresponding application; if it is a raw image application, the display content of the target window may be processed generatively, such as by processing through a raw image model to obtain the generated target image data, and this data may be given to the corresponding raw image reference. More specifically, if it is a document application, such as a word document, chat software, and smartnote, etc., the target window may be dragged into the writing input method of the electronic device system and then handwriting input may be performed directly.

[0150] By obtaining the running application information of the electronic device, the display content of the target window is processed accordingly based on the running application information, so that the processed target data is given to the corresponding target application, so that the target window and various types of applications can be used interactively, thereby realizing multiple functions, further improving the scope of application and convenience of handwriting input.

[0151] Example 3

[0152] like Figure 3 As shown, this embodiment is different from other embodiments in that it also includes:

[0153] Step S140: obtaining the relative position relationship between the application window of the target application and the target window, and providing the display content in the target window to the target application based on a processing method that matches the relative position relationship.

[0154] Specifically, if the target application is a drawing application or a raw image application, and there is an overlapping area between the application window of the target application and the target window, the display content in the target window can be directly given to the application window of the target application through mapping; if there is no overlap, it is necessary to consider sending it after conversion. By giving the display content in the target window to the target application based on a processing method that matches the relative position relationship, the display content in the target window can be given to the application window of the target application more quickly, thereby facilitating the user to further process the display content through the application window of the target application. More specifically, at this time, the target window can be a transparent window to avoid blocking the application window.

[0155] Example 4

[0156] An electronic device includes a processor, a touch panel and a display screen connected to the processor signal, wherein the processor is capable of:

[0157] In response to a target trigger event, controlling the electronic device to enter a first usage mode to display a target window matching the touch area of ​​the touch panel on the display screen; and

[0158] The display parameters of the target window are controlled based on the touch data of the target pen device acting on the touch area.

[0159] The present disclosure controls the electronic device to enter the first use mode to display the target window in the target display area in response to the target trigger event, so that the display of the target window can be controlled based on the input data acting on the input area to realize handwriting input on the computer. Data can be input to the target window in various ways such as a touch pad, and the target window can be used interactively with multiple applications, thus getting rid of the limitation that the digital tablet can only be input through a specific driver, and improving the scope of application and convenience of handwriting input.

[0160] Example 5

[0161] Some existing voice recorders are similar in appearance to traditional writing pens, and have integrated recording functions. The design of such products usually places the recording device inside the pen barrel, while the pen tip retains the normal writing function, and the pen tip can be used for writing.

[0162] However, when the voice recorder is used in classrooms, training rooms, conference rooms and other places where the recording distance is far, the voice recorder needs to be placed next to the lecturer. In this way, the tip of the voice recorder cannot be used to write during recording, which is very inconvenient.

[0163] In order to solve the above technical problems, a pen device is proposed to achieve writing while recording at a long distance, thereby improving convenience.

[0164] like Figure 4 , Figure 5 , Figure 6 and Figure 7 As shown, a pen device comprises a first body 1 and a second body 2 which are detachably connected;

[0165] The first body 1 is provided with an audio module 11 and a first power supply module 12 for supplying power to the audio module 11. The audio module 11 can collect voice data of the first user;

[0166] The second body 2 is provided with a writing part, which can perform a writing operation on the touch panel of the electronic device under the operation of the second user, and the writing operation can trigger the electronic device to obtain touch data;

[0167] The pen device is capable of sending voice data to the electronic device, and the first user object is the same as or different from the second user object.

[0168] Specifically, the first power supply module 12 can be any device capable of supplying power, such as a battery or a capacitor. The audio module 11 can also output audio data sent by the electronic device via Bluetooth, that is, a speaker can be integrated; more specifically, the audio module 11 can be a Bluetooth speaker, which has a built-in Bluetooth receiving module and can be paired with a Bluetooth-enabled device and transmit audio. The writing operation refers to an operation that generates a writing track, or a hovering operation in a suspended state, or other operations.

[0169] The pen device can be a passive pen or an active pen. In the case of a passive pen, the touch panel of the electronic device is triggered to generate touch data based on the input and writing operation so that the processor of the electronic device can obtain it; in the case of an active pen, the touch panel can sense the input and writing operation to generate corresponding touch data, or the active pen can automatically generate touch data and send it to the electronic device.

[0170] The pen device can establish a communication connection with the electronic device through Bluetooth or other communication modules to send collected voice data to the electronic device or receive audio data sent by the electronic device.

[0171] The first user is a user wearing the first body 1 or holding the first body 1. The first user and the second user may be the same or different, that is, the pen device may be given to one person or two people for simultaneous use.

[0172] The present invention connects a detachably connected first body 1 and a second body 2, and provides an audio module 11 and a first power supply module 12 for supplying power to the audio module 11 in the first body 1, so that the first body 1 can independently record and the second body 2 can independently write. Therefore, when the recording pen is used in classrooms, training rooms, conference rooms and other places where the recording distance is far, after placing the recording pen next to the lecturer, the writing part can also be used for writing, thereby improving the convenience of the pen-type device.

[0173] The pen device further includes at least one communication module disposed in the first body 1, the at least one communication module being connected to the first power supply module 12 and being at least used to send the audio data to the electronic device;

[0174] Specifically, the first power supply module 12 may be connected via a communication module such as Bluetooth, so that the audio data collected by the communication module is sent to the electronic device for easy storage and use.

[0175] The pen device further includes a second power supply module 21 and a control circuit disposed on the second body 2, wherein the second power supply module 21 is used to supply power to the control circuit and the writing part, wherein the control circuit can control the writing parameters of the writing part, and the first power supply module 12 can supply power to the second power supply module 21;

[0176] Specifically, the first power supply module can be a battery, the second power supply module can be a rechargeable capacitor, and specifically, the second power supply module can be an EDLC (electric double layer capacitor). When the first body 1 and the second body 2 are connected together, the first power supply module 12 and the second power supply module 21 are electrically connected, so as to charge the second power supply module 21. Setting the first power supply module 12 and the second power supply module 21 in this way can save the space occupied by the battery on the one hand, and on the other hand, it is only necessary to charge the first power supply module 12, which is also convenient for charging the pen device.

[0177] More specifically, the first power supply module 12 and the second power supply module 21 can be connected through the first conductive connector 13 and the second conductive connector 22; more specifically, as Figure 6 and Figure 7 As shown, the first conductive connector 13 can be a connector block, and the second conductive connector 22 can be a connector slot. The first conductive connector 13 can be arranged at one end of the first body 1, and the second conductive connector 22 can be arranged at one end of the second body 2. The first conductive connector 13 and the second conductive connector 22 cooperate to achieve electrical connection between the first power supply module 12 and the second power supply module 21.

[0178] An end cover may also be provided on the first body 1 , the end cover seals the first end of the recording portion, and a hole is provided on the end cover, and the first conductive connector 13 passes through the hole to connect with the second conductive connector 22 .

[0179] The pen device further includes a connection structure disposed at a connection point between the first body 1 and the second body 2 , for realizing a detachable connection between the first body 1 and the second body 2 .

[0180] Specifically, the connection structure can be in various forms, such as magnetic parts, threaded parts and clip parts. That is, the first body 1 and the second body 2 can be threadedly connected, connected by two magnetic parts respectively arranged at one end of the first body 1 and the second body 2. More specifically, the clip part can be a combination of an annular clip part and a slot similar to the connection between the pen tip and the pen cap, or other clip forms. Figure 5 As shown, the clamping member may be composed of a guide groove 14 and a positioning block 23, wherein the guide groove 14 is arranged at a set position corresponding to the first conductive plug connector 13; the guide groove 14 is arranged at a set position corresponding to the second conductive plug connector 22; a protrusion is arranged in the guide groove 14, and a groove 24 is arranged on one side of the positioning block 23, and the groove 24 matches the protrusion. Thus, positioning and connection are taken into consideration, and the first conductive member and the second conductive member can be accurately connected together while the first body 1 and the second body 2 are connected.

[0181] The pen device can be used interactively with the electronic device. For example, when a second position relationship is detected between the pen device and the touch pad of the electronic device, the target window is controlled to display a first icon of the pen device in a suspended state, wherein the second position relationship indicates that the pen device and the touch pad are in contact and stationary state.

[0182] When it is detected that the pen device and the touch panel of the electronic device switch from the second position relationship to a relative motion state, control the pen device to switch from a suspended state to a writing state to output writing traces in the target window, wherein the relative motion state is a state in which the pen device moves on the surface of the touch panel;

[0183] After detecting that the pen device has moved out of the target window, displaying a cursor representing the position of the pen device in the target display area;

[0184] The display content and / or display parameters of the target window are controlled based on the pen device configuration mode information and the input content data and / or input behavior data acting on the input area.

[0185] Specifically, the floating state is a state in which the icon is displayed in the target window but does not leave any trace in the target window. The first icon may be a circular icon or a triangular icon.

[0186] When the second position relationship is detected between the pen device and the touchpad of the electronic device, the target window is controlled to display the first icon of the pen device in a suspended state, and the second position relationship represents that the pen device and the touchpad are in contact and stationary state; that is, when the pen device and the touchpad are in contact and stationary state, the target window displays the first icon of the pen device in a suspended state, and at this time, only a flashing point is displayed in the target window without leaving any trace. When the second position relationship between the pen device and the touchpad of the electronic device is detected to switch to a relative motion state, the pen device is controlled to switch from the suspended state to the writing state, so as to output the writing traces in the target window. For example, when drawing, you can first make the pen device and the touchpad in contact and static state. At this time, the target window displays the first icon of the pen device in suspended state, and no trace is left in the target window. If the point is found accurately, you can control the pen device to move on the surface of the touchpad, so as to switch the suspended state to the writing state to output the writing handwriting in the target window; if the point is not found accurately, you can control the pen device to leave the control board, and at this time, no trace is left in the target window; then you can control the pen device and the touchpad to be in contact and static state again to find the accurate point position. By setting the suspended state, it is convenient for users to find the accurate point position in the target window position, so that users can draw relatively accurate drawings, avoid repeated point finding and repeated corrections, and improve user work efficiency.

[0187] After detecting that the pen device has moved out of the target window, a cursor representing the position of the pen device is displayed in the target display area. On the one hand, this allows the user to move the pen device back to the target window and find the exact position of the pen device after the user accidentally moves the pen out of the target window. On the other hand, the pen device becomes a cursor after detecting that it has moved out of the target window, which also allows the user to directly operate the mouse on the target input device.

[0188] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, which should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for controlling an electronic device, comprising: In response to a target trigger event, controlling the electronic device to enter a first usage mode to display a target window in a target display area, wherein the target window is a window matching an input area of ​​a target input device of the electronic device; as well as, The display of the target window is controlled based on the input data applied to the input area.

2. The method according to claim 1, wherein: Controlling the electronic device to enter a first usage mode to display a target window in a target display area includes: Obtaining the type and / or source of a target triggering event; Controlling the target display area to display a target window matching a target input area of ​​the target input device based on the type and / or source; The target display area belongs to or does not belong to the electronic device.

3. The method according to claim 1 or 2, wherein: The target trigger event is generated by at least one of the following: An operation of configuring a switch state of a first control on a first target application interface of an electronic device; A trigger operation acting on a target key of an electronic device, wherein the target key includes a single physical key or a combination of physical keys disposed on a body of the electronic device; Target instruction data is collected and / or recognized by target sensors; Detecting that the electronic device is running a second target application; Identify the operational requirements or user profile information of the target user; It is detected that the electronic device establishes a communication connection with an external target input / output device; detecting that a pen device disposed in a storage position of the electronic device has a first positional relationship with the electronic device; Obtaining target intent through context information in a third target application; The electronic device is detected to switch to the target device form.

4. The method according to claim 1, wherein: Controlling the electronic device to enter the first usage mode to display a target window in the target display area includes at least one of the following: In response to the electronic device entering the first use mode, the entire target display area or a first area of ​​the electronic device is used as the window area of ​​the target window, and there is a target mapping relationship between the window area and the input area of ​​the target input device; In the case where the target trigger event is generated by a trigger operation acting on the electronic device, a first window matching the first input area of ​​the target input device is displayed in a second area of ​​the target display area, and the second area has a first mapping relationship with the first input area; In a case where the target trigger event is generated from the obtained target instruction data or the running second target application, displaying a second window matching the second input area of ​​the target input device in a third area of ​​the target display area, the third area having a second mapping relationship with the second input area; In the case where the target trigger event is generated by the identified operation requirement or user portrait information, a third window matching the third input area of ​​the target input device is displayed in a fourth area of ​​the target display area, and the fourth area has a third mapping relationship with the third input area; In the case where the target trigger event is generated by the electronic device establishing a communication connection with an external input / output device, a fourth window matching a fourth input area of ​​the target input device is displayed in a fifth area of ​​the target display area, and the fifth area has a fourth mapping relationship with the fourth input area; In the case where the target trigger event is generated from a first position relationship between the electronic device and the pen device, a fifth window matching the fifth input area of ​​the target input device is displayed in a sixth area of ​​the target display area, and the sixth area has a fifth mapping relationship with the fifth input area; When the electronic device is switched to the first device form, a sixth window matching the sixth input area of ​​the target input device is displayed in the seventh area of ​​the target display area, and the seventh area has a sixth mapping relationship with the sixth input area; The first input area includes or does not include the second input area.

5. The method according to claim 1, wherein: Controlling the display of the target window based on the input data acting on the input area includes at least one of the following: Controlling display content and / or display parameters of the target window based on input content data and / or input behavior data acting on a first input area of ​​the target input device; Controlling display content and / or display parameters of the target window based on input content data and / or input behavior data acting on a second input area of ​​the target input device; controlling display content and / or display parameters of the target window based on input data acting on the input area and configuration information of a pen device generating the input data; Controlling the display content and / or display parameters of the target window based on the input data acting on the input area and the user portrait information of the user of the generated input data; The first input area of ​​the target input device may include or exclude the second input area.

6. The method according to claim 1 or 5, wherein: Controlling the display of the target window based on the input data acting on the input area includes at least one of the following: When a second position relationship is detected between the pen device and the touch panel of the electronic device, controlling the target window to display a first icon indicating that the pen device is in a suspended state, wherein the second position relationship indicates that the pen device and the touch panel are in a contact and stationary state; When it is detected that the pen device and the touch panel of the electronic device switch from the second position relationship to a relative motion state, control the pen device to switch from a suspended state to a writing state so as to output writing traces in the target window, wherein the relative motion state is a state in which the pen device moves on the surface of the touch panel; After detecting that the pen device has moved out of the target window, displaying a cursor representing the position of the pen device in the target display area; The display content and / or display parameters of the target window are controlled based on the pen device configuration mode information and the input content data and / or input behavior data acting on the input area.

7. The method according to claim 1, further comprising at least one of the following: Obtaining running application information of the electronic device, and performing corresponding processing on the display content of the target window based on the running application information, so as to provide the processed target data to the corresponding target application; The relative position relationship between the application window of the target application and the target window is obtained, and the display content in the target window is given to the target application based on a processing method matching the relative position relationship.

8. An electronic device comprising a processor, a touch panel and a display screen connected to the processor signal, wherein: The processor is capable of: In response to a target triggering event, controlling the electronic device to enter a first usage mode to display a target window matching the touch area of ​​the touch panel on the display screen; as well as The display parameters of the target window are controlled based on the touch data of the target pen device acting on the touch area.

9. A pen device comprising a first body and a second body that are detachably connected; The first body is provided with an audio module and a first power supply module for supplying power to the audio module, and the audio module is capable of collecting voice data of a first user object; The second body is provided with a writing part, and the writing part can perform a writing operation on the touch panel of the electronic device under the operation of the second user, and the writing operation can trigger the electronic device to obtain touch data; in, The pen device is capable of transmitting the voice data to an electronic device, and the first usage object is the same as or different from the second usage object.

10. The pen device according to claim 9, wherein: Also includes at least one of the following: at least one communication module disposed in the first body, the at least one communication module being connected to the first power supply module and at least used to send the audio data to the electronic device; A second power supply module and a control circuit are provided in the second body, the second power supply module is used to supply power to the control circuit and the writing part, the control circuit can control the writing parameters of the writing part, and the first power supply module can supply power to the second power supply module; The connection structure provided at the connection between the first body and the second body is used to realize a detachable connection between the first body and the second body.

Images