Touch pen, display equipment, control method and device of display equipment and electronic equipment system

Abstract

The invention relates to the technical field of electronic equipment, in particular to display equipment, a control method and device of the display equipment, a touch pen and an electronic equipment system. The display mode switching data is data determined by a touch pen matched with the display equipment in response to a holding gesture of a user; the display equipment is controlled to be switched to a display mode corresponding to the display mode switching data, and the display mode of the display equipment comprises at least one of a soft pen handwriting display mode, a hard pen handwriting display mode and a remote control mode.

Description

Technical Field

[0001] This disclosure relates to the field of terminal device technology, and more specifically, to a stylus and its control method, a display device, and an electronic device system. Background Technology

[0002] With technological advancements, touch-enabled display devices are finding increasingly widespread applications, such as in mobile phones, tablets, EEG devices, e-readers, and electronic writing tablets. The use of touch-enabled display devices has also led to the widespread adoption of styluses. Styluses interact with the display device through contact (e.g., clicking or swiping), but their functionality is relatively limited.

[0003] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0004] The purpose of this disclosure is to provide a stylus and its control method, display device, and electronic device system, thereby improving the ease of use of the stylus to at least a certain extent.

[0005] According to a first aspect of this disclosure, a method for controlling a display device is provided, the method comprising:

[0006] Acquire display mode switching data, wherein the display mode switching data is data determined by the stylus paired with the display device in response to the user's grip gesture;

[0007] The display device is controlled to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

[0008] In some embodiments of this disclosure, the display mode switching data includes touch data generated by the stylus in response to being held, and controlling the display device to switch to a display mode corresponding to the display mode switching data includes:

[0009] The grip gesture is determined based on the touch data;

[0010] Control the display device to switch to the display mode corresponding to the grip gesture.

[0011] In some embodiments of this disclosure, determining the grip gesture based on the display mode switching data includes:

[0012] Based on the touch data, the trigger area features of the stylus are determined, including the number of finger grip areas, the position of the finger grip areas, and the position of the hand grip area;

[0013] The grip gesture is determined by matching the trigger area features with preset features.

[0014] In some embodiments of this disclosure, the trigger area features are matched with preset features to determine the grip gesture, including:

[0015] When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture.

[0016] When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture;

[0017] When the trigger area features match the preset features of remote control grip, the grip gesture is determined to be a remote control grip gesture.

[0018] In some embodiments of this disclosure, the trigger area features are matched with preset features to determine the grip gesture, including:

[0019] When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are distributed in a ring around the stylus, the grip gesture is determined to be a pen grip gesture.

[0020] When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are spaced apart along the length direction of the stylus, the grip gesture is determined to be a soft pen grip gesture;

[0021] When the trigger area features include multiple finger trigger areas and palm trigger areas, the multiple finger trigger areas and palm trigger areas are located in the middle and rear part of the stylus, and the finger trigger areas and palm trigger areas are located on different sides of the stylus, the grip gesture is determined to be a remote control grip gesture.

[0022] In some embodiments of this disclosure, the display mode switching data acquired by the display device is Bluetooth data sent by the stylus.

[0023] In some embodiments of this disclosure, the display mode switching data includes a display mode switching instruction, and controlling the display device to switch to a display mode corresponding to the display mode switching data of the stylus includes:

[0024] In response to the display mode switching command, the display device is controlled to switch to the display mode corresponding to the display mode switching command.

[0025] In some embodiments of this disclosure, the display mode switching instruction acquired by the display device is either the coding data output by the stylus or Bluetooth data.

[0026] In some embodiments of this disclosure, the control method further includes:

[0027] Control the pairing of the display device and the stylus.

[0028] According to a second aspect of this disclosure, a stylus is provided, the stylus comprising:

[0029] Pen style;

[0030] A touch layer is disposed on the pen body. The touch layer has multiple touch units and a scanning circuit. The multiple touch units are used to generate touch data in response to the stylus being held. The scanning circuit is connected to the touch units and is used to scan and acquire the touch data.

[0031] The control device is electrically connected to the scanning circuit and communicatively connected to the corresponding display device, configured to send display mode switching data to the display device in response to the touch data.

[0032] In some embodiments of this disclosure, the touch layer includes multiple rows of touch units, each row of touch units includes multiple touch units arranged along a first direction, and the scanning circuit scans the touch units row by row, wherein the first direction is the length direction of the pen body.

[0033] In some embodiments of this disclosure, the control device includes:

[0034] A first control module is electrically connected to the touch unit and configured to generate the display mode switching data based on the touch data, wherein the display mode switching data includes a display mode switching instruction.

[0035] The first communication module is electrically connected to the first control module and is capable of communicating with the corresponding display device. It is configured to send the display mode switching command to the display device under the control of the first control module.

[0036] In some embodiments of this disclosure, the first communication module is a Bluetooth communication module or a coding signal generation module.

[0037] In some embodiments of this disclosure, the control device includes:

[0038] The first communication module is electrically connected to the touch unit and is capable of communicating with the corresponding display device. It is configured to send display mode switching data to the display device, wherein the display mode switching data includes touch data generated by the stylus in response to being held.

[0039] In some embodiments of this disclosure, the first communication module is a Bluetooth communication module.

[0040] In some embodiments of this disclosure, the pen body includes a pen tip and a pen body, and the touch layer at least partially covers the pen body.

[0041] In some embodiments of this disclosure, the touch layer is a capacitive touch layer or a resistive touch layer.

[0042] According to a third aspect of this disclosure, a method for controlling a stylus is provided for the aforementioned stylus, the method comprising:

[0043] Acquire touch data generated by multiple touch units in the touch layer in response to a grip;

[0044] Based on the touch data, display mode switching data is sent to the display device that is communicatively connected to the stylus. The display mode switching data is used to control the display device to switch display modes. The display modes of the display device include at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

[0045] In some embodiments of this disclosure, the display mode switching data includes a display mode switching instruction, which sends the display mode switching data to a display device communicatively connected to the stylus, including:

[0046] The grip gesture is determined based on the touch data;

[0047] The display mode switching command is determined based on the grip gesture;

[0048] Send the display mode switching command to the display device that is communicatively connected to the stylus.

[0049] In some embodiments of this disclosure, determining the grip gesture based on the touch data includes:

[0050] The trigger area features of the stylus are determined based on the number and location of the triggered touch units. The trigger area features include the number of finger grip areas, the location of the finger grip areas, and the location of the hand grip area.

[0051] The grip gesture is determined by matching the trigger area features with preset features.

[0052] In some embodiments of this disclosure, the trigger area features are matched with preset features to determine the grip gesture, including:

[0053] When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture.

[0054] When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture;

[0055] When the trigger area features match the preset features of remote control grip, the grip gesture is determined to be a remote control grip gesture.

[0056] In some embodiments of this disclosure, the trigger area features are matched with preset features to determine the grip gesture, including:

[0057] When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are distributed in a ring around the stylus, the grip gesture is determined to be a pen grip gesture.

[0058] When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are spaced apart along the length direction of the stylus, the grip gesture is determined to be a soft pen grip gesture;

[0059] When the trigger area features include multiple finger trigger areas and palm trigger areas, the multiple finger trigger areas and palm trigger areas are located in the middle and rear part of the stylus, and the finger trigger areas and palm trigger areas are located on different sides of the stylus, the grip gesture is determined to be a remote control grip gesture.

[0060] In some embodiments of this disclosure, the display mode switching command sent by the stylus to the display device is either coded data or Bluetooth data.

[0061] In some embodiments of this disclosure, the display mode switching data includes touch data generated by the stylus in response to being held, and the step of sending the display mode switching data to a display device communicatively connected to the stylus based on the touch data includes:

[0062] The touch data is sent to a display device that is communicatively connected to the stylus.

[0063] In some embodiments of this disclosure, the touch data sent by the stylus to the display device is Bluetooth data.

[0064] According to a fourth aspect of this disclosure, a control device for a display device is provided, the control device comprising:

[0065] The acquisition module is used to acquire display mode switching data, which is data determined by the stylus paired with the display device in response to the user's grip gesture;

[0066] The control module is used to control the display device to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display and remote control mode.

[0067] According to a fifth aspect of this disclosure, a display device is provided, the display device comprising:

[0068] processor;

[0069] Memory used to store processor-executable instructions;

[0070] The processor is configured as follows:

[0071] Acquire display mode switching data, wherein the display mode switching instruction is data determined by the stylus paired with the display device in response to the user's grip;

[0072] The display device is controlled to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

[0073] According to a sixth aspect of this disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, characterized in that the program instructions, when executed by a processor, implement the steps of the above-described method.

[0074] According to a seventh aspect of this disclosure, an electronic device system is provided, the electronic device system comprising:

[0075] The aforementioned stylus;

[0076] The aforementioned display device.

[0077] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0078] The control method for a display device provided in this disclosure acquires display mode switching data determined by the user's grip on the stylus paired with the display device, and controls the display device to switch to the display mode corresponding to the display mode switching data. This realizes the switching of the display mode of the display device according to the grip gesture of the stylus, avoiding the inconvenience caused by the user having to manually operate when switching display modes, and improving the convenience of using the stylus and the display device together.

[0079] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0080] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0081] Figure 1 A flowchart illustrating a control method for a display device provided as an exemplary embodiment of this disclosure;

[0082] Figure 2 A schematic diagram of the structure of a stylus provided for an exemplary embodiment of this disclosure;

[0083] Figure 3 A schematic block diagram of a first type of stylus provided for an exemplary embodiment of this disclosure;

[0084] Figure 4 A partially unfolded schematic diagram of a stylus provided for an exemplary embodiment of this disclosure;

[0085] Figure 5 A schematic diagram of the distribution of a touch unit provided for an exemplary embodiment of this disclosure;

[0086] Figure 6 A schematic diagram of a first electrode layer provided for an exemplary embodiment of this disclosure;

[0087] Figure 7 A schematic diagram of a second electrode layer provided for an exemplary embodiment of this disclosure;

[0088] Figure 8 A schematic block diagram of a second type of stylus provided for an exemplary embodiment of this disclosure;

[0089] Figure 9 A schematic block diagram of a third type of stylus provided for an exemplary embodiment of this disclosure;

[0090] Figure 10 A diagram illustrating a brush-writing grip for an exemplary embodiment of this disclosure;

[0091] Figure 11 A pen-writing grip diagram provided as an exemplary embodiment of this disclosure;

[0092] Figure 12 A laser pointer holding gesture diagram provided as an exemplary embodiment of this disclosure;

[0093] Figure 13 A flowchart illustrating a stylus control method provided as an exemplary embodiment of this disclosure;

[0094] Figure 14 A block diagram of a control device for a display device provided as an exemplary embodiment of the present disclosure;

[0095] Figure 15 A schematic block diagram of a display device provided for an exemplary embodiment of this disclosure.

[0096] Explanation of reference numerals in the attached figures:

[0097] 100. Stylus; 10. Pen body; 11. Pen body section; 12. Pen tip section; 20. Touch layer; 21. Touch unit; 201. First electrode unit; 202. Second electrode unit; 30. Control device; 31. First control module; 32. First communication module; 1500. Display device; 1502. Processing component; 1504. Memory; 1506. Power component; 1508. Multimedia component; 1510. Audio component; 1512. Input / output interface; 1514. Sensor component; 1516. Communication component; 1520. Processor. Detailed Implementation

[0098] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced without one or more of the specific details described, or other methods, materials, apparatus, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0099] In related technologies, styluses and display devices are used together. When using a stylus, if a user wants to switch the display device's operating mode, such as changing the displayed pen strokes, the user needs to operate on the display device itself. This causes inconvenience for users when using a stylus.

[0100] In view of this, the present disclosure provides a control method, apparatus, stylus, display device, and electronic device system for a display device. When a user holds the stylus, multiple touch units in the touch layer of the stylus acquire touch data, determine the stylus grip gesture based on the touch data, and control the display device to switch display modes according to the stylus grip gesture. The user can switch display modes without operating the display device, improving the convenience of using the stylus.

[0101] Figure 1 A flowchart illustrating a control method for a display device provided as an exemplary embodiment of this disclosure is shown below. Figure 1 As shown, the control method for the display device includes the following steps:

[0102] Step S110: Obtain display mode switching data. The display mode switching data is data determined by the stylus paired with the display device in response to the user's grip gesture.

[0103] Step S120: Control the display device to switch to the display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display and remote control mode.

[0104] The control method for a display device provided in this disclosure receives display mode switching data determined by the user's grip on a stylus paired with the display device, and controls the display device to switch to the display mode corresponding to the display mode switching data. This realizes the switching of the display mode of the display device according to the grip gesture of the stylus, avoiding the inconvenience caused by the user having to manually operate when switching display modes, and improving the convenience of using the stylus and the display device together.

[0105] In some embodiments of this disclosure, prior to step S110, the control method for the display device may further include: controlling the pairing of the display device and the stylus. By pairing the display device and the stylus, the display device and the stylus can recognize each other and interact with data.

[0106] To enable those skilled in the art to better understand the control method of the display device provided in this disclosure, the above steps are illustrated in detail below.

[0107] In this embodiment of the disclosure, a display device refers to an electronic device with display functionality. This display device can be a mobile phone, tablet computer, e-reader, MP4 player, laptop computer, in-vehicle infotainment system, desktop computer, portable terminal, laptop terminal, desktop terminal, or similar product. When a user operates the display device using a stylus, they can write or draw on the display device. For example, a user can use the stylus to write with a soft pen (e.g., a calligraphy brush) or a hard pen (e.g., a fountain pen, ballpoint pen, or pencil). Alternatively, the stylus can be used to remotely control the device, for example, by using the stylus as a laser pointer for meetings.

[0108] When users operate the display device with a stylus, different operations correspond to different gestures. For example, when writing or drawing with a hard pen, a hard pen grip gesture is used; when writing or drawing with a soft pen, a soft pen grip gesture is used. When remotely controlling the device, a laser pointer grip gesture is used.

[0109] The display device acquires display mode switching data, which is determined by the stylus paired with the display device in response to the user's hand gestures. A first communication module can be set on the stylus, and a second communication module can be set on the display device. The first and second communication modules can communicate with each other, with the first communication module sending the display mode switching data and the second communication module receiving the display mode switching data.

[0110] The stylus has a touch layer containing multiple touch units. For example, the touch layer may have multiple touch units arranged in an array. These touch units respond to the stylus by being held and generating touch data. The touch data may include whether a touch unit is triggered and its position.

[0111] In this embodiment, the stylus can be either a passive or active stylus. When the stylus is passive, the stylus and the display device interact wirelessly, for example, via Bluetooth. When the stylus is active, the stylus and the display device interact via Bluetooth or a coding signal. The coding signal is an electrical signal emitted by the tip of an active stylus; when the stylus and the display device are in contact, the touch structure of the display device receives the coding signal.

[0112] In some embodiments, controlling the pairing of the display device and the stylus can be achieved by the display device sending a pairing request to the stylus, and the stylus responding to the pairing request to complete the pairing. Alternatively, the display device can respond to the pairing request issued by the stylus to achieve pairing with the stylus.

[0113] It should be noted that pairing the display device and the stylus can be done each time the stylus is used to operate the display device. Alternatively, pairing can be done once, and the pairing relationship can be stored between the display device and the stylus, so that pairing is not required every time it is used subsequently.

[0114] For example, pairing a display device and a stylus can be done via Bluetooth. Both the display device and the stylus have Bluetooth modules. Before using the stylus to operate the display device, both devices enter Bluetooth pairing mode, thus achieving pairing. Alternatively, pairing can be achieved through contact pairing. The stylus tip is placed on the display screen, the display device sends an uplink signal to the stylus, the stylus responds by sending a downlink signal, and the display device receives the downlink signal to complete pairing.

[0115] A receiving module can be included in the display device to receive display mode switching data sent by the stylus. For example, the receiving module can be a Bluetooth communication module, or it can be the touch structure of the display device.

[0116] In some embodiments, the display mode switching data includes touch data, such as the number and position data of touch units triggered on the stylus. That is, the display mode switching data acquired by the display device is the touch data sent by the stylus, which needs further processing on the display device to obtain the grip gesture.

[0117] Based on this, the display device acquires display mode switching data via Bluetooth sent by the stylus. Sending stylus touch data to the display device via Bluetooth allows for large data transfer volumes and high speeds, improving the display device's response speed to stylus grip and display mode switching.

[0118] In other embodiments, the display mode switching data includes a display mode switching instruction; that is, the display mode switching data is touch data processed by the stylus. When the stylus's touch layer detects touch data, the stylus processes the touch data, determines the current grip gesture based on the touch data, and determines the display mode switching instruction based on the grip gesture. The display mode switching instruction is then sent to the display device as display mode switching data.

[0119] Based on this, the display mode switching command data obtained after processing by the stylus is small. Therefore, the display mode switching command can be converted into coded data by the stylus, and the stylus outputs this coded data to the display device. That is, the display mode switching command obtained by the display device is the coded data output by the stylus. Of course, the display mode switching command obtained by the display device can also be Bluetooth data output by the stylus, and this embodiment is not limited thereto.

[0120] When the display mode switching data includes touch data, controlling the display device to switch to the display mode corresponding to the display mode switching data can be achieved in the following way: determine the stylus grip gesture based on the display mode switching data; control the display device to switch to the display mode corresponding to the stylus grip gesture.

[0121] Specifically, determining the pen grip gesture based on display mode switching data can be achieved by determining the pen trigger area features based on touch data, including the number of finger grip areas, the position of the finger grip areas, and the position of the hand grip area; and matching the trigger area features with preset features to determine the grip gesture.

[0122] For example, when the trigger area feature matches the preset feature for hard pen grip, the grip gesture is determined to be a hard pen grip gesture; when the trigger area feature matches the preset feature for soft pen grip, the grip gesture is determined to be a soft pen grip gesture; when the trigger area feature matches the preset feature for remote control grip, the grip gesture is determined to be a remote control grip gesture.

[0123] Matching the trigger area features with preset pen grip features means that the degree of matching between the trigger area features and preset pen grip features is greater than a preset threshold (e.g., 80%, 90%, or 95%). Matching the trigger area features with preset remote control grip features means that the degree of matching between the trigger area features and preset remote control grip features is greater than a preset threshold (e.g., 80%, 90%, or 95%).

[0124] The number of fingers, the position of the fingers, and the position of the user's palm vary depending on the grip gesture. The current grip gesture can be determined by the number of fingers, the position of the fingers, and the position of the user's palm.

[0125] For example, the user's gesture of holding the stylus can be a soft pen grip, a hard pen writing grip, or a laser pointer grip (remote control gesture). When the user performs the above operations on the stylus, the opposing positions of the user's fingers and palm on the stylus are different.

[0126] Figure 10 This demonstrates a pen-holding gesture, such as... Figure 10 As shown, when the user holds the pen in a pen-writing gesture, there are 3-4 contact points between the finger and the stylus, and the distance between them is relatively wide.

[0127] Pen holding gestures can include pen writing gestures. Figure 11 This demonstrates a pen-writing grip gesture, such as... Figure 11 As shown, when the user holds the pen in a pen-writing gesture, the contact points between the fingers and the stylus form a ring, and the distance between them is close.

[0128] Figure 12 A remote-controlled grip gesture is shown, such as Figure 12 As shown, when the user's grip gesture is a remote control grip gesture (laser pen grip gesture), the palm and fingers are arranged near the middle and rear of the stylus, and the fingers and palm are in contact with different sides of the stylus.

[0129] The above Figures 10-12 The hand gesture features can be stored as preset features in the display device. For example, a model with preset features can be obtained through data training.

[0130] Based on this, the trigger area features and preset features are matched to determine the grip gesture, which can be achieved in the following ways: when the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are distributed in a ring around the stylus, the grip gesture is determined to be a hard pen grip gesture; when the trigger area features include multiple finger trigger areas, and the spacing between the finger trigger areas along the length of the stylus is greater than a preset threshold, the grip gesture is determined to be a soft pen grip gesture; when the trigger area features include multiple finger trigger areas and palm trigger areas, and the multiple finger trigger areas and palm trigger areas are located in the middle and rear part of the stylus, and the finger trigger areas and palm trigger areas are located on different sides of the stylus, the grip gesture is determined to be a remote control grip gesture.

[0131] When the stylus is held in a pen-like grip, multiple finger trigger areas are arranged in a ring around the stylus. In this case, there can be three finger trigger areas on the stylus, spaced apart from each other, with the line connecting the three finger trigger areas forming a circle or approximately a circle.

[0132] For example, the stylus can be divided into multiple detection zones along its length, each zone containing multiple touch units. Each detection zone is a cylindrical surface of a preset length. When multiple fingers of the user are wrapped around the same detection zone, it is determined that the user's grip gesture matches the pen grip gesture.

[0133] When the stylus is held in a soft-pen grip, it has multiple finger trigger areas, which are spaced apart along the length of the stylus. For example, the stylus may have three or four finger trigger areas. The distance between two adjacent finger trigger areas along the length of the stylus is greater than a preset threshold. Therefore, when three or four finger trigger areas are detected on the stylus, and these three or four finger trigger areas are spaced apart along the length of the stylus, it is determined that the trigger area features match the preset soft-pen grip features.

[0134] When the stylus is held in a remote control (laser pointer) grip gesture, the user is holding the stylus at its middle-rear portion. Therefore, the finger trigger areas and palm trigger areas are located in the middle-rear portion of the stylus. The middle-rear portion of the stylus refers to the half of the stylus furthest from the tip. The stylus has five finger trigger areas. Four of these finger trigger areas are roughly aligned in a straight line along the length of the stylus, while the remaining finger trigger area is not on the same straight line as the other four. Furthermore, the palm trigger area is not aligned with the finger trigger areas along the length of the stylus. Therefore, when multiple finger and palm trigger areas are located in the middle-rear portion of the stylus, and these finger and palm trigger areas are located on different sides of the stylus, the trigger area features are determined to match the preset features for remote control grip.

[0135] After determining the user's grip gesture for the stylus, the display device switches to the display mode corresponding to the stylus grip gesture. Switching the display mode can be as follows: when the stylus is held in a hard pen grip, the display device displays hard pen handwriting; when the stylus is held in a soft pen grip, the display device displays soft pen handwriting; and when the stylus is held in a remote control grip, the display device switches to remote control mode.

[0136] It should be noted that, in the embodiments of this disclosure, "controlling the display device to display hard-pen handwriting" refers to the display device displaying hard-pen handwriting when writing with a stylus. "Controlling the display device to display soft-pen handwriting" refers to the display device displaying soft-pen handwriting when writing with a stylus. "Controlling the display device to switch to remote control mode" means that the display device can respond to remote operations of the stylus, such as turning pages in a PowerPoint presentation.

[0137] When the display mode switching data includes a display mode switching instruction, control the display device to switch to the display mode corresponding to the display mode switching instruction, including: responding to the display mode switching instruction and controlling the display device to switch to the display mode corresponding to the display mode switching instruction.

[0138] The display mode switching command can be Bluetooth data or coded data. Switching the display mode of the display device can be as follows: when the stylus is held in a hard pen grip, control the display device to display hard pen handwriting; when the stylus is held in a soft pen grip, control the display device to display soft pen handwriting; when the stylus is held in a remote control grip, control the display device to switch to remote control mode.

[0139] The control method for a display device provided in this disclosure receives data generated by a user's grip on a stylus paired with the display device and controls the display device to switch to a display mode corresponding to the stylus's display mode switching data. This achieves switching of the display device's display mode based on the stylus's grip gesture, avoiding the inconvenience caused by the user having to manually operate when switching display modes, and improving the convenience of using the stylus and display device together.

[0140] Figure 2 A schematic diagram of the structure of a stylus provided as an exemplary embodiment of this disclosure, such as... Figure 2 and Figure 3 As shown, the stylus 100 includes a pen body 10, a touch layer 20, and a control device 30. The touch layer 20 is disposed on the pen body 10 and has multiple touch units 21 and a scanning circuit. The multiple touch units 21 are used to generate touch data in response to the stylus 100 being held. The scanning circuit is connected to the touch units 21 and is used to scan and acquire touch data. The control device 30 is electrically connected to the scanning circuit and is communicatively connected to the corresponding display device 200, configured to send display mode switching data to the display device in response to touch data.

[0141] The stylus 100 provided in this embodiment includes a pen body 10, a touch layer 20, and a control device 30. The touch layer 20 is disposed on the pen body 10 and has multiple touch units 21 and a scanning circuit. The multiple touch units 21 can generate touch data in response to the stylus 100 being held. The control device 30 can send display mode switching data to the display device in response to the touch data, enabling the stylus 100 to sense the user's grip gesture and interact with the display device, providing a data basis for judging different grip gestures and enriching the functionality of the stylus. Furthermore, it realizes the control of a real device communicating with the stylus 100 through the user's grip gesture, at least to a certain extent solving the problem of inconvenience caused by switching working modes on the display device, and improving the ease of use of the stylus 100.

[0142] The stylus 100 provided in this disclosure is described below using several embodiments:

[0143] like Figure 4As shown, the pen body 10 includes a pen tip 12 and a pen body 11. The pen tip 12 is located at one end of the pen body 11 along its length direction. The pen tip 12 is used to contact the touch screen of the display device for operations such as writing, drawing, clicking, or swiping. The pen body 11 forms the main structure of the stylus 100 and serves as the grip of the stylus 100. When the user uses the stylus 100, the user holds the pen body 11 of the stylus 100.

[0144] The pen body 11 can be a hollow structure, with components such as a battery, control chip, and circuit board housed inside. The pen tip 12 can be conical or nearly conical, for example, it can be a cone or a pyramid. The pen body 11 can be a hollow columnar structure, for example, it can be a hollow cylinder or a hollow quadrangular prism.

[0145] In some embodiments, the stylus 100 may also integrate laser pen functionality. Furthermore, the stylus 100 may include a light-emitting module, which may be located at the tip 12 or the body 11. For example, the tip 12 and the light-emitting module may be located at opposite ends of the body 11. Alternatively, the light-emitting module may be integrated into the tip 12. When the stylus 100 is used as a laser pen, it can remotely control the display device and emit laser light. For example, the stylus 100 can be used for operations such as turning pages in a PowerPoint presentation.

[0146] A touch layer 20 is disposed on the pen body 10. The touch layer 20 has a plurality of touch units 21, which are used to generate touch data in response to the stylus 100 being held. The touch layer 20 at least partially covers the pen body 11. For example, the touch layer 20 completely covers the pen body 11, or the touch layer 20 is disposed in the gripping area of ​​the pen body 11.

[0147] The touch layer 20 may include a touch unit 21 and a scanning circuit. The touch unit 21 is used to detect touch actions and generate electrical signals based on the touch actions. The scanning circuit is connected to the touch unit 21 and is used to scan and acquire touch data and output the touch data to the control device 30.

[0148] The touch layer 20 can be either a capacitive touch layer 20 or a resistive touch layer 20. When the touch layer 20 is a capacitive touch layer 20, when the user touches the stylus 100, the capacitance of the touch unit 21 changes in response to the touch, thereby generating a touch sensing signal. Multiple touch sensing signals form touch data. When the touch layer 20 is a resistive touch layer 20, when the user holds the stylus 100, pressure is applied to the touch layer 20. This pressure changes the resistance value of the touch unit 21, thereby generating a touch sensing signal. Multiple touch sensing signals form touch data.

[0149] Taking a capacitive touch layer 20 as an example, the touch layer 20 is provided with touch electrodes, which form a capacitor plate. When the user touches the stylus 100, the capacitance value of the capacitor formed by the touch electrodes changes. During operation, the touch electrodes can be connected to a touch signal source, which transmits an excitation signal to the touch electrodes. This excitation signal can be a pulse signal. When there is no touch, the touch electrodes respond to the excitation signal and output a first signal; when there is a touch, the touch electrodes respond to the excitation signal and output a second signal. The first signal output by the touch electrodes forms touch data.

[0150] In one feasible implementation, such as Figure 5 As shown, the touch layer 20 can be a self-capacitive structure. An electrode layer is disposed within the touch layer 20, and multiple electrode units (forming touch units 21) are disposed within the electrode layer. The electrode units are connected to a sensing circuit. The sensing circuit detects the capacitance value of the electrode unit to ground. When a user touches the stylus 100, the human body and the electrode unit form a capacitance, and the capacitance value detected by the sensing circuit increases. During use, when the capacitance detected by the sensing circuit increases, it is considered that the area where the electrode unit is located is being held by the user.

[0151] The electrode units can be square or approximately square in structure, and multiple electrode units are arranged in an array within the touch layer 20. For example, multiple electrode units can be arranged in M ​​rows × N columns.

[0152] In another feasible embodiment, the touch layer 20 can have a mutual inductance capacitor structure. The touch layer 20 has a first electrode layer and a second electrode layer. The first electrode layer has a plurality of first electrode units 201. The second electrode layer has a plurality of second electrode units 202. Corresponding first electrode units 201 and second electrode units 202 form a touch unit 21, and corresponding first electrode units 201 and second electrode units 202 form a capacitor. When a human body touches the stylus 100, the human body and the electrode units also form a capacitor, and the capacitance value detected by the sensing circuit decreases. During use, when the capacitance detected by the sensing circuit decreases, it is assumed that the area where the electrode unit is located is being held by the user.

[0153] In this design, the first electrode unit 201 in the first electrode layer can be a driving electrode unit, which receives a driving signal, which can be a pulse signal. The second electrode unit 202 in the second electrode layer can be a sensing electrode unit, which is connected to a sensing circuit. When a human body touches the stylus 100, the charge on the second electrode unit 202 moves, forming a sensing current. The sensing current is output to the control device 30 through the sensing circuit.

[0154] like Figure 6As shown, multiple first electrode units 201 are arranged in an array in the first electrode layer. For example, the multiple first electrode units 201 can be arranged in M ​​rows × N columns. In the first electrode layer, a row of first electrode units 201 is connected, that is, when a first electrode unit 201 receives a drive signal, a row of first electrode units 201 simultaneously receives the drive signal. In use, drive signals can be provided to the first electrode units 201 row by row.

[0155] like Figure 7 As shown, multiple second electrode units 202 are arranged in an array in the second electrode layer. For example, multiple second electrode units 202 can be arranged in M ​​rows × N columns. In the second electrode layer, one column of second electrode units 202 is connected, that is, when a second electrode unit 202 senses a touch sensing signal, N columns of second electrode units 202 simultaneously output touch sensing signals.

[0156] In some embodiments, the scanning circuit may include a driving circuit and a sensing circuit. The driving circuit provides a driving signal to the touch unit 21, and the sensing circuit outputs a touch sensing signal generated by the touch unit 21 in response to a user's grip. Multiple touch sensing signals and the position coordinates of the touch unit 21 form touch data.

[0157] The sensing circuit may include output traces that electrically connect the touch control unit 21 and the control device 30. In some embodiments, the sensing circuit may also include a control switch, an amplification module, and a filtering module. The switch module is connected to the touch control unit 21 and is turned on in response to a scan control signal. When the switch module is on, the touch sensing signal can be transmitted to the control device 30; when the switch module is off, the touch sensing signal will not be transmitted to the control device 30. The amplification module is located between the touch control unit 21 and the control device 30 and is used to amplify the touch sensing signal. The filtering unit is used to filter the amplified touch sensing signal.

[0158] The scanning circuit described in this embodiment of the present disclosure scans and acquires touch data by providing driving signals to the array of touch units 21 row by row or column by column, and acquiring touch sensing signals row by row or column by column.

[0159] For example, the touch layer 20 includes multiple rows of touch units 21. Each row of touch units 21 includes multiple touch units 21 arranged along a first direction. The scanning circuit scans the touch units 21 row by row, with the first direction being the length direction of the pen body 10. That is, the row direction of the touch units 21 in the touch layer 20 is the length direction of the pen body 10, and the column direction of the touch units 21 in the touch layer 20 is the circumferential direction surrounding the pen body 10.

[0160] The length of the pen body 10 is greater than its circumference. Therefore, in the M×N array of touch units 21, M is less than N. Scanning each touch unit 21 row by row requires M scans, and scanning each touch unit 21 column by column requires N scans. To save the time of one frame scan and increase the scan refresh rate, scanning is performed row by row. The time of one frame scan is the sum of the time required to scan an entire column of touch units 21 within the touch layer 20 once.

[0161] It is understood that the embodiments disclosed herein are not limited to line-by-line scanning. In some feasible implementations, the scanning of the touch layer 20 can also be column-by-column scanning. Since the number of columns in the touch layer 20 is greater than the number of rows, the number of scanning channels is less when performing column-by-column scanning than when performing line-by-line scanning, which helps to save scanning channels.

[0162] In this embodiment, the stylus 100 can be either a passive or active stylus. When the stylus 100 is a passive stylus, the stylus 100 and the display device interact wirelessly, for example, via Bluetooth. When the stylus 100 is an active stylus, the stylus 100 and the display device interact via Bluetooth or a coding signal.

[0163] The touch data collected by the touch unit 21 in the touch layer 20 includes the position of the triggered touch unit 21 on the stylus 100. Touch data processing can be performed on the stylus 100, converting the touch data into display mode switching data, which includes a display mode switching command. At this time, the display mode switching command is sent to the display device communicatively connected to the stylus 100. Alternatively, touch data processing can be performed on the display device communicatively connected to the stylus 100; in this case, the display mode switching data sent to the display device is the touch data.

[0164] In one feasible implementation, such as Figure 8 As shown, the control device 30 includes a first control module 31 and a first communication module 32. The first control module 31 is electrically connected to the touch unit 21 and is configured to generate display mode switching data based on touch data. The first communication module 32 is electrically connected to the first control module 31 and is capable of communicating with the corresponding display device. It is configured to send display mode switching data to the display device under the control of the first control module 31.

[0165] The first control module 31 can be a processing chip, and it is located on the pen body 11. The first control module 31 processes touch data and generates display mode switching data based on the touch data. The display mode switching data includes the grip gesture of the stylus 100, such as a hard pen grip gesture, a soft pen grip gesture, or a remote control grip gesture (laser pen grip gesture), etc.

[0166] The touch data includes whether the touch unit 21 is triggered, and the coordinate information of the triggered touch unit 21. When the touch data processing is performed within the stylus, the first control module 31 determines the trigger area features of the stylus 100 based on the number and position of the triggered touch units 21; the trigger area features are matched with preset features to determine the display mode switching data.

[0167] The trigger area features may include the number and position of the fingers holding the stylus 100, as well as the position of the palm holding the stylus 100. The trigger area features are determined based on the relationship between the number of fingers, the position of the fingers, and the position of the palm.

[0168] The preset features include a mapping relationship between display mode switching data and trigger area features, and these preset features can be obtained through data training. The preset features are pre-stored in the storage device of the stylus 100 and are invoked when a display mode switching command is determined. When the matching degree between the trigger area features and the preset features is greater than a preset threshold, the user's current grip gesture is determined.

[0169] Optionally, the grip gesture can be input into a pre-trained grip gesture recognition model for grip gesture recognition.

[0170] For example, matching the trigger area features with preset features to determine the grip gesture can be as follows: when the trigger area features match the preset features for hard pen grip, the grip gesture is determined to be a hard pen grip gesture; when the trigger area features match the preset features for soft pen grip, the grip gesture is determined to be a soft pen grip gesture; when the trigger area features match the preset features for remote control grip, the grip gesture is determined to be a remote control grip gesture.

[0171] When the stylus 100 is a passive stylus, the first communication module 32 can be a wireless communication module, such as a Bluetooth communication module, an infrared communication module, or a WiFi communication module. When the stylus 100 is an active stylus, the first communication module 32 can be a coding signal generation module. Alternatively, the first communication module 32 can be a wireless communication module, such as a Bluetooth communication module, an infrared communication module, or a WiFi communication module.

[0172] In one feasible implementation, such as Figure 9As shown, the control device 30 includes a first communication module 32, which is electrically connected to the touch unit 21 and can communicate with the corresponding display device. It is configured to send display mode switching data to the display device, and the display mode switching data is touch data.

[0173] Sending touch data to the display device as display mode switching data, without processing the data on the stylus 100, can save the computing power and power of the stylus 100, thereby controlling the cost of the stylus 100 and improving its battery life.

[0174] The first communication module 32 is communicatively connected to the display device, and the connection between the first communication module 32 and the display device can be wireless or wired. Since the amount of touch data is large, transmitting it using a coding signal is inconvenient; therefore, the first communication module 32 can be a wireless communication module. For example, the first communication module 32 can be a Bluetooth communication module, an infrared communication module, a WiFi communication module, etc.

[0175] Furthermore, to improve the accuracy of grip gesture judgment of the stylus 100, the stylus 100 provided in this embodiment may also include a tilt angle detection module. The tilt angle detection module is connected to the control device 30 and is used to detect the tilt angle of the stylus 100, which is used to assist in determining the grip gesture.

[0176] For example, the relative angle between the stylus 100 and the display device can be determined by combining the angle between the display device and the horizontal plane, as well as the angle between the stylus 100 and the horizontal plane. Based on this relative angle, the grip gesture can be further determined, improving the accuracy of grip gesture judgment. For instance, when the stylus and the display surface are perpendicular or nearly perpendicular, it can help determine that the current grip gesture is a soft-pen grip gesture.

[0177] When the control device 30 includes the first communication module 32, that is, when data processing is not performed at the stylus 100 end, the angle detected by the tilt angle detection module is sent to the display device through the first communication module.

[0178] When the control device 30 includes a first control module 31 and a first communication module 32, the first control module 31 can generate display mode switching data based on touch data and the tilt angle of the stylus 100. At this time, the stylus 100 can also request the display device to send the tilt angle of the display device to the stylus 100. The first control module 31 can generate touch data based on the touch data, the tilt angle of the stylus 100, and the tilt angle of the display device.

[0179] The stylus 100 provided in this embodiment includes a pen body 10, a touch layer 20, and a control device 30. The touch layer 20 is disposed on the pen body 10 and has multiple touch units 21 and a scanning circuit. The multiple touch units 21 can generate touch data in response to the stylus 100 being held. The control device 30 can send display mode switching data to the display device in response to the touch data, enabling the stylus 100 to sense the user's grip gesture and interact with the display device, providing a data basis for judging different grip gestures and enriching the functionality of the stylus. Furthermore, it realizes the control of a real device communicating with the stylus 100 through the user's grip gesture, at least to a certain extent solving the problem of inconvenience caused by switching working modes on the display device, and improving the ease of use of the stylus 100.

[0180] This exemplary embodiment provides a method for controlling a stylus, for use with the aforementioned stylus, such as... Figure 13 As shown, the control method includes the following steps:

[0181] Step S131: Obtain touch data generated by multiple touch units in the touch layer in response to gripping;

[0182] Step S132: Based on the touch data, send display mode switching data to the display device that is communicatively connected to the stylus. The display mode switching data is used to control the display device to switch display modes. The display modes of the display device include at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

[0183] The stylus control method provided in this embodiment acquires touch data generated by multiple touch units in the touch layer in response to gripping, and sends display mode switching data to the display device communicatively connected to the stylus based on the touch data. This realizes the switching of the display mode of the display device according to the gripping gesture of the stylus, avoiding the inconvenience caused by the user having to manually operate when switching display modes, and improving the convenience of using the stylus and display device together.

[0184] The stylus includes a pen body 10 and a touch layer 20. The touch layer 20 is disposed on the pen body 10 and has multiple touch units 21 and a scanning circuit. The multiple touch units 21 are used to generate touch data in response to the stylus 100 being held. The control device 30 of the stylus 100 acquires the touch data by scanning the scanning circuit.

[0185] In some embodiments, the display mode switching data includes a display mode switching instruction; that is, the processing of touch data is performed within the stylus 100. Sending the display mode switching data to a display device communicatively connected to the stylus 100 based on the touch data can be achieved by: determining a grip gesture based on the touch data; determining a display mode switching instruction based on the grip gesture; and sending the display mode switching instruction to the display device communicatively connected to the stylus 100.

[0186] Specifically, determining the grip gesture based on touch data can be achieved by: determining the trigger area features of the stylus based on the number and position of the triggered touch units 21, including the number of finger grip areas, the position of the finger grip areas, and the position of the hand grip area; and matching the trigger area features with preset features to determine the grip gesture.

[0187] For example, when the trigger area feature matches the preset feature for hard pen grip, the grip gesture is determined to be a hard pen grip gesture; when the trigger area feature matches the preset feature for soft pen grip, the grip gesture is determined to be a soft pen grip gesture; when the trigger area feature matches the preset feature for remote control grip, the grip gesture is determined to be a remote control grip gesture.

[0188] Matching the trigger area features with preset pen grip features means that the degree of matching between the trigger area features and preset pen grip features is greater than a preset threshold (e.g., 80%, 90%, or 95%). Matching the trigger area features with preset remote control grip features means that the degree of matching between the trigger area features and preset remote control grip features is greater than a preset threshold (e.g., 80%, 90%, or 95%).

[0189] Under different grip gestures, the number of fingers, the position of the fingers, and the position of the user's palm that are in contact with the stylus 100 vary. The current grip gesture can be determined by the number of fingers, the position of the fingers, and the position of the user's palm that are in contact with the stylus 100.

[0190] For example, the user's gesture of holding the stylus 100 can be a soft pen holding gesture, a hard pen writing gesture, or a laser pointer holding gesture (remote control gesture). When the user performs the above operations on the stylus, the opposing positions of the user's fingers and palm on the stylus are different.

[0191] Figure 10 This demonstrates a pen-holding gesture, such as... Figure 10 As shown, when the user holds the pen in a pen-writing gesture, there are 3-4 contact points between the finger and the stylus, and the distance between them is relatively wide.

[0192] Pen holding gestures can include pen writing gestures. Figure 11 This demonstrates a pen-writing grip gesture, such as... Figure 11 As shown, when the user holds the pen in a pen-writing gesture, the contact points between the fingers and the stylus form a ring, and the distance between them is close.

[0193] Figure 12 A remote-controlled grip gesture is shown, such as Figure 12 As shown, when the user's grip gesture is a remote control grip gesture (laser pen grip gesture), the palm and fingers are arranged near the middle and rear of the stylus, and the fingers and palm are in contact with different sides of the stylus.

[0194] The above Figures 10-12 The hand gesture features can be stored as preset features in the display device. For example, a model with preset features can be obtained through data training.

[0195] Based on this, the trigger area features are matched with preset features to determine the grip gesture of the stylus 100. This can be achieved in the following ways: When the trigger area features include multiple finger trigger areas, and these finger trigger areas are arranged in a ring around the stylus, the grip gesture is determined to be a hard-pen grip gesture. When the trigger area features include multiple finger trigger areas, and the spacing between the finger trigger areas along the length of the stylus 100 is greater than a preset threshold, the grip gesture is determined to be a soft-pen grip gesture. When the trigger area features include multiple finger trigger areas and a palm trigger area, and these finger and palm trigger areas are located in the middle and rear part of the stylus, and are located on different sides of the stylus, the grip gesture is determined to be a remote control grip gesture.

[0196] When the stylus 100 is held in a pen-grip gesture, multiple finger trigger areas are arranged in a ring around the stylus 100. At this time, the number of finger trigger areas on the stylus can be three, with intervals between them, and the line connecting the three finger trigger areas is circular or approximately circular.

[0197] For example, the stylus 100 can be divided into multiple detection zones along its length, each detection zone having multiple touch units. Each detection zone is a cylindrical surface of a preset length. When multiple fingers of a user are wrapped around the same detection zone, it is determined that the user's grip gesture matches the pen grip gesture.

[0198] When the stylus 100 is held in a soft-pen grip gesture, the stylus 100 has multiple finger trigger areas, which are spaced apart along the length of the stylus. For example, the stylus 100 may have three or four finger trigger areas. The distance between two adjacent finger trigger areas along the length of the stylus is greater than a preset threshold. Therefore, when three or four finger trigger areas are detected on the stylus 100, and these three or four finger trigger areas are spaced apart along the length of the stylus 100, it is determined that the trigger area features match the preset soft-pen grip features.

[0199] When the stylus 100 is in a remote control (laser pen) grip gesture, the user is holding the stylus at its middle-rear portion. Therefore, the finger trigger area and palm trigger area are located in the middle-rear portion of the stylus. The middle-rear portion of the stylus refers to the half of the stylus furthest from the tip. The stylus has five finger trigger areas. Four of these finger trigger areas are roughly aligned in a straight line along the length of the stylus, while the remaining finger trigger area is not on the same straight line as the other four. Furthermore, the palm trigger area is not aligned with the finger trigger area along the length of the stylus. Therefore, when multiple finger and palm trigger areas are located in the middle-rear portion of the stylus, and these finger and palm trigger areas are located on different sides of the stylus, the trigger area features are determined to match the preset features for remote control grip.

[0200] Sending a display mode switching command to a display device communicatively connected to the stylus 100 can be done wirelessly, for example, via a Bluetooth communication module. In other words, the stylus sends Bluetooth data to the display device. When the stylus is an active stylus, it can send coded data to the display device.

[0201] In some embodiments of this disclosure, the display mode switching data includes touch data. Based on the touch data, the display mode switching data is sent to a display device communicatively connected to the stylus. Alternatively, the touch data can be sent directly to the display device. In this case, the touch data processing is performed on the display device side.

[0202] The touch data sent by the stylus 100 to the display device is Bluetooth data. Because the amount of touch data is large, sending it using a data encoding method is difficult. Sending touch data to the display device via Bluetooth improves data interaction efficiency, thereby increasing the response speed of display mode switching.

[0203] Exemplary embodiments of this disclosure also provide a control device for a display device, such as... Figure 14 As shown, the control device for the display device includes:

[0204] The acquisition module 141 acquires display mode switching data, which is data determined by the stylus paired with the display device in response to the user's grip gesture.

[0205] The control module 142 is used to control the display device to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display and remote control mode.

[0206] Optionally, the display mode switching data includes touch data generated by the stylus in response to being held, and the control module 142 may include:

[0207] The first determining unit is used to determine the pen grip gesture based on the display mode switching data.

[0208] The first control unit is used to control the display device to switch to a display mode corresponding to the grip gesture of the stylus.

[0209] Optionally, the first determining unit may include:

[0210] The first determining subunit is used to determine the trigger area features of the stylus based on the touch data. The trigger area features include the number of finger grip areas, the position of the finger grip areas, and the position of the hand grip area.

[0211] The second determining subunit is used to match the trigger area features with preset features to determine the pen grip gesture.

[0212] Optionally, the second determining subunit is configured to determine the stylus as a hard pen holding gesture when the trigger area features match the hard pen holding preset features; determine the stylus as a soft pen holding gesture when the trigger area features match the soft pen holding preset features; and determine the stylus as a remote control holding gesture when the trigger area features match the remote control holding preset features.

[0213] Optionally, the second sub-determining unit can be configured as follows:

[0214] When the trigger area features include multiple finger trigger areas, and these multiple finger trigger areas are arranged in a ring around the stylus, the trigger area features are determined to match the preset features for hard pen grip. When the trigger area features include multiple finger trigger areas, and these multiple finger trigger areas are spaced apart along the length of the stylus, the trigger area features are determined to match the preset features for soft pen grip. When the trigger area features include multiple finger trigger areas and palm trigger areas, and these multiple finger trigger areas and palm trigger areas are located in the middle and rear part of the stylus, and the finger trigger areas and palm trigger areas are located on different sides of the stylus, the trigger area features are determined to match the preset features for remote control grip.

[0215] Optionally, the display mode switching data acquired by the display device is Bluetooth data sent by the stylus.

[0216] Display mode switching data includes display mode switching instructions, and the control module may include:

[0217] The second control unit is used to respond to the display mode switching command and control the display device to switch to the display mode corresponding to the display mode switching command.

[0218] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0219] An exemplary embodiment of this disclosure also provides a display device, the display device comprising:

[0220] processor;

[0221] Memory used to store processor-executable instructions;

[0222] The processor is configured as follows:

[0223] Acquire display mode switching data, which is data determined by the stylus paired with the display device in response to the user's grip gestures;

[0224] Control the display device to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display and remote control mode.

[0225] Figure 15 This is a block diagram illustrating a display device 1500 according to some embodiments of this disclosure. For example, the display device 1500 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0226] Reference Figure 15 The display device 1500 may include one or more of the following components: a processing component 1502, a memory 1504, a power component 1506, a multimedia component 1508, an audio component 1510, an input / output (I / O) interface 1512, a sensor component 1514, and a communication component 1516.

[0227] Processing component 1502 typically controls the overall operation of display device 1500, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1502 may include one or more processors 1520 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1502 may include one or more modules to facilitate interaction between processing component 1502 and other components. For example, processing component 1502 may include a multimedia module to facilitate interaction between multimedia component 1508 and processing component 1502.

[0228] Memory 1504 is configured to store various types of data to support operation of the device. Examples of this data include instructions for any application or method operating on display device 1500, contact data, phonebook data, messages, pictures, videos, etc. Memory 1504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0229] Power component 1506 provides power to various components of display device 1500. Power component 1506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to display device 1500.

[0230] Multimedia component 1508 includes a screen that provides an output interface between display device 1500 and a user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 1508 includes a front-facing camera and / or a rear-facing camera. When the device is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0231] Audio component 1510 is configured to output and / or input audio signals. For example, audio component 1510 includes a microphone (MIC) configured to receive external audio signals when display device 1500 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1504 or transmitted via communication component 816. In some embodiments, audio component 1510 also includes a speaker for outputting audio signals.

[0232] I / O interface 1512 provides an interface between processing component 1502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0233] Sensor assembly 1514 includes one or more sensors for providing state assessments of various aspects of display device 1500. For example, sensor assembly 1514 may detect the on / off state of device 1500, the relative positioning of components, such as the display and keypad of display device 1500, changes in position of display device 1500 or a component of display device 1500, the presence or absence of user contact with display device 1500, orientation or acceleration / deceleration of display device 1500, and temperature changes of display device 1500. Sensor assembly 1514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1514 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0234] Communication component 1516 is configured to facilitate wired or wireless communication between display device 1500 and other devices (e.g., a stylus). Display device 1500 can access wireless networks based on communication standards such as WiFi, 3G, 4G, 5G, other communication standards, or combinations thereof. In some embodiments of this disclosure, communication component 1516 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In some embodiments of this disclosure, communication component 1516 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0235] In some embodiments of this disclosure, the display device 1500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0236] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory 1504 including instructions that can be executed by a processor 1520 of a display device 1500 to complete the stylus handwriting processing method described above. For example, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, or optical data storage device, etc.

[0237] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the control method of the display device described above when executed by the programmable device.

[0238] This exemplary embodiment also provides an electronic device system including a stylus 100 and a display device 1500. The stylus 100 is communicatively connected to the display device 1500 and can operate the display device 1500. For example, the stylus 100 can write, draw, click, drag, or remotely control the display device. Other descriptions of this electronic device system can be found in the foregoing descriptions, and will not be repeated here.

[0239] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

Claims

1. A control method for a display device, characterized in that, The control method for the display device includes: Acquire display mode switching data, wherein the display mode switching data is data determined by the stylus paired with the display device in response to the user's grip gesture; The display device is controlled to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

2. The control method as described in claim 1, characterized in that, The display mode switching data includes touch data generated by the stylus in response to being held, and controlling the display device to switch to the display mode corresponding to the display mode switching data includes: The grip gesture is determined based on the touch data; Control the display device to switch to the display mode corresponding to the grip gesture.

3. The control method as described in claim 2, characterized in that, Determining the grip gesture based on the touch data includes: The trigger area features of the stylus are determined based on the touch data. The trigger area features include the number of finger grip areas, the position of the finger grip areas, and the position of the hand grip area. The grip gesture is determined by matching the trigger area features with preset features.

4. The control method as described in claim 3, characterized in that, Matching the trigger area features with preset features to determine the grip gesture includes: When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture. When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture; When the trigger area features match the preset features of remote control grip, the grip gesture is determined to be a remote control grip gesture.

5. The control method as described in claim 3 or 4, characterized in that, Matching the trigger area features with preset features to determine the grip gesture includes: When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are distributed in a ring around the stylus, the grip gesture is determined to be a pen grip gesture. When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are spaced apart along the length direction of the stylus, the grip gesture is determined to be a soft pen grip gesture; When the trigger area features include multiple finger trigger areas and palm trigger areas, the multiple finger trigger areas and palm trigger areas are located in the middle and rear part of the stylus, and the finger trigger areas and palm trigger areas are located on different sides of the stylus, the grip gesture is determined to be a remote control grip gesture.

6. The control method according to any one of claims 2-5, characterized in that, The display mode switching data acquired by the display device is Bluetooth data sent by the stylus.

7. The control method as described in claim 1, characterized in that, The display mode switching data includes a display mode switching instruction. Controlling the display device to switch to the display mode corresponding to the display mode switching data of the stylus includes: In response to the display mode switching command, the display device is controlled to switch to the display mode corresponding to the display mode switching command.

8. The control method as described in claim 7, characterized in that, The display mode switching command obtained by the display device is either the coding data output by the stylus or the Bluetooth data.

9. The control method according to any one of claims 1-8, characterized in that, The control method further includes: Control the pairing of the display device and the stylus.

10. A stylus, characterized in that, The stylus includes: Pen style; A touch layer is disposed on the pen body. The touch layer has multiple touch units and a scanning circuit. The multiple touch units are used to generate touch data in response to the stylus being held. The scanning circuit is connected to the touch units and is used to scan and acquire the touch data. The control device is electrically connected to the scanning circuit and communicatively connected to the corresponding display device, configured to send display mode switching data to the display device in response to the touch data.

11. The stylus as described in claim 10, characterized in that, The touch layer includes multiple rows of touch units, and each row of touch units includes multiple touch units arranged along a first direction. The scanning circuit scans the touch units row by row, and the first direction is the length direction of the pen body.

12. The stylus as described in claim 10, characterized in that, The control device includes: A first control module is electrically connected to the touch unit and configured to generate the display mode switching data based on the touch data, wherein the display mode switching data includes a display mode switching instruction. The first communication module is electrically connected to the first control module and is capable of communicating with the corresponding display device. It is configured to send the display mode switching command to the display device under the control of the first control module.

13. The stylus as described in claim 12, characterized in that, The first communication module is a Bluetooth communication module or a coding signal generation module.

14. The stylus as described in claim 10, characterized in that, The control device includes: The first communication module is electrically connected to the touch unit and is capable of communicating with the corresponding display device. It is configured to send display mode switching data to the display device, wherein the display mode switching data includes touch data generated by the stylus in response to being held.

15. The stylus as described in claim 14, characterized in that, The first communication module is a Bluetooth communication module.

16. The stylus as described in claim 10, characterized in that, The pen body includes a pen tip and a pen body, and the touch layer at least partially covers the pen body.

17. The stylus as described in any one of claims 10-16, characterized in that, The touch layer is either a capacitive touch layer or a resistive touch layer.

18. A method for controlling a stylus, characterized in that, For a stylus according to any one of claims 10-17, the control method includes: Acquire touch data generated by multiple touch units in the touch layer in response to a grip; Based on the touch data, display mode switching data is sent to the display device that is communicatively connected to the stylus. The display mode switching data is used to control the display device to switch display modes. The display modes of the display device include at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

19. The control method as described in claim 18, characterized in that, The display mode switching data includes a display mode switching instruction. Sending the display mode switching data to the display device communicatively connected to the stylus, based on the touch data, includes: The grip gesture is determined based on the touch data; The display mode switching command is determined based on the grip gesture; Send the display mode switching command to the display device that is communicatively connected to the stylus.

20. The control method as described in claim 19, characterized in that, Determining the pen grip gesture based on the touch data includes: The trigger area features of the stylus are determined based on the number and location of the triggered touch units. The trigger area features include the number of finger grip areas, the location of the finger grip areas, and the location of the hand grip area. The grip gesture is determined by matching the trigger area features with preset features.

21. The control method as described in claim 20, characterized in that, Matching the trigger area features with preset features to determine the grip gesture includes: When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture. When the trigger area features match the preset features of pen grip, the grip gesture is determined to be a pen grip gesture; When the trigger area features match the preset features of remote control grip, the grip gesture is determined to be a remote control grip gesture.

22. The control method as described in claim 20 or 21, characterized in that, Matching the trigger area features with preset features to determine the grip gesture includes: When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are distributed in a ring around the stylus, the grip gesture is determined to be a pen grip gesture. When the trigger area features include multiple finger trigger areas, and the multiple finger trigger areas are spaced apart along the length direction of the stylus, the grip gesture is determined to be a soft pen grip gesture; When the trigger area features include multiple finger trigger areas and palm trigger areas, the multiple finger trigger areas and palm trigger areas are located in the middle and rear part of the stylus, and the finger trigger areas and palm trigger areas are located on different sides of the stylus, the grip gesture is determined to be a remote control grip gesture.

23. The control method according to any one of claims 19-22, characterized in that, The display mode switching command sent by the stylus to the display device is either coded data or Bluetooth data.

24. The control method as described in claim 18, characterized in that, The display mode switching data includes touch data, and the step of sending the display mode switching data to the display device communicatively connected to the stylus based on the touch data includes: The touch data is sent to a display device that is communicatively connected to the stylus.

25. The control method as described in claim 24, characterized in that, The touch data sent by the stylus to the display device is Bluetooth data.

26. A control device for a display device, characterized in that, The control device for the display device includes: The acquisition module is used to acquire display mode switching data, which is data determined by the stylus paired with the display device in response to the user's grip gesture; The control module is used to control the display device to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display and remote control mode.

27. A display device, characterized in that, The display device includes: processor; Memory used to store processor-executable instructions; The processor is configured as follows: Acquire display mode switching data, wherein the display mode switching instruction is data determined by the stylus paired with the display device in response to the user's grip; The display device is controlled to switch to a display mode corresponding to the display mode switching data, wherein the display mode of the display device includes at least one of soft pen handwriting display, hard pen handwriting display, and remote control mode.

28. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When executed by a processor, the program instructions implement the steps of the method described in any one of claims 1-9.

29. An electronic device system, characterized in that, The electronic device system includes: The stylus according to any one of claims 10-17; The display device according to claim 27.

Images