Data input method and apparatus therefor

Abstract

A data input method includes: displaying an input area and an input prompt bar on an external screen; the input prompt bar includes prompt information that can be input via voice or an automatically generated control; the automatically generated control is used to generate content based on context; upon receiving a first input, displaying the input content in the input area; the first input is a first voice input or a selection operation on the automatically generated control; upon receiving a second input, displaying content modified from the input content; the second input is input applied to a touchpad or a selection operation on a control displayed on the external screen indicating modification. This application allows users to accurately input the required content on an external screen even without a keyboard with an input method set up, greatly reducing the obstruction of the original application interface by replacing the keyboard with an input prompt bar.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence, and more particularly to a data input method and apparatus thereof. Background Technology

[0002] With the continuous development of electronic devices, more and more electronic devices with displays are being used in people's daily lives and work, such as mobile phones with displays. Furthermore, with the development of screen technology, the displays of electronic devices are becoming larger and larger to provide users with richer information and a better user experience.

[0003] However, excessively large displays on electronic devices severely compromise their portability. Therefore, electronic devices equipped with foldable screens (such as foldable phones) represent the future direction of electronic device development.

[0004] Currently, foldable screens can be categorized into folded and unfolded states. When folded, the screen can be folded into at least two screens. The outer screen (also known as the secondary screen or cover screen) is a crucial design element of foldable phones at this stage. As more and more applications can be used directly on the outer screen, its functionality is gradually increasing, highlighting the drawback of its small size. One issue is input problems; due to the small screen size, the keyboard, when fully unfolded, obstructs the screen, resulting in a poor user experience. Summary of the Invention

[0005] This application provides a data input method and apparatus that enables users to accurately input the required content on an external screen even without setting an input method on a keyboard.

[0006] In a first aspect, this application provides a data input method applied to an electronic device, the electronic device including a display screen and a touchpad, the display screen including a foldable screen and an outer screen, the foldable screen being foldable along a folding edge to form multiple inner screens; the outer screen and the touchpad being located on the same side; the method includes: displaying an input area and an input prompt bar on the outer screen; the input prompt bar including prompt information that can be input by voice or an automatically generated control; the automatically generated control being used to generate content based on context; receiving a first input and displaying the input content in the input area; the first input being a first voice input or a selection operation on the automatically generated control; receiving a second input and displaying content modified from the input content; the second input being an input applied to the touchpad or a selection operation on a control displayed on the outer screen indicating modification.

[0007] In input scenarios, the keyboard size of the input method is too large for a small external screen. If the keyboard needs to be displayed on the external screen, the font size needs to be very small, resulting in poor user accuracy and experience. The approach of this application is to generate input content through voice or an automatic generation function provided by the electronic device, instead of using the input method's keyboard. Users can then modify the input content by interacting with the touchpad or with controls on the external screen. This allows users to accurately input content on the external screen without needing a physical keyboard. Replacing the keyboard with an input prompt bar significantly reduces obstruction of the original application interface. Furthermore, the touchpad reduces the touch interaction burden on the foldable external screen and provides greater freedom of interaction.

[0008] In one possible implementation, the input content is text, and the modification includes at least one of the following: deleting characters in the text, selecting and replacing a portion of characters in the text, and optimizing the content of the text.

[0009] In one possible implementation, the auto-response control includes: an identifier of the type of generated content, the type being at least one of the following: text, location, business card, file, application card, or image.

[0010] In one possible implementation, the second input is a first gesture operation, which is a first type of swipe gesture for the touchpad, and the first gesture operation is used to select at least one character in the input content and delete it.

[0011] In one possible implementation, receiving the second input includes: receiving a first gesture operation to select at least one character from the input content; the second gesture operation being a second type of swipe gesture for the touchpad; displaying a delete confirmation control associated with the at least one character; and receiving a confirmation operation for the delete confirmation control.

[0012] In one possible implementation, the number of characters in the at least one character is related to the length, pressing time, or number of times of the first type of swipe gesture.

[0013] In one possible implementation, receiving the first gesture operation and selecting at least one character from the input content includes:

[0014] A first swipe gesture is received for the touchpad; the first swipe gesture is used to select multiple characters from the input content;

[0015] A second swipe gesture is received for the touchpad; the second swipe gesture is in the opposite direction to the first swipe gesture; the second swipe gesture is used to remove some characters from the plurality of characters in order to select at least one character from the input content.

[0016] In one possible implementation, displaying input content in the input area includes: displaying input content and a cursor in the input area; the method further includes:

[0017] Upon receiving a second gesture operation, which is a second type of swipe gesture, the cursor position is moved; wherein the direction of the cursor position movement is related to the direction of the second type of swipe gesture.

[0018] In one possible implementation, the second input is a third gesture operation, which is a touch gesture that covers an area or proportion of the touchpad exceeding a preset value or a touch gesture with continuous pressing pressure exceeding a threshold. The modification specifically involves optimizing the input content.

[0019] In one possible implementation, the content optimization is at least one of the following: tone optimization, grammatical correction, format adjustment, and content refinement.

[0020] Tone optimization refers to the linguistic reorganization of input text to align with a specific tone, such as gentle or formal. The tone type can be preset or selected by the user after an overlay gesture is detected.

[0021] Grammar correction: This involves reorganizing text according to a pre-defined grammatical logic to eliminate grammatical errors.

[0022] Formatting adjustments: This involves adjusting the format of the input text, which is typically used for inputting multiple paragraphs, such as emails. Examples include aligning paragraphs and indenting the first line.

[0023] Content refinement: Refine the text by eliminating repetitive words, interjections, etc.

[0024] In one possible implementation, the text content indicated by the first voice input is an instruction, and the input content is content generated according to the instruction that satisfies the requirements of the instruction.

[0025] In one possible implementation, receiving the first input includes: receiving a first voice input simultaneously with detecting a fourth gesture operation, wherein the fourth gesture operation is a continuous touch gesture with a pressing pressure greater than a threshold.

[0026] For example, when a user presses the touchpad hard, the user's voice input can be used as a command, and the generated content that meets the requirements of the command can be displayed in the input area. When a user presses the touchpad lightly, the text input by the user's voice can be directly displayed in the input area.

[0027] In one possible implementation, receiving the second input and displaying modified content includes: receiving a second voice input simultaneously with detecting a fifth gesture operation, the fifth gesture operation being an operation applied to the touchpad; modifying the input content according to the content of the second voice input, and displaying the modified content. For example, the fifth gesture operation is a sustained press on the touchpad (e.g., a press with pressure greater than a threshold).

[0028] Secondly, this application provides a data input device applied to an electronic device, the electronic device including a display screen and a touchpad, the display screen including a foldable screen and an outer screen, the foldable screen being foldable along a folding edge to form multiple inner screens; the outer screen and the touchpad being located on the same surface; the device includes:

[0029] The display module is used to display an input area and an input prompt bar for the input area on the external screen; the input prompt bar includes prompt information that can be input by voice or an automatically generated control; the automatic reply control is used to generate content based on the context;

[0030] The receiving module is used to receive a first input, and the display module is used to display the input content in the input area; the first input is a first voice input or a selection operation on the automatically generated control;

[0031] The receiving module is used to receive the second input, and the display module is used to display the modified content of the input; the second input is an input applied to the touchpad or a selection operation of a control displayed on the external screen to indicate modification.

[0032] In one possible implementation, the input content is text, and the modification includes at least one of the following:

[0033] The text is processed by deleting characters, selecting and replacing certain characters, and optimizing the text content.

[0034] In one possible implementation, the auto-response control includes: an identifier of the type of the generated content, said type being at least one of the following:

[0035] Text, location, business cards, documents, application cards, or images.

[0036] In one possible implementation, the second input is a first gesture operation, which is a first type of swipe gesture for the touchpad, and the first gesture operation is used to select at least one character in the input content and delete it.

[0037] In one possible implementation, the receiving module is configured to:

[0038] Upon receiving a first gesture operation, at least one character from the input content is selected; the second gesture operation is a second type of swipe gesture for the touchpad.

[0039] The display module is used to display a deletion confirmation control associated with the at least one character;

[0040] The receiving module is used to receive a confirmation operation for the deletion confirmation control.

[0041] In one possible implementation, the number of characters in the at least one character is related to the length, pressing time, or number of times of the first type of swipe gesture.

[0042] In one possible implementation, the receiving module is configured to:

[0043] A first swipe gesture is received for the touchpad; the first swipe gesture is used to select multiple characters from the input content;

[0044] A second swipe gesture is received for the touchpad; the second swipe gesture is in the opposite direction to the first swipe gesture; the second swipe gesture is used to remove some characters from the plurality of characters in order to select at least one character from the input content.

[0045] In one possible implementation, the display module is configured to display input content and a cursor in the input area; the receiving module is configured to:

[0046] Upon receiving a second gesture operation, which is a second type of swipe gesture, the cursor position is moved; wherein the direction of the cursor position movement is related to the direction of the second type of swipe gesture.

[0047] In one possible implementation, the second input is a third gesture operation, which is a touch gesture that covers an area or proportion of the touchpad exceeding a preset value or a touch gesture with continuous pressing pressure exceeding a threshold. The modification specifically involves optimizing the input content.

[0048] In one possible implementation, the content optimization is at least one of the following: tone optimization, grammatical correction, format adjustment, and content refinement.

[0049] In one possible implementation, the text content indicated by the first voice input is an instruction, and the input content is content generated according to the instruction that satisfies the requirements of the instruction.

[0050] In one possible implementation, the receiving module is configured to:

[0051] Simultaneously with detecting the fourth gesture operation, the first voice input is received, wherein the fourth gesture operation is a continuous touch gesture with a pressing pressure greater than a threshold.

[0052] In one possible implementation, the receiving module is configured to:

[0053] Simultaneously with detecting the fifth gesture operation, a second voice input is received, wherein the fifth gesture operation is an operation performed on the touchpad;

[0054] The display module is used to modify the input content according to the content of the second voice input, and display the modified content.

[0055] Thirdly, embodiments of this application provide a data input device, which may include a memory, a processor, and a bus system, wherein the memory is used to store a program, and the processor is used to execute the program in the memory to perform the methods described in the first aspect above and any of its optional methods.

[0056] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the methods described in the first aspect and any of its optional methods.

[0057] Fifthly, embodiments of this application provide a computer program that, when run on a computer, causes the computer to perform the first aspect and any of its optional methods described above.

[0058] Sixthly, this application provides a chip system including a processor for supporting the execution of data input devices to perform the functions involved in the foregoing aspects, such as transmitting or processing data involved in the foregoing methods; or, information. In one possible design, the chip system further includes a memory for storing program instructions and data necessary for the execution device or training device. This chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0059] Figures 1 to 4 This is a schematic diagram of an optional hardware structure for a terminal.

[0060] Figure 5This is a schematic diagram of one product form according to this application;

[0061] Figure 6 A flowchart illustrating a data input method provided in an embodiment of this application;

[0062] Figures 7 to 10G This application provides an example of an application interface.

[0063] Figure 11 This is a schematic diagram of a data input device provided in an embodiment of this application. Detailed Implementation

[0064] The technical solutions in the embodiments of this application will now be described clearly and in detail with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0065] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0066] This application provides a display method for a foldable screen, which can be applied to an electronic device 100 having a foldable screen. The foldable screen can be folded to form at least two screens. For example, the foldable screen can be folded along a folding edge or folding axis to form multiple inner screens (e.g., the multiple inner screens include a first screen and a second screen).

[0067] The folding method of the foldable screen on the electronic device 100 can be divided into two categories. One type is an outward-folding foldable screen (referred to as an outward-folding foldable screen), and the other type is an inward-folding foldable screen (referred to as an inward-folding foldable screen). Taking the foldable screen folding into a first screen and a second screen as an example: After the outward-folding foldable screen is folded, the display directions of the first screen and the second screen are opposite to each other. After the inward-folding foldable screen is folded, the display directions of the first screen and the second screen are opposite to each other. In this embodiment, the first screen can be referred to as screen A, and the second screen can be referred to as screen B.

[0068] In this embodiment of the application, the electronic device 100 uses an inward folding screen, that is, the display direction of the first screen is opposite to the display direction of the second screen.

[0069] For example, please refer to Figure 1 This illustration shows a schematic diagram of a product form of an electronic device 100 with an inwardly folding screen, according to an embodiment of this application. Figure 1 (a) is a schematic diagram of the fully unfolded inward-folding screen. This inward-folding screen can be unfolded along the folding edge... Figure 1 Folding in directions 11a and 11b as shown in (a) can form Figure 1 The image shows screens A and B in a semi-folded configuration, as shown in (b). When the foldable screen is folded into screens A and B, screen A can be on the same side as the front-facing camera on the electronic device 100. This inward-folding screen can be folded along the folding edge... Figure 1 Screens A and B are shown in (b) above. This inward-folding screen can be folded along the folding edge, according to... Figure 1 If directions 12a and 12b, as shown in (b), are folded further, they can form Figure 1 The outward-folding screen in its fully folded state, as shown in (c) above. Figure 1 As shown in (c), when the folding screen of the electronic device 100 is fully folded, screen A and screen B are facing each other and are not visible to the user.

[0070] It should be noted that a display screen, which can be referred to as a third screen, can also be provided on the back of the first or second screen of the inward-folding screen provided in the embodiments of this application. For example, Figure 2 As shown in (a) above, a C screen (i.e., a third screen) can be installed on the back of screen A (i.e., the first screen). Figure 2 As shown in (b), when the inward-folding screen is fully folded, screen C faces away from screen A and is visible to the user. Screen C can be on the same side as the rear camera on the electronic device 100. It can be understood that for the electronic device 100 with this type of inward-folding screen, when the folding screen is fully folded, the interface can be displayed on the third screen; when the folding screen is half-folded, the interface can be displayed on the first, second, and third screens; and when the folding screen is unfolded, the interface can be displayed on the first and second screens.

[0071] The above Figures 1-2 In this embodiment, the foldable screen of the electronic device 100 is folded vertically, that is, folded along the vertical folding edge to form two screens (screen A and screen B). Alternatively, in this embodiment, the foldable screen of the electronic device 100 can also be folded horizontally, that is, folded along the horizontal folding edge to form two screens (screen A and screen B). For example, as... Figure 3 The folding screen shown in (a) is formed by folding along the folding edges in the horizontal direction of the folding screen. Figure 3 (b) in the middle Figure 3 (c) / Figure 3 As shown in (d) in the figure.

[0072] In some embodiments of this application, the electronic device 100 may have a display screen (i.e., an outer screen) disposed on the back of the first or second screen, which may be referred to as a third screen. For example, as Figure 3 As shown in (d), a C screen (third screen) can be provided on the back of the A screen (first screen), and the C screen can be on the same side as the rear camera on the electronic device 100.

[0073] In some embodiments, the foldable screen of the electronic device 100 can surround the entire perimeter of the electronic device 100, and the aforementioned screen A (first screen), screen B (second screen), and screen C (third screen) can all be part of the foldable screen. When the foldable screen is folded, screen A can be opposite to screen C, and screen A can be adjacent to screen B.

[0074] In this embodiment, the angle between screen A and screen B of the foldable screen of the electronic device 100 ranges from [0°, 180°]. Specifically, if α ∈ [0°, P1], the electronic device 100 can determine that the foldable screen is in a fully folded state; if α ∈ (P1, P2), the electronic device 100 can determine that the foldable screen is in a half-folded state; and if α ∈ [P2, 180°], the electronic device 100 can determine that the foldable screen is in a fully unfolded state. Wherein, 0° < P1 < P2 < 180°. P1 and P2 can be preset angle thresholds. P1 and P2 can be determined based on the usage habits of a large number of users of foldable screens; or, P1 and P2 can be set by the user in the electronic device 100.

[0075] In some embodiments, based on the usage habits of most users, when the angle α between screens A and B is greater than 100°, the user is more likely to want to use screens A and B as a whole (i.e., as a complete display). When the angle α between screens A and B is less than 80 degrees, the user is more likely to want to use screen A or screen B separately, and the foldable screen can be in a fully folded state. When the angle α between screens A and B is between 80 degrees and 100 degrees, the user is more likely to want to use screens A and B to display different content, and the foldable screen can be in a semi-folded state.

[0076] Therefore, in this embodiment of the application, the preset angle threshold P1 can be in the range of (0, 80°), and the preset angle threshold P2 can be in the range of [100°, 180°]. For example, the preset angle threshold P1 can be 75°, and the preset angle threshold P2 can be 105°. The above examples are merely for explaining this application and should not be construed as limiting it.

[0077] It should be noted that the foldable screen in this embodiment can be at least two independent screens or a single integrated screen, which is simply folded to form at least two parts.

[0078] For example, a foldable screen can be a flexible foldable screen, which includes folding edges made of a flexible material. This flexible foldable screen may be partially or entirely made of a flexible material. When folded, the flexible foldable screen forms at least two integrated screens, constituting a single, complete structure, simply folded into at least two parts.

[0079] For example, the aforementioned foldable screen can be a multi-screen foldable screen. This multi-screen foldable screen can include multiple (two or more) screens. These multiple screens are multiple individual displays. These multiple screens can be connected sequentially via folding axes. Each screen can rotate around the folding axis to which it is connected, thus achieving the folding of the multi-screen foldable screen.

[0080] In subsequent embodiments of this application, the method provided in the embodiments of this application will be described using a flexible foldable screen that can be folded horizontally as an example.

[0081] For example, the electronic device 100 in this application embodiment may be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, as well as cellular phone, personal digital assistant (PDA), augmented reality (AR) / virtual reality (VR) device, etc., including the above-mentioned foldable screen. This application embodiment does not impose any special restrictions on the specific type of the electronic device 100.

[0082] The electronic device 100 provided in the embodiments of this application will now be described with reference to the accompanying drawings.

[0083] Figure 4 A schematic diagram of the structure of the electronic device 100 is shown.

[0084] The following description uses electronic device 100 as an example to illustrate the embodiment. It should be understood that... Figure 4 The electronic device 100 shown is merely an example, and the electronic device 100 may have more than Figure 4 The more or fewer components shown can be combined into two or more components, or they can have different component configurations. The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0085] Electronic device 100 may include: processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0086] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0087] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0088] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0089] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0090] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0091] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0092] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0093] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0094] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0095] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0096] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0097] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0098] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0099] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0100] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0101] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0102] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0103] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0104] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0105] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0106] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0107] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0108] The display screen 194 is used to display images, videos, etc. The display screen 194 may include the aforementioned inward-folding screen. In some embodiments, the display screen 194 includes the aforementioned inward-folding screen and a C-screen, such as those described above. Figure 2 As shown in (a) or above Figure 3 As shown in (d) in the figure.

[0109] The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0110] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0111] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0112] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0113] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0114] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0115] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0116] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0117] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0118] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0119] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0120] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0121] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0122] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0123] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0124] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0125] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0126] With the continuous development of electronic devices, more and more electronic devices with displays are being used in people's daily lives and work, such as mobile phones with displays. Furthermore, with the development of screen technology, the displays of electronic devices are becoming larger and larger to provide users with richer information and a better user experience.

[0127] However, excessively large displays on electronic devices severely compromise their portability. Therefore, electronic devices equipped with foldable screens (such as foldable phones) represent the future direction of electronic device development.

[0128] Currently, foldable screens can be categorized into folded and unfolded states. When folded, the screen can be folded into at least two screens. The outer screen (also known as the secondary screen or cover screen) is a crucial design element of foldable phones at this stage. As more and more applications can be used directly on the outer screen, its functionality is gradually increasing, highlighting the drawback of its small size. One issue is input problems; due to the small screen size, the keyboard, when fully unfolded, obstructs the screen, resulting in a poor user experience.

[0129] Specifically, when the full keyboard function of the inner screen is migrated to the outer screen, the key size needs to be significantly reduced, making it difficult to click; and the font size in the text box of the outer screen is too small, making it difficult to position the cursor and select text after input, thus affecting the efficiency of text editing.

[0130] Reference Figure 5 The electronic device in this application may have a screen (outer screen 101) and a touchpad 102, with the touchpad located near the screen for easy operation. Considering the form factor of a small folding device, it has an inner screen and an outer screen. The inner screen supports folding; when folded, the inner screen is hidden, making it difficult for the user to operate. The user uses the outer screen to access applications. In this solution, unless otherwise specified, "screen" generally refers to the outer screen, and the touchpad is located near the outer screen.

[0131] To address the aforementioned problems, embodiments of this application provide a data input method. The data input method of this application embodiment will be described in detail below with reference to the accompanying drawings.

[0132] Reference Figure 6 , Figure 6 This is a flowchart illustrating a data input method provided in an embodiment of this application, such as... Figure 6 As shown in the figure, the data input method provided in this application embodiment may include steps 601 to 603, which are described in detail below.

[0133] 601. Display an input area and an input prompt bar on the external screen; the input prompt bar includes prompts that can be input by voice or automatically generated controls; the automatic reply control is used to generate content based on the context.

[0134] When the foldable screen is folded, users can use the application through the outer screen.

[0135] In input scenarios, the keyboard size of the input method is too large for a small external screen. If the keyboard needs to be displayed on the external screen, the font size needs to be very small, resulting in poor user accuracy and experience. The approach of this application is to generate input content through voice or an automatic generation function provided by the electronic device, instead of using the input method's keyboard. Users can then modify the input content by interacting with the touchpad or with controls on the external screen. This allows users to accurately input content on the external screen without needing a physical keyboard. Replacing the keyboard with an input prompt bar significantly reduces obstruction of the original application interface. Furthermore, the touchpad reduces the touch interaction burden on the foldable external screen and provides greater freedom of interaction.

[0136] The outer screen can display information guiding users to make voice input or automatic replies, which is the input prompt bar.

[0137] Next, we will introduce the input prompt bar:

[0138] In one possible implementation, the electronic device can detect gestures on the screen, enter an input scenario, and display an input prompt bar on the screen. For example, when an input box is displayed on the screen, the user can trigger the input scenario by clicking the input box. In the input scenario, the user expects to use an input method to input data. In traditional input schemes, after entering an input scenario, the operating system launches the input method application and displays a virtual keyboard on the screen. However, due to the screen's height, when displayed on an external screen, the input method essentially occupies most of the screen area. In this embodiment, after entering an input scenario, the input method application is not launched; instead, an input prompt bar is displayed on the screen (without displaying a virtual keyboard).

[0139] Optionally, the input prompt bar may include prompts that can be entered via voice and an automatic reply control (also known as a smart reply bubble). Additionally, the input prompt bar may include input prompt messages.

[0140] The input method prompts include indicators of the current input status, such as "Waiting to start input" or "Inputting," and can be text or visual icons. After input is complete, the prompts can also include controls to indicate modifications. These controls can include one or more actions to adjust the input content in the current input box. Different actions correspond to different adjustments, such as deletion or optimizing the input text using AI capabilities. Actions can be presented as visual icons on the prompt bar (or independently outside the prompt bar).

[0141] Next, we will introduce the input auto-responder control:

[0142] In one possible implementation, an auto-reply control is used to provide intelligent replies within the current page context. When the auto-reply control is clicked, at least one recommended intelligent reply is displayed on the screen. The user can select one as input, and after clicking, the selected intelligent reply is filled into the input box, or the message is sent directly. The intelligent reply function can help users save time and improve communication quality, and is especially suitable for quickly replying to messages in mobile scenarios.

[0143] In one possible implementation, the auto-response control includes: an identifier of the type of generated content, the type being at least one of the following: text, location, business card, file, application card, or image.

[0144] In other words, the auto-response control can also include an association identifier, which is associated with the smart reply content and can indicate the content attributes of the smart reply content. For example, when the smart reply content is a plain text reply, the association identifier is the default identifier; when the reply content includes location data obtained from location, the association identifier can be a location identifier; when it includes business card data, the association identifier can be a business card; when it includes travel data such as flights, it can be the corresponding travel identifier (e.g., airplane or train).

[0145] Figure 7 The text shows the input tooltip displayed on the screen, which is shown at the bottom of the screen by default. Figure 7 In (a), based on the context, it is only search input and no response is required; therefore, the input prompt bar only includes input prompt information. Figure 7 (b) and Figure 7 In (c), the user needs to respond based on the context of the content displayed on the screen; therefore, the input prompt bar also includes a smart reply bubble. Figure 7 In (b), if you click on the smart reply bubble, all the recommended reply content will be plain text. Then, the association markers in the smart reply bubble will be the three dots indicating the text attributes. Figure 7 In (c), if you click on the smart reply bubble and at least one of the recommended replies is a file, then the association identifier is a file identifier.

[0146] It's understandable that the correspondence between the shape of the association identifier and the content attributes of the reply can be predefined. When any of the multiple recommended replies has a content attribute, the association identifier corresponding to that content attribute is displayed within the smart reply bubble. The recommended reply content can be generated using AI-powered smart replies.

[0147] In one possible implementation, the text content indicated by the first voice input is an instruction, and the input content is content generated according to the instruction that satisfies the requirements of the instruction.

[0148] In other words, when inputting content via voice, the input content can be the text indicated by the voice, or it can be an enhanced version of the voice-indicated content. For example, the voice input content can be enhanced using the system's AI capabilities (such as an AI assistant).

[0149] For example, in this embodiment of the application, the system's AI capabilities (such as an AI assistant) can be invoked through interaction with the touchpad, and then a brief description can be provided to the AI ​​assistant. After receiving the brief description, the AI ​​assistant obtains the input text based on the brief description and displays the input text in the input box.

[0150] As described above, this embodiment utilizes the system's AI capabilities to achieve input, typically using one type of AI capability—speech-to-text. In this mode, the voice signal collected by the electronic device is directly transmitted to the AI ​​assistant, which then performs speech-to-text conversion to obtain the input text. The AI ​​assistant then sends a signal carrying the input text to the application to which the input box belongs. Upon receiving the signal, the application obtains the input text and displays it in the input box.

[0151] Users can use touchpad gestures (such as a hard press: see reference) Figure 8 (When the pressure is between F1 and F2), switch to another AI capability. Under this capability, after receiving the voice, the AI ​​understands the voice and then, based on the understanding of the voice, combined with its own knowledge graph, network search results, etc., obtains the input text according to the input voice. Then, it sends the signal carrying the input text to the application to which the input box belongs. After receiving it, the application obtains the input text and displays the input text in the input box.

[0152] The difference between the two methods is that the first method obtains input text that corresponds to the user's voice; the other method uses the user's voice as input and the AI's output as input text.

[0153] Of course, in some designs, the input text and the actual musical notes produced by the user don't necessarily correspond one-to-one in the first input method; they only need to roughly correspond. For example, during the input process, the operating system can automatically utilize AI capabilities to optimize the input text. These optimizations can include at least one of the following: tone optimization, grammar correction, formatting adjustment, and content refinement. For instance, the text that corresponds one-to-one with the musical notes produced by the user can be displayed first, and then optimization can be performed to obtain the final input text.

[0154] Whether or not the content of the voice input is enhanced can be triggered by different gesture types. For example, in one possible implementation, the first voice input can be received at the same time as the fourth gesture operation is detected, wherein the fourth gesture operation is a continuous touch gesture with a pressing pressure greater than a threshold.

[0155] Figure 8 The images show the input results under two different gestures. After entering input mode by clicking the input box, following the input method in the upper right branch, a light press followed by the user's voice prompt "Not participating, time conflict" results in the corresponding input text "Not participating, time conflict." In the lower right input method, a hard press followed by the user's voice prompt "Not participating, time conflict" serves as input for the voice assistant. The voice assistant, based on semantic understanding, obtains a text, uses this text as input, and then displays the input text in the email editing box.

[0156] 602. Upon receiving the first input, display the input content in the input area; the first input is either a first voice input or a selection operation on the automatically generated control;

[0157] For example, the electronic device can detect a preset gesture 1 applied to the touchpad, acquire a voice signal through the microphone, convert the voice signal into text to obtain the input text, and display the input text on the screen. When the screen displays an input prompt bar, it indicates that voice input is available, and the user can interact with the touchpad to input the text. When the user performs preset gesture 1 on the touchpad, the electronic device accesses the microphone to acquire a voice signal in real time, processes the voice signal by filtering and amplifying it, and then converts the voice signal into text to obtain the input text.

[0158] In this embodiment, the preset gesture 1 can be a light press gesture. Under a light press gesture, the hand remains in contact with the touchpad, but the touch pressure is less than a preset value. Touch pressure detection can be achieved using a configured pressure sensor. After the speech-to-text input text is obtained, the text is displayed in the input box, which is the input box selected by the user, such as a search box or the input box of a dialog box. During the input process, the input prompt information on the input prompt bar changes, for example, from... Figure 7 The "Press touchpad to input" message has been changed to "Inputting" in the input field.

[0159] Figure 9 The input interface is shown. The user's pressure level is between F0 and F1 (pressure levels below F0 will not be recognized as gestures), and the user holds the press for more than a preset time (e.g., 1 second). The microphone begins capturing ambient audio signals, and the input prompt bar changes to a graphic icon indicating that speech is being received, signifying that input is in progress. The speech-to-text input text is then displayed in the input box.

[0160] 603. Upon receiving the second input, display the modified content of the input; the second input is either input applied to the touchpad or a selection operation of a control displayed on the external screen to indicate modification.

[0161] In this embodiment, the input text can be modified or adjusted before it is sent (by clicking the send button / OK button or other sending actions). Modifications / adjustments to the input text can be made through interaction with the touchpad or with controls displayed on the screen that indicate the modification (e.g., the type of modification).

[0162] In one possible implementation, the modification includes at least one of the following: deleting characters in the text, selecting and replacing a portion of characters in the text, or optimizing the content of the text.

[0163] Regarding deletion:

[0164] In one possible implementation, the second input is a first gesture operation, which is a first type of swipe gesture for the touchpad, and the first gesture operation is used to select at least one character in the input content and delete it.

[0165] Users can delete text using edge swipe gestures. When the electronic device detects an edge swipe gesture, it executes a text deletion. The number of deleted texts is directly proportional to the swipe distance; the greater the swipe distance, the more text is deleted. Due to the limited area of ​​the touchpad, the distance of each swipe is finite. Therefore, the distances of multiple swipes can be cumulatively calculated to delete multiple texts at once. Alternatively, each swipe can be calculated individually, deleting one or two texts based on the distance of each swipe; or each edge swipe gesture can delete the text closest to the cursor.

[0166] An edge swipe gesture refers to swiping from the edge of the touchpad towards the center. To detect an edge swipe gesture, simply adding the detection of the starting point of the swipe to the detection of the swipe trajectory (whether it is located at the edge of the touchpad) is sufficient to recognize the gesture.

[0167] In one possible implementation, a first gesture operation may be received, selecting at least one character from the input content; the second gesture operation is a second type of swipe gesture for the touchpad; a delete confirmation control associated with the at least one character is displayed; and a confirmation operation for the delete confirmation control is received.

[0168] In one possible implementation, the number of characters in the at least one character is related to the length, pressing time, or number of times of the first type of swipe gesture.

[0169] After performing an edge swipe gesture, the text is not immediately deleted. Instead, a deletion marker is added to the selected text, such as a horizontal line in the middle of the text to indicate that it needs to be deleted. After selecting the text to be deleted, a confirmation action is taken to delete it. The confirmation action can be a tap on a control on the screen or a touchpad gesture. For example, after adding a deletion marker, a delete control is displayed in the deletion area. Tapping this delete control will delete all text currently marked with a deletion marker. Alternatively, after adding a deletion marker, tapping (or swiping down or using other gestures) the touchpad will delete all text marked with a deletion marker. After deletion, the deleted text is no longer displayed on the screen.

[0170] Figure 10A In the input text, before executing the edge swipe gesture, the cursor is located at the end of the input text. Based on the swipe distance, this swipe deletes two characters (or two consecutive edge swipe gestures are executed). Therefore, the two characters before the cursor are the text to be deleted, marked with a delete indicator. Simultaneously, the cursor moves forward two characters to before the text to be deleted. The delete indicator is also displayed on the screen. Once the text to be deleted is confirmed, clicking the delete indicator will remove the text to be deleted, and the text will no longer be displayed.

[0171] In one possible implementation, a first swipe gesture may be received for the touchpad; the first swipe gesture is used to select multiple characters in the input content; a second swipe gesture may be received for the touchpad; the second swipe gesture is in the opposite direction to the first swipe gesture; the second swipe gesture is used to remove some characters from the multiple characters to select at least one character in the input content.

[0172] When a deletion marker (pre-deletion text) is present on the screen, a swipe gesture in the opposite direction to the edge swipe gesture cancels the deletion of the pre-deletion text. The number of pre-deletion texts canceled is positively correlated with the swipe distance / number of swipes, similar to the number of texts deleted via an edge swipe gesture. Correspondingly, the cursor also moves backward. For example, if the edge swipe gesture is a swipe from the right edge of the touchpad to the left, and the selected pre-deletion text is incorrect, resulting in the deletion of more text, it can be undone with a right swipe gesture (either a regular right swipe or the reverse edge swipe gesture). Each right swipe cancels the deletion marker of one pre-deletion text, and the cursor moves back one position. Alternatively, the number of pre-deletion texts canceled is determined by the swipe distance; the greater the swipe distance, the more pre-deletion texts are canceled.

[0173] Figure 10BThe figure in the middle shows the screen display interface after a single right swipe. Before the right swipe, the pre-deleted text was originally the two characters "Name". After the right swipe to cancel the deletion, the pre-deleted text only has the single character "称".

[0174] When there is already input text in the input box, the user can select part of the input text to delete only the selected input text separately, such as the deletion / text optimization mentioned above. In this embodiment, after detecting a double-tap gesture on the touchpad, the cursor position is first determined, and then several input texts near the cursor are selected. For example, 3 Chinese characters / English words behind the cursor are selected.

[0175] Figure 10C In the figure. After the double-tap gesture, two Chinese characters behind the cursor are selected. At this time, when performing input operations such as deletion and text intelligent optimization, only the two selected Chinese characters are operated on. If the selection is cancelled, the operation is for all the input text in the input box.

[0176] In a possible implementation, the input content and the cursor can be displayed in the input area; when adjusting the cursor position, a second gesture operation can be received, and the second gesture operation is a second type of swipe gesture to move the position of the cursor; wherein, the direction of movement of the cursor is related to the direction of the second type of swipe gesture.

[0177] When in the input scenario, a cursor is displayed in the input box to indicate the current input position. The user can adjust the position of the cursor by performing a normal swipe gesture (the starting point is not at the edge of the touchpad) on the touchpad. The electronic device determines the moving direction of the cursor by detecting the swipe direction: when swiping up, the cursor moves up; when swiping left, the cursor moves left; the same applies to swiping down and right. The electronic device can also detect the swipe distance to determine the moving distance of the cursor. The so-called moving distance is the number of texts moved horizontally and the number of lines moved vertically.

[0178] For example, when swiping up once, the cursor swipes up one line. When swiping left, the number of texts the cursor moves forward is determined according to the distance.

[0179] Refer to Figure 10D On the left side, after swiping up once, the cursor moves up one line, moving from the end of the input text to between "能" and "不". Then when swiping left, according to the calculated swipe distance of moving 2 text intervals, the cursor moves in front of "?".

[0180] In some designs, during the movement of the cursor, for easy observation, the input box and the text in the input box are enlarged and displayed, thus having an effect similar to a magnifying glass. This enlarged display can directly enlarge the input box for display, or mirror the input box through a system ability similar to a magnifier and then enlarge it.

[0181] Figure 10E The text shows the intermediate state of the movement process. During the movement, the input box is enlarged to fit the width of the desktop and obscures the original input box. The text and cursor in the input box are also enlarged accordingly.

[0182] Regarding content optimization:

[0183] In one possible implementation, the second input is a third gesture operation, which is a touch gesture that covers an area or proportion of the touchpad exceeding a preset value or a touch gesture with continuous pressing pressure exceeding a threshold. The modification specifically involves optimizing the input content.

[0184] In one possible implementation, the content optimization is at least one of the following: tone optimization, grammatical correction, format adjustment, and content refinement.

[0185] In this embodiment, AI capabilities can be invoked to intelligently optimize the input text during the input process. In this embodiment, if the electronic device detects that the area of ​​the touchpad covered by a gesture exceeds a preset value (e.g., 90%), the electronic device acquires the input text within the input box and performs intelligent optimization on it. Intelligent optimization includes: tone optimization, grammar correction, format adjustment, and content refinement.

[0186] Tone optimization refers to the linguistic reorganization of input text to align with a specific tone, such as gentle or formal. The tone type can be preset or selected by the user after an overlay gesture is detected.

[0187] Grammar correction: This involves reorganizing text according to a pre-defined grammatical logic to eliminate grammatical errors.

[0188] Formatting adjustments: This involves adjusting the format of the input text, which is typically used for inputting multiple paragraphs, such as emails. Examples include aligning paragraphs and indenting the first line.

[0189] Content refinement: Refine the text by eliminating repetitive words, interjections, etc.

[0190] Figure 10F The text is shown in the comparison before and after the execution of the overlay gesture. The text is reorganized and the format is adjusted so that the format automatically adapts to the email reply format, while making the tone more formal and written.

[0191] Figure 10FIn the input bar, after input is completed or paused, the input prompt changes, displaying delete and refine controls. The delete control removes the text preceding the cursor. Clicking the refine control displays multiple sub-menu options, allowing users to optimize the text. For example, tone optimization, grammar correction, formatting adjustment, and content refinement each correspond to a specific menu item.

[0192] In one possible implementation, a second voice input can be received simultaneously with the detection of the fifth gesture operation, the fifth gesture operation being an operation applied to the touchpad; based on the content of the second voice input, the input content is modified, and the modified content is displayed.

[0193] In another design, if there is already text in the input field, a hard press gesture is performed. The electronic device then uses the existing text in the input field as input for the AI ​​assistant, resulting in updated text. The updated text then replaces the existing text, and so on. Figure 10G After performing a hard press gesture on the upper right side of the interface, the AI ​​assistant reinterprets the text in the email editing box and then obtains the updated input text on the lower right side of the interface.

[0194] In another design, the user can provide voice commands while the key is pressed, allowing the user to modify the existing input text based on the voice commands, such as replacing content.

[0195] Figure 10G The example demonstrates how to partially modify existing input text. With existing input text, hold down the key and enter a voice command; the AI ​​assistant can then modify the input text based on semantic understanding. For instance, changing "If it's for family members, I want to bring two" to "If it's for family members, I want to bring one."

[0196] After modifying existing input text, you can also undo the previous modification using an undo gesture. For example, the undo gesture is a swipe down gesture. Figure 10G In the middle, after performing a swipe down gesture, the text entered in the email editing box on the right is restored to the text in the email editing box on the left.

[0197] Reference Figure 11 , Figure 11 This application provides a schematic diagram of the structure of a data input device according to an embodiment of the present application. Figure 11 As shown, the device is applied to an electronic device, which includes a display screen and a touchpad. The display screen includes a foldable screen and an outer screen. The foldable screen can be folded along its folding edge to form multiple inner screens. The outer screen and the touchpad are located on the same side. The device 1100 includes:

[0198] Display module 1101 is used to display an input area and an input prompt bar for the input area on the external screen; the input prompt bar includes prompt information that can be input by voice or an automatically generated control; the automatic reply control is used to generate content based on the context;

[0199] The specific description of the display module 1101 can be found in the description of the display action steps in steps 601, 602 and 603 of the above embodiments. The similarities will not be repeated here.

[0200] The receiving module 1102 is used to receive a first input, and the display module 1101 is used to display the input content in the input area; the first input is a first voice input or a selection operation on the automatically generated control;

[0201] The receiving module 1102 is used to receive the second input, and the display module 1101 is used to display the modified content of the input; the second input is an input applied to the touchpad or a selection operation of a control displayed on the external screen to indicate modification.

[0202] The specific description of the receiving module 1102 can be found in the description of the receiving action in steps 601, 602 and 603 of the above embodiment. The similarities will not be repeated here.

[0203] In one possible implementation, the input content is text, and the modification includes at least one of the following:

[0204] The text is processed by deleting characters, selecting and replacing certain characters, and optimizing the text content.

[0205] In one possible implementation, the auto-response control includes: an identifier of the type of the generated content, said type being at least one of the following:

[0206] Text, location, business cards, documents, application cards, or images.

[0207] In one possible implementation, the second input is a first gesture operation, which is a first type of swipe gesture for the touchpad, and the first gesture operation is used to select at least one character in the input content and delete it.

[0208] In one possible implementation, the receiving module 1102 is configured to:

[0209] Upon receiving a first gesture operation, at least one character from the input content is selected; the second gesture operation is a second type of swipe gesture for the touchpad.

[0210] The display module 1101 is used to display a deletion confirmation control associated with the at least one character;

[0211] The receiving module 1102 is used to receive a confirmation operation for the deletion confirmation control.

[0212] In one possible implementation, the number of characters in the at least one character is related to the length, pressing time, or number of times of the first type of swipe gesture.

[0213] In one possible implementation, the receiving module 1102 is configured to:

[0214] A first swipe gesture is received for the touchpad; the first swipe gesture is used to select multiple characters from the input content;

[0215] A second swipe gesture is received for the touchpad; the second swipe gesture is in the opposite direction to the first swipe gesture; the second swipe gesture is used to remove some characters from the plurality of characters in order to select at least one character from the input content.

[0216] In one possible implementation, the display module 1101 is used to display input content and a cursor in the input area; the receiving module 1102 is used to:

[0217] Upon receiving a second gesture operation, which is a second type of swipe gesture, the cursor position is moved; wherein the direction of the cursor position movement is related to the direction of the second type of swipe gesture.

[0218] In one possible implementation, the second input is a third gesture operation, which is a touch gesture that covers an area or proportion of the touchpad exceeding a preset value or a touch gesture with continuous pressing pressure exceeding a threshold. The modification specifically involves optimizing the input content.

[0219] In one possible implementation, the content optimization is at least one of the following: tone optimization, grammatical correction, format adjustment, and content refinement.

[0220] In one possible implementation, the text content indicated by the first voice input is an instruction, and the input content is content generated according to the instruction that satisfies the requirements of the instruction.

[0221] In one possible implementation, the receiving module 1102 is configured to:

[0222] Simultaneously with detecting the fourth gesture operation, the first voice input is received, wherein the fourth gesture operation is a continuous touch gesture with a pressing pressure greater than a threshold.

[0223] In one possible implementation, the receiving module 1102 is configured to:

[0224] Simultaneously with detecting the fifth gesture operation, a second voice input is received, wherein the fifth gesture operation is an operation performed on the touchpad;

[0225] The display module 1101 is used to modify the input content according to the content of the second voice input and display the modified content.

[0226] It should also be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. In addition, in the device embodiment drawings provided in this application, the connection relationship between modules indicates that they have a communication connection, which can be implemented as one or more communication buses or signal lines.

[0227] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware, or it can be implemented by special-purpose hardware including application-specific integrated circuits, special-purpose CPUs, special-purpose memory, special-purpose components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for this application, software program implementation is more often the preferred implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, training equipment, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0228] In the above embodiments, the implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, in the form of a computer program product.

[0229] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

Claims

1. A data input method, characterized in that, Applied to electronic devices, the electronic devices include a display screen and a touchpad, the display screen includes a foldable screen and an outer screen, the foldable screen can be folded along the folding edge to form multiple inner screens; The outer screen and the touchpad are located on the same side; the method includes: An input area and an input prompt bar for the input area are displayed on the external screen; the input prompt bar includes prompts that can be entered via voice or automatically generated controls; the automatic response control is used to generate content based on the context. Upon receiving a first input, the input content is displayed in the input area; the first input is either a first voice input or a selection operation on the automatically generated control. Upon receiving a second input, the modified content is displayed; the second input is either input applied to the touchpad or a selection operation on a control displayed on the external screen to indicate modification.

2. The method according to claim 1, characterized in that, The input content is text, and the modification includes at least one of the following: The text is processed by deleting characters, selecting and replacing certain characters, and optimizing the text content.

3. The method according to claim 1 or 2, characterized in that, The automatic reply control includes: an identifier of the type of generated content, wherein the type is at least one of the following: Text, location, business cards, documents, application cards, or images.

4. The method according to any one of claims 1 to 3, characterized in that, The second input is a first gesture operation, which is a first type of swipe gesture for the touchpad. The first gesture operation is used to select at least one character in the input content and delete it.

5. The method according to any one of claims 1 to 3, characterized in that, The receipt of the second input includes: Upon receiving a first gesture operation, at least one character from the input content is selected; the second gesture operation is a second type of swipe gesture for the touchpad. Display a deletion confirmation control associated with the at least one character; A confirmation operation was received for the deletion confirmation control.

6. The method according to claim 4 or 5, characterized in that, The number of characters in the at least one character is related to the length, pressing time, or number of times of the first type of swipe gesture.

7. The method according to claim 5 or 6, characterized in that, Receiving the first gesture operation and selecting at least one character from the input content includes: A first swipe gesture is received for the touchpad; the first swipe gesture is used to select multiple characters from the input content; A second swipe gesture is received for the touchpad; the second swipe gesture is in the opposite direction to the first swipe gesture; the second swipe gesture is used to remove some characters from the plurality of characters in order to select at least one character from the input content.

8. The method according to any one of claims 1 to 7, characterized in that, The step of displaying input content in the input area includes: displaying input content and a cursor in the input area; the method further includes: Upon receiving a second gesture operation, which is a second type of swipe gesture, the cursor position is moved; wherein the direction of the cursor position movement is related to the direction of the second type of swipe gesture.

9. The method according to any one of claims 1 to 3, characterized in that, The second input is a third gesture operation, which is a touch gesture that covers an area or proportion of the touchpad exceeding a preset value or a touch gesture with continuous pressing pressure exceeding a threshold. The modification specifically involves optimizing the input content.

10. The method according to any one of claims 2 to 9, characterized in that, The content optimization includes at least one of the following: tone optimization, grammar correction, format adjustment, and content refinement.

11. The method according to any one of claims 1 to 10, characterized in that, The text content of the first voice input instruction is an instruction, and the input content is content generated according to the instruction that meets the requirements of the instruction.

12. The method according to claim 11, characterized in that, The receipt of the first input includes: Simultaneously with detecting the fourth gesture operation, the first voice input is received, wherein the fourth gesture operation is a continuous touch gesture with a pressing pressure greater than a threshold.

13. The method according to any one of claims 1 to 12, characterized in that, The step of receiving the second input and displaying the modified content includes: Simultaneously with detecting the fifth gesture operation, a second voice input is received, wherein the fifth gesture operation is an operation performed on the touchpad; Based on the content of the second voice input, the input content is modified, and the modified content is displayed.

14. A data input device, characterized in that, Applied to electronic devices, the electronic devices include a display screen and a touchpad, the display screen includes a foldable screen and an outer screen, the foldable screen can be folded along the folding edge to form multiple inner screens; The outer screen and the touchpad are located on the same side; the device includes: The display module is used to display an input area and an input prompt bar for the input area on the external screen; the input prompt bar includes prompt information that can be input by voice or an automatically generated control; the automatic reply control is used to generate content based on the context; The receiving module is used to receive a first input, and the display module is used to display the input content in the input area; the first input is a first voice input or a selection operation on the automatically generated control; The receiving module is used to receive the second input, and the display module is used to display the modified content of the input; the second input is an input applied to the touchpad or a selection operation of a control displayed on the external screen to indicate modification.

15. The apparatus according to claim 14, characterized in that, The input content is text, and the modification includes at least one of the following: The text is processed by deleting characters, selecting and replacing certain characters, and optimizing the text content.

16. The apparatus according to claim 14 or 15, characterized in that, The automatic reply control includes: an identifier of the type of generated content, wherein the type is at least one of the following: Text, location, business cards, documents, application cards, or images.

17. The apparatus according to any one of claims 14 to 16, characterized in that, The second input is a first gesture operation, which is a first type of swipe gesture for the touchpad. The first gesture operation is used to select at least one character in the input content and delete it.

18. The apparatus according to any one of claims 14 to 16, characterized in that, The receiving module is used for: Upon receiving a first gesture operation, at least one character from the input content is selected; the second gesture operation is a second type of swipe gesture for the touchpad. The display module is used to display a deletion confirmation control associated with the at least one character; The receiving module is used to receive a confirmation operation for the deletion confirmation control.

19. The apparatus according to claim 17 or 18, characterized in that, The number of characters in the at least one character is related to the length, pressing time, or number of times of the first type of swipe gesture.

20. The apparatus according to claim 18 or 19, characterized in that, The receiving module is used for: A first swipe gesture is received for the touchpad; the first swipe gesture is used to select multiple characters from the input content; Received a second swipe gesture for the touchpad; The second swipe gesture is in the opposite direction to the first swipe gesture; The second swipe gesture is used to remove some characters from the plurality of characters in order to select at least one character from the input content.

21. The apparatus according to any one of claims 14 to 20, characterized in that, The display module is used to display input content and a cursor in the input area; the receiving module is used to: Upon receiving a second gesture operation, which is a second type of swipe gesture, the cursor position is moved; wherein the direction of the cursor position movement is related to the direction of the second type of swipe gesture.

22. The apparatus according to any one of claims 14 to 21, characterized in that, The second input is a third gesture operation, which is a touch gesture that covers an area or proportion of the touchpad exceeding a preset value or a touch gesture with continuous pressing pressure exceeding a threshold. The modification specifically involves optimizing the input content.

23. The apparatus according to any one of claims 15 to 22, characterized in that, The content optimization includes at least one of the following: tone optimization, grammar correction, format adjustment, and content refinement.

24. The apparatus according to any one of claims 14 to 23, characterized in that, The text content of the first voice input instruction is an instruction, and the input content is content generated according to the instruction that meets the requirements of the instruction.

25. The apparatus according to claim 24, characterized in that, The receiving module is used for: Simultaneously with detecting the fourth gesture operation, the first voice input is received, wherein the fourth gesture operation is a continuous touch gesture with a pressing pressure greater than a threshold.

26. The apparatus according to any one of claims 14 to 25, characterized in that, The receiving module is used for: Simultaneously with detecting the fifth gesture operation, a second voice input is received, wherein the fifth gesture operation is an operation performed on the touchpad; The display module is used to modify the input content according to the content of the second voice input, and display the modified content.

27. A computer storage medium, characterized in that, The computer storage medium stores one or more instructions, which, when executed by one or more computers, cause the one or more computers to perform the operation of the method according to any one of claims 1-13.

28. A computer program product, characterized in that, Includes computer-readable instructions that, when executed on a computer device, cause the computer device to perform the method as described in any one of claims 1-13.

29. A system comprising at least one processor and at least one memory; the processor and the memory are connected via a communication bus and communicate with each other. The at least one memory is used to store code; The at least one processor is used to execute the code to perform the method as described in any one of claims 1-13.

30. A chip, characterized in that, It includes at least one processing unit and an interface circuit, the interface circuit being used to provide program instructions or data to the at least one processing unit, the at least one processing unit being used to execute the program instructions to implement the method of any one of claims 1-13.

Images