End-to-end text input method and electronic device
Through end-to-end low-power Bluetooth technology, the problem of slow text input speed and cumbersome operation on TV and other devices is solved, efficient and convenient text input and search functions are achieved, and the interactive experience between smart devices is improved.
Patent Information
- Application Number
- CN202411233492.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-04
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-09-04
AI Technical Summary
The screens of TV and other devices do not support touch control, resulting in text input that requires clicking and input on the text input keyboard displayed on the screen through the remote control, which is slow, low efficiency and cumbersome to operate.
Using end-to-end low-power Bluetooth technology, activates low-power Bluetooth on the device side, broadcasts connection information to establish a Bluetooth connection. After scanning and connecting on the mobile side, the text input box is displayed on the device side through the Bluetooth connection, and text is sent and received in real time. Content, search after the input is completed.
It improves the efficiency and convenience of text input, realizes high-efficiency and low-power wireless text input and search functions on the device side, avoids the inconvenience of inputting text on the device side, and improves the user's interactive experience between different smart devices.
Smart Images

Figure CN118732922B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of multi-device interaction, and in particular to an end-to-end text input method and electronic device. Background Art
[0002] In related scenarios, since the screens of devices such as televisions do not support touch, typing usually requires using a remote control to click and input on the text input keyboard displayed on the screen. Not only is the input speed slow, resulting in low efficiency in text input, but the operation is also cumbersome and less convenient to use. Summary of the invention
[0003] The purpose of the present invention is to provide an end-to-end text input method and electronic device, aiming to improve the efficiency and convenience of inputting text content on a display screen such as a television.
[0004] In order to achieve the above-mentioned purpose, a first aspect of an embodiment of the present disclosure provides an end-to-end text input method, which is applied to a device end, and the method includes:
[0005] In response to a low-power Bluetooth activation operation, activating the low-power Bluetooth of the device end, and in the case of activating the low-power Bluetooth, broadcasting the connection information of the low-power Bluetooth, so that the mobile end can scan the connection information and establish a Bluetooth connection with the device end according to the scanned connection information;
[0006] In the case where the Bluetooth connection is successfully established, in response to the text input start operation instruction, a device-side text input box is displayed on the display screen of the device-side, and a text input instruction is sent to the mobile terminal through the Bluetooth connection, so that the mobile terminal displays an input cursor in the mobile-side text input box on the display screen of the mobile terminal when the text input instruction is received;
[0007] Receiving input text content sent in real time by the mobile terminal through the Bluetooth connection, and displaying text content in the device-side text input box of the device-side according to the input text content;
[0008] Upon receiving an input completion instruction sent by the mobile terminal, a search operation for the input text content is performed on the device terminal, wherein the input completion instruction is generated by the mobile terminal in response to a confirmation operation on the text input content and is sent to the device terminal via the Bluetooth connection.
[0009] In a possible implementation, in response to the text input start operation instruction, displaying a device-side text input box on the display screen of the device side includes:
[0010] In response to the text input start operation instruction, determining the identity identifier carried by the text input start operation instruction;
[0011] Determining the source of the text input start operation instruction according to the identity identifier;
[0012] Determining whether a soft keyboard for text input is displayed on the display screen of the device end according to the source of the text input start operation instruction;
[0013] In the case where it is determined that the soft keyboard for text input is not displayed on the display screen of the device end, the soft keyboard for text input is not started to be displayed on the display screen of the device end, and the text input box of the device end for text display is started to be displayed on the display screen of the device end;
[0014] When it is determined that a soft keyboard for text input is displayed on the display screen of the device, the soft keyboard for text input displayed on the display screen of the device and the text input box of the device for text display are simultaneously started.
[0015] In a possible implementation, the source includes the mobile terminal or the device terminal, and determining whether to display a soft keyboard for text input on the display screen of the device terminal according to the source of the text input start operation instruction includes:
[0016] In the case where the source of the text input start operation instruction is the mobile terminal, determining not to display a soft keyboard for text input on the display screen of the device terminal, wherein the text input start operation instruction sent by the mobile terminal is generated according to the identity identifier of the mobile terminal and sent to the device terminal after the mobile terminal displays a soft keyboard for text input and the mobile terminal text input box for text display on the display screen of the mobile terminal in response to a user operation;
[0017] In a case where the source of the text input start operation instruction is the device end, it is determined that a soft keyboard for text input is displayed on the display screen of the device end, wherein the text input start operation instruction generated by the device end is generated by the device end in response to a user text input operation on the device end, according to an identity identifier of the device end, and in response to a user hiding operation on the soft keyboard for text input displayed on the display screen of the device end, a mobile terminal text input interface instruction is sent to the mobile terminal through the Bluetooth connection, so that when the mobile terminal receives the mobile terminal text input interface instruction, the soft keyboard for text input and the mobile terminal text input box for text display are displayed on the display screen of the mobile terminal.
[0018] In a possible implementation, displaying text content in the device-side text input box on the device-side according to the input text content includes:
[0019] Parsing the language type and symbol type of the input text content;
[0020] Determining the target language type of the input text content from a preset text library according to the language type and the symbol type;
[0021] Matching target text content corresponding to the input text content from a text library corresponding to the target language type;
[0022] The target text content is displayed as text content in the device-side text input box on the device side.
[0023] In one possible implementation, the low-power Bluetooth activation operation includes but is not limited to: powering on the device, turning on the low-power Bluetooth on the device, and turning on a smart home device connected to the IoT of the device.
[0024] A second aspect of the embodiments of the present disclosure provides an end-to-end text input method, which is applied to a mobile terminal, and the method includes:
[0025] Scanning the connection information of the low-power Bluetooth of the device end, and establishing a Bluetooth connection with the device end according to the scanned connection information, wherein the connection information is broadcast by the device end after activating the low-power Bluetooth of the device end in response to the low-power Bluetooth activation operation;
[0026] receiving a text input instruction sent by the device end through the Bluetooth connection, and displaying an input cursor in a mobile end text input box on the display screen of the mobile end upon receiving the text input instruction, wherein the text input instruction is sent by the device end after displaying the device end text input box on the display screen of the device end in response to a text input start operation;
[0027] In response to a text input operation on the soft keyboard of the mobile terminal, determining input text content according to the text input operation, and sending the input text content to the device terminal via the Bluetooth connection in real time, so that the device terminal displays the input text content as input in the text input box of the device terminal;
[0028] In response to a confirmation operation on the text input content, an input completion instruction is generated, and the input completion instruction is sent to the device end via the Bluetooth connection, so that the device end performs a search operation for the text input content on the device end when receiving the input completion instruction.
[0029] In a possible implementation, before receiving the text input instruction sent by the device through the Bluetooth connection, the method further includes:
[0030] In response to a user operation, a soft keyboard for text input and a text input box for text display on the display screen of the mobile terminal are displayed;
[0031] A text input start operation instruction is generated based on the identity identifier of the mobile terminal and sent to the device terminal, so that when the device terminal determines that the source of the text input start operation instruction is the mobile terminal based on the identity identifier carried by the text input start operation instruction, it determines not to display a soft keyboard for text input on the display screen of the device terminal and determines to display the device-side text input box for text display on the display screen of the device terminal.
[0032] In a possible implementation, before receiving the text input instruction sent by the device through the Bluetooth connection, the method further includes:
[0033] When receiving a mobile terminal text input interface instruction sent by the device end through the Bluetooth connection, displaying a soft keyboard for text input and the mobile terminal text input box for text display on the display screen of the mobile terminal;
[0034] Among them, the mobile terminal text input interface instruction is sent to the mobile terminal through the Bluetooth connection by the device terminal when the device terminal determines that the source of the text input start operation instruction is the device terminal, and the device terminal displays a soft keyboard for text input on the display screen of the device terminal, and responds to the user's hiding operation on the soft keyboard for text input displayed on the display screen of the device terminal, wherein the text input start operation instruction generated by the device terminal is generated by the device terminal in response to the user's text input operation on the device terminal, according to the identity identifier of the device terminal.
[0035] In one possible implementation, the mobile terminal includes at least one of a smart phone, a tablet computer, and a smart wearable device, and the device terminal includes at least one of a vehicle multimedia device, a smart TV, and a projector.
[0036] According to a third aspect of the present disclosure, an electronic device is provided, including:
[0037] a memory having a computer program stored thereon;
[0038] A processor is used to execute the computer program in the memory to implement the steps of any one of the methods described in the first aspect, or to execute the computer program in the memory to implement the steps of any one of the methods described in the second aspect.
[0039] The present invention provides an end-to-end text input method and electronic device. Compared with the prior art, the present invention has the following beneficial effects:
[0040] In response to the low-power Bluetooth activation operation on the device side, the BLE connection information is activated and broadcasted, and the mobile terminal can discover and establish a BLE connection with it. After the connection is successful, the text input is started through the operation instructions on the device side, the text input box is displayed on the device side display, and the text input start instruction is sent to the mobile terminal. The mobile terminal responds to this instruction and displays the input cursor. The mobile terminal sends the text content entered by the user to the device side through the BLE connection in real time, and the device side displays the text content synchronously. When the mobile terminal receives the instruction from the user to confirm that the input is complete, it sends the instruction to the device side, and the device side performs the search operation for the input text content accordingly. In this way, efficient and low-power wireless text input and search functions are realized on the device side, avoiding the inconvenience of entering text on the device side, thereby improving the user's interactive experience between different smart devices.
[0041] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure but do not constitute a limitation of the present disclosure. In the accompanying drawings:
[0043] Figure 1 It is a flow chart of an end-to-end text input method on a device side according to an embodiment of the specification.
[0044] Figure 2 According to the embodiment of the specification, an implementation Figure 1 Flowchart of step S12 in FIG.
[0045] Figure 3 It is a flow chart of an end-to-end text input method for a mobile terminal according to an embodiment of the specification. DETAILED DESCRIPTION
[0046] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0047] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.
[0048] Before introducing an end-to-end text input method and electronic device provided by an embodiment of the present disclosure, the technical content and existing technical problems in related scenarios are first introduced. For example, to search for TV or movies on a TV, the TV's soft keyboard is usually activated by the remote control, and then the cursor is moved by the up, down, left, and right keys of the remote control, and the selected letters are confirmed by the confirmation key to search, which is not only inefficient but also cumbersome to operate. For another example, to navigate on a car multimedia system, it is necessary to touch and activate the soft keyboard on the car multimedia, and then enter text to enter the navigation destination. Since the multimedia display screen usually has a low resolution, the response speed of inputting text and the accuracy of touching and selecting text are both low, which also leads to low efficiency and cumbersome operation.
[0049] In view of this, the purpose of the present disclosure is to improve the convenience and efficiency of text input on, for example, a television or a car multimedia.
[0050] In order to achieve the above-mentioned object, the present disclosure provides an end-to-end text input method, which is applied to a device end. Figure 11 is a flow chart of an end-to-end text input method according to an embodiment. The method comprises:
[0051] In step S11, in response to a low-power Bluetooth activation operation, the low-power Bluetooth of the device is activated, and when the low-power Bluetooth is activated, connection information of the low-power Bluetooth is broadcasted, so that the mobile terminal can scan the connection information and establish a Bluetooth connection with the device according to the scanned connection information;
[0052] Among them, Bluetooth Low Energy (BLE) is a wireless communication technology designed for small, low-power devices. It can not only extend the battery life of the device by reducing power consumption, but also reduce power consumption. The activation operation can be an action initiated by the user or the system to start or enable Bluetooth Low Energy. In this context, it can specifically be the process of starting the Bluetooth Low Energy module. Connection information is the information sent by the device when broadcasting to identify and establish a connection with other devices, usually including the MAC address of the device (or a randomly generated address), service UUID, etc. Scanning is the process in which the mobile terminal actively searches for broadcast information sent by other Bluetooth devices around it in Bluetooth communication. Bluetooth connection is a Bluetooth communication link established between the device and the mobile terminal.
[0053] In the disclosed embodiment, the device initializes the BLE stack when it is started or receives a specific activation instruction. This includes configuring the BLE hardware interface, setting necessary parameters (such as broadcast interval, device name, etc.), and registering necessary callback functions to handle BLE events. If the BLE stack is initialized, the device will start broadcasting its existence. The broadcast data usually includes the device name, service UUID (if the device provides specific services), manufacturer information, etc. This information is sent in the form of a BLE advertising packet so that it can be detected by nearby BLE scanning devices. And while broadcasting, the device will listen for connection requests from other BLE devices. When the mobile terminal scans the broadcast information of the device and decides to establish a connection, it will send a connection request to the device. After receiving the request, the device will respond according to a predefined strategy (such as automatically accepting all connection requests or requiring user confirmation).
[0054] For example, in response to a Bluetooth Low Energy activation operation, the TV or car multimedia stack is initialized, configured as a peripheral device mode, and starts broadcasting its BLE information, including the name (such as "living room TV" or "car display") and service UUID.
[0055] In this way, open the BLE scanning application on the smartphone, the application scans the broadcast information of "Living Room TV" or "Car Display", and displays it in the device list. The mobile terminal can manually select "Living Room TV" or "Car Display" from the list and click to connect. The smartphone sends a connection request to the TV or car multimedia, the TV or car multimedia automatically accepts the request, and the two parties establish a BLE connection.
[0056] In step S12, when the Bluetooth connection is successfully established, in response to the text input start operation instruction, a device-side text input box is displayed on the display screen of the device-side, and a text input instruction is sent to the mobile terminal through the Bluetooth connection, so that when the mobile terminal receives the text input instruction, an input cursor is displayed in the mobile-side text input box on the display screen of the mobile terminal;
[0057] Among them, the Bluetooth connection is successfully established, the device end and the mobile end successfully complete the pairing and connection process, and the data transmission process can be started. The text input start operation instruction can be an instruction issued by the user or the system to start the text input function on the device end. The display screen of the device end can be an electronic screen for displaying images, text and other information. The text input box is an area on a certain interface on the display screen that allows the user to enter text or characters. The text input instruction is an instruction sent by the device end to the mobile end to instruct the mobile end to display the input cursor on the display screen. The input cursor can be the position where the text that the user is prompted to enter is displayed.
[0058] In the disclosed embodiment, if the BLE connection is successfully established, the communication channel between the device and the mobile terminal is established. At this time, the device can respond to the user's text input start operation instruction and send the text input instruction to the mobile terminal through the BLE connection to start the text input interface of the mobile terminal.
[0059] Among them, the device displays a text input box on the display screen, indicating that it can receive input from the mobile terminal. The device sends a custom instruction or message to the mobile terminal through the BLE connection, which contains a command to start the text input interface. The specific format and content of this instruction depend on the protocol definition between the device and the mobile terminal. After receiving the text input instruction, the mobile terminal parses the instruction content and performs the corresponding operation according to the protocol regulations. Usually, this involves displaying a text input box and a flashing cursor on the display screen of the mobile terminal, prompting the user to start typing.
[0060] In one embodiment, in response to a text input start operation instruction, displaying a device-side text input box on the display screen of the device side may include: in response to the text input start operation instruction, displaying prompt information, the prompt information is used to guide the user to choose to input text content directly on the device side or to input text content through the mobile side, for example, displaying two selection buttons, and then, if the user chooses to input text content directly on the device side through the button, the soft keyboard on the device side is pulled up, and the user can input text content through the soft keyboard on the device side; if the user chooses to input text content through the mobile side through the button, the device-side text input box is displayed on the display screen of the device side.
[0061] For example, the "living room TV" or "car display" displays a prompt message on the display to inform the user that text content will be entered through the mobile phone. The "living room TV" or "car display" sends a text input command to the smartphone through the BLE connection. After receiving the command, the BLE application on the smartphone displays a text input box and a flashing cursor on its interface, prompting the user to start entering the note information.
[0062] In step S13, receiving input text content sent in real time by the mobile terminal through the Bluetooth connection, and displaying text content in the device-side text input box of the device-side according to the input text content;
[0063] Among them, real-time transmission means that the mobile terminal sends the text content input by the user immediately via Bluetooth after receiving it, so as to reduce the delay and enhance the experience of text input on the device and mobile terminals. The input text content is the text information input by the user through the soft keyboard touch of the mobile terminal or the text information input by voice. The text information can include emoticons or pure pinyin or pure Chinese characters. Content display is to display the received information in a visual form on the display screen of the device.
[0064] In the embodiment of the present disclosure, the mobile terminal sends the text content input by the user to the device terminal in real time. The device terminal receives the text content and displays it in the text input box on its display screen to achieve real-time synchronization. The user enters text in the text input box of the mobile terminal (for example, typing or handwriting through the soft keyboard in the touch display screen, or through voice input). After each character or paragraph of text is entered, the mobile terminal sends the text content as a data packet to the device terminal via the BLE connection.
[0065] Furthermore, the device receives data packets from the mobile terminal through the BLE connection and parses the data packet content to obtain text characters. The device then displays these characters in the text input box on its display screen, ensuring that the user can see the real-time synchronized input content.
[0066] For example, when a user enters the navigation destination "TV station parking lot entrance" in the text input box on the smartphone, each time a character or word (such as "TV" or "TV") is entered, the information is sent to the vehicle multimedia in real time via the BLE connection. After the vehicle multimedia receives the information, it immediately displays it in the text input box on its display screen, and finally forms the complete note information "TV station parking lot entrance".
[0067] It is understandable that if a deletion operation is performed on the mobile terminal, the corresponding text content will also be deleted synchronously on the device terminal.
[0068] In step S14, upon receiving the input completion instruction sent by the mobile terminal, the search operation of the input text content is performed on the device terminal, wherein the input completion instruction is generated by the mobile terminal in response to the confirmation operation for the text input content and sent to the device terminal via the Bluetooth connection.
[0069] The input completion instruction is sent by the mobile terminal after the user completes the text input, and is used to notify the device terminal that the input is completed. The confirmation operation is an action in which the user confirms the input text content by clicking a button, selecting a menu item, etc. The search operation is the process in which the device terminal searches for relevant information in a database, network resources or other data sources based on the received input text content.
[0070] In the disclosed embodiment, after receiving the user's confirmation operation for the text input content (such as clicking the "Finish" button), the mobile terminal generates an input completion instruction and sends the instruction to the device terminal through the BLE connection. After receiving the input completion instruction, the device terminal performs a series of operations related to the input text content, such as searching, storing or processing the input information.
[0071] Specifically, the mobile terminal generates an input completion instruction: After the user completes the input in the text input box of the mobile terminal, he usually clicks a "Done", "Submit" or similar button to confirm the input. At this time, the mobile terminal captures this confirmation operation and generates an input completion instruction. This instruction is a specific data packet that contains a flag or code indicating that the input is completed.
[0072] Send input completion command: The mobile end sends the input completion command as a data packet to the device end through the established BLE connection. The BLE connection ensures the reliable transmission of the command, and due to the low power consumption of BLE, this process has little impact on the power consumption of the mobile end.
[0073] The device receives and processes the input completion instruction: The device receives the data packet from the mobile terminal through the BLE connection and parses the data packet content to identify the input completion instruction. Once the input completion instruction is confirmed, the device stops receiving new input text content (if it was receiving it before) and performs subsequent operations related to the input text content.
[0074] Perform search or other operations: Depending on the application scenario, the device may perform different operations after receiving the input completion instruction. In the above example, if the device is a smart TV, it may use the input text content as the search keyword to search for related TV or movies in the local database or on the Internet, and display the search results to the user. If the device is a car multimedia, it may store the input text content in the internal memory and perform a driving path search for the "TV station parking lot entrance" in the navigation.
[0075] Continuing with the above car multimedia example, the user enters the note information "TV station parking lot entrance" in the text input box on the smartphone and clicks the "Done" button. The smartphone generates an input completion instruction and sends it to the car multimedia via the BLE connection. After receiving this instruction, the car multimedia stops accepting new input content and searches for the driving path from the current location to the "TV station parking lot entrance". If the car multimedia supports historical data recording and analysis functions. In other words, the input completion instruction serves as a signal to tell the device that the input phase has ended and that subsequent processing or analysis work can begin.
[0076] The method in the above technical solution responds to the low-power Bluetooth activation operation on the device side, activates and broadcasts BLE connection information, and the mobile terminal can discover and establish a BLE connection with it. After the connection is successful, the text input is started through the operation instruction of the device side, the text input box is displayed on the device side display, and the text input start instruction is sent to the mobile terminal, and the mobile terminal responds to this instruction to display the input cursor. The mobile terminal sends the text content entered by the user to the device side through the BLE connection in real time, and the device side displays the text content synchronously. When the mobile terminal receives the instruction from the user to confirm that the input is completed, the instruction is sent to the device side, and the device side performs the search operation of the input text content accordingly. In this way, by realizing efficient and low-power wireless text input and search functions on the device side, the inconvenience of entering text on the device side is avoided, thereby improving the user's interactive experience between different smart devices.
[0077] In one embodiment of the present disclosure, see Figure 2 As shown, in step S12, in response to the text input start operation instruction, displaying a device-side text input box on the display screen of the device side includes:
[0078] In step S121, in response to the text input start operation instruction, determining the identity identifier carried by the text input start operation instruction;
[0079] Among them, the identifier is a string or number used to uniquely identify the identity of an object. The device can then use it to distinguish the sources of different text input start operation instructions to ensure that the device can correctly identify and process each instruction. This identifier may be automatically attached by the mobile terminal when sending an instruction to identify the sender, priority, type and other information of the instruction. It may also be generated by the device itself.
[0080] In the disclosed embodiment, when the device receives a text input start operation instruction, the instruction is usually not just a simple request signal, but carries a series of additional information so that the device can accurately identify and process the instruction. The identity identifier is one of these additional information, which is used to uniquely identify the sender, type, priority and other attributes of the instruction. By parsing this part of information in the instruction, the device can understand who (or what application or service) initiated the text input request, as well as the specific characteristics and requirements of the request.
[0081] For example, suppose a user uses a mobile app called "Smart Navigation Notes" on the car multimedia and clicks the "New Navigation Note" button on the app interface, which triggers a text input start operation instruction. When this instruction is sent to the device, it will carry an identifier, such as a unique string "App_SmartNotes_NewNote" defined by the app developer. After receiving this instruction, the device will first parse the identifier to know that this instruction is sent by the "Smart Navigation Notes" app to start the text input function when creating a new note.
[0082] In step S122, the source of the text input start operation instruction is determined according to the identity identifier;
[0083] The source of the instruction is the entity or device that triggers the text input to start the operation instruction. By parsing the identity identifier determined in step S121, the device side can identify which specific mobile device or application sent this instruction. For the device side, the display interface, permission settings or different subsequent operations can be adjusted according to different instruction sources.
[0084] In the disclosed embodiment, after determining the identity identifier, the device can use a preset mapping table or logic rule to parse the identifier to determine the specific source of the instruction. This mapping table or logic rule may contain various possible identity identifiers and their corresponding source information (such as application name, user ID, device type, etc.). By searching for matching items, the device can quickly and accurately identify the sender or source of the instruction.
[0085] Continuing with the above scenario, after parsing the identity identifier "App_SmartNotes_NewNote", the device will search for the source information corresponding to this identifier in its internal mapping table. Assuming that the mapping table has defined the correspondence between this identifier and the "Smart Navigation Notes" application, the device will determine that the source of this text input start operation instruction is the "Smart Navigation Notes" application.
[0086] In step S123, according to the source of the text input start operation instruction, it is determined whether a soft keyboard for text input is displayed on the display screen of the device end;
[0087] Among them, the soft keyboard (Soft Keyboard / On-Screen Keyboard) is a virtual interface that simulates a physical keyboard on the display screen. Users can enter text by selecting keys or touching keys on the screen. In step S123, the device side will decide whether to display the soft keyboard on the display screen based on the source of the text input start operation instruction. For example, if the instruction comes from a known application that supports text input, the device side may display the soft keyboard for user input; but if the instruction comes from a service that does not require or support text input, the device side may choose not to display the soft keyboard.
[0088] In the disclosed embodiment, after determining the source of the instruction, the device side can decide whether to display the soft keyboard on the display screen according to factors such as the characteristics of the source, permissions, and user preferences. This decision-making process may involve multiple judgment conditions, such as whether the instruction source is an application that supports text input, whether the user has previously selected the option to hide the soft keyboard, whether the current device is connected to an external keyboard, etc. If all conditions meet the requirements for displaying the soft keyboard, the device side will start displaying the soft keyboard; otherwise, the text input box will be directly displayed to receive the user's input.
[0089] For example, after determining that the text input start operation instruction comes from the "Smart Navigation Notes" application, the device will further check the permission settings and user preferences of the application. Assuming that the user has not set the option to hide the soft keyboard and the current device is not connected to an external keyboard, the device will decide to display the soft keyboard on the display. In this way, the user can enter the navigation address by touching the soft keyboard keys on the screen. If the situation is the opposite, for example, the user has previously selected the option to hide the soft keyboard, or the device has been connected to an external keyboard, the device will choose not to display the soft keyboard, but directly display a text input box for the user to enter.
[0090] In step S124, when it is determined that the soft keyboard for text input is not displayed on the display screen of the device end, the soft keyboard for text input is not started to be displayed on the display screen of the device end, and the text input box of the device end for text display is started to be displayed on the display screen of the device end;
[0091] The device-side text input box is an area displayed on the device-side display screen, which is used to receive and display text input by the user in some way (it may be a soft keyboard, an external keyboard, voice recognition, etc.). In this step, since it is determined that the soft keyboard does not need to be displayed, the device side will only start and display this text input box so that the user can input text through other means (such as an external device), or it is only used to display the text content that has been entered or preset.
[0092] Among them, non-activation of the soft keyboard means that the device will not perform any operations or programs related to the display of the soft keyboard.
[0093] In the disclosed embodiment, the device has determined that it is not necessary to display a soft keyboard for text input on the display screen according to the previous steps (S121-S123). This may be due to a variety of reasons, such as the source of the instruction not supporting soft keyboard input, user preference settings, or the device being connected to an external keyboard. Therefore, in this step, the device will perform two main operations: one is not to start the display of the soft keyboard, and the other is to start and display the text input box on the device.
[0094] Not starting the display of the soft keyboard means that the device will not load and render the soft keyboard graphical interface, thereby saving system resources and screen space. At the same time, in order to provide the text input function, the device will start and display a text input box, which is located on the device display screen and is used to receive and display text content entered by the user through other methods (such as an external keyboard, voice recognition, etc.).
[0095] In step S125, when it is determined that a soft keyboard for text input is displayed on the display screen of the device, the soft keyboard for text input displayed on the display screen of the device and the text input box of the device for text display displayed on the display screen of the device are simultaneously started.
[0096] Among them, simultaneous activation means that the device will perform two operations at the same time: one is to start and display the soft keyboard so that the user can enter text by touching the keys on the screen; the other is to start and display the device text input box to receive and display the text content entered by the user through the soft keyboard. These two operations are performed in parallel to provide users with a complete text input and display interface.
[0097] In the disclosed embodiment, the device has determined that a soft keyboard for text input needs to be displayed on the display screen according to the previous steps (S121-S123). This usually means that the source of the instruction is an application that supports soft keyboard input, and the current device is not connected to an external keyboard, or the soft keyboard is not disabled in the user's preferences. Therefore, in this step, the device will perform two operations at the same time: one is to start and display the soft keyboard, and the other is to start and display the text input box on the device.
[0098] Starting and displaying the soft keyboard means that the device will load and render the soft keyboard's graphical interface to the display screen for the user to input text by touching the screen. At the same time, in order to provide instant input feedback and display the text content that has been entered, the device will also start and display a text input box, which is usually located above or below the soft keyboard and is used to receive and display the text entered by the user through the soft keyboard.
[0099] The above technical solution starts the operation instruction by responding to the text input, and determines its source according to the identity identifier carried by the instruction. The technology can intelligently judge the needs of users or applications. Depending on the source, the technology can automatically decide whether to display the soft keyboard on the display screen of the device, thereby avoiding unnecessary interference from interface elements and improving the simplicity and user experience of the user interface. Furthermore, the text input method can be flexibly adjusted according to the needs of different devices and scenarios. For example, when it is detected that the device is connected to an external keyboard, the soft keyboard is automatically selected not to be displayed to reduce screen occupancy and provide a more efficient input experience. This adaptability enables the technology to be widely used in various devices and scenarios to meet the personalized needs of different users.
[0100] Furthermore, by not starting the display of the soft keyboard when it is not necessary to display it, system resources and power can be effectively saved. When the soft keyboard needs to be displayed, the technology can start the display of the soft keyboard and the text input box at the same time, ensuring that the user can see the input text content in real time, improving the accuracy and efficiency of the input. In addition, through reasonable interface layout and interactive design, the technology can further enhance the user's input experience. In summary, by intelligently identifying and processing text input startup operation instructions, flexible control and optimization of text input methods are achieved, improving user experience, system adaptability, resource utilization efficiency and input efficiency.
[0101] In an embodiment of the present disclosure, the source includes the mobile terminal or the device terminal, and in step S123, determining whether a soft keyboard for text input is displayed on the display screen of the device terminal according to the source of the text input start operation instruction includes:
[0102] In step S1231, when the source of the text input start operation instruction is the mobile terminal, it is determined not to display a soft keyboard for text input on the display screen of the device terminal, wherein the text input start operation instruction sent by the mobile terminal is generated according to the identity identifier of the mobile terminal and sent to the device terminal after the mobile terminal displays a soft keyboard for text input and the mobile terminal text input box for text display on the display screen of the mobile terminal in response to a user operation;
[0103] In the embodiment of the present disclosure, when the source of the text input start operation instruction is a mobile terminal, it is determined that the instruction is not directly generated by the device terminal, but is initiated by the mobile terminal communicating with it. After responding to a specific user operation (such as clicking, touching, etc.), the mobile terminal will first display a soft keyboard for text input and a corresponding text input box on its own display screen to allow the user to input directly on the mobile terminal after the device terminal is ready. Subsequently, the mobile terminal will generate a text input start operation instruction based on its own identity identifier (which may be a unique identification code, device ID or application ID, etc.) and send the instruction to the device terminal.
[0104] After receiving this instruction, the device will recognize that it comes from a mobile terminal and make a decision accordingly: since the mobile terminal has assumed the responsibility of displaying the soft keyboard and text input box, and the user is inputting through the mobile terminal, there is no need for the device to display the soft keyboard interface element again. This decision is based on the consideration of improving user experience and resource utilization efficiency, avoiding unnecessary screen occupation and interface confusion.
[0105] For example, a user may perform a specific operation on the phone (such as clicking a "Send to device" button), which triggers the mobile app to generate a text input start operation instruction. The instruction contains the phone's identity identifier to ensure that the device can recognize and process the instruction. The instruction is sent to the device through the app's backend service combined with Bluetooth.
[0106] After receiving this instruction, the device will parse the instruction as coming from the mobile terminal and recognize that the mobile terminal has already provided the user with a complete input interface. Therefore, the device decides not to display the soft keyboard for text input on its display. Instead, the device may start a text input box that is synchronized with the mobile terminal, but the soft keyboard will not be included in this interface because the user will continue to input through the mobile terminal. In this way, the user can take advantage of the large screen of the device to view and edit documents while maintaining input continuity.
[0107] In step S1232, when the source of the text input start operation instruction is the device end, it is determined to display a soft keyboard for text input on the display screen of the device end, wherein the text input start operation instruction generated by the device end is generated by the device end in response to the user's text input operation on the device end, according to the identity identifier of the device end, and in response to the user's hiding operation on the soft keyboard for text input displayed on the display screen of the device end, a mobile terminal text input interface instruction is sent to the mobile terminal through the Bluetooth connection, so that when the mobile terminal receives the mobile terminal text input interface instruction, the soft keyboard for text input and the mobile terminal text input box for text display are displayed on the display screen of the mobile terminal.
[0108] In the embodiment of the present disclosure, when the source of the text input start operation instruction is the device end, this means that the instruction is generated and triggered by the device end itself, usually because the user performs some operation related to text input on the device end. When responding to such an operation, the device end generates a text input start operation instruction according to its identity identifier, and the instruction instructs the device end to display a soft keyboard for text input.
[0109] However, this step also involves an additional function: when the user performs a hiding operation on the soft keyboard on the device (such as clicking a button to hide the keyboard), the device will not only hide the soft keyboard locally, but also send a mobile text input interface instruction to the paired mobile terminal through the Bluetooth connection. The purpose of this instruction is to notify the mobile terminal that the soft keyboard on the device has been hidden. If the mobile terminal also needs to display the input interface (such as for synchronous input or to provide auxiliary input), the soft keyboard and text input box should be displayed on the mobile terminal's display. This achieves cross-device input collaboration, allowing users to seamlessly switch input methods between different devices while keeping the input content synchronized.
[0110] For example, suppose a user is using the car multimedia to input a navigation address. The user triggers the text input start operation by touching a certain area on the screen (such as a blank area on the interface). The car multimedia responds to this operation as a device and generates a corresponding text input start operation instruction. According to this instruction, the car multimedia displays a soft keyboard and a text input box on its display screen, allowing the user to start inputting.
[0111] After entering some text during the input process, the user may think that input on the car multimedia display screen is cumbersome and inconvenient. The user performs an operation to hide the soft keyboard on the car multimedia display screen (such as clicking a "hide keyboard" button or icon). After receiving this operation, not only will the soft keyboard be hidden locally, but a mobile text input interface instruction will also be sent to the smartphone through the previously established Bluetooth connection.
[0112] After receiving this command, the smartphone will parse the meaning and display a soft keyboard and text input box on its display screen accordingly. In this way, the user can continue to input text on the smartphone, while the car multimedia as a display device displays the input content in real time. This cross-device input collaboration not only improves the flexibility of input, but also enhances the convenience of users switching between different devices.
[0113] In one implementation of the present disclosure, in step S14, displaying text content in the device-side text input box according to the input text content includes:
[0114] In step S141, the language type and symbol type of the input text content are parsed;
[0115] In the embodiments of the present disclosure, after receiving the input text content of the user, the device side first needs to parse this content to identify the language type and symbol type it contains. The language type refers to the language category to which the input text belongs (such as Chinese, English, Japanese, etc.), and the symbol type includes punctuation marks, special characters, etc. Because different languages and symbol types may need to be matched from different character libraries.
[0116] For example, the user inputs a piece of text: "IFS entrance" through the soft keyboard on the mobile terminal. After the device side receives this text, it first parses it and identifies that it contains two language types, English ("IFS") and Chinese ("entrance").
[0117] In step S142, according to the language type and the symbol type, determine the target language type of the input text content from a preset character library;
[0118] In the embodiments of the present disclosure, after identifying the language type and symbol type of the input text content, the device side can determine a target language type from a preset character library according to this information. This target language type is usually the number of target language types matched according to the number of languages in the input text. Continuing the above scenario, the device side identifies that the input text contains two language types, English and Chinese. Therefore, the target language types can be determined as Chinese and English.
[0119] In step S143, match the target text content corresponding to the input text content from the character library corresponding to the target language type;
[0120] In the embodiments of the present disclosure, after determining the target language type, the target text content matching the input text content can be found from the character library corresponding to this language type. This matching process may involve character-by-character or word-by-word comparison of the input text content to ensure that the found target text content is exactly the same as the input content or has the same semantics.
[0121] For example, find the target text content matching "entrance" from the Chinese character library, and find the target text content matching "IFS" from the English character library. It can be noted that devices such as in-vehicle multimedia and televisions are usually developed based on the Android operating system, and the Android operating system has built-in character libraries for all language types. Therefore, various language types of text content sent from the mobile terminal can be successfully completed.
[0122] In step S144, display the target text content in the device-side text input box of the device as the text content.
[0123] In the disclosed embodiment, the matched target text content is displayed in the text input box of the device end. This step is a direct feedback of the user interface, so that the user can see the text content input by himself.
[0124] In one embodiment of the present disclosure, the low-power Bluetooth activation operation includes but is not limited to: turning on the device end, turning on the low-power Bluetooth on the device end, and turning on a smart home device connected to the Internet of Things of the device end.
[0125] Among them, device power-on: When the device (such as a TV or car multimedia) is turned on, its internal BLE module will also start and enter the standby state, ready to receive or initiate a BLE connection request. This is achieved by directly linking to the power state of the device.
[0126] Operation of turning on Bluetooth low energy consumption on the device: Operation of turning on Bluetooth low energy consumption on the device: In some cases, the BLE function may be turned off by default on the device to save power. In this case, the user needs to manually turn on the BLE switch through the device's settings interface to activate the BLE module. This operation mode gives the user more control and can flexibly turn on or off the BLE function according to actual needs.
[0127] Turning on smart home devices that are connected to the device-side IoT: In smart home scenarios, the device side (such as a smartphone or smart speaker) often acts as a control center and is connected to multiple smart home devices (such as TVs) via BLE or other communication protocols. When smart home devices are turned on (whether through a physical switch, remote control, or remote control), they may actively initiate a BLE connection request to communicate and exchange data with the device side. This activation method reflects the interconnectivity between smart home devices.
[0128] See also Figure 3 As shown, the embodiment of the present disclosure also provides an end-to-end text input method, which is applied to a mobile terminal, and the method includes:
[0129] In step S21, the connection information of the low-power Bluetooth of the device is scanned, and a Bluetooth connection is established with the device according to the scanned connection information, wherein the connection information is broadcasted by the device after the low-power Bluetooth of the device is activated in response to the low-power Bluetooth activation operation;
[0130] Among them, the activation operation can be an action initiated by the user or the system to start or enable low-power Bluetooth. In this context, it can be the process of starting the low-power Bluetooth module. Connection information is the information sent by the device when broadcasting to identify and establish connections with other devices, usually including the MAC address of the device (or a randomly generated address), service UUID, etc. Scanning is the process in which the mobile terminal actively searches for broadcast information sent by other Bluetooth devices around it in Bluetooth communication. Bluetooth connection is the Bluetooth communication link established between the device and the mobile terminal.
[0131] In the disclosed embodiment, the device initializes the BLE stack when it is started or receives a specific activation instruction. This includes configuring the BLE hardware interface, setting necessary parameters (such as broadcast interval, device name, etc.), and registering necessary callback functions to handle BLE events. If the BLE stack is initialized, the device will start broadcasting its existence. The broadcast data usually includes the device name, service UUID (if the device provides specific services), manufacturer information, etc. This information is sent in the form of a BLE advertising packet so that it can be detected by nearby BLE scanning devices. And while broadcasting, the device will listen for connection requests from other BLE devices. When the mobile terminal scans the broadcast information of the device and decides to establish a connection, it will send a connection request to the device. After receiving the request, the device will respond according to a predefined strategy (such as automatically accepting all connection requests or requiring user confirmation).
[0132] For example, in response to a Bluetooth Low Energy activation operation, the TV or car multimedia stack is initialized, configured as a peripheral device mode, and starts broadcasting its BLE information, including the name (such as "living room TV" or "car display") and service UUID.
[0133] In this way, open the BLE scanning application on the smartphone, the application scans the broadcast information of "Living Room TV" or "Car Display", and displays it in the device list. The mobile terminal can manually select "Living Room TV" or "Car Display" from the list and click to connect. The smartphone sends a connection request to the TV or car multimedia, the TV or car multimedia automatically accepts the request, and the two parties establish a BLE connection.
[0134] In step S22, a text input instruction sent by the device is received through the Bluetooth connection, and an input cursor is displayed in a mobile terminal text input box on the display screen of the mobile terminal when the text input instruction is received, wherein the text input instruction is sent by the device after the device terminal displays the device terminal text input box on the display screen of the device terminal in response to a text input start operation;
[0135] In the disclosed embodiment, if the BLE connection is successfully established, the communication channel between the device and the mobile terminal is established. At this time, the device can respond to the user's text input start operation instruction and send the text input instruction to the mobile terminal through the BLE connection to start the text input interface of the mobile terminal.
[0136] Among them, the device displays a text input box on the display screen, indicating that it can receive input from the mobile terminal. The device sends a custom instruction or message to the mobile terminal through the BLE connection, which contains a command to start the text input interface. The specific format and content of this instruction depend on the protocol definition between the device and the mobile terminal. After receiving the text input instruction, the mobile terminal parses the instruction content and performs the corresponding operation according to the protocol regulations. Usually, this involves displaying a text input box and a flashing cursor on the display screen of the mobile terminal, prompting the user to start typing.
[0137] In step S23, in response to a text input operation on the soft keyboard of the mobile terminal, an input text content is determined according to the text input operation, and the input text content is sent to the device terminal via the Bluetooth connection in real time, so that the device terminal displays the input text content as an input in the text input box of the device terminal;
[0138] In the disclosed embodiment, the mobile terminal can receive text content input by the user through text typing on the soft keyboard or voice or handwriting, and send the text content input by the user to the device terminal in real time. The device terminal receives these text contents and displays them in the text input box on its display screen to achieve real-time synchronization. The user enters text in the text input box of the mobile terminal (for example, by typing text or handwriting input through the soft keyboard in the touch display screen, or by voice input). After each character or paragraph of text is entered, the mobile terminal sends these text contents as data packets to the device terminal via the BLE connection.
[0139] Furthermore, the device receives data packets from the mobile terminal through the BLE connection and parses the data packet content to obtain text characters. The device then displays these characters in the text input box on its display screen, ensuring that the user can see the real-time synchronized input content.
[0140] In step S24, in response to the confirmation operation on the text input content, an input completion instruction is generated, and the input completion instruction is sent to the device end through the Bluetooth connection, so that the device end performs a search operation for the text input content on the device end when receiving the input completion instruction;
[0141] The input completion instruction is sent by the mobile terminal after the user completes the text input, and is used to notify the device terminal that the input is completed. The confirmation operation is an action in which the user confirms the input text content by clicking a button, selecting a menu item, etc. The search operation is the process in which the device terminal searches for relevant information in a database, network resources or other data sources based on the received input text content.
[0142] In the disclosed embodiment, after receiving the user's confirmation operation for the text input content (such as clicking the "Finish" button), the mobile terminal generates an input completion instruction and sends the instruction to the device terminal through the BLE connection. After receiving the input completion instruction, the device terminal performs a series of operations related to the input text content, such as searching, storing or processing the input information.
[0143] Specifically, the mobile terminal generates an input completion instruction: After the user completes the input in the text input box of the mobile terminal, he usually clicks a "Done", "Submit" or similar button to confirm the input. At this time, the mobile terminal captures this confirmation operation and generates an input completion instruction. This instruction is a specific data packet that contains a flag or code indicating that the input is completed.
[0144] Send input completion command: The mobile end sends the input completion command as a data packet to the device end through the established BLE connection. The BLE connection ensures the reliable transmission of the command, and due to the low power consumption of BLE, this process has little impact on the power consumption of the mobile end.
[0145] In an embodiment of the present disclosure, before receiving the text input instruction sent by the device through the Bluetooth connection, the method further includes:
[0146] In step S31, in response to a user operation, a soft keyboard for text input and a text input box for text display on the mobile terminal display screen are displayed;
[0147] In the disclosed embodiment, when a user needs to input text on a mobile terminal (such as a smart phone or tablet computer) and hopes that the input text can be displayed in real time or later on another device (device terminal, such as a smart TV or smart projector), step S31 first responds to the user's operation and displays two key elements on the display screen of the mobile terminal: one is a soft keyboard for text input, which allows the user to input text by touching the screen; the other is a mobile terminal text input box for text display, which displays the text content input by the user through the soft keyboard in real time.
[0148] In step S32, a text input start operation instruction is generated based on the identity identifier of the mobile terminal and sent to the device terminal, so that when the device terminal determines that the source of the text input start operation instruction is the mobile terminal based on the identity identifier carried by the text input start operation instruction, it determines not to display a soft keyboard for text input on the display screen of the device terminal and determines to display the device-side text input box for text display on the display screen of the device terminal.
[0149] In the disclosed embodiment, the mobile terminal generates a text input start operation instruction based on its own identity identifier (such as device ID, MAC address, etc.) and sends the instruction to the device terminal. The purpose of this instruction is to notify the device terminal that there is a text input request from a specific mobile terminal (i.e., the mobile terminal identified by the identity identifier carried in the instruction). After receiving this instruction, the device terminal will verify and confirm the source of the instruction based on the identity identifier carried in the instruction.
[0150] Furthermore, after confirmation, the device side will perform a series of operations: first, determine not to display the soft keyboard for text input on its display screen, because the text input work has been undertaken by the mobile side; second, determine to display a device-side text input box for text display on its display screen, so as to display the text content received from the mobile side in real time or later.
[0151] In another embodiment of the present disclosure, before receiving the text input instruction sent by the device through the Bluetooth connection, the method further includes:
[0152] When receiving a mobile terminal text input interface instruction sent by the device end through the Bluetooth connection, displaying a soft keyboard for text input and the mobile terminal text input box for text display on the display screen of the mobile terminal;
[0153] Among them, the mobile terminal text input interface instruction is sent to the mobile terminal through the Bluetooth connection by the device terminal when the device terminal determines that the source of the text input start operation instruction is the device terminal, and the device terminal displays a soft keyboard for text input on the display screen of the device terminal, and responds to the user's hiding operation on the soft keyboard for text input displayed on the display screen of the device terminal, wherein the text input start operation instruction generated by the device terminal is generated by the device terminal in response to the user's text input operation on the device terminal, according to the identity identifier of the device terminal.
[0154] Among them, the device starts text input: the device first responds to the user's text input operation on its display screen and generates a text input start operation instruction based on its own identity identifier. This instruction is originally intended to start the text input interface (such as soft keyboard and input box) on the device itself, but in this scenario, it may not directly trigger the display, but serve as the basis for subsequent operations.
[0155] The device hides the soft keyboard and sends a command: However, the device may decide not to display the soft keyboard on its display for some reason (such as user preference, interface layout restrictions, etc.). Instead, it may respond to the user's hiding operation on the soft keyboard (although this operation may not be directly triggered) and send a mobile text input interface command to the mobile terminal via the Bluetooth connection.
[0156] The mobile terminal receives the command and displays the input interface: After receiving the command, the mobile terminal recognizes that it is a request from the device terminal to display the text input interface on the mobile terminal. Therefore, the mobile terminal displays a soft keyboard and a mobile terminal text input box for displaying input text on its display screen.
[0157] The detailed implementation methods and examples involved in the mobile terminal of the present disclosure can also refer to the implementation methods and examples of the device terminal, so they will not be repeated here.
[0158] In one embodiment of the present disclosure, the mobile terminal includes at least one of a smart phone, a tablet computer, and a smart wearable device, and the device terminal includes at least one of a vehicle multimedia device, a smart TV, and a projector.
[0159] In one embodiment of the present disclosure, an electronic device is also provided, including:
[0160] a memory having a computer program stored thereon;
[0161] A processor is used to execute the computer program in the memory to implement the steps of the method described in any one of the device ends in the aforementioned embodiments, or to execute the computer program in the memory to implement the steps of the method described in any one of the mobile ends in the aforementioned embodiments.
[0162] It can be explained that when the electronic device is used as a device end, such as a smart TV, it can be remotely controlled by inputting text to search for TV, movies, etc. through a remote control panel, or it can be connected to a mobile end through Bluetooth through the above method provided by the present disclosure, and search for TV, movies, etc. by receiving text sent by the mobile end connected by Bluetooth. Among them, the electronic device can be developed based on the Android system, and can then match various language and text libraries on the Android system.
[0163] When the electronic device is used as a mobile terminal, such as a mobile phone or a tablet computer, a mobile terminal text input box can be displayed on the display screen of the mobile terminal by installing an application, and then the mobile terminal can be used as, for example, a remote control to control the TV to switch programs via Bluetooth and to search for TV and movies by inputting text on the mobile terminal. Similarly, the mobile terminal can be used as an input terminal to control the in-vehicle multimedia via Bluetooth to perform, for example, air conditioning temperature adjustment, music switching and text input (text input can be performed, for example, by entering a destination for search during map navigation).
[0164] The embodiment of the present disclosure further provides a computer-readable storage medium having program code stored thereon. When the program code is executed by a processor, the steps and corresponding contents of the aforementioned end-to-end text input method embodiment can be implemented.
[0165] The preferred embodiments of the present disclosure are described in detail above in conjunction with the accompanying drawings; however, the present disclosure is not limited to the specific details in the above embodiments; within the technical concept of the present disclosure, various changes, modifications, substitutions and variations may be made to these embodiments, and these changes, modifications, substitutions and variations all fall within the protection scope of the present disclosure.
[0166] It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any appropriate manner without contradiction, which should also be regarded as the content disclosed by this disclosure. In order to avoid unnecessary repetition, this disclosure will not further explain various possible combinations. The technical scope of this application is not limited to the content in the specification.
Claims
1. An end-to-end text input method, characterized in that: Applied to a device, the method includes: In response to a low-power Bluetooth activation operation, activating the low-power Bluetooth of the device end, and when the low-power Bluetooth is activated, broadcasting connection information of the low-power Bluetooth, so that the mobile end can scan the connection information and establish a Bluetooth connection with the device end according to the scanned connection information; In the case where the Bluetooth connection is successfully established, in response to the text input start operation instruction, a device-side text input box is displayed on the display screen of the device-side, and a text input instruction is sent to the mobile terminal through the Bluetooth connection, so that the mobile terminal displays an input cursor in the mobile-side text input box on the display screen of the mobile terminal when the text input instruction is received; Receiving input text content sent in real time by the mobile terminal through the Bluetooth connection, and displaying text content in the device-side text input box of the device-side according to the input text content; Upon receiving an input completion instruction sent by the mobile terminal, performing a search operation of the input text content on the device terminal, wherein the input completion instruction is generated by the mobile terminal in response to a confirmation operation on the input text content and sent to the device terminal via the Bluetooth connection; The step of displaying a text input box on the device side on the display screen of the device side in response to the text input start operation instruction includes: In response to a text input start operation instruction, determining whether a soft keyboard for text input is displayed on a display screen of the device end according to a source of the text input start operation instruction; In the case where it is determined that the soft keyboard for text input is not displayed on the display screen of the device end, the soft keyboard for text input is not started to be displayed on the display screen of the device end, and the text input box of the device end for text display is started to be displayed on the display screen of the device end; When it is determined that a soft keyboard for text input is displayed on the display screen of the device end, simultaneously starting to display the soft keyboard for text input on the display screen of the device end and displaying the device end text input box for text display on the display screen of the device end; The source includes the mobile terminal or the device terminal, and determining whether to display a soft keyboard for text input on the display screen of the device terminal according to the source of the text input start operation instruction includes: In the case where the source of the text input start operation instruction is the mobile terminal, determining not to display a soft keyboard for text input on the display screen of the device terminal, wherein the text input start operation instruction sent by the mobile terminal is generated according to the identity identifier of the mobile terminal and sent to the device terminal after the mobile terminal displays a soft keyboard for text input and the mobile terminal text input box for text display on the display screen of the mobile terminal in response to a user operation; In a case where the source of the text input start operation instruction is the device end, it is determined that a soft keyboard for text input is displayed on the display screen of the device end, wherein the text input start operation instruction generated by the device end is generated by the device end in response to a user text input operation on the device end, according to an identity identifier of the device end, and in response to a user hiding operation on the soft keyboard for text input displayed on the display screen of the device end, a mobile terminal text input interface instruction is sent to the mobile terminal through the Bluetooth connection, so that when the mobile terminal receives the mobile terminal text input interface instruction, the soft keyboard for text input and the mobile terminal text input box for text display are displayed on the display screen of the mobile terminal.
2. The end-to-end text input method according to claim 1, characterized in that: Before determining whether to display a soft keyboard for text input on the display screen of the device according to the source of the text input start operation instruction in response to the text input start operation instruction, the method includes: Determine the identity identifier carried by the text input start operation instruction; The source of the text input start operation instruction is determined according to the identity identifier.
3. The end-to-end text input method according to claim 1, characterized in that: The displaying of text content in the text input box on the device side according to the input text content includes: Parsing the language type and symbol type of the input text content; Determining the target language type of the input text content from a preset text library according to the language type and the symbol type; Matching target text content corresponding to the input text content from a text library corresponding to the target language type; The target text content is displayed as text content in the device-side text input box on the device side.
4. The end-to-end text input method according to any one of claims 1 to 3, characterized in that: The low-power Bluetooth activation operation includes: turning on the device end, turning on the low-power Bluetooth on the device end, and turning on a smart home device that is connected to the device end Internet of Things.
5. An end-to-end text input method, characterized in that: Applied to a mobile terminal, the mobile terminal is the mobile terminal according to any one of claims 1 to 4, and the method comprises: Scanning the connection information of the low-power Bluetooth of the device end, and establishing a Bluetooth connection with the device end according to the scanned connection information, wherein the connection information is broadcast by the device end after activating the low-power Bluetooth of the device end in response to the low-power Bluetooth activation operation; receiving a text input instruction sent by the device end through the Bluetooth connection, and displaying an input cursor in a mobile end text input box on the display screen of the mobile end upon receiving the text input instruction, wherein the text input instruction is sent by the device end after displaying the device end text input box on the display screen of the device end in response to a text input start operation; In response to a text input operation on the soft keyboard of the mobile terminal, determining input text content according to the text input operation, and sending the input text content to the device terminal via the Bluetooth connection in real time, so that the device terminal displays the input text content as input in the text input box of the device terminal; In response to a confirmation operation on the input text content, an input completion instruction is generated, and the input completion instruction is sent to the device end via the Bluetooth connection, so that the device end performs a search operation for the input text content on the device end when receiving the input completion instruction.
6. The end-to-end text input method according to claim 5, characterized in that: Before receiving the text input instruction sent by the device end through the Bluetooth connection, the method further includes: In response to a user operation, a soft keyboard for text input and a text input box for text display on the display screen of the mobile terminal are displayed; A text input start operation instruction is generated based on the identity identifier of the mobile terminal and sent to the device terminal, so that when the device terminal determines that the source of the text input start operation instruction is the mobile terminal based on the identity identifier carried by the text input start operation instruction, it determines not to display a soft keyboard for text input on the display screen of the device terminal and determines to display the device-side text input box for text display on the display screen of the device terminal.
7. The end-to-end text input method according to claim 5, characterized in that: Before receiving the text input instruction sent by the device end through the Bluetooth connection, the method further includes: When receiving a mobile terminal text input interface instruction sent by the device end through the Bluetooth connection, displaying a soft keyboard for text input and the mobile terminal text input box for text display on the display screen of the mobile terminal; Among them, the mobile terminal text input interface instruction is sent to the mobile terminal through the Bluetooth connection by the device terminal when the device terminal determines that the source of the text input start operation instruction is the device terminal, and the device terminal displays a soft keyboard for text input on the display screen of the device terminal, and responds to the user's hiding operation on the soft keyboard for text input displayed on the display screen of the device terminal, wherein the text input start operation instruction generated by the device terminal is generated by the device terminal in response to the user's text input operation on the device terminal, according to the identity identifier of the device terminal.
8. The end-to-end text input method according to any one of claims 5 to 7, characterized in that: The mobile terminal includes at least one of a smart phone, a tablet computer, and a smart wearable device, and the device terminal includes at least one of a vehicle multimedia device, a smart TV, and a projector.
9. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the method described in any one of claims 1 to 4, or to execute the computer program in the memory to implement the steps of the method described in any one of claims 5 to 8.
