A display device and a method for displaying and inputting data using a soft keyboard.

Abstract

This disclosure relates to a display device and a method for displaying and inputting a soft keyboard, belonging to the field of soft keyboard technology. The display device includes: a controller configured to: control a display to show an input interface; a user input interface configured to: receive input trigger operations from a user on the input interface; the controller is further configured to: in response to the input trigger operation, acquire the screen size of the display and the position information of elements in the input interface; determine the display range of the soft keyboard based on the screen size and the position information of the elements; and control the display to show the soft keyboard within the display range; the user input interface is further configured to: receive input control operations from a user on the soft keyboard; the controller is further configured to: acquire the input content corresponding to the input control operation and control the display to show the input content on the input interface. Embodiments of this disclosure adaptively adjust the position of the soft keyboard, improving the user experience.

Description

Technical Field

[0001] This disclosure relates to the field of soft keyboard technology, and more particularly to a display device and a method for displaying and inputting on a soft keyboard. Background Technology

[0002] With the development of big data and artificial intelligence, users' functional needs for display devices are becoming increasingly diverse. When a user accesses the input interface of a display device, a soft keyboard is displayed on the screen. This soft keyboard is usually located on the layer above the input interface, which can obscure some information on the input interface and affect the user's input. Existing methods avoid this by moving the input interface upwards, but the display area of ​​a monitor is limited. Moving the input interface upwards makes it difficult to display other information completely, further affecting user input and resulting in a poor user experience. Summary of the Invention

[0003] To solve the above-mentioned technical problems, or at least partially solve them, this disclosure provides a display device and a method for displaying and inputting a soft keyboard, which can adaptively adjust the position of the soft keyboard and improve the user experience.

[0004] To achieve the above objectives, the technical solutions provided by the embodiments of this disclosure are as follows:

[0005] In a first aspect, this disclosure provides a display device, comprising:

[0006] The controller is configured to control the display to show the input interface;

[0007] The user input interface is configured to receive user input triggered by the input interface.

[0008] The controller is also configured to: in response to an input trigger operation, obtain the screen size of the display and the position information of the elements in the interface to be input; determine the display range of the soft keyboard based on the screen size and the position information of the elements; and control the display to show the soft keyboard within the display range.

[0009] The user input interface is also configured to receive user input control operations for the soft keyboard;

[0010] The controller is also configured to: acquire the input content corresponding to the input control operation, and control the display to show the input content on the input interface.

[0011] Secondly, this disclosure provides a method for displaying and inputting data using a soft keyboard, including:

[0012] Control the display to show the input interface;

[0013] Receive user input triggered by the input interface;

[0014] In response to an input trigger operation, obtain the screen size of the display and the position information of the elements in the interface to be input; determine the display area of ​​the soft keyboard based on the screen size and the position information of the elements; and control the display to show the soft keyboard within the display area.

[0015] Receive user input control operations for the soft keyboard;

[0016] Obtain the input content corresponding to the input control operation, and control the display to show the input content on the input interface.

[0017] Thirdly, this disclosure provides a computer-readable storage medium, including: storing a computer program on the computer-readable storage medium, wherein when the computer program is executed by a processor, it implements the display and input method of the soft keyboard as described in the second aspect.

[0018] Fourthly, this disclosure provides a computer program product comprising a computer program that, when run on a computer, enables the computer to implement the soft keyboard display and input method as described in the second aspect.

[0019] This disclosure provides a display device and a method for displaying and inputting a soft keyboard. The display device first controls the monitor to display an input interface via a controller. Then, it receives input trigger operations from the user on the input interface via a user input interface. The controller then responds to the input trigger operations by acquiring the screen size of the monitor and the position information of elements in the input interface. Based on the screen size and element position information, it determines the display range of the soft keyboard and controls the monitor to display the soft keyboard within this range. Furthermore, the user input control operations are received via the user input interface, and the controller acquires the corresponding input content and controls the monitor to display the input content on the input interface. This achieves adaptive adjustment of the soft keyboard's display position based on the monitor's screen size and the position information of elements in the input interface, thus fully displaying the input interface. This facilitates accurate input by the user from the fully displayed input interface, improving the user experience. Attached Figure Description

[0020] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0021] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1A This is a schematic diagram of the input interface;

[0023] Figure 1B This is a schematic diagram of a soft keyboard display in the prior art;

[0024] Figure 2A These are schematic diagrams of scenarios provided in some embodiments of the present disclosure;

[0025] Figure 2B This is a schematic diagram of the input interface provided in an embodiment of this disclosure;

[0026] Figure 2C This is a schematic diagram of the input interface provided in this embodiment of the disclosure;

[0027] Figure 3 This is a block diagram showing the configuration of the control device in an embodiment of this disclosure;

[0028] Figure 4 This is a hardware configuration block diagram of the display device in an embodiment of this disclosure;

[0029] Figure 5 This is a schematic diagram of the software configuration in the display device in an embodiment of this disclosure;

[0030] Figure 6A A flowchart illustrating a display and input method for a soft keyboard provided in an embodiment of this disclosure;

[0031] Figure 6B Schematic diagram 2 of the input interface provided in this embodiment of the disclosure;

[0032] Figure 6C A schematic diagram of the input interface provided in the embodiments of this disclosure. Figure 3 ;

[0033] Figure 6D This is a schematic diagram illustrating the position information of elements in the input interface in an embodiment of this disclosure;

[0034] Figure 7A This is a schematic diagram of the first display range provided in an embodiment of this disclosure;

[0035] Figure 7B This is a schematic diagram of the area to be displayed provided in an embodiment of this disclosure;

[0036] Figure 7CThis is a schematic diagram of the display area provided in this embodiment of the disclosure;

[0037] Figure 7D This is a second schematic diagram of the first display range provided in an embodiment of this disclosure;

[0038] Figure 7E This is a schematic diagram of the display area provided in the embodiments of this disclosure. Figure 3 ;

[0039] Figure 7F This is a schematic diagram of the display area provided in the embodiments of this disclosure. Figure 4 ;

[0040] Figure 8A This is a schematic diagram of the display area provided in the embodiments of this disclosure. Figure 5 ;

[0041] Figure 8B This is a schematic diagram of the display area provided in an embodiment of this disclosure;

[0042] Figure 8C A schematic diagram of the focus provided in the embodiments of this disclosure;

[0043] Figure 8D Schematic diagram seven showing the display area provided in this embodiment of the disclosure;

[0044] Figure 8E This is a schematic diagram (eight) illustrating the display area provided in this embodiment of the disclosure;

[0045] Figure 8F Schematic diagram nine shows the area to be displayed provided in this embodiment of the disclosure;

[0046] Figure 8G Schematic diagram 2 showing the focus provided in the embodiments of this disclosure;

[0047] Figure 8H This is a schematic diagram of the area to be displayed provided in an embodiment of this disclosure. Detailed Implementation

[0048] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0049] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0050] Currently, in scenarios requiring content input to a display device, such as when a user enters the name of a media asset on the display device to search for it, the command triggers the display device's screen to show the input interface for the media asset to be searched. If the topic name of this input interface is "movies," it means the user expects to search for movies. The topic name can also be TV series, variety shows, music, etc. Figure 1A As shown, Figure 1A This is a schematic diagram of the input interface. The input interface 101 shown in the diagram includes an input box 11, a confirmation option 12, and a cancel option 13. When the user touches and clicks the input box, the soft keyboard is brought up, as shown below. Figure 1B As shown, Figure 1B This is a schematic diagram of a soft keyboard display in the prior art. The diagram includes an input interface 101 and a soft keyboard 102. When the soft keyboard 102 is brought up, it may obscure the confirmation option 12 and the cancel option 13. To avoid this, the prior art moves the input interface 101 upwards. However, due to the limited display range of the display device's monitor, after the input interface 101 is moved upwards, the subject name "movie" of the input interface 101 is not displayed on the current page, making it difficult for users to determine the type of media asset they need to search for, thus affecting the user experience.

[0051] To address the aforementioned technical problems, this disclosure provides a display device. This device first controls a monitor to display an input interface via a controller. Then, it receives user input trigger operations on the input interface via a user input interface. The controller responds to the input trigger operations by acquiring the screen size of the monitor and the position information of elements in the input interface. Based on the screen size and element position information, it determines the display range of the soft keyboard and controls the monitor to display the soft keyboard within this range. Furthermore, the device receives user input control operations on the soft keyboard via the user input interface, acquires the corresponding input content via the controller, and controls the monitor to display the input content on the input interface. This achieves adaptive adjustment of the soft keyboard's display position based on the monitor's screen size and the position information of elements in the input interface, thus fully displaying the input interface. This facilitates accurate input by the user from the fully displayed input interface, improving the user experience.

[0052] Figure 2A These are schematic diagrams illustrating scenarios from some embodiments provided in this disclosure. For example... Figure 2A As shown, Figure 2A It includes a control device 100, a display device 200, an intelligent device 300, and a server 400.

[0053] like Figure 2AAs shown, taking the control device 100 operating the display device 200 as an example, in a scenario where a user modifies the display device name during system configuration, the user first sends a modification command to the display device 200 through the control device 100. After receiving the modification command, the display device 200 controls the monitor to display the input interface, such as... Figure 2B As shown, Figure 2B This is a schematic diagram of the input interface provided in this embodiment of the disclosure. The input interface 101 shown in the figure includes an input box 11, a confirmation option 12, a cancellation option 13, and a topic name 14. The user can input the name of the display device to be modified in the input box 11 through the control device 100.

[0054] After displaying the input interface 101, the display device receives the input trigger operation from the user via the control device 100 for the input interface 101 through the user input interface, obtains the screen size of the display and the position information of the elements in the input interface, and determines the display range of the soft keyboard based on the screen size and the position information, thereby controlling the display of the soft keyboard within the display range. Figure 2C As shown, Figure 2C The second schematic diagram of the input interface provided in this embodiment shows that the display device receives input control operations from the user via the control device 100 on the soft keyboard through the user input interface, obtains the input content corresponding to the input control operation, and controls the display of the input content on the input interface, making the current interface aesthetically pleasing, improving the user-friendliness of the display device, enabling the user to make accurate input based on the fully displayed input interface, and improving the user experience.

[0055] In some embodiments, the control device 100 may be a remote control, and communication between the remote control and the display device may include infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200. Users can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. In some embodiments, mobile terminals, tablet computers, computers, laptops, and other smart devices may also be used to control the display device 200.

[0056] In some embodiments, the smart device 300 can install software applications with the display device 200 to achieve connection and communication via network communication protocols, enabling one-to-one control operations and data communication. Audio and video content displayed on the smart device 300 can also be transmitted to the display device 200 for synchronized display. The display device 200 also communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactive features to the display device 200.

[0057] Display device 200 can be an LCD monitor, OLED monitor, or projection display device. It can also be a television, mobile phone, refrigerator, range hood, or other device with a built-in display. In addition to providing broadcast television reception functionality, display device 200 can also be equipped with smart network television functionality that provides computer support.

[0058] Figure 3 This is a block diagram showing the configuration of the control device in an embodiment of this disclosure. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. The communication interface 130 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or a replacement module. The user input / output interface 140 includes at least one of a microphone, a touchpad, a sensor, buttons, or a replacement module.

[0059] Figure 4 This is a hardware configuration block diagram of the display device in an embodiment of this disclosure. For example... Figure 4 The display device 200 includes: a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, etc. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to nth interface for input / output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The detector 230 is used to collect signals from the external environment or signals interacting with the external environment. The controller 250 and the tuner / demodulator 210 can be located in different separate devices; that is, the tuner / demodulator 210 can also be an external device of the main device where the controller 250 is located, such as an external set-top box.

[0060] In some embodiments, the display device described above is a terminal device with display function, such as a television, mobile phone, computer, or learning machine.

[0061] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. The user can input user commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0062] The output interface (display 260, and / or audio output interface 270) is configured to output user interaction information;

[0063] Communicator 220 is used to communicate with server 400 or other devices.

[0064] This disclosure provides a display device, which includes:

[0065] Controller 250 is configured to control the display to show the input interface;

[0066] The user input interface is configured to receive user input triggered by the input interface.

[0067] The controller 250 is also configured to: in response to an input trigger operation, obtain the screen size of the display and the position information of the elements in the interface to be input; determine the display range of the soft keyboard based on the screen size and the position information of the elements; and control the display to display the soft keyboard within the display range.

[0068] The user input interface is also configured to receive user input control operations for the soft keyboard;

[0069] The controller 250 is also configured to: acquire the input content corresponding to the input control operation, and control the display to show the input content on the input interface.

[0070] The aforementioned display device determines the display area of ​​the soft keyboard based on the screen size of the monitor and the position information of the elements in the interface to be input, so as to achieve reasonable display without obstructing the interface to be displayed, thus improving the user-friendliness of the interface display and enhancing the user experience.

[0071] In some embodiments, the screen size of the display includes the side length of the first side and the side length of the second side, the first side and the second side being two mutually perpendicular sides of the screen of the display; the element is the target element in the interface to be input that is closest to the target edge, or the element is the focus of the interface to be input, and the target edge is any edge of the screen of the display.

[0072] In some embodiments, the element is the target element in the interface to be input that is closest to the target edge, and the target edge is an edge on the screen of the display that is opposite to the first edge or the second edge.

[0073] The controller 250 determines the display range of the soft keyboard based on the screen size and the position information of the element. Specifically, it is configured to: determine a first display range of the soft keyboard in a first direction based on the screen size and the position information of the target element; the first direction is the direction perpendicular to the target edge; determine a second display range of the soft keyboard in a second direction based on the first display range and the screen size; the second direction is the direction parallel to the target edge; and determine the display range of the soft keyboard based on the first display range and the second display range.

[0074] In some embodiments, a coordinate system is established with the intersection of the first side and the second side as the origin; the position information of the target element is the first coordinate value of the target point in the first direction, and the target point is the point in the target element that is closest to the target side;

[0075] Before determining the display range of the soft keyboard based on the screen size and the position information of the target element, the controller 250 is also configured to: determine the first coordinate value based on the screen size;

[0076] The controller 250 determines the first display range of the soft keyboard in the first direction based on the screen size and the position information of the target element. Specifically, the controller 250 is configured to: determine the first target value based on the screen size and the golden ratio; and determine the first display range of the soft keyboard based on the first coordinate value and the screen size if the first coordinate value is less than or equal to the first target value.

[0077] In some embodiments, the controller 250 determines the first display range of the soft keyboard in the first direction based on the screen size and the position information of the target element by: determining a first target value based on the screen size and the golden ratio; determining a second coordinate value of the focus of the input interface in the first direction if the first coordinate value is greater than the first target value; and determining the first display range of the soft keyboard in the first direction based on the screen size and the second coordinate value.

[0078] In some embodiments, after determining the second coordinate value of the focus of the input interface in the first direction, the controller 250 is further configured to: determine a second target value based on the screen size and the golden ratio; if the second coordinate value is greater than or equal to the second target value, determine a first display range of the soft keyboard according to the second coordinate value and the side length of the target side; if the second coordinate value is less than the second target value, determine a first display range of the soft keyboard according to the second coordinate value, the side length of the first side and the side length of the second side.

[0079] In some embodiments, a coordinate system is established with the intersection of the first side and the second side as the origin, and the element is the focus of the interface to be input.

[0080] The controller 250 determines the display range of the soft keyboard based on the screen size and element position information in the following manner: a second target value is determined based on the screen size and the golden ratio; if the second coordinate value of the focus in the first direction is greater than or equal to the second target value, a first display range of the soft keyboard is determined based on the second coordinate value, the length of the first side, and the length of the second side; a second display range of the soft keyboard is determined based on the first display range and the screen size in the second direction, where the second direction is parallel to the target side; and the final display range of the soft keyboard is determined based on the first and second display ranges.

[0081] In some embodiments, the controller 250 determines the display range of the soft keyboard based on the screen size and element position information by: determining the display range of the soft keyboard based on the screen size, element position information, and display offset value; wherein the display offset value is determined based on the screen size and the golden ratio.

[0082] like Figure 5 As shown, Figure 5 This is a schematic diagram of the software configuration in the display device in an embodiment of this disclosure, such as... Figure 5 As shown, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0083] To illustrate this solution in more detail, the following will use examples to illustrate it. Figure 6A To explain, it is understandable that Figure 6A The steps involved may include more or fewer steps in actual implementation, and the order of these steps may also be different, depending on whether the display and input method of the soft keyboard provided in the embodiments of this disclosure can be achieved.

[0084] like Figure 6A As shown, Figure 6AThis is a flowchart illustrating a display and input method for a soft keyboard according to an embodiment of the present disclosure. The method is applied to the aforementioned display device and includes the following steps S601 to S605:

[0085] S601, Control the display to show the input interface.

[0086] The input interface includes, but is not limited to: topic name, input box, confirmation option, and cancellation option.

[0087] In some embodiments, the input interface can be displayed in either landscape or portrait mode. First, the aspect ratio of the display device (e.g., a TV, mobile phone) is determined. Then, based on the aspect ratio of the display device, the aspect ratio of the input interface is determined, such as... Figure 2B As shown; taking a TV as an example, the input interface 101 is displayed in landscape mode, as shown. Figure 6B As shown, Figure 6B This is a second schematic diagram of the input interface provided in an embodiment of this disclosure. Figure 6B Taking a mobile phone as an example, the input interface 101 is displayed according to the aspect ratio of the mobile phone.

[0088] S602, Receive user input trigger operation for the input interface.

[0089] In some embodiments, users can send input trigger operations to the display device via a control device or smart device, generate input trigger operations by touching and clicking on the interface to be input on the display, or generate input operations for the interface to be input via voice input.

[0090] For example, such as Figure 6C As shown, Figure 6C A schematic diagram of the input interface provided in the embodiments of this disclosure. Figure 3 The input interface 101 shown in the figure includes an input box 11, a confirmation option 12, a cancellation option 13, and a topic name 14. When a user touches the input box 11 on the currently displayed input interface 101, an input trigger operation is generated to instruct the display device to bring up the soft keyboard for the user to input.

[0091] S603. In response to an input trigger operation, obtain the screen size of the display and the position information of the elements in the interface to be input; determine the display range of the soft keyboard based on the screen size and the position information of the elements; and control the display to display the soft keyboard within the display range.

[0092] The screen size of a monitor includes the length of the first side and the length of the second side. The first side and the second side are two mutually perpendicular sides of the monitor screen. It can be understood that the screen size of a monitor includes the width value and the height value of the monitor. The screen size of a monitor may also include the aspect ratio of the monitor.

[0093] In this embodiment of the disclosure, the element in the input interface is the target element in the input interface that is closest to the target edge, or the element is the focus of the input interface; the target edge is any edge in the screen of the display.

[0094] The positional information of elements in the input interface includes, but is not limited to: the positional information of the topic name, the positional information of the input box, the positional information of the confirm option, and the positional information of the cancel option. The positional information is in coordinates. In this embodiment, any one of the four vertices of the display (top left, top right, bottom right, and bottom left) can be used as the origin of the coordinate system. Figure 6D As shown, Figure 6D This is a schematic diagram of the position information of elements in the interface to be input in this embodiment of the present disclosure. The interface to be input 101 shown in the figure includes an input box 11, a confirmation option 12, a cancellation option 13, and a topic name 14. A spatial rectangular coordinate system is established with the top left corner of the display as the origin, the top of the display as the horizontal axis, and the left side of the display as the vertical axis. It should be noted that the position information of each element included in the input interface 101 is a set of coordinates. This disclosure takes regular geometric elements as an example for illustration. The position information of topic name 14 is {x1, y1}, which includes the coordinates of the top left vertex (x11, y11), top right vertex (x12, y12), bottom right vertex (x13, y13), and bottom left vertex (x14, y14) of topic name 14. Correspondingly, the position information of input box 11 is {x2, y2}, the position information of confirmation option 12 is {x3, y3}, and the position information of cancellation option 13 is {x4, y4}. The vertex coordinates included in the position information of each element are not elaborated here.

[0095] The following sections will use the top left corner of the display as the origin of the coordinate system to illustrate other embodiments of the soft keyboard display and input method.

[0096] Combination Figure 6C For example, if the target edge is the bottom edge of the display, the element is the target element closest to the target edge in the input interface: Confirm option 12 or Cancel option 13; or, the element is the focus of the input interface, such as the geometric center point of the area composed of the input box, Confirm option, and Cancel option in the input interface, or the point corresponding to the cursor, or the upper right corner or lower left corner of the input box.

[0097] The soft keyboard can be a 26-key soft keyboard, a 9-key soft keyboard, or a soft keyboard for handwriting input. The types of soft keyboards can be found in existing soft keyboards, and will not be elaborated upon here.

[0098] The following will explain the process of determining the display area of ​​the soft keyboard according to different elements:

[0099] (1) The element is the target element in the interface to be input that is closest to the target edge.

[0100] In some embodiments, in response to an input trigger operation, the display device first obtains the screen size of the display and the position information of the element in the interface to be input. If the element is the target element in the interface to be input that is closest to the target edge, and if the target edge is an edge on the screen of the display that is opposite to the first edge or the second edge, then a first display range of the soft keyboard in a first direction is determined based on the screen size and the position information of the target element, wherein the first direction is the vertical direction of the target edge.

[0101] In some embodiments, the target edge is determined based on the position information of elements in the input interface, with reference to... Figure 6D The input interface 101 includes an input box 11, a confirmation option 12, a cancellation option 13, and a topic name 14. The position information of the topic name 14 is {x1, y1}, the position information of the input box 11 is {x2, y2}, the position information of the confirmation option 12 is {x3, y3}, and the position information of the cancellation option 13 is {x4, y4}. The distance between the horizontal coordinate of each element and the four sides of the display is calculated. For example, based on the coordinates of the top left vertex of the topic name 14 (x11, y11), the distance between the topic name 14 and the right side of the display is determined to be a-x11. The calculation method for other distances is similar and will not be elaborated here. The maximum value among the distances between the horizontal coordinate of each element and the four sides of the display is determined, and the edge of the display corresponding to this maximum value is taken as the target edge. This can be understood as comparing the boundary sizes between each element and the edge of the display, thereby filtering out smaller boundary areas based on the size of the input interface and the screen, retaining larger areas, and then determining the final display range based on the target edge. For example, the distance between the element theme name 14 and the top edge of the display is less than the distance between the confirmation option 12 and the bottom edge of the display, so the target edge is determined to be the bottom edge of the display, indicating that there is a large space left near the bottom edge of the display, and thus the soft keyboard is displayed in a larger area below the input interface 101.

[0102] A Cartesian coordinate system is established with the top left corner of the monitor as the origin, the top edge (second edge) of the monitor as the horizontal axis, and the left edge (first edge) of the monitor as the vertical axis. The monitor's screen dimensions include the top edge length (width *a*) and the left edge length (height *b*). The target edge is either the edge on the monitor screen opposite the first edge or the edge opposite the second edge.

[0103] Based on the screen size of the display, a target element is determined from multiple elements of the interface to be input. In this embodiment, the target element is the element closest to the target edge. Different target edges result in different target elements.

[0104] A. The target edge is the edge opposite the top edge (second edge) of the display.

[0105] This disclosure provides an implementation method whereby, if the target edge is an edge opposite to the top edge (second edge) of the display, that is, the bottom edge of the display, the element whose vertical coordinate is closest to the top edge of the display is determined based on the vertical coordinates of multiple elements on the input interface.

[0106] Furthermore, based on the screen size and the position information of the target element, the first display area of ​​the soft keyboard in the first direction is determined. Since the bottom of the display is along the horizontal axis and the first direction is perpendicular to the target edge, the first direction is along the vertical axis. The position information of the target element is the first coordinate point of the target point in the first direction, where the target point is the point in the target element that is closest to the target edge.

[0107] Before determining the first display area, this embodiment of the disclosure provides an implementation method that determines a first coordinate value based on the screen size of the display. The first coordinate value is the coordinate value of the target point closest to the target edge in the target element in a first direction. For example, the first coordinate value is the ordinate of the lower left or lower right vertex of the target element. Then, a first target value is determined based on the screen size and the golden ratio. The screen size includes: the width value 'a' and the length value 'b' of the display; the golden ratio (GSP) is typically taken as 0.618, and the first target value is 0.618 * b.

[0108] If the first coordinate value is less than or equal to the first target value, it means that there is enough space to display the soft keyboard when the element is the target element closest to the target edge in the input interface. Furthermore, the first display range of the soft keyboard is determined according to the first coordinate value and the screen size so that the soft keyboard can be displayed on the bottom or top of the screen.

[0109] When the first coordinate value is greater than the first target value, the element becomes the focus of the input interface. For the specific implementation process, please refer to the implementation process described in (2) The element becomes the focus of the input interface. It will not be repeated here.

[0110] The target element is a regular quadrilateral. Based on the left side length of the monitor and the first coordinate value of the target element (the y-coordinate of the bottom-left or bottom-right vertex), the first display range of the soft keyboard along the vertical axis is determined. This can be understood as follows: based on the left side length of the monitor and the y-coordinate value of the bottom-left or bottom-right vertex of the target element, the first display range of the soft keyboard along the vertical axis is determined. This first display range is the y-coordinate range: from the y-coordinate value of the bottom-left or bottom-right vertex of the target element to the maximum value on the vertical axis, with the left side length of the monitor used as the maximum value on the vertical axis.

[0111] For example, such as Figure 7A As shown, Figure 7A This is a schematic diagram of the first display range provided in this embodiment of the present disclosure. The elements included in the input interface 101 shown in the figure are: input box 11, confirmation option 12, cancellation option 13, and topic name 14. The position information of topic name 14 is {x1, y1}, the position information of input box 11 is {x2, y2}, the position information of confirmation option 12 is {x3, y3}, and the position information of cancellation option 13 is {x4, y4}. The target edge is the bottom edge of the display. Based on the vertical coordinates of the elements included in the input interface 101: y14, y24, y34, y44, the vertical coordinate closest to the bottom edge of the display is determined to be y44, and the corresponding element is cancellation option 13. Further, based on the left side length b of the display and the vertical coordinate y44 of cancellation option 13, the first display range is determined to be [y44, b].

[0112] After determining the first display area, a second display area for the soft keyboard in the second direction is determined based on the first display area and the screen size. In this embodiment of the disclosure, the aspect ratio of the display is determined based on the top side length (width value) and the left side length (height value) of the display, and then the second display area for the soft keyboard in the second direction is determined based on the aspect ratio of the display and the first display area.

[0113] The display length m1 of the soft keyboard along the vertical axis is determined based on the first display range, and is calculated using formula (1-1):

[0114] m1 = by b …Formula (1-1)

[0115] Where b is the left side length of the display, which is also the maximum value of the vertical axis; y b The first coordinate value of the target point of the target element in the vertical direction.

[0116] Following the previous example, the display length of the soft keyboard along the vertical axis, m1 = b - y44, is calculated using formula (1-1). Based on the top and left side lengths of the monitor, the aspect ratio of the monitor is determined to be a:b. The display length along the horizontal axis of the soft keyboard is then calculated using formula (1-2) based on the vertical axis display length m1 and the aspect ratio a:b.

[0117]

[0118] The minimum x-coordinate of the second display area of ​​the soft keyboard 1min Calculated according to formula (1-3):

[0119]

[0120] The maximum horizontal coordinate (x) of the second display area of ​​the soft keyboard 1max Calculated according to formula (1-4)

[0121] x 1max =x 1min +n1…Formula (1-4)

[0122] Determine the second display range of the soft keyboard as [x 1min x 1max ].

[0123] For example, based on the first display range [y44, b] of the soft keyboard, and the second display range [x... 1min x 1max [The text appears to be incomplete and contains several grammatical errors. A more accurate translation would require the full context.] like Figure 7B As shown, Figure 7B This is a schematic diagram of the display area provided in this embodiment of the present disclosure. The diagram shows the input interface 101 and the display area 103, wherein the display area is [(x 1min ,y44),(x 1max b)], that is:

[0124]

[0125] Furthermore, the display device controls the display to show the soft keyboard within the display area 103.

[0126] For aesthetic purposes, this disclosure provides another implementation method, which determines the display area of ​​the soft keyboard based on the screen size, the position information of the target element, and the display offset value. The display offset value is calculated according to formula (4) based on the golden ratio and the aspect ratio of the display:

[0127]

[0128] Where offset is the display offset value, GSP is the golden section ratio, which is usually taken as 0.618. 'a' is the width of the monitor, and 'b' is the height of the monitor. It should be noted that the aspect ratio a:b in the above formula (2-1) is the aspect ratio in landscape mode, and b:a in portrait mode. The above formula (2-1) can be adjusted according to actual conditions. This disclosure is for illustrative purposes only and is not intended to limit the scope of the application.

[0129] In determining the display area of ​​the soft keyboard based on screen size, target element position information, and display offset value, the first display area is determined firstly based on the left side length of the monitor, the ordinate of the target element, and the display offset value. The minimum ordinate of the first display area is y. 2min Calculated according to formula (2-2):

[0130] y 2min =y b +offset...formula (2-2)

[0131] The first display range of the soft keyboard is [y 2min b-offset).

[0132] Then, the second display area of ​​the soft keyboard is calculated based on the first display area of ​​the soft keyboard and the top edge length of the display.

[0133] The display length m2 of the soft keyboard along the vertical axis is determined based on the first display range, and is calculated using formula (2-3):

[0134] m2 = b - offset - y 2min …Formula (2-3)

[0135] Among them, the minimum x-coordinate of the second display range 2min Calculated according to formula (2-4):

[0136]

[0137] The maximum horizontal coordinate (x) of the second display area of ​​the soft keyboard 2max Calculated according to formula (2-5)

[0138] x 2max =x 2min +n2…Formula (2-5)

[0139] Where n2 is the display length of the soft keyboard along the horizontal axis, as shown in formula (2-6):

[0140]

[0141] Determine the second display range of the soft keyboard as [x 2min x 2max ].

[0142] Furthermore, based on the first display range of the soft keyboard [y 2min b-offset], the second display range is [x 2min x 2max The desired display area for the soft keyboard is obtained.

[0143] For example, such as Figure 7C As shown, Figure 7C This is a second schematic diagram of the display area provided in this embodiment of the present disclosure. The diagram shows the input interface 101 and the display area 103, wherein the display area is [(x 2min y 2min ), (x 2max b-offset), that is: Furthermore, the display device controls the display to show the soft keyboard within the display area 103.

[0144] B. The target edge is the edge opposite the left side (first edge) of the monitor.

[0145] This disclosure provides an implementation method whereby, if the target edge is the edge opposite to the left side (first edge) of the display, that is, the target edge is the right side of the display, then for the right side of the display, based on the horizontal coordinates of multiple elements of the input interface, the element whose horizontal coordinate is closest to the right side of the display is determined as the target element.

[0146] Understandably, when the display device is in landscape mode, if the target side is the right side of the monitor, the target element is the element furthest from the left side of the monitor, thus reserving the largest area on the left or right side of the screen to display the soft keyboard.

[0147] Furthermore, based on the screen size and the position information of the target element, the first display range of the soft keyboard in the first direction is determined. The position information of the target element refers to the first coordinate point of the target point within the target element in the first direction, and the target point is the point within the target element closest to the target edge.

[0148] If the target edge is the right side of the monitor, since the direction of the right side of the monitor is along the vertical axis and the first direction is perpendicular to the target edge, then the first direction is along the horizontal axis. The target point is the point in the target element that is closest to the right side of the monitor, and the first coordinate value is the horizontal coordinate value of the upper right vertex or the lower right vertex of the target element.

[0149] Before determining the first display range, this embodiment of the disclosure provides an implementation method that determines a first coordinate value based on the screen size of the display. The first coordinate value is the coordinate value of the target point closest to the target edge in the target element in a first direction. For example, the first coordinate value is the x-coordinate of the upper right vertex or the lower right vertex of the target element. Then, a first target value is determined based on the screen size and the golden ratio. The screen size includes: the width value 'a' and the length value 'b' of the display; the golden ratio (GSP) is typically taken as 0.618, and the first target value is 0.618 * 'a'.

[0150] If the first coordinate value is less than or equal to the first target value, it means that there is enough space to display the soft keyboard when the element is the target element closest to the target edge in the input interface. Furthermore, the first display range of the soft keyboard is determined based on the first coordinate value and the screen size.

[0151] When the first coordinate value is greater than the first target value, the element becomes the focus of the input interface. For the specific implementation process, please refer to the implementation process in (2) where the element is the focus of the input interface. It will not be repeated here.

[0152] This disclosure provides an implementation method that determines the first display range of the soft keyboard along the horizontal axis based on the top edge length of the display and the horizontal coordinate value of the top right vertex or the bottom right vertex of the target element. This can be understood as determining the minimum horizontal coordinate of the soft keyboard along the horizontal axis based on the top edge length of the display and the horizontal coordinate value of the top right vertex or the bottom right vertex of the target element. The first display range is the horizontal coordinate range: from the minimum horizontal coordinate to the maximum horizontal coordinate, with the top edge length of the display as the maximum horizontal coordinate.

[0153] For example, such as Figure 7D As shown, Figure 7D This is a second schematic diagram of the first display range provided in this embodiment. The elements included in the input interface 101 shown in the figure are: input box 11, confirmation option 12, cancellation option 13, and topic name 14. The position information of topic name 14 is {x1, y1}, the position information of input box 11 is {x2, y2}, the position information of confirmation option 12 is {x3, y3}, and the position information of cancellation option 13 is {x4, y4}. The target side is the right side of the display. Based on the horizontal coordinates of the elements included in the input interface 101 (x12, x22, x32, x42), the horizontal coordinate closest to the right side of the display is determined to be x42, and the corresponding element is cancellation option 13. Further, based on the top side length a of the display and the horizontal coordinate x42 of cancellation option 13, the first display range is determined to be [x42, a].

[0154] After determining the first display area, a second display area for the soft keyboard in the second direction is determined based on the first display area and the screen size. In this embodiment of the disclosure, the aspect ratio of the display is determined based on the top side length (width value) and the left side length (height value) of the display, and then the second display area for the soft keyboard in the second direction is determined based on the aspect ratio of the display and the first display area.

[0155] The display length n3 of the soft keyboard along the horizontal axis is determined based on the first display range, and is calculated according to formula (2-1):

[0156] n3 = ax a …Formula (3-1)

[0157] Where 'a' is the top side length of the display, which is also the maximum value of the horizontal axis, and 'x' is the maximum value of the horizontal axis. a This is the first coordinate value of the target point of the target element in the horizontal direction.

[0158] Following the previous example, the display length n3 of the soft keyboard along the horizontal axis is calculated using formula (2-1) as a = a - x42. Based on the top and left side lengths of the monitor, the aspect ratio of the monitor is determined to be b:a. The display length m3 of the soft keyboard along the vertical axis is then calculated based on the display length n3 along the vertical axis and the aspect ratio b:a.

[0159]

[0160] The minimum y-coordinate of the second display range of the soft keyboard 3min Calculated according to formula (2-3):

[0161]

[0162] The maximum y-coordinate of the second display range of the soft keyboard 3max Calculated according to formula (2-4)

[0163] y 3max =y 3min +m3…Formula (3-4)

[0164] Determine the second display range of the soft keyboard as [y 3min y 3max ].

[0165] For example, based on the first display range [x42, a] of the soft keyboard and the second display range [y... 3min y 3max [The text appears to be incomplete and contains several grammatical errors. A more accurate translation would require the full context.] like Figure 7E As shown, Figure 7EThis is a schematic diagram of the display area provided in the embodiments of this disclosure. Figure 3 The figure shows the input interface 101 and the display range 103, where the display range 103 is [(x42, y ... 3min ), (a, y 3max )],Right now:

[0166] Further display device controls the display to show the soft keyboard within the display area 103.

[0167] For aesthetic purposes, this disclosure provides another implementation method: determining the display area of ​​the soft keyboard based on the screen size, the position information of the target element, and the display offset value. First, a first display area is determined based on the top edge length of the display, the horizontal coordinate of the target element, and the display offset value, wherein the minimum horizontal coordinate x of the first display area is... 4min Calculated according to formula (4-1):

[0168] x 4min =x a +offset...formula (4-1)

[0169] The first display range of the soft keyboard is [x 4min (a-offset).

[0170] Then, the second display area of ​​the soft keyboard is calculated based on the first display area of ​​the soft keyboard and the left side length of the display.

[0171] The display length n4 of the soft keyboard along the horizontal axis is determined based on the first display range, and is calculated using formula (4-2):

[0172] n4 = a - offset - x 4min …Formula (4-2)

[0173] The minimum y-coordinate of the second display range of the soft keyboard 4min According to formula (15), the result is:

[0174]

[0175] The maximum y-coordinate of the second display range of the soft keyboard 4max According to formula (4-4), the result is:

[0176] y 4max =y 4min +m4…Formula (4-4)

[0177] Where m4 is the display length of the soft keyboard along the vertical axis, as shown in formula (4-5):

[0178]

[0179] Determine the second display range of the soft keyboard as [y 4min y 4max ].

[0180] Furthermore, based on the first display range of the soft keyboard [x] 4min [a-offset], and the second display range [y 4min y 4max The area to be displayed for the soft keyboard is determined as follows:

[0181] For example, such as Figure 7F As shown, Figure 7F This is a schematic diagram of the display area provided in the embodiments of this disclosure. Figure 4 The figure shows the input interface 101 and the display area 103, where the display area is [(x 4min y 4min ), (a-offset, y 4max )],Right now: Further display device controls the display to show the soft keyboard 102 within the display area 103.

[0182] (2) The element is the focus of the input interface.

[0183] In this embodiment of the disclosure, the focus can be the point corresponding to the cursor in the input box, the geometric center point of the area composed of the input box, confirmation option, and cancellation option in the interface to be input, or the lower left vertex of the input box, so as to ensure that the input box is not obscured during input, and the content being entered can be fully displayed, making it convenient for the user to confirm the input content.

[0184] In some embodiments, in response to an input trigger operation, the display device first acquires the screen size of the display and the position information of the element in the interface to be input. If the element is the focus of the interface to be input, a first target value is determined based on the screen size and the golden ratio. The first target value is 0.618*a or 0.618*b.

[0185] The display range of the soft keyboard varies depending on the target edge and its vertical direction (i.e., the first direction). The following will explain the process of determining the display range of the soft keyboard in two different cases: when the first direction is along the horizontal axis and when the first direction is along the vertical axis.

[0186] (a) The first direction is along the horizontal axis.

[0187] In some embodiments, the focus is the point corresponding to the cursor in the input box, and the position information of the point corresponding to the cursor is denoted as (x5, y5). Then, the second coordinate value of the focus in the first direction is x5. Further, the second coordinate value x5 of the focus determines the first display range of the soft keyboard as [x5, a]. Based on the first display range, the second coordinate value x5 = x a Substituting into formulas (3-1), (3-2), (3-3), and (3-4), we obtain the second display range of the soft keyboard as follows:

[0188] The area to be displayed for the soft keyboard is:

[0189] like Figure 8A As shown, Figure 8A This is a schematic diagram of the display area provided in the embodiments of this disclosure. Figure 5 The diagram shows an input interface 101 and a display area 103, where the display area 103 is...

[0190] When the focus is on the point corresponding to the cursor in the input box, the cursor will move as you type. The position information of the focus can be detected in real time to adjust the size of the area to be displayed on the soft keyboard.

[0191] When the focus is the point corresponding to the cursor in the input box, the display offset value can also be used to determine the display range of the soft keyboard. The implementation process is the same as or similar to that in the previous embodiments, and will not be described in detail here. Figure 8B This is a schematic diagram six of the display area provided in this embodiment of the present disclosure. The diagram shows an input interface 101 and a display area 103, wherein the display area 103 is...

[0192] When the focus is the geometric center point of the area consisting of the input box, confirmation option, and cancel option in the input interface, the target edge is the right side of the display, and the first direction is along the horizontal axis, such as... Figure 8C As shown, Figure 8C This is a schematic diagram of the focus provided in this embodiment of the disclosure. The input interface 101 shown in the figure includes an input box 11, a confirmation option 12, and a cancellation option 13. The position information of the topic name 14 is {x1, y1}, the position information of the input box 11 is {x2, y2}, the position information of the confirmation option 12 is {x3, y3}, and the position information of the cancellation option 13 is {x4, y4}. The minimum horizontal coordinate of the area formed by the input box, confirmation option, and cancellation option in the input interface is x21, and the maximum horizontal coordinate is x42. The position information of the focus along the horizontal axis is...

[0193] In some embodiments, to improve the user-friendliness of the soft keyboard display, the position information of the focus along the horizontal axis is determined as follows: Then, the position information (x22, y22) of the point on the right side of the input box can be obtained, and then the x-coordinate of the focus can be compared. And the size of the x-coordinate of the point to the right of the input box (x22). At the focus x-coordinate... When the x-coordinate of the point to the right of the input box is greater than or equal to x22, since the focus is the geometric center of the area consisting of the input box, confirmation option, and cancel option in the input interface, the soft keyboard will not obscure the input content in the input box. Furthermore, the target edge is the bottom edge of the display, based on the second coordinate value of the focus. The first display area of ​​the soft keyboard along the horizontal axis is determined by the top side length 'a' of the monitor.

[0194] For example, based on the second coordinate value The first display area of ​​the soft keyboard is determined by the top side length 'a' of the monitor.

[0195] After determining the first display range of the soft keyboard, the second display range of the soft keyboard in the second direction is determined based on the first display range and the screen size.

[0196] For example, the second coordinate value Substituting into formulas (3-1), (3-2), (3-3), and (3-4), the left side length 'b' of the monitor gives the second display area of ​​the soft keyboard as follows:

[0197] Further, based on the first display range and the second display range, the area to be displayed for the soft keyboard is determined as follows:

[0198] Along the horizontal axis, the x-coordinate of the top right corner vertex of the input box (x22) is less than the x-coordinate of the geometric center point of the area formed by the input box, the confirmation option, and the cancellation option in the input interface. The focus is determined to be the top right corner of the input box, and the second coordinate value of the focus is the x-coordinate of the top right corner of the input box, thus maximizing the display area of ​​the soft keyboard. The first display area of ​​the soft keyboard [x22, a] is determined based on the x-coordinate of the top right corner of the input box and the top side length a of the display. Then, the second display area of ​​the soft keyboard in the second direction is determined as follows:

[0199] Get the display area of ​​the soft keyboard:

[0200] Optionally, the display range of the soft keyboard can be obtained based on formulas (4-1), (4-2), (4-3), (4-4), and (4-5):

[0201] like Figure 8D As shown, Figure 8D This is a schematic diagram (7) illustrating the display area provided in this embodiment of the present disclosure. The diagram shows an input interface 101 and a display area 103, wherein the display area 103 is... Further, the display device controls the display to show the soft keyboard within the display area 103. Also, for the sake of interface aesthetics, this embodiment extracts one approach: a second target value is determined based on the screen size and the golden ratio. When the second coordinate value is greater than or equal to the second target value, it indicates that the input interface has occupied most of the current interface area. Therefore, it is necessary to determine the first display area of ​​the soft keyboard based on the second coordinate value and the length of the target side, so that the input interface is not obstructed along the first direction, and the soft keyboard is fully displayed.

[0202] The second target value can be set to 0.5*0.618*a or 0.5*0.618*b. The second target value can be set according to actual needs, and this disclosure does not limit it.

[0203] For example, the second coordinate value Substituting into formula (4-1), we obtain the first display range of the soft keyboard in the first direction (horizontal axis). Based on the first display range and the left side length b of the monitor, substituting into formulas (4-2), (4-3), (4-4), and (4-5), the second display range of the soft keyboard in the second direction (vertical axis direction) is obtained as follows: Further, based on the first display range and the second display range, the area to be displayed for the soft keyboard is determined as follows:

[0204] The position information of the focus along the horizontal axis is determined as follows: And compare the x-coordinates of the focal points. The x-coordinate of the focus point is determined by the x-coordinate of the point to the right of the input box. When the x-coordinate of the point to the right of the input box is less than x22, in order not to obscure the content being entered in the input box, this embodiment of the disclosure provides an implementation method: First, obtain the position information (x5, ...) of the point corresponding to the cursor in the input box. y 5) Then compare the coordinates x5 of the point corresponding to the cursor along the horizontal axis with the position information of the focus along the horizontal axis. The size is the size of the x-coordinate of the point corresponding to the cursor and the x-coordinate of the focus.

[0205] If the x-coordinate x5 of the point corresponding to the cursor is less than the x-coordinate of the focus... If the area to be displayed by the soft keyboard has not yet obscured the input content in the input box, then the x-coordinate of the focus point can be used as a reference. The display area of ​​the soft keyboard is determined by the top side length 'a' of the monitor. refer to Figure 8D The area to be displayed is shown as 103. Alternatively, a more aesthetically pleasing area to be displayed can be determined based on the display offset value:

[0206] If the x-coordinate x5 of the point corresponding to the cursor is greater than or equal to the x-coordinate of the focus... Determining the display area of ​​the soft keyboard based on the x-coordinate of the focus point would obscure the input content. To avoid this, the x-coordinate of the focus point is used as the maximum value of the first display area of ​​the soft keyboard. This can be understood as displaying the soft keyboard in the area to the left of the focus point, thus determining the first display area of ​​the soft keyboard as... The second display area of ​​the soft keyboard is: The area to be displayed for the soft keyboard is:

[0207] For example, such as Figure 8E As shown, Figure 8E This is a schematic diagram (eight) illustrating the display area 103 provided in this embodiment. The diagram shows the display area 103 and the input interface 101, which includes an input box 11, a confirmation option 12, and a cancellation option 13. The input box 11 includes a cursor 111. The position information of the input box 11 includes the position information of the left point (x21, y21) and the position information of the right point (x22, y22); the cursor 111 corresponds to the position information (x5, y5), and the display area 103 is...

[0208] Additionally, based on the display offset value, the area to be displayed with higher aesthetic appeal is determined as follows: like Figure 8F As shown, Figure 8F This is a schematic diagram nine of the display area provided in this embodiment of the present disclosure. The diagram includes an input interface 101 and a display area 103, wherein the display area 103 is:

[0209] In the above embodiments, when the first direction is along the horizontal axis, different display areas are determined based on the focus point. When the focus point is the geometric center of the area comprising the input box, confirmation option, and cancel option in the input interface, to avoid the display area obscuring the input content in the input box, the display area is accurately obtained by comparing the horizontal coordinate of the focus point and the horizontal coordinate of the cursor in the input box. Furthermore, the horizontal coordinate of the focus point is compared with the horizontal coordinate of the upper right corner of the input box, and the smaller of the two horizontal coordinates is used to determine the display area of ​​the soft keyboard. This allows for a larger display area to be determined without obscuring the content currently displayed in the input box, thus improving the user experience.

[0210] (b) The first direction is along the longitudinal axis.

[0211] With the first direction being along the vertical axis, the target side is the right side of the display. Based on the input box, confirmation option, and cancellation option in the interface to be input, the second coordinate value of the focus of the interface to be input along the vertical axis is determined.

[0212] When the focus is the point corresponding to the cursor, the method for determining the display range is similar to the method of "the first direction is along the horizontal axis". Substituting the second coordinate value of the focus, y5 = yb, into formulas (1-1), (1-2), (1-3), and (1-4), the display range of the soft keyboard is obtained as follows:

[0213] Alternatively, substituting formulas (2-1), (2-2), (2-3), (2-4), (2-5), and (2-6) yields a more aesthetically pleasing display area for the soft keyboard:

[0214] The focus can be the geometric center point of the area composed of the input box, confirmation option, and cancellation option in the input interface. First, determine the ordinate of the lower left vertex in the position information of each element along the vertical axis, and then determine the second coordinate value of the focus based on the ordinate of these lower left vertices.

[0215] like Figure 8G As shown, Figure 8G This is a second schematic diagram of the focus provided in this embodiment of the present disclosure. The input interface 101 shown in the figure includes an input box 11, a confirmation option 12, and a cancellation option 13. The lower left corner vertex (x24, ...) of the input box 11 is... y 24) Confirm the bottom left corner vertex (x34, y34) of option 12, deselect the bottom left corner vertex (x44, y44) of option 13, determine the ordinate y24 of the bottom left corner vertex of input box 11 in the input interface, then determine the ordinate y44 of the vertex closest to the bottom edge of the display, and determine the position information of the focus along the vertical axis.

[0216] When the target edge is the edge opposite to the top edge (second edge) of the display (i.e., the bottom edge of the display) or the target edge is the edge opposite to the left edge (first edge) of the display (i.e., the right edge of the display), the first display range of the soft keyboard along the vertical axis is determined based on the second coordinate value of the focus and the length of the left side of the display.

[0217] For example, the focus is the geometric center point of the area consisting of the input box, the confirmation option, and the cancellation option in the input interface, and the second coordinate value used to determine the focus is... Then, based on the second coordinate value Based on the left side length 'b' of the monitor, determine the first display area of ​​the soft keyboard as follows:

[0218] After determining the first display range of the soft keyboard, the second display range of the soft keyboard in the second direction is determined based on the first display range and the screen size.

[0219] For example, the second coordinate value Substituting into formulas (1-1), (1-2), and (1-4), the top side length 'a' of the monitor gives the second display area of ​​the soft keyboard as: Further, based on the first display range and the second display range, the area to be displayed for the soft keyboard is determined as follows:

[0220] Along the vertical axis, the focus can also be the lower left corner of input box 11. The display area for the soft keyboard is determined by the vertical coordinate of the lower left corner of input box 11, without obscuring the input content within input box 11. Therefore, based on the second coordinate value of the lower left corner of input box 11 as the focus, the display area for the soft keyboard is determined as follows:

[0221] In some embodiments, when the focus is the geometric center point of the area consisting of the input box, confirmation option, and cancel option in the input interface, the second coordinate value is used. Screen size and display offset value determine the display area of ​​the soft keyboard, improving the aesthetics of the interface.

[0222] For example, based on the second coordinate value Substituting the top side length 'a', the left side length 'b', and the display offset value 'offset' into formulas (2-1), (2-2), and (2-3), we obtain the first display area of ​​the soft keyboard: Based on the first display range of the soft keyboard, and combining formulas (2-3), (2-4), (2-5), and (2-6), the second display range of the soft keyboard can be obtained:

[0223] Furthermore, based on the first display range and the second display range, the area to be displayed for the soft keyboard is determined as follows:

[0224] In some embodiments, to better display the soft keyboard without obscuring any element in the input interface, this disclosure provides an implementation method that determines a blank area based on the position information of each element in the input interface. This blank area does not contain any elements. The display range of the soft keyboard is determined based on this blank area. This method fully displays both the input interface and the soft keyboard without obscuring any elements in the input interface, thus improving user-friendliness.

[0225] For example, based on the position information of input box 11 in the input interface 101 as {x2, y2}, the position information of confirmation option 12 as {x3, y3}, and the position information of cancel option 13 as {x4, y4}, the range of the blank area along the horizontal axis is determined to be [x24, x42], and the range of the blank area along the vertical axis is determined to be [y24, y42]. Therefore, the display range of the soft keyboard can be determined to be [(x24, y24), (x42, y42)]. Furthermore, by combining the display offset value, the display range of the soft keyboard can be determined to be [(x24-offset, y24+offset), (x42+offset, y42-offset)].

[0226] It should be noted that in landscape mode, the first step is to determine the range of the blank area along the horizontal axis and the range along the vertical axis. Then, based on the range of the blank area along the vertical axis and the aspect ratio of the display device, the first display range of the soft keyboard along the horizontal axis is determined. This allows for the determination of the soft keyboard's intended display area, making greater use of the space along the vertical axis and improving the aesthetics of the display. Determining the intended display area of ​​the soft keyboard in portrait mode is similar to the above process and will not be elaborated upon here.

[0227] like Figure 8H As shown, Figure 8H This is a schematic diagram (eight) illustrating the display area provided in this embodiment of the present disclosure. The diagram shows an input interface 101 and a display area 103, wherein the display area is... Further display device controls the display to show the soft keyboard within the display area 103.

[0228] Following the previous example, we take the bottom left corner of input box 11 as the focus, and then use the second coordinate value of the focus... y 24. Based on the screen size and display offset value, the display area of ​​the soft keyboard is determined as follows:

[0229] In the above embodiments, the element is the focus of the input interface. Determining the display range of the soft keyboard according to the focus can avoid obscuring important information of the input interface, such as the input box, so that the input content can be fully displayed when inputting through the soft keyboard.

[0230] When the aforementioned first coordinate value is greater than the first target value, it indicates that the input interface has occupied most of the current page area, and the display cannot simultaneously display the input interface and the soft keyboard completely. Therefore, in order to display the soft keyboard completely without obscuring important information, the element changes from the target element to the focus. Furthermore, the display range of the soft keyboard is determined according to the second position coordinates of the focus and the screen size. The process is the same as or similar to the process in the above embodiment, and will not be described in detail here.

[0231] S604: Receive user input control operations for the soft keyboard.

[0232] S605. Obtain the input content corresponding to the input control operation, and control the display to show the input content on the input interface.

[0233] refer to Figure 2C As shown, the input content "HisenseVIDDATV" corresponding to the input control operation is obtained, and the input content is displayed in the input box 11 in the input interface 101.

[0234] In summary, the soft keyboard display and input method provided in this disclosure first controls the display to show the input interface via a controller. Then, it receives user input trigger operations on the input interface via a user input interface. Next, the controller responds to the input trigger operations by acquiring the screen size of the display and the position information of elements in the input interface. Based on the screen size and element position information, it determines the display range of the soft keyboard and controls the display to show the soft keyboard within this range. Furthermore, it receives user input control operations on the soft keyboard via the user input interface, acquires the corresponding input content via the controller, and controls the display to show the input content on the input interface. This achieves adaptive adjustment of the soft keyboard's display position based on the screen size and element position information of the input interface, thus fully displaying the input interface. This facilitates accurate input by the user from the fully displayed input interface, improving the user experience.

[0235] In addition, if it is determined that most of the current interface area has been used to display the input interface based on the first coordinate value of the element in the first direction, the area to be displayed for the soft keyboard is determined based on the intersection of the input interface, so as to fully display the soft keyboard without obscuring important information in the input interface.

[0236] This disclosure provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the above-described soft keyboard display and input method, and achieves the same technical effect. To avoid repetition, further details are omitted here.

[0237] The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0238] This disclosure provides a computer program product, which includes a computer program that, when run on a computer, enables the computer to implement the above-described soft keyboard display and input method.

[0239] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.

Claims

1. A display device, characterized by comprising: include: The controller is configured to control the display to show the input interface; The user input interface is configured to receive user input trigger operations for the input interface to be input. The controller is also configured to: in response to the input triggering operation, acquire the screen size of the display and the position information of the elements in the interface to be input; determine the display range of the soft keyboard based on the screen size and the position information of the elements; and control the display to display the soft keyboard within the display range. Wherein, the element is the target element in the interface to be input that is closest to the target edge, the target edge is an edge in the screen of the display that is opposite to the first edge or the second edge, and the first edge and the second edge are two mutually perpendicular edges in the screen of the display. Alternatively, the element is the focus of the interface to be input, and the target edge is any edge of the screen of the display. The screen dimensions include the side length of the first side and the side length of the second side, as well as the aspect ratio of the display. The controller, based on the screen size and the position information of the element, determines the display range of the soft keyboard in the following manner: Based on the screen size and the position information of the target element, it determines a first display range of the soft keyboard in a first direction, where the first direction is perpendicular to the target edge; based on the first display range and the screen size, it determines a second display range of the soft keyboard in a second direction, where the second direction is parallel to the target edge; based on the first display range and the second display range, it determines the final display range of the soft keyboard. The user input interface is also configured to receive user input control operations for the soft keyboard; The controller is further configured to: acquire the input content corresponding to the input control operation, and control the display to display the input content on the input interface.

2. The display device of claim 1, wherein, A coordinate system is established with the intersection of the first side and the second side as the origin; the position information of the target element is the first coordinate value of the target point in the target element in the first direction, and the target point is the point in the target element that is closest to the target side; Before determining the display range of the soft keyboard based on the screen size and the position information of the target element, the controller is further configured to: The first coordinate value is determined based on the screen size; The controller determines the first display range of the soft keyboard in the first direction based on the screen size and the position information of the target element, specifically configured as follows: The first target value is determined based on the screen size and the golden ratio; If the first coordinate value is less than or equal to the first target value, the first display range of the soft keyboard is determined based on the first coordinate value and the screen size.

3. The display device of claim 2, wherein, The controller, based on the screen size and the position information of the target element, determines the first display range of the soft keyboard in the first direction in the following manner: The first target value is determined based on the screen size and the golden ratio; If the first coordinate value is greater than the first target value, determine the second coordinate value of the focus of the interface to be input in the first direction; Based on the screen size and the second coordinate value, the first display range of the soft keyboard in the first direction is determined.

4. The display device of claim 3, wherein, After determining the second coordinate value of the focus of the input interface in the first direction, the controller is further configured to: The second target value is determined based on the screen size and the golden ratio; If the second coordinate value is greater than or equal to the second target value, the first display range of the soft keyboard is determined based on the second coordinate value and the side length of the target side. If the second coordinate value is less than the second target value, the first display range of the soft keyboard is determined based on the second coordinate value, the length of the first side, and the length of the second side.

5. The display device of claim 1, wherein, A coordinate system is established with the intersection of the first side and the second side as the origin, and the element is the focus of the interface to be input; The controller is specifically configured to determine the display area of ​​the soft keyboard based on the screen size and the position information of the elements as follows: The second target value is determined based on the screen size and the golden ratio; If the second coordinate value of the focus in the first direction is greater than or equal to the second target value, the first display range of the soft keyboard is determined based on the second coordinate value, the side length of the first side, and the side length of the second side. Based on the first display range and the screen size, a second display range of the soft keyboard is determined in a second direction, wherein the second direction is the direction parallel to the target edge; The display range of the soft keyboard is determined based on the first display range and the second display range.

6. The display device according to any one of claims 1 to 5, characterized in that, The controller is specifically configured to determine the display area of ​​the soft keyboard based on the screen size and the position information of the elements as follows: The display range of the soft keyboard is determined based on the screen size, the position information of the element, and the display offset value. The display offset value is determined based on the screen size and the golden ratio.

7. A display and input method of a soft keyboard, characterized by, include: Control the display to show the input interface; Receive user input trigger operation for the input interface; In response to the input triggering operation, the screen size of the display and the position information of the elements in the interface to be input are obtained; Based on the screen size and the position information of the elements, determine the display area of ​​the soft keyboard; control the display to show the soft keyboard within the display area; Receive user input control operations for the soft keyboard; Obtain the input content corresponding to the input control operation, and control the display to show the input content on the input interface; Wherein, the element is the target element in the interface to be input that is closest to the target edge, the target edge is an edge in the screen of the display that is opposite to the first edge or the second edge, and the first edge and the second edge are two mutually perpendicular edges in the screen of the display. Alternatively, the element is the focus of the interface to be input, and the target edge is any edge of the screen of the display. The screen dimensions include the side length of the first side and the side length of the second side, as well as the aspect ratio of the display. The method of determining the display range of the soft keyboard based on the screen size and the position information of the element includes: determining a first display range of the soft keyboard in a first direction based on the screen size and the position information of the target element; the first direction being the direction perpendicular to the target edge; determining a second display range of the soft keyboard in a second direction based on the first display range and the screen size; the second direction being the direction parallel to the target edge; and determining the display range of the soft keyboard based on the first display range and the second display range.

Images