Information processing method, device and electronic equipment

By integrating interface control of display screen and touch screen in electronic devices, receiving and converting input operation information, the problem of multiple input devices is solved, and the integration of multiple input functions is realized, which simplifies the device structure and reduces costs.

CN113760143BActive Publication Date: 2025-08-19LENOVO (BEIJING) LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111055752.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-09
Publication Date
2025-08-19
Estimated Expiration
2041-09-09

AI Technical Summary

Technical Problem

In the prior art, display screens need to be equipped with multiple input devices to achieve different functions, resulting in increased equipment complexity and cost.

Method used

By controlling the interface between the display screen and the touch screen of the display device connected to the electronic device, the input operation information of the operation body is received and converted into target information to control the response of the display device, thereby realizing the integration of multiple input functions.

Benefits of technology

The functions of multiple input devices are implemented with only one electronic device, simplifying the device structure and reducing complexity and cost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113760143B_ABST
    Figure CN113760143B_ABST
Patent Text Reader

Abstract

The present application provides an information processing method, device and electronic device, including: controlling the display screen of a display device connected to the electronic device to display the interface of an operation application, and controlling the touch screen of the electronic device to display the interface of an input application; receiving input operation information performed by an operating body on the touch screen; converting the input operation information into target information; sending the target information to the display device, so that the display device responds to the target information based on the operation application. In this solution, the electronic device can set corresponding applications for different functions to achieve adaptation with the display content of the display device, the display screen of the display device is used to display the interface of the operation application, and the touch screen of the electronic device displays the interface of the input application, and the electronic device is used as an input device to input information and control the display device. Since various applications can be set for different functions in the electronic device, only one electronic device is needed to equip the display screen with multiple input devices.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of information technology, and more specifically, to an information processing method, device, and electronic device. Background Art

[0002] Display screens are commonly used to display content, and are typically equipped with input devices with corresponding functions. For example, when the display screen is used as a game display, an external game controller can be connected to control the game character by operating its buttons. Another example is when the display screen is used as a display screen for other applications and content input is required, an external physical keyboard can be connected to enable input through the operation of the physical keyboard keys.

[0003] Therefore, in order to control the display screen, it is necessary to equip the display screen with multiple input devices. Summary of the Invention

[0004] In view of this, the present application provides an information processing method as follows:

[0005] An information processing method, comprising:

[0006] Controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application;

[0007] receiving input operation information generated by an operator performing an input operation on the touch screen;

[0008] Converting the input operation information into target information;

[0009] The display device is controlled to respond based on the target information.

[0010] Optionally, in the above method, controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application, includes:

[0011] Establishing a correspondence between the touch screen and the display screen;

[0012] Based on the received first operation and the corresponding relationship, controlling the display screen to display an interface of a target operation application, wherein the first operation is an input operation performed by an operating body on the touch screen;

[0013] An input application is started, and an interface of the input application is displayed on the touch screen.

[0014] Optionally, the above method of starting the input application includes:

[0015] Acquire the operation gestures of the operator within a preset distance of the touch screen;

[0016] Based on the operation gesture satisfying a preset startup condition, control is performed to start an input application.

[0017] Optionally, in the above method, converting the input operation information into target information includes:

[0018] selecting a target position on the touch screen corresponding to the operating body based on detecting that the distance between the operating body and the touch screen meets a preset close distance condition;

[0019] determining a target object corresponding to the target position based on the input application interface;

[0020] Based on detecting that the operating body is in contact with the target position on the touch screen, information corresponding to the target object is used as target information.

[0021] Optionally, the above method, after determining the target object corresponding to the target position based on the input application interface, further includes:

[0022] Prompt information is generated based on the target object to prompt the user that the position of the operating body corresponds to the target object.

[0023] Optionally, the above method, after determining the target object corresponding to the target position based on the input application interface and before the operating body contacts the target position on the touch screen, further includes:

[0024] Get historical operation information;

[0025] Analyzing the historical operation information to obtain the operation parameters when the operator clicks the target object;

[0026] At least the display area of the target object is adjusted based on the operation parameter, and the display area of the target object after the adjustment is larger than the display area of the target object before the adjustment.

[0027] Optionally, the method according to any one of the above items, after sending the target information to the display device, further includes:

[0028] The timing starts from the time of responding based on the target information, and if no input operation is received within a preset time period, the input application is controlled to end.

[0029] An information processing device, comprising:

[0030] A first control module, configured to control a display screen of a display device connected to the electronic device to display an interface of an operation application, and to control a touch screen of the electronic device to display an interface of an input application;

[0031] A receiving module, configured to receive input operation information generated by an operator performing an input operation on the touch screen;

[0032] A conversion module, configured to convert the input operation information into target information;

[0033] The second control module is configured to control the display device to respond based on the target information.

[0034] An electronic device, comprising:

[0035] A touch screen, used to display content to be displayed and receive input operations;

[0036] A processor is used to control the display screen of a display device connected to the electronic device to display an interface of an operation application, and to control the touch screen of the electronic device to display an interface of an input application; receive input operation information generated by an operator performing an input operation on the touch screen; convert the input operation information into target information; and control the display device to respond based on the target information.

[0037] A readable storage medium stores a computer program thereon, wherein the computer program is called and executed by a processor to implement the steps of the information processing method according to any one of the above claims.

[0038] It can be seen from the above technical solution that compared with the prior art, the present application provides an information processing method, including: controlling the display screen of a display device connected to an electronic device to display the interface of an operation application, and controlling the touch screen of the electronic device to display the interface of an input application; receiving input operation information performed by an operating body on the touch screen; converting the input operation information into target information; sending the target information to the display device, so that the display device responds to the target information based on the operation application. In this solution, the electronic device can set corresponding applications for different functions to achieve adaptation to the display content of the display device, the display screen of the display device is used to display the interface of the operation application, and the touch screen of the electronic device displays the interface of the input application, based on the electronic device as an input device to input information and control the display device. Since various applications can be set for different functions in the electronic device, only one electronic device is needed to equip the display screen with multiple input devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without any creative work.

[0040] Figure 1 This is a flowchart of Example 1 of an information processing method provided by this application;

[0041] Figure 2 This is a flowchart of Example 2 of an information processing method provided by this application;

[0042] Figure 3 This is a schematic diagram of an electronic device and a display device in Example 2 of an information processing method provided by this application;

[0043] Figure 4 This is a flowchart of Example 3 of an information processing method provided by this application;

[0044] Figure 5 This is a flowchart of Example 4 of an information processing method provided by this application;

[0045] Figure 6 This is a schematic diagram of a touch screen of an electronic device in Example 4 of an information processing method provided by this application;

[0046] Figure 7 This is a flowchart of Example 5 of an information processing method provided by this application;

[0047] Figure 8 This is a schematic diagram of a touch screen of an electronic device in Example 5 of an information processing method provided by this application;

[0048] Figure 9 This is a flowchart of Example 6 of an information processing method provided by this application;

[0049] Figure 10 This is a schematic structural diagram of an information processing device embodiment provided by the present application;

[0050] Figure 11 This is a schematic structural diagram of an electronic device embodiment provided by the present application;

[0051] Figure 12 This is a schematic diagram of an application scenario of an information processing method provided by this application. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0053] like Figure 1The figure is a flowchart of Example 1 of an information processing method provided by the present application. The method is applied to an electronic device and includes the following steps:

[0054] Step S101: controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application;

[0055] The electronic device may be a mobile device, such as a mobile phone, a pad, etc., and the mobile device has a touch screen.

[0056] The electronic device is connected to a display device, and the display device can receive display content output by the electronic device.

[0057] The display screen of the display device connected to the electronic device displays the interface of the operating application, while the touch screen of the electronic device displays the interface of the input application.

[0058] As an example, the display screen displays a game interface, and the touch screen of the electronic device displays an interface for inputting a game controller application.

[0059] As an example, the display screen displays an application interface for inputting content, such as WeChat, text messages, browsers, etc., and the touch screen of the electronic device displays an interface of a virtual keyboard.

[0060] Specifically, an extension mode is provided in the electronic device. When the electronic device is connected to an external display device, the display device is used as an extended screen for display. The display device and the display screen of the electronic device display different content.

[0061] Specifically, after the electronic device is connected to the display device, the electronic device switches to the extended mode so that the display device serves as an extended screen; after the electronic device is disconnected from the display device, the electronic device switches to the non-extended mode.

[0062] Step S102: receiving input operation information generated by an operator performing an input operation on the touch screen;

[0063] The operating body may be an object such as a user's finger, a stylus pen, etc. that can perform touch operations on the touch screen.

[0064] The operating body performs an input operation on the touch screen and receives input operation information generated by the input operation.

[0065] It should be noted that in this application, the display screen of the display device serves as the interface for displaying operation applications, the touch screen of the electronic device serves as the interface for displaying input applications, and the operating body can perform input operations through the touch screen, using the electronic device as an input device.

[0066] Step S103: converting the input operation information into target information;

[0067] The electronic device displays an interface of an input application, and based on the interface of the input application, the input operation information is converted into target information.

[0068] The target information is information corresponding to the input application.

[0069] As an example, the touch screen of the electronic device displays an interface for inputting a game controller application, and converts input operation information into game operation instructions.

[0070] As an example, the touch screen of the electronic device displays the interface of a virtual keyboard and converts the input operation information into key values of the virtual keyboard.

[0071] Step S104: controlling the display device to respond based on the target information.

[0072] The display device responding based on the target information includes: the electronic device responding to the target information and sending the response content to the display device, or the display device responding to the target information.

[0073] Specifically, the target information is sent to the display device, so that the display device responds to the target information, and the display device controls the switching of display content;

[0074] Specifically, the electronic device responds to the target information, controls the switching of display content, and sends the switched display content to the display device, so that the display content in the display device changes accordingly.

[0075] In summary, the present embodiment provides an information processing method, comprising: controlling the display screen of a display device connected to the electronic device to display the interface of an operation application, and controlling the touch screen of the electronic device to display the interface of an input application; receiving input operation information performed by an operating body on the touch screen; converting the input operation information into target information; and sending the target information to the display device, so that the display device responds to the target information based on the operation application. In this solution, corresponding applications can be set in the electronic device for different functions to achieve adaptation to the content displayed by the display device. The display screen of the display device is used to display the interface of the operation application, and the touch screen of the electronic device displays the interface of the input application. Information is input based on the electronic device as an input device to control the display device. Since various applications can be set for different functions in the electronic device, only one electronic device is needed to equip the display screen with multiple input devices.

[0076] like Figure 2The figure is a flowchart of Example 2 of an information processing method provided by the present application, and the method includes the following steps:

[0077] Step S201: establishing a correspondence between the touch screen and the display screen;

[0078] Among them, the electronic device is connected to the display device, and the two can be connected through a cable or wirelessly. This application does not limit the connection form between the two.

[0079] Among them, after the electronic device is connected to the display device, the electronic device switches to the extension mode, supports the display screen of the display device as an extended screen, and establishes a corresponding relationship between the touch screen of the electronic device and the display screen of the display device.

[0080] Specifically, the plane coordinates of the touch screen and the display screen are continuous, or the plane coordinates of the touch screen and the display screen are proportionally corresponding, and the proportions correspond to the length ratio and width ratio of the touch screen and the display screen respectively.

[0081] Specifically, in this embodiment, the extended screen is used to display target display content based on the electronic device. The target display content is the content displayed on the touch screen in non-extended mode, and when the electronic device is in extended mode, its touch screen can display content other than the target display content.

[0082] Step S202: Based on the received first operation and the corresponding relationship, controlling the display screen to display an interface of the target operation application;

[0083] The first operation is an input operation performed by an operating body on the touch screen.

[0084] The first operation may be a click-to-open operation on a target operation application icon on the touch screen.

[0085] After receiving the first operation, the electronic device controls the launch of the target application and calls the interface of the target application. Based on the correspondence between the touch screen and the display screen, the electronic device controls the interface of the target application to be output as display content to the display device, so that the display screen of the display device displays the interface of the target application. At this time, the touch screen of the electronic device still displays the desktop, which is different from the content displayed on the display screen.

[0086] Step S203: starting an input application and displaying an interface of the input application on the touch screen;

[0087] The input application may be started automatically or manually.

[0088] Specifically, there may be an association relationship between the input application and the target operation application. After the target operation application is started, the input application may be automatically started based on the association relationship.

[0089] For example, when the target operation application is a game, and the input application associated with the game is a game controller application, the game controller application is automatically started after the game is started.

[0090] When the input application is manually started, the input application can be started based on the received second operation control, and the interface of the input application is displayed on the touch screen. The second operation is an input operation performed by the operating body on the touch screen.

[0091] Specifically, you can select and open it from the application list or from the notification bar.

[0092] The information interaction between the display screen and the electronic device is performed from the system layer of the electronic device (such as the Android system).

[0093] Specifically, after the input application is started, an input node is created in the system layer of the electronic device, so that information input by the electronic device can be transmitted to the target operation application node through the input node.

[0094] For example, if the input application is a game controller application, the input node may be a game controller application node; if the input application is a virtual keyboard, the input node may be a keyboard node.

[0095] like Figure 3 What is shown is a schematic diagram of an electronic device and a display device, including an electronic device (using the Android system) 301 and a display device 302, wherein the game controller interface is displayed on the touch screen of the electronic device, the display device serves as an extended screen, the content of the electronic device is projected onto the extended screen, and the game output interface is displayed on its display screen.

[0096] Among them, starting the input application includes:

[0097] Acquire the operation gestures of the operator within a preset distance of the touch screen;

[0098] Based on the operation gesture satisfying a preset startup condition, control is performed to start an input application.

[0099] Among them, the touch screen turns on the hover function to sense the floating operation within the preset distance.

[0100] Among them, the electronic device has a preset operation gesture for starting the input application. The electronic device senses the operation gesture within a preset distance of its touch screen to determine whether it matches the preset operation gesture. If it matches, the input application is started.

[0101] The preset distance may be a distance relatively close to the touch screen, such as within 5 centimeters, and this application does not limit its value.

[0102] Among them, the preset operation gesture for starting the input application can be set by the user of the electronic device, and is not limited in this application.

[0103] Step S204: receiving input operation information generated by the operator performing an input operation on the touch screen;

[0104] Step S205: converting the input operation information into target information;

[0105] Step S206: controlling the display device to respond based on the target information.

[0106] Among them, steps S204-206 are consistent with steps S102-104 in Example 1 and are not described in detail in this embodiment.

[0107] In summary, in an information processing method provided by this embodiment, the control of the display screen of the display device connected to the electronic device to display the interface of the operation application, and the control of the touch screen of the electronic device to display the interface of the input application, include: establishing a correspondence between the touch screen and the display screen; based on the received first operation and the correspondence, controlling the display screen to display the interface of the target operation application, wherein the first operation is an input operation performed by the operating body on the touch screen; starting the input application, and displaying the interface of the input application on the touch screen. In this solution, after the electronic device is connected to the display device, a correspondence is established between the touch screen of the electronic device and the display screen of the display device; based on the correspondence and the input operation of the operating body on the touch screen, the display screen is controlled to display the interface of the target application, and subsequently the input application is started, and the interface of the input application is displayed on the touch screen of the electronic device, thereby realizing the touch screen of the electronic device as an external input device for the display screen.

[0108] like Figure 4 The flowchart shown is a third embodiment of an information processing method provided by the present application, which includes the following steps:

[0109] Step S401: controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application;

[0110] Step S402: receiving input operation information generated by an operator performing an input operation on the touch screen;

[0111] Among them, steps S401-402 are consistent with steps S101-102 in Example 1 and are not described in detail in this embodiment.

[0112] Step S403: selecting a target position on the touch screen corresponding to the operating body based on the detection that the distance between the operating body and the touch screen meets a preset close distance condition;

[0113] Among them, the preset close distance condition is that the distance between the operating body and the touch screen is less than a preset threshold, such as 5 cm, 3 cm, etc. The preset threshold range is the sensing range of the touch screen. This application does not limit the value of the threshold, and the threshold can be set according to the situation in specific implementation.

[0114] The electronic device detects whether an operating body appears within a preset distance of the touch screen.

[0115] Specifically, it is possible to determine whether an object within a preset distance from the touch screen is an operating body based on parameters such as temperature and static electricity.

[0116] When it is detected that an operating body is close to the touch screen and the distance between the two is less than a preset threshold, a target position corresponding to the operating body is determined on the touch screen.

[0117] The target position is a regional position, and the target position region may be composed of multiple pixels.

[0118] Specifically, the portion of the operating body that is closest to the touch screen in vertical distance and the position of the touch screen that is closest to the portion in vertical distance are used as the target position.

[0119] Step S404: determining a target object corresponding to the target position based on the input application interface;

[0120] The touch screen displays an input application interface, which may include objects involved in various input applications, such as virtual keyboard buttons, icons, and handle buttons.

[0121] Specifically, a target object in the input application interface is determined at a target position on the touch screen.

[0122] When the operating body enters the sensing range of the touch screen, the target position that the operating body wants to touch and the corresponding target object are predetermined.

[0123] Step S405: Based on the detection of the contact between the operating body and the target position on the touch screen, information corresponding to the target object is used as target information;

[0124] When it is detected that the operating body is in contact with the touch screen and is in contact with the target position, information of the target object corresponding to the determined target position is used as target information.

[0125] The target information is information representing the target object, such as key values of a virtual keyboard, virtual handle events, etc.

[0126] As an example, the target object is a virtual keyboard key, such as the letter a, and the key value of the letter a is used as the target information.

[0127] As an example, if the target object is the left direction of the virtual handle, the virtual handle event "left" is used as the target information.

[0128] It should be noted that, during the execution of steps S403-404, the operating body is only close to the touch screen but has not yet touched it. Before step S405, the operating body touches the touch screen, triggering step S405.

[0129] Step S406: controlling the display device to respond based on the target information.

[0130] Among them, step S406 is consistent with step S104 in embodiment 1 and is not described in detail in this embodiment.

[0131] In summary, the information processing method provided in this embodiment converts the input operation information into target information, including: selecting a target position on the touch screen corresponding to the operating body based on detecting that the distance between the operating body and the touch screen meets a preset close distance condition; determining a target object corresponding to the target position based on the input application interface; and using information corresponding to the target object as target information based on detecting contact between the operating body and the target position on the touch screen. In this solution, when the operating body enters the sensing range of the touch screen, the target position and corresponding target object that the operating body intends to contact are pre-determined, and after the operating body contacts the touch screen, the target object information is used as target information, enabling a rapid response to the operating body's touch operation.

[0132] like Figure 5 The flowchart shown is a fourth embodiment of an information processing method provided by the present application, which includes the following steps:

[0133] Step S501: controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application;

[0134] Step S502: receiving input operation information generated by an operator performing an input operation on the touch screen;

[0135] Step S503: selecting a target position on the touch screen corresponding to the operating body based on detecting that the distance between the operating body and the touch screen meets a preset close distance condition;

[0136] Step S504: determining a target object corresponding to the target position based on the input application interface;

[0137] Among them, steps S501-504 are consistent with steps S401-404 in Example 3 and are not described in detail in this embodiment.

[0138] Step S505: generating prompt information based on the target object to prompt the user that the position of the operating body corresponds to the target object;

[0139] After the target object corresponding to the operating body is determined, prompt information is generated, and the prompt information includes a display prompt and / or a voice prompt and / or a vibration prompt, etc.

[0140] Among them, the display prompt includes: changing the brightness or color of the target object or the size of the display area, etc., and the voice prompt includes generating audio information of the target object and outputting the audio through the audio output module of the electronic device.

[0141] In a specific implementation, the audio of each virtual key is preset in the electronic device. After determining that one of the virtual keys is the target object, the audio of the virtual key is obtained and played.

[0142] When the target position does not correspond to a virtual key but is an intermediate area between two virtual keys, the intermediate area may be used as a target object and prompt information may be generated to prompt the intermediate area.

[0143] like Figure 6 What is shown is a schematic diagram of the touch screen of an electronic device, in which a QWERT keyboard is shown. The target object corresponding to the operating body is determined to be the virtual key "f". The brightness of the virtual key "f" is greater than that of other virtual keys, and the electronic device outputs the audio of "f" so that the user can know the click position and key in advance, which is convenient for the user to type blindly.

[0144] Of course, in specific implementation, the prompting method can be set according to actual conditions and is not limited to the display prompting method and voice prompting method listed in this embodiment.

[0145] Step S506: Based on the detection of the contact between the operating body and the target position on the touch screen, information corresponding to the target object is used as target information;

[0146] Step S507: controlling the display device to respond based on the target information.

[0147] Among them, steps S506-507 are consistent with steps S405-406 in Example 3 and are not described in detail in this embodiment.

[0148] In summary, the information processing method provided in this embodiment further includes: generating prompt information based on the target object to notify the user that the position of the operating body corresponds to the target object. In this solution, after the target object is determined when the operating body is close to the touch screen but not in contact, prompt information is generated to notify the user of the target object, so that the user can promptly understand the target object they are about to contact, thereby improving the user experience.

[0149] like Figure 7 The flowchart shown is a fifth embodiment of an information processing method provided by the present application, and the method includes the following steps:

[0150] Step S701: controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application;

[0151] Step S702: receiving input operation information generated by an operator performing an input operation on the touch screen;

[0152] Step S703: selecting a target position on the touch screen corresponding to the operating body based on the detection that the distance between the operating body and the touch screen meets a preset close distance condition;

[0153] Step S704: determining a target object corresponding to the target position based on the input application interface;

[0154] Among them, steps S701-704 are consistent with steps S401-404 in Example 3 and are not described in detail in this embodiment.

[0155] Step S705: Obtain historical operation information;

[0156] The historical operation information is information about operations performed by the operator on various keys in the input application interface before the current operation.

[0157] Specifically, the operation information of each operation performed by the operating body is associated with the input application and stored in a preset storage area, and the information stored in the preset storage area can be filtered.

[0158] The historical operation information stored in the electronic device may be screened based on the input application to obtain the historical operation information related to the input application.

[0159] Step S706: Analyze the historical operation information to obtain the operation parameters when the operator clicks the target object;

[0160] The historical operation information includes operation parameters of multiple click operations performed by the operator on the target object.

[0161] The operating parameters may include contact area, touch pressure, etc.

[0162] It should be noted that when the operator clicks a button in the input application interface, the operator may click in the center of the button, or in the edge area of the button, or even partially in the contact area of the operator outside the area where the button is located.

[0163] The operation parameter represents the contact area of the target object before the operator clicks on the target object. The contact area can be at any position within the area where the target object is located.

[0164] Step S707: adjusting at least the display area of the target object based on the operation parameter, wherein the display area of the target object after adjustment is larger than the display area of the target object before adjustment;

[0165] Among them, based on the historical operation information of the target object, the contact area of the historical click operation on the target object is analyzed and determined, and the contact area is not only in the central position of the contact area, so the display area of the target object can be enlarged. The enlarged display area of the target object includes the locations of most historical operations, so that the click location can be corrected in advance according to the user's operating habits.

[0166] The display area of the target object is enlarged based on the contact area of the operator when clicking the target object. The enlarged display area includes the locations of most historical operations.

[0167] For example, each time the operator clicks the button "a", it is always on the left side of the display area of the button. Then the display area of the button can be enlarged and the left area can also be used as the display area of the button.

[0168] like Figure 8 The figure shows a schematic diagram of a touch screen of an electronic device, in which a QWERT keyboard is shown. The target object corresponding to the operating body is determined to be a virtual key "h", and the display area of the virtual key "h" is larger than that of other virtual keys.

[0169] Step S708: Based on the detection of the contact between the operating body and the target position on the touch screen, information corresponding to the target object is used as target information;

[0170] Step S709: controlling the display device to respond based on the target information.

[0171] Among them, steps S708-709 are consistent with steps S405-406 in Example 3 and are not described in detail in this embodiment.

[0172] In summary, the information processing method provided in this embodiment further includes: obtaining historical operation information; analyzing the historical operation information to determine the operation parameters when the operator clicks the target object; and adjusting at least the display area of the target object based on the operation parameters, such that the display area of the target object after adjustment is larger than the display area of the target object before adjustment. In this solution, the display area of the target object is increased based on the historical operation information to preemptively correct the click location based on the user's operating habits.

[0173] like Figure 9 The figure is a flowchart of Example 6 of an information processing method provided by the present application, and the method includes the following steps:

[0174] Step S901: controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application;

[0175] Step S902: receiving input operation information generated by an operator performing an input operation on the touch screen;

[0176] Step S903: converting the input operation information into target information;

[0177] Step S904: controlling the display device to respond based on the target information;

[0178] Among them, steps S901-904 are consistent with steps S101-104 in Example 1 and are not described in detail in this embodiment.

[0179] Step S905: starting timing from the time of responding based on the target information, if no input operation is received within a preset time period, controlling the input application to end.

[0180] Among them, the control display device starts timing in response to the target information. Whether an input operation performed by the operating body is received within a preset time period, indicating that the user no longer uses the input application, the input application is controlled to end. At this time, the touch screen of the electronic device no longer displays the input application.

[0181] Specifically, the preset time period can be set to 10 seconds, 20 seconds, etc., and the specific value can be set according to actual conditions.

[0182] Among them, the electronic device and the display device exchange information from the system layer. When the input application ends, the input application node set in the system layer is deleted, and the touch screen of the electronic device displays the same display content as the display screen of the display device.

[0183] In specific implementations, there are multiple ways to exit the input application: clicking the exit icon, clicking the exit key (back) to exit.

[0184] In summary, the information processing method provided in this embodiment further includes: starting a timer from the time of responding based on the target information, and controlling the input application to terminate if no input operation is received within a preset time period. In this solution, if the user does not input an operation within the preset time period, the input application automatically exits, thereby improving the user's experience in operating the electronic device.

[0185] Corresponding to the above-mentioned information processing method embodiment provided by the present application, the present application also provides an apparatus embodiment applying the information processing method.

[0186] like Figure 10 The figure shows a schematic diagram of the structure of an embodiment of an information processing device provided by the present application. The device includes the following structures: a first control module 1001, a receiving module 1002, a conversion module 1003 and a second control module 1003;

[0187] The first control module 1001 is configured to control a display screen of a display device connected to the electronic device to display an interface of an operation application, and to control a touch screen of the electronic device to display an interface of an input application;

[0188] The receiving module 1002 is configured to receive input operation information generated by an operator performing an input operation on the touch screen;

[0189] The conversion module 1003 is used to convert the input operation information into target information;

[0190] The second control module 1004 is configured to control the display device to respond based on the target information.

[0191] Optionally, in the above device, the first control module is specifically configured to:

[0192] Establishing a correspondence between the touch screen and the display screen;

[0193] Based on the received first operation and the corresponding relationship, controlling the display screen to display an interface of a target operation application, wherein the first operation is an input operation performed by an operating body on the touch screen;

[0194] An input application is started, and an interface of the input application is displayed on the touch screen.

[0195] Optionally, in the above device, the first control module is specifically configured to:

[0196] Acquire the operation gestures of the operator within a preset distance of the touch screen;

[0197] Based on the operation gesture satisfying a preset startup condition, control is performed to start an input application.

[0198] Optionally, the conversion module of the above device is specifically used to:

[0199] selecting a target position on the touch screen corresponding to the operating body based on detecting that the distance between the operating body and the touch screen meets a preset close distance condition;

[0200] determining a target object corresponding to the target position based on the input application interface;

[0201] Based on detecting that the operating body is in contact with the target position on the touch screen, information corresponding to the target object is used as target information.

[0202] Optionally, the above-mentioned device, the conversion module, is further used to:

[0203] Prompt information is generated based on the target object to prompt the user that the position of the operating body corresponds to the target object.

[0204] Optionally, the above-mentioned device, the conversion module, is further used to:

[0205] Get historical operation information;

[0206] Analyzing the historical operation information to obtain the operation parameters when the operator clicks the target object;

[0207] At least the display area of the target object is adjusted based on the operation parameter, and the display area of the target object after the adjustment is larger than the display area of the target object before the adjustment.

[0208] Optionally, in the above device, the first control module is further configured to:

[0209] The control starts timing from when a response is made based on the target information, and if no input operation is received within a preset time period, the control ends the input application.

[0210] The structure and function of each part in the information processing device refer to the explanation of the method embodiment and will not be described in detail in this embodiment.

[0211] In summary, the present embodiment provides an information processing device, comprising: a first control module for controlling the display screen of a display device connected to the electronic device to display the interface of an operation application, and controlling the touch screen of the electronic device to display the interface of an input application; a receiving module for receiving input operation information generated by an operating body performing an input operation on the touch screen; a conversion module for converting the input operation information into target information; and a second control module for controlling the display device to respond based on the target information. In this solution, corresponding applications can be set in the electronic device for different functions to achieve adaptation to the content displayed by the display device. The display screen of the display device is used to display the interface of the operation application, and the touch screen of the electronic device displays the interface of the input application. Information is input based on the electronic device as an input device to control the display device. Since various applications can be set in the electronic device for different functions, only one electronic device is needed to equip the display screen with multiple input devices.

[0212] Corresponding to the above-mentioned embodiment of an information processing method provided by the present application, the present application also provides an embodiment of an electronic device applying the information processing method.

[0213] like Figure 11 The figure shows a schematic diagram of the structure of an electronic device embodiment provided by the present application, and the electronic device includes the following structures: a touch screen 1101 and a processor 1102;

[0214] The touch screen 1101 is used to display content to be displayed and receive input operations;

[0215] Among them, the processor 1102 is used to control the display screen of the display device connected to the electronic device to display the interface of the operation application, and control the touch screen of the electronic device to display the interface of the input application; receive input operation information generated by the operating body performing input operation on the touch screen; convert the input operation information into target information; and control the display device to respond based on the target information.

[0216] The structure and function of each part in the electronic device refer to the explanation of the method embodiment and will not be described in detail in this embodiment.

[0217] as follows Figure 12 What is shown is a schematic diagram of an application scenario of an information processing method provided by the present application. In this scenario, the electronic device serves as a game controller, the game interface is displayed on the extended screen, and the electronic device is connected to the extended screen.

[0218] The user inputs touch operations through the touch screen, and the TP (touch panel) node uploads the touch operation information to the OS (Operating System). The Android (Android system) of the electronic device is equipped with a handle APP (application) and a game APP. The OS sends the touch operation information to the virtual handle node. The virtual handle node determines the game instruction corresponding to the touch operation based on the handle APP, and sends it to the game APP through the OS. The game APP responds to the game instruction and sends the display information to the extended screen.

[0219] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Reference can be made to the common and similar parts between the various embodiments. For the devices provided in the embodiments, since they correspond to the methods provided in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method description.

[0220] The above description of the provided embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features provided herein.

Claims

1. An information processing method, comprising: Controlling a display screen of a display device connected to an electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application; wherein, after the electronic device is connected to the display device, the electronic device switches to an extended mode; When the operating body enters the sensing range of the touch screen, pre-determining the target position that the operating body will touch and the corresponding target object; Based on detecting that the operating body is in contact with the target position on the touch screen, using information corresponding to the target object as target information; The display device is controlled to respond based on the target information.

2. The method according to claim 1, wherein controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application, comprises: Establishing a correspondence between the touch screen and the display screen; Based on the received first operation and the corresponding relationship, controlling the display screen to display an interface of a target operation application, wherein the first operation is an input operation performed by an operating body on the touch screen; An input application is started, and an interface of the input application is displayed on the touch screen.

3. The method according to claim 2, wherein starting an input application comprises: Acquire the operation gestures of the operator within a preset distance of the touch screen; Based on the operation gesture satisfying a preset startup condition, control is performed to start an input application.

4. The method according to claim 1, wherein when the operating body enters the sensing range of the touch screen, predetermining the target position that the operating body will touch and the corresponding target object comprises: selecting a target position on the touch screen corresponding to the operating body based on detecting that the distance between the operating body and the touch screen meets a preset close distance condition; Based on the input application interface, a target object corresponding to the target position is determined.

5. The method according to claim 4, after determining the target object corresponding to the target position based on the input application interface, further comprising: Prompt information is generated based on the target object to prompt the user that the position of the operating body corresponds to the target object.

6. The method according to claim 4, further comprising: after determining a target object corresponding to the target position based on the input application interface and before the operating body contacts the target position on the touch screen; Get historical operation information; Analyzing the historical operation information to obtain the operation parameters when the operator clicks the target object; At least the display area of the target object is adjusted based on the operation parameter, and the display area of the target object after the adjustment is larger than the display area of the target object before the adjustment.

7. The method according to any one of claims 1 to 6, further comprising: after sending the target information to a display device: The timing starts from the time of responding based on the target information, and if no input operation is received within a preset time period, the input application is controlled to end.

8. An information processing device comprising: a first control module, configured to control a display screen of a display device connected to the electronic device to display an interface of an operation application, and to control a touch screen of the electronic device to display an interface of an input application; wherein, after the electronic device is connected to the display device, the electronic device switches to an extended mode; a receiving module, configured to predetermine a target position and a corresponding target object that the operating body will touch when the operating body enters the sensing range of the touch screen; a conversion module, configured to use information corresponding to the target object as target information based on detecting that the operating body is in contact with the target position on the touch screen; The second control module is configured to control the display device to respond based on the target information.

9. An electronic device comprising: A touch screen, used to display content to be displayed and receive input operations; A processor is used to control a display screen of a display device connected to an electronic device to display an interface of an operation application, and to control a touch screen of the electronic device to display an interface of an input application; wherein, after the electronic device is connected to the display device, the electronic device switches to an extended mode; when an operating body enters a sensing range of the touch screen, a target position that the operating body is about to contact and a corresponding target object are predetermined; based on detection of contact between the operating body and the target position in the touch screen, information corresponding to the target object is used as target information; and the display device is controlled to respond based on the target information.

10. A readable storage medium having a computer program stored thereon, wherein the computer program is called and executed by a processor to implement the steps of the information processing method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Display control method and mobile terminal

    CN108762471A

  • Information processing method and electronic equipment

    CN112558825A