Information processing method and device and electronic equipment

Abstract

The invention provides an information processing method and device and electronic equipment, and the method comprises the steps: controlling a display screen of display equipment connected with the electronic equipment to display an interface of an operation application, and controlling a touch screen of the electronic equipment to display an interface of an input application; receiving input operation information executed by an operation body on the touch screen; converting the input operation information into target information; and sending the target information to the display equipment, so that the display equipment responds to the target information based on the operation application. According to the scheme, corresponding applications can be set for different functions in the electronic equipment so as to be matched with the display content of the display equipment, the display screen of the display equipment is used for displaying the interface of the operation application, the interface of the input application is displayed in the touch screen of the electronic equipment, and information is input based on the electronic equipment serving as an input device. And controlling the display device. Due to the fact that various applications can be set in the electronic equipment according to different functions, the display screen can be provided with various input devices only through one piece of electronic equipment.

Description

[0001] This application is a divisional application filed on September 9, 2021, with application number 202111055752.4 and invention title: An Information Processing Method, Apparatus and Electronic Device. Technical Field

[0002] This application relates to the field of information technology, and more specifically, to an information processing method, apparatus, and electronic device. Background Technology

[0003] As a commonly used device for displaying content, a display screen is generally equipped with corresponding input devices. For example, when a display screen is used as a game monitor, an external game controller is connected, allowing users to control virtual game characters by manipulating its buttons. Alternatively, when a display screen is used for other applications and requires input, an external physical keyboard is connected, allowing users to input content by pressing the keys on the physical keyboard.

[0004] Therefore, in order to control the display screen, multiple input devices are needed to equip the display screen. Summary of the Invention

[0005] In view of this, this application provides an information processing method, as follows:

[0006] An information processing method, comprising:

[0007] Controls the display screen of the display device connected to the electronic device to display the interface of the operation application, and controls the touch screen of the electronic device to display the interface of the input application;

[0008] Receive input operation information generated by the operator performing an input operation on the touch screen;

[0009] Convert the input operation information into target information;

[0010] The display device is controlled to respond based on the target information.

[0011] Optionally, in the above method, controlling the display screen of the display device connected to the electronic device to display the interface of the operation application, and controlling the touch screen of the electronic device to display the interface of the input application, includes:

[0012] Establish the correspondence between the touch screen and the display screen;

[0013] Based on the received first operation and the corresponding relationship, the interface of the target operation application is displayed on the screen. The first operation is an input operation performed by the operator on the touch screen.

[0014] Launch the input application, and the input application interface will be displayed on the touchscreen.

[0015] Optionally, the above method for launching the input application includes:

[0016] Acquire the gestures of the operator within a preset distance on the touchscreen;

[0017] Based on the operation gestures meeting the preset startup conditions, the input application is launched.

[0018] Optionally, in the above method, converting the input operation information into target information includes:

[0019] Based on the detection that the distance between the operator and the touch screen meets the preset close distance condition, a target position on the touch screen corresponding to the operator is selected;

[0020] Based on the input application interface, determine the target object corresponding to the target location;

[0021] Based on the detection that the operating body is in contact with the target position on the touch screen, the information corresponding to the target object is used as the target information.

[0022] Optionally, the above method, after determining the target object corresponding to the target location based on the input application interface, further includes:

[0023] Based on the target object, a prompt message is generated to indicate to the user that the position of the operation body corresponds to the target object.

[0024] Optionally, the above method, after determining the target object corresponding to the target location based on the input application interface and before the operating body contacts the target location on the touch screen, further includes:

[0025] Retrieve historical operation information;

[0026] Based on the analysis of the historical operation information, the operation parameters when the operator clicks the target object are obtained;

[0027] Based on the operation parameters, at least the display area of ​​the target object is adjusted, and the adjusted display area of ​​the target object is larger than the original display area of ​​the target object.

[0028] Optionally, the method described in any of the above embodiments, after sending the target information to the display device, further includes:

[0029] The timing starts when a response is made based on the target information. If no input operation is received within a preset time period, the input application is controlled to end.

[0030] An information processing apparatus, comprising:

[0031] The first control module is used to control the display screen of the display device connected to the electronic device to display the interface of the operation application, and to control the touch screen of the electronic device to display the interface of the input application.

[0032] The receiving module is used to receive input operation information generated by the operator performing input operations on the touch screen;

[0033] The conversion module is used to convert the input operation information into target information;

[0034] The second control module is used to control the display device to respond based on the target information.

[0035] An electronic device, comprising:

[0036] A touchscreen is used to display content and receive input.

[0037] The processor is configured to control the display screen of a display device connected to the electronic device to display an interface for an operation application, and to control the touch screen of the electronic device to display an interface for an input application; receive input operation information generated by an operator performing an input operation on the touch screen; convert the input operation information into target information; and control the display device to respond based on the target information.

[0038] A readable storage medium having a computer program stored thereon, the computer program being invoked and executed by a processor to implement the steps of the information processing method as described in any one of the preceding claims.

[0039] As can be seen from the above technical solution, compared with the prior art, this application provides an information processing method, including: controlling the display screen of a display device connected to an electronic device to display an interface of an operation application, and controlling the touch screen of the electronic device to display an interface of an input application; receiving input operation information performed by an operator on the touch screen; converting the input operation information into target information; and sending the target information to the display device, so that the display device responds to the target information based on the operation application. In this solution, the electronic device can set corresponding applications for different functions to achieve adaptation with the display content of the display device. The display screen of the display device is used to display the interface of the operation application, while the touch screen of the electronic device displays the interface of the input application. Based on the electronic device as an input device, input information is input to control the display device. Since various applications can be set for different functions in the electronic device, only one electronic device is needed to equip the display screen with multiple input devices. Attached Figure Description

[0040] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0041] Figure 1 This is a flowchart of an embodiment 1 of an information processing method provided in this application;

[0042] Figure 2 This is a flowchart of an embodiment 2 of an information processing method provided in this application;

[0043] Figure 3 This is a schematic diagram of the electronic device and display device in Embodiment 2 of the information processing method provided in this application;

[0044] Figure 4 This is a flowchart of an embodiment 3 of an information processing method provided in this application;

[0045] Figure 5 This is a flowchart of embodiment 4 of the information processing method provided in this application;

[0046] Figure 6 This is a schematic diagram of the touch screen of an electronic device in Embodiment 4 of an information processing method provided in this application;

[0047] Figure 7 This is a flowchart of embodiment 5 of the information processing method provided in this application;

[0048] Figure 8 This is a schematic diagram of the touch screen of an electronic device in Embodiment 5 of an information processing method provided in this application;

[0049] Figure 9 This is a flowchart of an embodiment 6 of an information processing method provided in this application;

[0050] Figure 10 This is a schematic diagram of the structure of an embodiment of an information processing device provided in this application;

[0051] Figure 11 This is a schematic diagram of the structure of an embodiment of an electronic device provided in this application;

[0052] Figure 12 This is a schematic diagram illustrating an application scenario of an information processing method provided in this application. Detailed Implementation

[0053] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0054] like Figure 1 The diagram shown is a flowchart of an embodiment 1 of an information processing method provided in this application. The method is applied to an electronic device and includes the following steps:

[0055] Step S101: Control the display screen of the display device connected to the electronic device to display the interface of the operation application, and control the touch screen of the electronic device to display the interface of the input application;

[0056] The electronic device can be a mobile device, such as a mobile phone or a tablet, which has a touch screen.

[0057] The electronic device is connected to a display device, which is capable of receiving the display content output by the electronic device.

[0058] The display screen of the display device connected to the electronic device displays the interface of the operating application, while the touch screen of the electronic device displays the interface of the input application.

[0059] As an example, the display screen shows the game interface, and the touch screen of the electronic device displays the interface for inputting the game controller application.

[0060] As an example, the display screen shows the application interface for inputting content, such as WeChat, SMS, or a browser, while the touchscreen of the electronic device displays the interface of a virtual keyboard.

[0061] Specifically, the electronic device has an extended mode. When the electronic device is connected to an external display device, the external display device acts as an extended screen and displays different content than the electronic device's main screen.

[0062] Specifically, after the electronic device is connected to the display device, the electronic device switches to extended mode so that the display device acts as an extended screen; after the electronic device is disconnected from the display device, the electronic device switches to non-extended mode.

[0063] Step S102: Receive input operation information generated by the operator performing an input operation on the touch screen;

[0064] The operating object can be a user's finger, stylus, or other object capable of performing touch operations on the touchscreen.

[0065] The operator performs input operations on the touch screen and receives the input operation information generated by the input operation.

[0066] It should be noted that in this application, the display screen of the display device serves as the interface for displaying the operation application, the touch screen of the electronic device displays the interface for inputting the application, and the operator can perform input operations through the touch screen, thus using the electronic device as an input device.

[0067] Step S103: Convert the input operation information into target information;

[0068] The electronic device displays an interface for an input application, and based on this interface, the input operation information is converted into target information.

[0069] The target information is information corresponding to the input application.

[0070] As an example, the electronic device's touchscreen displays an interface for inputting game controller applications, converting input information into game control commands.

[0071] As an example, the electronic device's touchscreen displays a virtual keyboard interface, converting input information into virtual keyboard key values.

[0072] Step S104: Control the display device to respond based on the target information.

[0073] The display device responding based on the target information includes: the electronic device responding to the target information and sending the response content to the display device, or the display device responding to the target information.

[0074] Specifically, the target information is sent to the display device so that the display device can respond to the target information and control the switching of the displayed content;

[0075] Specifically, the electronic device responds to the target information, controls the switching of display content, and sends the switched display content to the display device so that the display content on the display device changes accordingly.

[0076] In summary, this embodiment provides an information processing method comprising: controlling a display screen of a display device connected to the electronic device to display an interface of an operation application, and controlling a touch screen of the electronic device to display an interface of an input application; receiving input operation information performed by an operator on the touch screen; converting the input operation information into target information; and sending the target information to the display device, so that the display device responds to the target information based on the operation application. In this solution, the electronic device can be configured with corresponding applications for different functions to adapt to the content displayed on the display device. The display screen of the display device is used to display the interface of the operation application, while the touch screen of the electronic device displays the interface of the input application. Input information is input based on the electronic device as an input device to control the display device. Since various applications can be configured for different functions in the electronic device, only one electronic device is needed to equip the display screen with multiple input devices.

[0077] like Figure 2 The diagram shown is a flowchart of an embodiment 2 of an information processing method provided in this application. The method includes the following steps:

[0078] Step S201: Establish the correspondence between the touch screen and the display screen;

[0079] The electronic device and the display device are connected, either by cable or wirelessly. This application does not restrict the connection method between the two.

[0080] In this mode, after the electronic device is connected to the display device, the electronic device switches to extended mode, supporting the display screen of the display device as an extended screen, and a corresponding relationship is established between the touch screen of the electronic device and the display screen of the display device.

[0081] Specifically, the planar coordinates of the touch screen and the display screen are continuous, or the planar coordinates of the touch screen and the display screen are proportionally related, with the proportions corresponding to the length and width of the touch screen and the display screen, respectively.

[0082] Specifically, in this embodiment, the extended screen is used to display content based on the target display content of the electronic device. The target display content is the content displayed on the touch screen in the non-extended mode, while in the extended mode, the electronic device can display content other than the target display content on its touch screen.

[0083] Step S202: Based on the received first operation and the corresponding relationship, control the display screen to show the interface of the target operation application;

[0084] The first operation is an input operation performed by the operator on the touch screen.

[0085] The first operation can be a click to open the target application icon on the touchscreen.

[0086] Upon receiving the first operation, the electronic device launches the target application and invokes its interface. Based on the correspondence between the touchscreen and the display screen, it outputs the target application's interface as display content to the display device, causing the display screen to show the target application's interface. At this time, the touchscreen of the electronic device still displays the desktop, which differs from the content displayed on the display screen.

[0087] Step S203: Launch the input application and display the interface of the input application on the touch screen;

[0088] The input application can be started automatically or manually.

[0089] Specifically, there can be a relationship between the input application and the target operation application. After the target operation application is started, the input application can be automatically started based on this relationship.

[0090] For example, if the target operation application is a game, and the associated input application is a game controller application, then the game controller application will be automatically launched after the game starts.

[0091] When the input application is manually launched, it can be launched based on the received second operation control and the interface of the input application will be displayed on the touch screen. The second operation is the input operation performed by the operator on the touch screen.

[0092] Specifically, you can open the app by selecting it from the app list or by selecting it from the notification bar.

[0093] The information interaction between the display screen and the electronic device is executed from the system layer of the electronic device (such as the Android system).

[0094] Specifically, after the input application is launched, an input node is created at the system layer of the electronic device so that the information input by the electronic device can be transmitted to the target operation application node through the input node.

[0095] For example, if the input application is a game controller application, the input node can be a game controller application node; if the input application is a virtual keyboard, the input node can be a keyboard node.

[0096] like Figure 3The diagram shows an electronic device and a display device, including an electronic device (using the Android system) 301 and a display device 302. The touch screen of the electronic device displays a game controller interface, and the display device acts as an extended screen, projecting the content of the electronic device onto the extended screen, which displays the game output interface.

[0097] Launching the input application includes:

[0098] Acquire the gestures of the operator within a preset distance on the touchscreen;

[0099] Based on the operation gestures meeting the preset startup conditions, the input application is launched.

[0100] Among them, the touchscreen enables the hover function to sense hovering operations that are within a preset distance.

[0101] Among them, the electronic device has preset operation gestures to start the input application. The electronic device senses the operation gestures within a preset distance of its touch screen and determines whether they match the preset operation gestures. If they match, the input application is launched.

[0102] The preset distance can be a distance relatively close to the touch screen, such as within 5 centimeters. This application does not restrict its value.

[0103] The preset gesture for launching the input application can be set by the user of the electronic device, and this application does not restrict it.

[0104] Step S204: Receive input operation information generated by the operator performing an input operation on the touch screen;

[0105] Step S205: Convert the input operation information into target information;

[0106] Step S206: Control the display device to respond based on the target information.

[0107] Steps S204-206 are the same as steps S102-104 in Example 1, and will not be described again in this example.

[0108] In summary, the information processing method provided in this embodiment, which controls the display screen of a display device connected to the electronic device to display the interface of an operation application, and controls the touch screen of the electronic device to display the interface of an input application, includes: establishing a correspondence between the touch screen and the display screen; controlling the display screen to display the interface of a target operation application based on a received first operation and the correspondence, wherein the first operation is an input operation performed by an operator on the touch screen; and launching the input application and displaying the interface of the input application on the touch screen. In this solution, after the electronic device is connected to the display device, a correspondence between the touch screen of the electronic device and the display screen of the display device is established. Based on this correspondence and the input operation of the operator on the touch screen, the display screen is controlled to display the interface of the target application, and subsequently, the input application is launched, and the interface of the input application is displayed on the touch screen of the electronic device, thereby realizing the use of the touch screen of the electronic device as an external input device for the display screen.

[0109] like Figure 4 The diagram shown is a flowchart of an embodiment 3 of an information processing method provided in this application. The method includes the following steps:

[0110] Step S401: Control the display screen of the display device connected to the electronic device to display the interface of the operation application, and control the touch screen of the electronic device to display the interface of the input application;

[0111] Step S402: Receive input operation information generated by the operator performing an input operation on the touch screen;

[0112] Steps S401-402 are the same as steps S101-102 in Example 1, and will not be described again in this example.

[0113] Step S403: Based on the detection that the distance between the operating body and the touch screen meets the preset close distance condition, select the target position on the touch screen corresponding to the operating body;

[0114] The preset close distance condition is that the distance between the operator and the touch screen is less than a preset threshold, such as 5 cm or 3 cm. The range of this preset threshold is the sensing range of the touch screen. This application does not restrict the value of this threshold. The threshold can be set according to the situation in specific implementation.

[0115] Among them, the electronic device detects whether there is an operating object within a preset distance of the touch screen.

[0116] Specifically, parameters such as temperature and static electricity can be used to determine whether an object within a preset distance of the touchscreen is a controllable object.

[0117] Specifically, when an operator is detected approaching the touchscreen and the distance between them is less than a preset threshold, the target position corresponding to the operator is determined on the touchscreen.

[0118] The target location is a region, and the target location region can consist of multiple pixels.

[0119] Specifically, the part of the operating body that is closest to the touch screen in terms of vertical distance, and the part of the touch screen that is closest to that part in terms of vertical distance, is taken as the target position.

[0120] Step S404: Based on the input application interface, determine the target object corresponding to the target location;

[0121] The touchscreen displays an input application interface, which may include various objects involved in the input application, such as virtual keyboard keys, icons, and gamepad buttons.

[0122] Specifically, determine the target location on the touchscreen, the target object in the input application interface.

[0123] Specifically, when the operator enters the sensing range of the touch screen, the target position to be touched by the operator and the corresponding target object are determined in advance.

[0124] Step S405: Based on the detection that the operating body is in contact with the target position on the touch screen, the information corresponding to the target object is used as target information;

[0125] Specifically, when it is detected that the operating body is in contact with the touch screen and is in contact with the target position, the information of the target object corresponding to the determined target position is used as the target information.

[0126] The target information refers to the information representing the target object, such as the key values ​​of the virtual keyboard and virtual gamepad events.

[0127] As an example, the target object is a virtual keyboard key, such as the letter 'a', and the key value of the letter 'a' is used as the target information.

[0128] As an example, if the target object is the virtual controller moving left, then the virtual controller event "left" would be used as the target information.

[0129] It should be noted that during steps S403-404, the operating body only approaches the touchscreen but has not yet made contact with it. Before step S405, the operating body makes contact with the touchscreen, triggering step S405.

[0130] Step S406: Control the display device to respond based on the target information.

[0131] Step S406 is the same as step S104 in Example 1, and will not be described again in this example.

[0132] In summary, the information processing method provided in this embodiment converts the input operation information into target information, including: selecting a target position on the touchscreen corresponding to the operation body based on the detection that the distance between the operation body and the touchscreen meets a preset close-range condition; determining a target object corresponding to the target position based on the input application interface; and using the information corresponding to the target object as target information based on the detection that the operation body is in contact with the target position on the touchscreen. In this solution, when the operation body enters the sensing range of the touchscreen, the target position to be contacted by the operation body and the corresponding target object are predetermined, and after the operation body contacts the touchscreen, the information of the target object is used as target information, enabling a rapid response to the touch operation of the operation body.

[0133] like Figure 5 The diagram shown is a flowchart of an embodiment 4 of an information processing method provided in this application. The method includes the following steps:

[0134] Step S501: Control the display screen of the display device connected to the electronic device to display the interface of the operation application, and control the touch screen of the electronic device to display the interface of the input application;

[0135] Step S502: Receive input operation information generated by the operator performing an input operation on the touch screen;

[0136] Step S503: Based on the detection that the distance between the operating body and the touch screen meets the preset close distance condition, select the target position on the touch screen corresponding to the operating body;

[0137] Step S504: Based on the input application interface, determine the target object corresponding to the target location;

[0138] Steps S501-504 are the same as steps S401-404 in Example 3, and will not be described again in this example.

[0139] Step S505: Generate prompt information based on the target object to prompt the user that the position of the operation body corresponds to the target object;

[0140] Once the target object corresponding to the operating body is determined, a prompt message is generated, which includes a display prompt and / or a voice prompt and / or a vibration prompt, etc.

[0141] The display prompts include changing the brightness, color, or display area size of the target object, while the voice prompts include generating audio information about the target object and outputting the audio through the audio output module of the electronic device.

[0142] In practice, the electronic device has preset audio for each virtual button. After determining that one of the virtual buttons is the target object, the audio of that virtual button is acquired and played.

[0143] When the target location does not correspond to a single virtual button, but rather to the area between two virtual buttons, the area between the two virtual buttons can be used as the target object, and a prompt message can be generated to indicate the area between the two virtual buttons.

[0144] like Figure 6 The diagram shows a touch screen of an electronic device. The touch screen shows a QWERTY keyboard. The target object corresponding to the operation is the virtual key "f". The brightness of the virtual key "f" is greater than that of other virtual keys. In addition, the electronic device outputs the audio of "f" so that the user knows the click position and key in advance, which facilitates the user's blind typing.

[0145] Of course, in actual implementation, the method of providing prompts can be set according to the actual situation, and is not limited to the display prompts and voice prompts listed in this embodiment.

[0146] Step S506: Based on the detection that the operating body is in contact with the target position on the touch screen, the information corresponding to the target object is used as target information;

[0147] Step S507: Control the display device to respond based on the target information.

[0148] Steps S506-507 are the same as steps S405-406 in Example 3, and will not be described again in this example.

[0149] In summary, the information processing method provided in this embodiment further includes: generating prompt information based on the target object to inform the user that the position of the operating body corresponds to the target object. In this solution, after determining the target object when the operating body is near the touch screen but has not yet touched it, prompt information is generated to inform the user of the target object, so that the user can promptly understand the target object they are about to touch, thereby improving the user experience.

[0150] like Figure 7 The flowchart shown is a 5th embodiment of an information processing method provided in this application. The method includes the following steps:

[0151] Step S701: Control the display screen of the display device connected to the electronic device to display the interface of the operation application, and control the touch screen of the electronic device to display the interface of the input application;

[0152] Step S702: Receive input operation information generated by the operator performing an input operation on the touch screen;

[0153] Step S703: Based on the detection that the distance between the operating body and the touch screen meets the preset close distance condition, select the target position on the touch screen corresponding to the operating body;

[0154] Step S704: Based on the input application interface, determine the target object corresponding to the target location;

[0155] Steps S701-704 are the same as steps S401-404 in Example 3, and will not be described again in this example.

[0156] Step S705: Obtain historical operation information;

[0157] This historical operation information refers to the actions performed by the user on the various buttons in the input application interface prior to the current operation.

[0158] Specifically, the operation information of each operation performed by the operator is associated with the input application and stored in a preset storage area, and the information stored in the preset storage area can be filtered.

[0159] Specifically, the input application can be used to filter historical operation information stored in the electronic device to obtain the historical operation information involved in the input application.

[0160] Step S706: Based on the historical operation information, analyze and obtain the operation parameters when the operator clicks the target object;

[0161] The historical operation information includes operation parameters for multiple click operations performed by the operator on the target object.

[0162] The operating parameters may include the contact area and the touch pressure.

[0163] It should be noted that when the operator clicks a button in the input application interface, it may click in the center of the button, on the edge of the button, or even with part of the operator's contact area outside the button's area.

[0164] This operation parameter represents the contact area of ​​the operator when it previously clicked the target object. This contact area can be located anywhere within the area where the target object is located.

[0165] Step S707: Adjust the display area of ​​the target object at least based on the operation parameters, such that the display area of ​​the target object after adjustment is larger than the display area of ​​the target object before adjustment;

[0166] In this process, based on the historical operation information of the target object, the contact area of ​​the historical click operations on the target object is analyzed and determined. Since the contact area is not only in the center of the contact area, the display area of ​​the target object can be enlarged. The enlarged display area of ​​the target object includes most of the historical operation positions, so as to correct the click position in advance according to the user's operation habits.

[0167] The magnification of the target object's display area is based on the contact area of ​​the operator when clicking on the target object. The magnified display area includes the location of most historical operations.

[0168] For example, if the user always clicks button "a" on the left side of the button's display area, then the display area of ​​the button can be enlarged, and the left side area can also be used as the display area of ​​the button.

[0169] like Figure 8 The diagram shows a touch screen of an electronic device. The touch screen shows a QWERTY keyboard. The target object corresponding to the operation is identified as the virtual key "h". The display area of ​​the virtual key "h" is larger than that of other virtual keys.

[0170] Step S708: Based on the detection that the operating body is in contact with the target position on the touch screen, the information corresponding to the target object is used as target information;

[0171] Step S709: Control the display device to respond based on the target information.

[0172] Steps S708-709 are the same as steps S405-406 in Example 3, and will not be described again in this example.

[0173] In summary, the information processing method provided in this embodiment further includes: acquiring historical operation information; analyzing the historical operation information to obtain operation parameters when the operator clicks the target object; and adjusting the display area of ​​the target object based on the operation parameters, wherein the adjusted display area of ​​the target object is larger than the original display area. In this solution, the display area of ​​the target object is increased based on historical operation information to allow for advance correction of the click position according to the user's operating habits.

[0174] like Figure 9 The flowchart shown is a sample of embodiment 6 of an information processing method provided in this application. The method includes the following steps:

[0175] Step S901: Control the display screen of the display device connected to the electronic device to display the interface of the operation application, and control the touch screen of the electronic device to display the interface of the input application;

[0176] Step S902: Receive input operation information generated by the operator performing an input operation on the touch screen;

[0177] Step S903: Convert the input operation information into target information;

[0178] Step S904: Control the display device to respond based on the target information;

[0179] Steps S901-904 are the same as steps S101-104 in Example 1, and will not be described again in this example.

[0180] Step S905: Start timing from the time of responding based on the target information. If no input operation is received within the preset time period, control the input application to end.

[0181] The control display device starts timing based on the target information. If an input operation is received from the operator within a preset time period, indicating that the user no longer uses the input application, the control of the input application ends, and the touch screen of the electronic device no longer displays the input application.

[0182] Specifically, the preset time period can be set to 10 seconds, 20 seconds, etc., and the specific value can be set according to the actual situation.

[0183] In this system, the electronic device and the display device exchange information at the system layer. When the input application ends, the input application node set in the system layer is deleted, and the touch screen of the electronic device displays the same content as the display screen of the display device.

[0184] In practice, there are several ways to exit the input application: click the exit icon or click the exit (back) button.

[0185] In summary, the information processing method provided in this embodiment further includes: starting a timer from the moment a response is made based on the target information, and controlling the input application to terminate if no input operation is received within a preset time period. In this solution, the user automatically exits the input application if no input operation is performed within the preset time period, improving the user experience of operating electronic devices.

[0186] Corresponding to the above-described embodiment of an information processing method provided in this application, this application also provides an embodiment of an apparatus for applying the information processing method.

[0187] like Figure 10 The diagram shown is a structural schematic of an embodiment of an information processing device provided in this application. The device includes the following structure: a first control module 1001, a receiving module 1002, a conversion module 1003, and a second control module 1003.

[0188] The first control module 1001 is used to control the display screen of the display device connected to the electronic device to display the interface of the operation application, and to control the touch screen of the electronic device to display the interface of the input application.

[0189] The receiving module 1002 is used to receive input operation information generated by the operator performing an input operation on the touch screen;

[0190] The conversion module 1003 is used to convert the input operation information into target information.

[0191] The second control module 1004 is used to control the display device to respond based on the target information.

[0192] Optionally, in the above-described apparatus, the first control module is specifically used for:

[0193] Establish the correspondence between the touch screen and the display screen;

[0194] Based on the received first operation and the corresponding relationship, the interface of the target operation application is displayed on the screen, where the first operation is an input operation performed by the operator on the touch screen.

[0195] Launch the input application, and the input application interface will be displayed on the touchscreen.

[0196] Optionally, in the above-described apparatus, the first control module is specifically used for:

[0197] Acquire the gestures of the operator within a preset distance on the touchscreen;

[0198] Based on the operation gestures meeting the preset startup conditions, the input application is launched.

[0199] Optionally, in the above-described apparatus, the conversion module is specifically used for:

[0200] Based on the detection that the distance between the operator and the touch screen meets the preset close distance condition, a target position on the touch screen corresponding to the operator is selected;

[0201] Based on the input application interface, determine the target object corresponding to the target location;

[0202] Based on the detection that the operating body is in contact with the target position on the touch screen, the information corresponding to the target object is used as the target information.

[0203] Optionally, in the above-described apparatus, the conversion module is further configured to:

[0204] Based on the target object, a prompt message is generated to indicate to the user that the position of the operation body corresponds to the target object.

[0205] Optionally, in the above-described apparatus, the conversion module is further configured to:

[0206] Retrieve historical operation information;

[0207] Based on the analysis of the historical operation information, the operation parameters when the operator clicks the target object are obtained;

[0208] Based on the operation parameters, at least the display area of ​​the target object is adjusted, and the adjusted display area of ​​the target object is larger than the original display area of ​​the target object.

[0209] Optionally, in the above-described apparatus, the first control module is further used for:

[0210] The control starts timing when responding based on the target information, and ends the input application if no input operation is received within a preset time period.

[0211] The structural functions of each part of the information processing device are explained in the reference method embodiment, and will not be described in detail in this embodiment.

[0212] In summary, this embodiment provides an information processing device comprising: a first control module for controlling the display screen of a display device connected to the electronic device to display an interface for an operation application, and controlling the touch screen of the electronic device to display an interface for an input application; a receiving module for receiving input operation information generated by an operator performing an input operation on the touch screen; a conversion module for converting the input operation information into target information; and a second control module for controlling the display device to respond based on the target information. In this solution, the electronic device can be configured with corresponding applications for different functions to adapt to the content displayed on the display device. The display screen of the display device is used to display the interface for the operation application, while the touch screen of the electronic device displays the interface for the input application. Input information is input based on the electronic device as an input device to control the display device. Since various applications can be configured for different functions in the electronic device, only one electronic device is needed to equip the display screen with multiple input devices.

[0213] Corresponding to the above-described embodiment of an information processing method provided in this application, this application also provides an embodiment of an electronic device that applies the information processing method.

[0214] like Figure 11 The diagram shown is a structural schematic of an embodiment of an electronic device provided in this application. The electronic device includes the following structures: a touch screen 1101 and a processor 1102.

[0215] The touch screen 1101 is used to display content to be displayed and to receive input operations;

[0216] The processor 1102 is configured to control the display screen of a display device connected to the electronic device to display the interface of an operation application, and to control the touch screen of the electronic device to display the interface of an input application; receive input operation information generated by an operator performing an input operation on the touch screen; convert the input operation information into target information; and control the display device to respond based on the target information.

[0217] The structural and functional descriptions of the various parts of the electronic device are explained in the reference method embodiment, and will not be detailed in this embodiment.

[0218] as follows Figure 12 The diagram shown is an application scenario illustration of an information processing method provided in this application. In this scenario, the electronic device acts as a game controller, the game interface is displayed on the extended screen, and the electronic device is connected to the extended screen.

[0219] The user inputs touch operations through the touchscreen. The TP (touch panel) node uploads the touch operation information to the OS (Operating System). The Android system of the electronic device has a gamepad app and a game app. The OS sends the touch operation information to the virtual gamepad node. The virtual gamepad node determines the corresponding game command based on the gamepad app and sends it to the game app through the OS. The game app responds to the game command and sends the display information to the extended screen.

[0220] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. The apparatus provided in the embodiments is described simply because it corresponds to the method provided in the embodiments; relevant parts can be found in the method section.

[0221] The above description of the provided embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features provided herein.

Claims

1. An information processing method applied to an electronic device, comprising: After the electronic device is connected to the display device, the electronic device switches to extended mode; Receive input operation information generated by the operator performing a touch operation on the touch screen of the electronic device; Based on the input operation information and the correspondence between the touch screen and the display screen of the display device, the display device is controlled to respond so that the touch screen acts as an input device for the display device in the extended mode.

2. The method according to claim 1, further comprising, before receiving input operation information generated by the operator performing a touch operation on the touch screen of the electronic device: Establish the correspondence between the touch screen and the display screen; Based on the received first operation and the corresponding relationship, the interface of the target operation application is displayed on the screen, where the first operation is an input operation performed by the operator on the touch screen. Launch the input application, and the input application interface will be displayed on the touch screen.

3. The method according to claim 2, activating the input application, comprising: Acquire the gestures of the operator within a preset distance on the touchscreen; Based on the operation gestures meeting the preset startup conditions, the input application is launched.

4. The method according to claim 2, further comprising: Based on the detection that the distance between the operator and the touch screen meets the preset close distance condition, a target position on the touch screen corresponding to the operator is selected; Based on the input application interface, determine the target object corresponding to the target location; Based on the detection that the operating body is in contact with the target position on the touch screen, the information corresponding to the target object is used as the input operation information.

5. The method according to claim 4, after determining the target object corresponding to the target location based on the input application interface, further comprising: Based on the target object, a prompt message is generated to indicate to the user that the position of the operation body corresponds to the target object.

6. The method according to claim 4, after determining the target object corresponding to the target location based on the input application interface, and before the operating body contacts the target location on the touch screen, further includes: Retrieve historical operation information; Based on the analysis of the historical operation information, the operation parameters when the operator clicks the target object are obtained; Based on the operation parameters, at least the display area of ​​the target object is adjusted, and the adjusted display area of ​​the target object is larger than the original display area of ​​the target object.

7. The method according to any one of claims 2-6, wherein after controlling the display device to respond, it further comprises: The timer starts when a response is initiated, and if no input operation is received within a preset time period, the input application is terminated.

8. An information processing apparatus, comprising: The first control module is used to control the electronic device to switch to extended mode after the electronic device is connected to the display device; The receiving module is used to receive input operation information generated by the operator performing a touch operation on the touch screen of the electronic device; The second control module is used to control the display device to respond based on the input operation information and the correspondence between the touch screen and the display screen of the display device, so that the touch screen serves as the input device of the display device in the extended mode.

9. An electronic device, comprising: A touchscreen is used to display content and receive touch input. The processor controls the electronic device to switch to extended mode after the electronic device is connected to the display device; and receives input operation information generated by the operator performing touch operation on the touch screen of the electronic device. Based on the input operation information and the correspondence between the touch screen and the display screen of the display device, the display device is controlled to respond so that the touch screen acts as an input device for the display device in the extended mode.

10. A readable storage medium having a computer program stored thereon, the computer program being invoked and executed by a processor to implement the steps of the information processing method as described in any one of claims 1-7.

Images