Auxiliary input method, display method, corresponding device and electronic device
By establishing a device pairing relationship in a multi-device collaborative processing scenario, allowing slave devices to adjust content and feed back to the master device, the problem of failure to fully exert slave devices in the prior art is solved, and more efficient multi-device collaborative and resource utilization are achieved.
Patent Information
- Application Number
- CN202110580652.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-26
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2041-05-26
AI Technical Summary
In the prior art, when multi-device collaborative processing, the allocation of master-slave equipment leads to the failure to fully utilize the functions of slave equipment, resulting in waste of resources and poor synergy.
By establishing a pairing relationship between the first electronic device and the second electronic device, when the first electronic device is a slave device, the user can adjust the first target content on the first electronic device and send feedback information to the second electronic device to adjust the second target content.
It significantly improves the synergy of multiple electronic devices, greatly exerts the functionality of subordinate devices, and simplifies user operation processes.
Smart Images

Figure CN113311985B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of computer technology, and specifically relates to an auxiliary input method, a display method, a corresponding device and an electronic device. Background Art
[0002] With the development of science and technology, users will encounter situations where they need to use multiple devices to collaboratively handle problems. In the prior art, when using master and slave devices to collaboratively handle problems, the master device is generally used as the operation end, and the slave device is used as the display end only to display content, so the function of the slave device is difficult to be fully utilized, resulting in a waste of resources. Summary of the invention
[0003] In a first aspect, an embodiment of the present application provides an auxiliary input method, which is applied to a first electronic device, and the method includes:
[0004] Displaying first target content on a first target interface, the first target content corresponds to second target content displayed on a second electronic device, and the second electronic device has a pairing relationship with the first electronic device;
[0005] Receiving a first input from a user on the first target interface;
[0006] In response to the first input, the first target content is adjusted, and feedback information for adjusting the second target content is sent to the second electronic device.
[0007] In a second aspect, an embodiment of the present application provides another display method, which is applied to a second electronic device, and the method includes:
[0008] Displaying the second target content on the second target interface;
[0009] Sending a first target content to a first electronic device, where the first target content corresponds to the second target content, and the first electronic device and the second electronic device have a pairing relationship;
[0010] receiving feedback information sent by the first electronic device;
[0011] In response to the feedback information, the second target content is adjusted.
[0012] In a third aspect, an embodiment of the present application provides an auxiliary input device, applied to a first electronic device, the device comprising:
[0013] A first display module, configured to display first target content on a first target interface, wherein the first target content corresponds to second target content displayed on a second electronic device, and the second electronic device has a pairing relationship with the first electronic device;
[0014] A first receiving module, used to receive a first input of a user on the first target interface;
[0015] The first processing module is configured to adjust the first target content in response to the first input, and send feedback information used for adjusting the second target content to the second electronic device.
[0016] In a fourth aspect, an embodiment of the present application provides a display device, which is applied to a second electronic device, and the device includes:
[0017] A second display module, used for displaying the second target content on the second target interface;
[0018] A sending module, configured to send a first target content to a first electronic device, wherein the first target content corresponds to the second target content, and the first electronic device and the second electronic device have a pairing relationship;
[0019] A second receiving module, used to receive feedback information sent by the first electronic device;
[0020] The second processing module is configured to adjust the second target content in response to the feedback information.
[0021] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect or the second aspect.
[0022] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.
[0023] In the seventh aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect or the second aspect.
[0024] In an embodiment of the present application, by establishing a pairing relationship between a first electronic device and a second electronic device, when the first electronic device is a slave device, a user can adjust the first target content on the first electronic device, which significantly improves the coordination of multiple electronic devices, greatly exerts the functionality of the slave device, and simplifies the user operation process. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 is a flow chart of the auxiliary input method provided by an embodiment of the present application;
[0026] Figure 2 is a corresponding relationship diagram of the auxiliary input method and the display method provided in the embodiment of the present application;
[0027] Figure 3 It is one of the interface schematic diagrams of the auxiliary input method or display method provided in the embodiment of the present application;
[0028] Figure 4 This is the second interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0029] Figure 5 This is the third interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0030] Figure 6 This is the fourth interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0031] Figure 7 This is the fifth interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0032] Figure 8 This is the sixth interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0033] Fig. 9 This is the seventh interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0034] Fig.10 This is the eighth interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0035] Fig.11 This is the ninth interface diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0036] Fig.12 This is the tenth interface schematic diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0037] Fig.13 This is the eleventh interface diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0038] Fig.14 This is the twelfth interface diagram of the auxiliary input method or display method provided in the embodiment of the present application;
[0039] Fig.15 is a structural diagram of an auxiliary input device provided in an embodiment of the present application;
[0040] Fig.16 is a flow chart of a display method provided in an embodiment of the present application;
[0041] Fig.17 is a structural diagram of a display device provided in an embodiment of the present application;
[0042] Fig.18 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0043] Fig.19 This is one of the hardware structure diagrams of the electronic device provided in the embodiment of the present application;
[0044] Fig. 20 This is the second schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0045] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0046] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0047] With the development of technology, electronic devices have extended to more products, such as mobile phones, tablets, watches, smart screens and car screens. When using electronic devices, users often face the problem of multi-electronic device coordination. For example, when projecting the screen, you need to preview the document; when editing the document, you need to copy and paste other parts of the content; or when opening multiple pages in the browser and browsing the content of one of the pages, you need to switch and perform other operations;
[0048] In the prior art, when multiple electronic devices collaborate, the main device is generally used as the operating end and the slave device is used as the display end. For example, when editing through a tablet, the mobile phone is only used as a screen projection and cannot play a greater role. Not only is the collaborative effect poor, but it also causes a waste of resources.
[0049] The auxiliary input method, auxiliary input device, display method, display device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.
[0050] The auxiliary input method or display method can be applied to a terminal, and can be specifically executed by hardware or software in the terminal. The execution subject of the auxiliary input method or display method can be a terminal, or a control device of the terminal, etc.
[0051] The terminal includes but is not limited to mobile phones, tablet computers, watches and other portable communication devices with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the terminal may not be a portable communication device, but a desktop computer, smart screen, and car screen with a touch-sensitive surface (e.g., touch screen displays and / or touch pads).
[0052] In the following various embodiments, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a touch pad, a physical keyboard, a mouse, and a joystick.
[0053] An embodiment of the present application provides an auxiliary input method, and the execution subject of the auxiliary input method can be a terminal, including but not limited to a mobile terminal, a non-mobile terminal, or a control device of a terminal.
[0054] The auxiliary input method is applied to a first electronic device.
[0055] It can be understood that the first electronic device includes a display screen for display, and the display screen can be a display screen set on the electronic device, such as a mobile phone screen, a tablet screen or a watch screen, etc.; or, the display screen can also be a display screen connected to the electronic device for communication, such as a projection screen, etc.
[0056] The first electronic device also includes an input device for receiving user input, and the input device can be an input device arranged on the electronic device, such as a touch display screen, input controls and microphone arranged on a mobile phone and a tablet, a touchpad and a physical keyboard arranged on a laptop computer, etc.; or, the input device can also be an external input device communicatively connected to the electronic device, such as a mouse, a joystick, an external keyboard, an external touchpad and an external speaker, etc.
[0057] During the actual implementation process, the first electronic device may be: a mobile phone, a tablet computer, a desktop computer, a laptop computer, a watch, a smart screen, a car screen and other electronic devices.
[0058] like Figure 1As shown, the auxiliary input method includes: step 110, step 120 and step 130.
[0059] Step 110: Displaying first target content on the first target interface, the first target content corresponds to second target content displayed on the second electronic device, and the second electronic device has a pairing relationship with the first electronic device;
[0060] In this step, the first target interface is a display interface displayed on a display screen of the first electronic device, such as a text display interface, a video playback interface, or a web browsing interface;
[0061] The second electronic device includes a display module having a display function and an information transmission module having an information sending and receiving function;
[0062] For example, the second electronic device may be any electronic device with display function and information receiving and sending function, such as a mobile phone, a tablet computer, a desktop computer, a laptop computer, a watch, a smart screen, and a car screen;
[0063] The number of the second electronic device can be one or more, which can be selected according to actual needs during the actual implementation process.
[0064] It can be understood that the first target interface correspondingly displays the first target content, wherein the first target content corresponds to the second target content displayed on the second electronic device.
[0065] For example, when the second target content is text information, the first target content may be related content corresponding to the text information; when the second target content is web page information, the first target content may be related content corresponding to the web page information.
[0066] It should be noted that the first target content and the second target content may be the same or different.
[0067] like Figure 2 As shown, the second electronic device has a pairing relationship with the first electronic device, and information can be transmitted between the two.
[0068] In the actual implementation process, the pairing relationship between the second electronic device and the first electronic device can be achieved in the following manner:
[0069] receiving a third input from the user;
[0070] In response to the third input, a pairing relationship between the first electronic device and the second electronic device is established, and the first electronic device is a slave device of the second electronic device.
[0071] The third input is used to establish a pairing relationship between the first electronic device and the second electronic device, and determine a master-slave relationship between the two;
[0072] The third input can be expressed in at least one of the following ways:
[0073] First, the third input may be a touch input, including but not limited to a click input, a slide input, and a press input.
[0074] In this implementation, receiving the third input from the user may be performed by receiving a touch operation from the user on a display area of the terminal display screen, or receiving a touch operation from the user on a touch pad that is communicatively connected to the terminal display screen.
[0075] In order to reduce the user error rate, the effective area of the third input can be limited to a specific area, such as the middle area of the display interface; or the target control can be displayed on the current interface, and the third input can be implemented by touching the target control; or the third input can be set to a continuous multiple tapping operation on the display area within a target time interval.
[0076] Secondly, the third input can be expressed as a physical key input.
[0077] In this implementation, the terminal body is provided with corresponding physical buttons, such as a keyboard or a mouse, and receiving the third input from the user can be performed by receiving the third input from the user pressing the corresponding physical button.
[0078] Thirdly, the third input may be voice input.
[0079] In this implementation, upon receiving a voice message such as "set the second electronic device as a slave device", the terminal may generate a control instruction for setting the second electronic device as a slave device.
[0080] Of course, in other embodiments, the third input may also be in other forms, which can be determined according to actual needs, and the embodiments of the present application are not limited to this.
[0081] In response to the third input, establishing a pairing relationship between the first electronic device and the second electronic device may be performed by initiating a dock pairing mode based on a Bluetooth or WiFi connection in response to the third input to establish a pairing relationship between the first electronic device and the second electronic device;
[0082] After the pairing relationship between the two is established, it is confirmed that the second electronic device is the master device, and the first electronic device becomes the slave device of the second electronic device.
[0083] The pairing method is described in detail below through a specific embodiment.
[0084] In the actual implementation process, the user turns on the mobile phone and tablet respectively, turns on the Bluetooth or WiFi connection to initiate the dock pairing mode, and then establishes a pairing relationship between the mobile phone and the tablet;
[0085] After the pairing relationship is established, the phone will display Figure 3 The display interface shown in the figure is displayed on the tablet computer. Figure 4 The display interface shown, wherein both display interfaces display a first control for selecting a master-slave relationship;
[0086] The user clicks on the "I am a slave device" control on the display interface of the mobile phone. The mobile phone receives the user's third input, responds to the third input, confirms that the mobile phone is a slave device, and the tablet computer receives the feedback signal sent by the mobile phone. In response to the feedback signal, it becomes the master device, thereby confirming the master-slave relationship between the two.
[0087] In this embodiment, the mobile phone is the first electronic device, and the tablet computer is the second electronic device.
[0088] Of course, in other embodiments, a tablet computer may be used as the first electronic device and a mobile phone may be used as the second electronic device; or, the first electronic device and the second electronic device may be the same type of electronic device, such as both are tablet computers or both are mobile phones; or, the first electronic device and the second electronic device may be any type of electronic device, which is not limited in this application.
[0089] Step 120: The first electronic device receives a first input of a user to a first target interface;
[0090] Wherein, the first input is used to adjust the first target content;
[0091] The first input is expressed in the same manner as the third input, such as touch input, physical button input, voice input, etc., which will not be elaborated here.
[0092] It should be noted that, corresponding to different first target interfaces, the specific content of the first input may be different during the actual execution process.
[0093] In the following multiple embodiments, the specific implementation of this step will be described in detail from multiple aspects.
[0094] Step 130: The first electronic device adjusts the first target content in response to the first input, and sends feedback information for adjusting the second target content to the second electronic device.
[0095] It should be noted that, in this step, based on the first input of different contents, the adjustment form of the first target content is also different;
[0096] That is, the adjustment of the first target content may be expressed in various forms.
[0097] For example, in the case of reading an article or editing a text, the first electronic device adjusts the first target content in response to the first input, generates feedback information, and sends the feedback information to the second electronic device;
[0098] The second electronic device adjusts the second target content accordingly in response to the feedback information.
[0099] Alternatively, in the case of multi-page browsing, the first electronic device adjusts the first target content in response to the first input and does not generate feedback information, thereby not changing the second target content displayed on the second electronic device.
[0100] It is understandable that, based on different adjustment methods, the corresponding feedback information is also different.
[0101] In the following multiple embodiments, specific adjustment methods for the first target content will be described corresponding to multiple first inputs respectively.
[0102] According to the auxiliary input method provided in the embodiment of the present application, by establishing a pairing relationship between a first electronic device and a second electronic device, when the first electronic device is a slave device, a user can adjust the first target content on the first electronic device, and corresponding feedback information for adjusting the second target content on the second device is generated, thereby significantly improving the coordination of multiple electronic devices, greatly exerting the functionality of the slave device, and simplifying the user operation process.
[0103] The following describes the embodiments of the present application in detail from four different implementation perspectives.
[0104] 1. The first electronic device displays the target word segmentation information, and sends feedback information to the second device by marking the target word segmentation information.
[0105] The embodiments of the present application can be used in the context of reading articles or editing texts.
[0106] In this embodiment, step 110, displaying the first target content on the first target interface, includes: displaying word segmentation information corresponding to the second target content on the first target interface, wherein the second target content is text information;
[0107] like Figure 5 A first target interface is shown, including a word segmentation display area 510 for displaying first target content,
[0108] One or more word segmentation information is displayed in the word segmentation display area 510 , wherein the word segmentation information is obtained based on the second target content.
[0109] For example, when a user uses a second electronic device to edit text, Figure 6 As shown, the second goal content displayed on the second goal interface is "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass.";
[0110] The corresponding segmentation information including: "of", "sunshine", "bird", "," "flower", "child", "happy", "." and "bright" is displayed in the segmentation display area 510 of the first target interface.
[0111] Step 120, the first electronic device receives a first input of a user on a first target interface, including: the first electronic device receives a first input of a user on target word segmentation information in the first target interface;
[0112] Wherein, the first input is used to input target word segmentation information;
[0113] The user can implement the first input of the target word segmentation information in the first target interface by touching or clicking the target word segmentation information displayed in the word segmentation display area 510 .
[0114] The adjusting of the first target content in step 130 includes: marking the target word segmentation information, and sending feedback information of the marked target word segmentation information to the second electronic device;
[0115] In this step, marking the target word segmentation information may be performed by highlighting the target word segmentation, underlining the target word segmentation, changing the order of the target word segmentation, or establishing an association between the target word segmentation and the second target content.
[0116] In response to the first input, marking target word segmentation information,
[0117] It should be noted that the marked target word segmentation information is determined based on the first input of the user in step 120 .
[0118] For example, the user clicks on "sunshine" in the word segmentation display area 510. In response to the first input, the first electronic device marks the target word segmentation "sunshine".
[0119] The marking information is synchronously fed back to the second electronic device, and the second electronic device performs background marking on the second target content in response to the feedback information.
[0120] Of course, in other embodiments, different word segmentation information may be marked differently, such as using different colors to highlight different word segmentation information.
[0121] It can be understood that marking the target word segmentation information may include: marking one target word segmentation information, marking multiple target word segmentation information, or not marking the target word segmentation information.
[0122] After marking the target word segmentation information, the first electronic device sends feedback information of the marked target word segmentation information to the second electronic device;
[0123] The second electronic device performs background marking on the second target content in response to the feedback information.
[0124] It should be noted that, in this embodiment, the second electronic device only performs background marking on the second target content, which helps to establish a quick query channel without changing the currently displayed second target content, and is suitable for a scenario where multiple people read.
[0125] For example, when the word segment "sunshine" of the first electronic device is marked for quick jump, the next time the user reads the text, he only needs to click on the word segment "sunshine", and the second electronic device can jump to the page where the word segment is located, thereby improving reading efficiency.
[0126] According to the auxiliary input method provided in the embodiment of the present application, by marking the target word segmentation information on the first electronic device, the first device sends feedback information to the second device. The second target content can be marked in the background without changing the second target content displayed by the second electronic device, thereby expanding the screen function of the electronic device and simplifying the user operation process.
[0127] 2. The first electronic device displays target information determined from the second target content, and sends feedback information to the second electronic device by editing the target information.
[0128] The embodiments of the present application can be used in the context of reading articles or editing texts.
[0129] In this embodiment, step 120, the first electronic device receives a first input of the user to the first target interface, including: the first electronic device receives a first input of the user to the first target content in the first target interface; wherein the first target content may be target information determined from the second target content;
[0130] The target information is different from the second target content.
[0131] like Figure 8 A first target interface is shown, comprising a first text display area 810 for displaying text information in a first target content, and an image display area 820 for displaying image information in the first target content;
[0132] The text information may be words, short sentences or paragraphs extracted from the second target content;
[0133] The image information may be any image such as a circle, a triangle, a straight line or a wavy line, and each image information corresponds to a text information.
[0134] For example, when a user uses a second electronic device to edit text, Figure 7 As shown, the second goal content displayed on the second goal interface is "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass.";
[0135] The user marks the second target content, such as marking "sunshine" with a circle, marking "bird" with a triangle, marking "children are happy" with a horizontal line, and marking "playing on the grass" with a wavy line, then the first target interface of the first electronic device correspondingly displays the first target content, including:
[0136] Display circle image information and its corresponding "sunshine" text information; display triangle image information and its corresponding "bird" text information; display horizontal line image information and its corresponding "children are happy" text information; and display wave line image information and its corresponding "playing on the grass" text information.
[0137] It should be noted that, in other embodiments, the first target interface may also include other display areas, such as Fig. 9 Another first target interface is shown, for displaying target information determined from second target content;
[0138] In this embodiment, the first target interface only displays text information corresponding to the target information, such as "sunshine", "birds", "happy children" and "playing on the grass".
[0139] In this step, the first input is used to edit the target information, such as adjusting the format of the target information, or deleting the target information, etc.
[0140] The following takes the case where the first input is a touch input as an example to specifically describe the implementation method of the first input.
[0141] Continue to refer Figure 8 , in the actual execution process, the user selects the corresponding image in the image display area 820, and can perform operations such as zooming in up and down, zooming in left and right, adjusting the color, and deleting the target image;
[0142] For example, the height of the triangle can be enlarged by sliding the pen tip or finger up and down, or the length of the triangle can be enlarged by sliding left and right. The speed of sliding the pen tip or finger can be used to control the fineness of the adjustment.
[0143] Alternatively, operations such as vertical zooming, horizontal zooming, color adjustment, and deletion may be performed directly on the corresponding text content in the first text display area 810 .
[0144] Of course, in other embodiments, it is also possible to directly Fig. 9The text information in the display interface shown is enlarged up and down, enlarged left and right, and the color is adjusted.
[0145] Adjusting the first target content in step 130 includes: editing the first target content and sending feedback information to the second electronic device, where the feedback information is used for synchronously editing the second target content.
[0146] The feedback information includes relevant information for adjusting the format of the target information or relevant information for deleting the target information;
[0147] Continue to refer to Figure 8 In step 120, the user selects the corresponding image in the image display area 820 and edits the target image. The first electronic device receives a first input for editing target information and synchronously edits the first target content in response to the first input.
[0148] For example, the user slides the pen tip or finger up and down to enlarge the height of the triangle, and the font size of the text information "bird" displayed in the first text display area 810 is correspondingly enlarged; or the user slides the pen tip or finger left and right to enlarge the length of the triangle, and the font of "bird" is bolded; or by clicking on the corresponding line or image, the font color of the text corresponding to the image can be changed; or by deleting the corresponding line or image, the text corresponding to the image can be deleted;
[0149] The precision of adjusting the format of the target text may be controlled based on the speed of sliding the pen tip or finger. For example, the slower the sliding speed, the higher the precision of the adjustment.
[0150] According to the auxiliary input method provided in the embodiment of the present application, by editing the target information on the first electronic device, the first electronic device sends feedback information to the second electronic device. The second target content can be edited accordingly only by operating the first electronic device without the need to operate through the second electronic device. This greatly utilizes the functionality of the slave device, simplifies the user operation process, and enhances the user experience.
[0151] 3. The first electronic device displays the first target content, and sends feedback information to the second electronic device by editing the first target content.
[0152] The embodiments of the present application can be used in the context of reading articles or editing texts.
[0153] Step 120, the first electronic device receives a first input of a user to a first target interface, including: the first electronic device receives a first input of a user to a first target content in the first target interface;
[0154] The first input is used to edit the first target content, including but not limited to operations such as selecting, copying, pasting, and deleting the first target content.
[0155] It should be noted that, in this embodiment, step 110, displaying the first target content on the first target interface, can be manifested as displaying the first target content that is the same as the second target content on the first target interface, or can be manifested as displaying the first target content that is different from the second target content on the first target interface.
[0156] like Fig.10 A first target interface is shown, on which first target content is displayed, wherein the first target content is the same as the second target content.
[0157] For example, when a user uses a second electronic device to edit text, Fig.11 As shown, the second goal content displayed on the second goal interface is "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass.";
[0158] The first target interface of the first electronic device will display "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are happily playing on the grass." The user can select, copy, paste and delete the first target content on the first target interface, such as deleting: "happily".
[0159] Of course, in other embodiments, the first target content and the second target content may also be different. Figure 5 Another first target interface is shown, on which word segmentation information is displayed. The user can select, copy, paste, and delete the target word segmentation information on the first target interface, such as deleting: "happy".
[0160] The adjusting of the first target content in step 130 includes: the first electronic device edits the first target content and sends feedback information to the second electronic device, where the feedback information is used for synchronously editing the second target content.
[0161] In this step, in response to the first input, when the first target content is edited, feedback information is also generated accordingly.
[0162] The feedback information includes relevant information for editing the first target content, and is used for synchronously editing the second target content.
[0163] For example, when a user is editing the same text content, the same target content can be displayed on multiple electronic devices. Fig.10 , the first electronic device displays the same content as the second target: "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass.";
[0164] The user edits the first target content on the first electronic device by touch input, such as deleting the three words "happily". The first electronic device receives the first input of the user, and in response to the first input, correspondingly adjusts the first target content displayed in the first target interface, and the displayed content changes to "The sun is shining outside the window, the birds are singing, and the flowers are fragrant. Children are playing on the grass.";
[0165] At the same time, based on the first input, the first electronic device generates corresponding feedback information, and sends the feedback information to the second electronic device;
[0166] The second electronic device receives the feedback information, and deletes "happily" in response to the feedback information.
[0167] According to the auxiliary input method provided in the embodiment of the present application, by editing the first target content on the first electronic device, the editing information can be synchronously fed back to the second electronic device, which significantly enhances the coordination between electronic devices and improves the functionality of the subordinate electronic device.
[0168] 4. The first electronic device displays a page tag and a display interface corresponding to a page tag, and sends feedback information to the second electronic device by editing the first target content.
[0169] This embodiment is mainly applied to the situation of browsing, processing or editing multiple pages.
[0170] In this embodiment, step 110, displaying the first target content on the first target interface, may also include: displaying the first target content corresponding to the second target content on the first target interface, the second target content including the target page and a plurality of background page tags, and the first target content including the target page;
[0171] like Fig.13 A first target interface is shown, including a first target page display area 1310 for displaying a target page and a first tab bar display area 1320 for displaying a tab bar.
[0172] Among them, at least one tab bar is displayed in the first tab bar display area 1320; the tab bars correspond one-to-one to the page tabs in the second target content respectively;
[0173] The first target page display area 1310 is used to display a page corresponding to the target tab bar selected in the first tab bar display area 1320 .
[0174] For example, when tab bar 4 in the first tab bar display area 1320 is selected, the page content corresponding to tab bar 4 is displayed in the first target page display area 1310, such as Fig.14 shown.
[0175] The step 130 of adjusting the first target content and sending feedback information for adjusting the second target content to the second electronic device may further include:
[0176] Displaying other display pages corresponding to the background page tag, and sending feedback information for displaying the other display pages corresponding to the background page tag to the second electronic device;
[0177] or closing the currently displayed page, and sending feedback information for closing the currently displayed page to the second electronic device;
[0178] Or create a new page, and send feedback information for the new page to the second electronic device.
[0179] Before step 130, the first electronic device receives a first input from a user on a first target interface;
[0180] The user adjusts the first target content through the first input, including but not limited to selecting, deleting or creating a new tab bar in the tab bar display area 1220;
[0181] The first electronic device receives a first input from a user, and in response to the first input, makes corresponding adjustments to the first target content.
[0182] For example, when a user opens multiple tab pages on the second electronic device, Fig.12 As shown, the second target content includes multiple background page tags: tag 1, tag 2, tag 3, tag 4 and tag 5, and a target page; wherein the target page is the page corresponding to tag 3, and the pages corresponding to other tags are all displayed through the background;
[0183] The first electronic device displays the first target content corresponding to the second target content, such as Fig.13 As shown, multiple tab bars corresponding to the second target content are displayed in the first tab bar display area 1320, including: tab bar 1, tab bar 2, tab bar 3, tab bar 4 and tab bar 5;
[0184] like Fig.13 As shown, when the first electronic device does not receive the first input from the user, the first target page display area 1310 may display a page corresponding to the same tag 3 in the second target interface; or may not display any information;
[0185] like Fig.14As shown, when the first electronic device receives the first input from the user, if the user adjusts the tab bar in the first tab bar display area 1320 by touch, such as clicking "tab bar 4", the display page corresponding to tab bar 4 is displayed in the first target page display area 1310;
[0186] For example, when tab bar 4 is a video tab, the corresponding video content is displayed in the first target page display area 1310; or when tab bar 4 is a game tab, the corresponding game interface is displayed in the first target page display area 1310; or when tab bar 4 is a chat tab, the corresponding chat interface is displayed in the first target page display area 1310.
[0187] Of course, in other embodiments, the user can also browse the tab bar by sliding the tab bar up and down; or close the target tab by sliding the target tab bar to the left; or collect the target tab by sliding the target tab bar to the right, etc.
[0188] The user can also slide up and down, click, or slide left and right on the display page in the first target page display area 1310.
[0189] In some other embodiments, the user may also use the pen to slide on the first target interface of the first electronic device to quickly switch and operate between pages, and the specific implementation method is as follows:
[0190] The distance the pen tip travels is L1. When L1 exceeds the set distance Sn, the page switches to the next page.
[0191] The speed of the pen tip is V1. When V1 exceeds the set speed Vn, the current page is closed.
[0192] At the same time, the pen trajectory is mapped to the current application. For example, drawing X closes the current page, and drawing N creates a new page.
[0193] At the same time, the first electronic device sends feedback information for adjusting the second target content to the second electronic device.
[0194] For example, the user adjusts the tab bar in the first tab bar display area 1320 by touch, such as clicking "tab bar 4", and then the display page corresponding to tab bar 4 is displayed in the first target page display area 1310;
[0195] At the same time, the corresponding feedback information for switching pages is sent to the second electronic device, and the second electronic device displays the display page corresponding to the tab bar 4 in the second target page display area 1210 in response to the feedback information.
[0196] According to the auxiliary input method provided in the embodiment of the present application, by establishing a pairing relationship between a first electronic device and a second electronic device, the second electronic device can be controlled to display other display pages corresponding to the background page tab or close the current display page, or create a new page by editing the first electronic device, thereby improving the user's operating experience in the browser.
[0197] It should be noted that the auxiliary input method provided in the embodiment of the present application can be executed by an auxiliary input device, or a control module in the auxiliary input device for executing the auxiliary input method. In the embodiment of the present application, the auxiliary input device executing the auxiliary input method is taken as an example to illustrate the auxiliary input device provided in the embodiment of the present application.
[0198] The embodiment of the present application also provides an auxiliary input device.
[0199] The auxiliary input device is applied to a first electronic device.
[0200] like Fig.15 As shown, the auxiliary input device includes: a first display module 1510 , a first receiving module 1520 and a first processing module 1530 .
[0201] The first display module 1510 is used to display first target content on a first target interface, where the first target content corresponds to second target content displayed on a second electronic device, and the second electronic device has a pairing relationship with the first electronic device;
[0202] The first receiving module 1520 is used to receive a first input of a user to a first target interface;
[0203] The first processing module 1530 is configured to adjust the first target content in response to the first input, and send feedback information for adjusting the second target content to the second electronic device.
[0204] According to the auxiliary input device provided in the embodiment of the present application, by establishing a pairing relationship between the first electronic device and the second electronic device, when the first electronic device is a slave device, the user can adjust the first target content on the first electronic device, which significantly improves the coordination of multiple electronic devices, greatly exerts the functionality of the slave device, and simplifies the user operation process.
[0205] In some embodiments, the first display module 1510 is further used to: display word segmentation information corresponding to the second target content on the first target interface, wherein the second target content is text information;
[0206] The first receiving module 1520 is further used to: receive a first input of the target word segmentation information in the first target interface by the user;
[0207] The first processing module 1530 is further used to mark the target word segmentation information, and send feedback information of the marked target word segmentation information to the second electronic device.
[0208] In some embodiments, the first receiving module 1520 is further used to: receive a first input of a user to a first target content in the first target interface;
[0209] The first processing module 1530 is further used to edit the first target content and send feedback information to the second electronic device, where the feedback information is used to synchronously edit the second target content.
[0210] In some embodiments, the first display module 1510 is further used to: display the first target content corresponding to the second target content on the first target interface, the second target content includes a target page and a plurality of background page tags, and the first target content includes the target page;
[0211] The first processing module 1530 is further configured to:
[0212] Displaying other display pages corresponding to the background page tag, and sending feedback information for displaying the other display pages corresponding to the background page tag to the second electronic device;
[0213] or closing the currently displayed page, and sending feedback information for closing the currently displayed page to the second electronic device;
[0214] Or create a new page, and send feedback information for the new page to the second electronic device.
[0215] According to the auxiliary input device provided in the embodiment of the present application, by establishing a pairing relationship between the first electronic device and the second electronic device, when the first electronic device is a slave device, the user can adjust the first target content on the first electronic device, which significantly improves the coordination of multiple electronic devices, greatly exerts the functionality of the slave device, and simplifies the user operation process.
[0216] An embodiment of the present application provides a display method, and the execution subject of the display method may be a terminal, including but not limited to a mobile terminal, a non-mobile terminal, or a control device of a terminal.
[0217] The display method is applied to a second electronic device.
[0218] It can be understood that the second electronic device includes a display screen for display, and the display screen can be a display screen set on the electronic device, such as a mobile phone screen, a tablet screen or a watch screen, etc.; or, the display screen can also be a display screen connected to the electronic device for communication, such as a projection screen, etc.
[0219] The second electronic device also includes an input device for receiving user input, and the input device can be an input device arranged on the electronic device, such as a touch display screen, input controls and microphone arranged on a mobile phone and a tablet, a touchpad and a physical keyboard arranged on a laptop computer, etc.; or, the input device can also be an external input device communicatively connected to the electronic device, such as a mouse, a joystick, an external keyboard, an external touchpad and an external speaker, etc.
[0220] During the actual implementation process, the second electronic device can be: a mobile phone, a tablet computer, a desktop computer, a laptop computer, a watch, a smart screen, a car screen and other electronic devices.
[0221] like Fig.16 As shown, the display method includes: step 1610, step 1620, step 1630 and step 1640.
[0222] Step 1610: The second electronic device displays the second target content on the second target interface;
[0223] In this step, the second target interface is a display interface displayed on a display screen of the second electronic device or displayed on a display device communicatively connected to the second electronic device, such as a text display interface, a video playback interface, or a web browsing interface;
[0224] It can be understood that the second target content is displayed on the second target interface, such as text information is displayed on the text display interface, video information is displayed on the video playback interface, and one or more tabs and content information corresponding to the tabs are displayed on the web browsing interface.
[0225] like Figure 6 As shown, a second target interface is provided, which includes a second text display area 610 for displaying text content and an input area 620 for receiving a fourth input from a user;
[0226] Among them, the fourth input is used to input text content;
[0227] For example, the user touches the virtual keyboard in the input area 620 to input the text message "The sun is shining outside the window, the birds are singing, and the flowers are fragrant. The children are playing happily on the grass.";
[0228] The second electronic device receives the fourth input, and in response to the fourth input, displays the second target content “The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass” in the second text display area 610 .
[0229] Of course, in other embodiments, the fourth input may also be expressed as physical key input, voice input or other input methods, which will not be described in detail here;
[0230] When the fourth input method is an input method such as physical key input or voice input, the second target interface may not include an input area for receiving the fourth input of the user, such as a virtual keyboard.
[0231] like Fig.12 As shown, another second target interface is provided, which includes a second tag bar display area 1220 for displaying tags and a second target page display area 1210 for displaying a target page;
[0232] In the actual execution process, the user selects a target tag in the second tag bar display area 1220, and a target page corresponding to the target tag is displayed in the second target page display area 1210;
[0233] For example, if the user clicks "Tag 3" in the second tab bar display area 1220, the target page corresponding to Tag 3 will be displayed in the second target page display area 1210; or if the user clicks "Tag 1" in the second tab bar display area 1220, the target page corresponding to Tag 1 will be displayed in the second target page display area 1210;
[0234] For another example, if the user clicks the close control corresponding to "Tag 3" in the second tab bar display area 1220, the target page corresponding to Tag 3 will be closed in the second target page display area 1210; or if the user clicks the "New" control in the second tab bar display area 1220 to create "Tag 6", the target page corresponding to Tag 6 will be created in the second target page display area 1210.
[0235] It can be understood that the target tag and the target page have a corresponding relationship. For example, when the target tag is a video tag, the corresponding video content is displayed in the second target page display area 1210; or when the target tag is a game tag, the corresponding game interface is displayed in the second target page display area 1210; or when the target tag is a chat tag, the corresponding chat interface is displayed in the second target page display area 1210.
[0236] Step 1620: The second electronic device sends the first target content to the first electronic device, the first target content corresponds to the second target content, and the first electronic device and the second electronic device have a pairing relationship;
[0237] In this step, the first target content is determined based on the second target content;
[0238] The first target content and the second target content may be the same or different.
[0239] In the following multiple embodiments, the method for determining the first target content will be described in detail from multiple aspects.
[0240] As shown in Figure 2, a first electronic device and a second electronic device are in a paired relationship, and information can be transmitted between the first electronic device and the second electronic device.
[0241] The second electronic device displays the second target content on the second target interface, and sends the first target content to the first electronic device;
[0242] The first electronic device receives the first target content and displays the first target content on the first target interface.
[0243] The method for establishing the pairing relationship between the first electronic device and the second electronic device is as described above and will not be elaborated here.
[0244] The second electronic device sends the first target content to the first electronic device, and the first target content is used to be displayed in a first target interface of the first electronic device.
[0245] Step 1630: The second electronic device receives feedback information sent by the first electronic device;
[0246] The feedback information is information generated by the first electronic device in response to the first input, and is used to adjust the second target content;
[0247] like Figure 2 As shown, the first electronic device receives a first input from a user to a first target interface, adjusts the first target content in response to the first input, and in some cases, sends feedback information to the second electronic device.
[0248] The specific method for generating the feedback information has been described in the previous embodiment and will not be repeated here.
[0249] Step 1640: The second electronic device adjusts the second target content in response to the feedback information.
[0250] After receiving the feedback information, the second device adjusts the second target content in response to the feedback information.
[0251] It should be noted that adjusting the second target content can be performed as an explicit adjustment, that is, the adjusted content is displayed on the second target interface; or adjusting the second target content can also be performed as an implicit adjustment, that is, the adjusted content is marked in the background and not displayed on the second target interface.
[0252] In the following multiple embodiments, the adjustment method of the second target content will be described in detail from multiple aspects.
[0253] According to the display method provided by the embodiments of the present application, by establishing a pairing relationship between the second electronic device and the first electronic device, when the second electronic device is the master device, the user can adjust the second target content on the second electronic device correspondingly by adjusting the first target content on the first electronic device, which significantly improves the coordination of multiple electronic devices, greatly exerts the functionality of the slave device, and simplifies the user operation process.
[0254] The embodiments of the present application will be specifically described from four different implementation perspectives below.
[0255] First, in response to the feedback information, when the second target content is kept displayed on the second target interface, the second electronic device marks the target word segmentation information corresponding to the second target content in the background.
[0256] The embodiments of the present application can be used in scenarios of reading articles or editing texts.
[0257] In this embodiment, step 1620, sending the first target content to the first electronic device, includes: sending the word segmentation information corresponding to the second target content to the first electronic device, where the second target content is text information;
[0258] Text information is displayed in the second target interface, and the second electronic device performs word segmentation extraction on the text information to generate multiple word segmentation information, and sends the word segmentation information to the first electronic device.
[0259] For example, as Figure 6 shown, the text information displayed in the second target interface is "The sun is shining brightly outside the window, birds are singing and flowers are blooming, and the kids are playing happily on the grass.";
[0260] Performing word segmentation extraction on the text information to obtain multiple words, including: "of", "sunshine", "bird", ",", "flower", "kid", "happy", ".", and "brightly", etc.;
[0261] The second electronic device sends the word segmentation information to the first electronic device for displaying the word segmentation information in the first target interface of the first electronic device.
[0262] Step 1530, the second electronic device receives the feedback information sent by the first electronic device, includes: receiving the feedback information sent by the first electronic device for marking the target word segmentation information;
[0263] In this step, the feedback information is the feedback information generated by the first electronic device in response to the first input;
[0264] For example, the user clicks on the segmentation information "sunshine" displayed in the first target interface of the first electronic device to change the font color of "sunshine" to red. In response to the first input, the first electronic device marks the target segmentation "sunshine", generates feedback information marking "sunshine", and sends the feedback information to the second electronic device; wherein the feedback information includes information that the font color of the segmentation "sunshine" is changed to red;
[0265] The second electronic device receives the feedback information.
[0266] Step 1640: the second electronic device adjusts the second target content in response to the feedback information, including: in response to the feedback information, while the second target content is still displayed on the second target interface, marking the target word segmentation information corresponding to the second target content in the background;
[0267] like Figure 2 As shown, the second electronic device receives the feedback information sent by the first electronic device, and adjusts the second target content in response to the feedback information;
[0268] It should be noted that, in this embodiment, the adjustment of the second target content is performed as an invisible adjustment, that is, the second target content displayed on the second target interface is not changed, and only the target word segmentation information corresponding to the second target content is marked in the background;
[0269] like Figure 6 As shown, the second electronic device receives the feedback information marked "sunshine" sent by the first electronic device, and keeps displaying "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are happily playing on the grass." in the second text display area 610. The background marks "sunshine" and marks the font color of "sunshine" in red, and does not change the font color of "sunshine" in the text information displayed in the second text display area 610.
[0270] According to the display method provided in the embodiment of the present application, the second electronic device can mark the target word segmentation information corresponding to the second target content in the background in response to the feedback information without changing the second target content displayed by the second electronic device, thereby expanding the screen function of the electronic device and optimizing the user experience.
[0271] 2. In response to the feedback information, the second electronic device displays the second target content after synchronously adjusting the format of the target information in the second target content.
[0272] The embodiments of the present application can be used in the context of reading articles or editing texts.
[0273] In this embodiment, step 1620, sending the first target content to the first electronic device, includes:
[0274] The second electronic device receives a second input of the user to the second target interface;
[0275] The second electronic device sends target information to the first device in response to the second input, the target information being determined from the second target content;
[0276] Wherein, the second input is used to mark the second target content to generate target information;
[0277] The second input is expressed in the same manner as the first input, and may include touch input, physical key input, voice input, or other input methods.
[0278] The following will take the touch mode as an example to specifically explain this step.
[0279] For example, when the second target content is displayed on the second target interface as: "The sun is shining outside the window, the birds are singing, and the flowers are fragrant. The children are playing happily on the grass."
[0280] The user may mark the second target content, for example, the user touches the display screen of the second electronic device with a finger or a pen tip to process the second target content.
[0281] The method comprises: marking a target word on the second target content with a circle, a triangle, a straight line or a wavy line, etc., the second electronic device receives a second input from the user, and in response to the second input, displays the target mark on the second target interface accordingly, so as to obtain the following Figure 7 The second target interface shown;
[0282] Among them, the circle is marked "sunshine", the triangle is marked "birds", the horizontal line is marked "children are happy", and the wavy line is marked "playing on the grass";
[0283] The second electronic device generates target information based on the above mark and its corresponding text content, and sends the target information to the first electronic device;
[0284] Among them, the target information includes: displaying circle image information and its corresponding "sunshine" text information; displaying triangle image information and its corresponding "bird" text information; displaying horizontal line image information and its corresponding "children are happy" text information; and displaying wavy line image information and its corresponding "playing on the grass" text information.
[0285] Step 1630: The second electronic device receives feedback information sent by the first electronic device, including: receiving feedback information sent by the first electronic device, where the feedback information is used to synchronously edit the second target content;
[0286] In this step, feedback information is generated by the first electronic device in response to a first input from a user, and is used for synchronously editing the second target content;
[0287] On the contrary, the second target content may be formatted or deleted.
[0288] For example, when the user's first input is to slide up and down through the pen tip or finger to enlarge the height of the triangle, the corresponding feedback information is: bolding the font of the target information "bird" in the second target content.
[0289] Step 1640: The second electronic device adjusts the second target content in response to the feedback information, including: in response to the feedback information, displaying the second target content after synchronously editing the second target content.
[0290] like Figure 6 A second target interface is provided, and the second target interface includes a second text display area 610, wherein the second text display area 610 is used to display the second target content;
[0291] For example, the second goal is: "The sun is shining outside the window, the birds are singing, and the flowers are fragrant. The children are playing happily on the grass." Among them, the font of "bird" is not bold;
[0292] When the feedback information is: making the font of the target information "bird" in the second target content bold, the second electronic device responds to the feedback information, makes the font of "bird" in the second target content bold, obtains a new second target content with the format adjusted, and synchronously displays the new second target content on the second target interface.
[0293] According to the display method provided in the embodiment of the present application, the second electronic device can display the second target content after synchronously editing the target information in the second target content without the user having to operate through the second electronic device, thereby greatly exerting the functionality of the slave device, simplifying the user operation process, and enhancing the user experience.
[0294] 3. The second electronic device displays the second target content after synchronous editing in response to the feedback information.
[0295] The embodiments of the present application can be used in the context of reading articles or editing texts.
[0296] In this embodiment,
[0297] Step 1630, the second electronic device receives feedback information sent by the first electronic device, including: the second electronic device receives the feedback information sent by the first electronic device, the feedback information is used to synchronously edit the second target content;
[0298] It should be noted that, in this embodiment, the first target content sent by the second electronic device to the first electronic device may be the same as the second target content, or may be different;
[0299] like Fig.11 A second target interface is provided, which displays the second target content: "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass."
[0300] The second electronic device generates the first target content based on the second target content;
[0301] Among them, the content of the first target is the same as the second target, which is: "The sun is shining outside the window, the birds are singing, the flowers are fragrant, and the children are playing happily on the grass."
[0302] The second electronic device sends the first target content to the first electronic device for display on the first target interface, such as Fig.10 shown.
[0303] In this step, feedback information is generated by the first electronic device in response to a first input from a user, and is used for synchronously editing the second target content;
[0304] The feedback information includes relevant information for editing the first target content;
[0305] For example, when a user edits the first target content on the first electronic device, such as deleting the three words "happily", the first electronic device receives the user's first input, generates feedback information in response to the first input, and sends the feedback information to the second electronic device.
[0306] Among them, the feedback information includes: deleting "happily";
[0307] The second electronic device receives the feedback information for synchronously editing the second target content.
[0308] Step 1640: The second electronic device adjusts the second target content in response to the feedback information, including: the second electronic device displays the second target content after synchronous editing in response to the feedback information.
[0309] In this step, adjusting the second target content may be performed by selecting, copying, pasting or deleting the second target content;
[0310] The adjusted second target content is synchronously displayed on the second target interface.
[0311] For example, when the feedback information is to delete "happily", the second electronic device adjusts the second target content "The sun is shining outside the window, the birds are singing, and the flowers are fragrant, and the children are playing happily on the grass" in response to the feedback information, and deletes "happily" to obtain the edited second target content.
[0312] The second goal is: "The sun is shining outside the window, the birds are singing, the flowers are blooming, and the children are playing on the grass."
[0313] Of course, according to other embodiments, when the first target content is different from the second target content, the second target content may be adjusted in other ways, such as by deleting or changing the order of the target word segmentation information displayed on the first target interface to generate feedback information;
[0314] The second electronic device receives the feedback information, and correspondingly deletes the target word segmentation information in the second target content, or adjusts the order of the target word segments, generates the edited second target content, and synchronously displays it on the second target interface.
[0315] 4. The second electronic device displays a page after switching, deleting or creating the first target content in response to the feedback information.
[0316] This embodiment is mainly applied to the situation of browsing, processing or editing multiple pages.
[0317] In this embodiment, receiving feedback information sent by the first electronic device includes: receiving feedback information sent by the first electronic device for displaying other display pages corresponding to the background page tag;
[0318] In response to the feedback information, adjusting the second target content includes: in response to the feedback information, displaying another display page corresponding to the background page tag;
[0319] Alternatively, receiving feedback information sent by the first electronic device includes: receiving feedback information sent by the first electronic device for closing the currently displayed page;
[0320] In response to the feedback information, adjusting the second target content includes: in response to the feedback information, closing the currently displayed page;
[0321] Alternatively, receiving feedback information sent by the first electronic device includes: receiving feedback information for creating a new page sent by the first electronic device;
[0322] In response to the feedback information, adjusting the second target content includes: in response to the feedback information, creating a new page.
[0323] For example, the user adjusts the tab bar in the first tab bar display area 1320 in the first electronic device by touching, such as clicking "tab bar 4", and then the display page corresponding to tab bar 4 is displayed in the first target page display area 1310;
[0324] At the same time, the corresponding feedback information for switching pages is sent to the second electronic device. The second electronic device receives the feedback information and displays the display page corresponding to the tab bar 4 in the second target page display area 1210 in response to the feedback information.
[0325] Alternatively, the user creates a new "Tab Bar 6" on the first electronic device, and the first electronic device sends feedback information of the newly created page to the second electronic device, and in response to the feedback information, creates a new "Tab Bar 6" in the second tab bar display area 1220, and displays a display page corresponding to "Tab Bar 6" in the second target page display area 1210. According to the display method provided in the embodiment of the present application, the second electronic device can synchronously send feedback information of editing the first target content on the first electronic device to the second electronic device in response to the feedback information without the user having to operate through the second electronic device, which significantly enhances the synergy between electronic devices and improves the functionality of the subordinate electronic device.
[0326] It should be noted that the display method provided in the embodiment of the present application can be executed by a display device or a control module in the display device for executing the display method. In the embodiment of the present application, the method of executing the display by the display device is taken as an example to illustrate the display device provided in the embodiment of the present application.
[0327] The embodiment of the present application also provides a display device.
[0328] The display device is applied to a second electronic device.
[0329] like Fig.17 As shown, the display device includes: a second display module 1710 , a sending module 1720 , a second receiving module 1730 and a second processing module 1740 .
[0330] The second display module 1710 is used to display the second target content on the second target interface;
[0331] The sending module 1720 is used to send the first target content to the first electronic device, the first target content corresponds to the second target content, and the first electronic device and the second electronic device have a pairing relationship;
[0332] The second receiving module 1730 is used to receive feedback information sent by the first electronic device;
[0333] The second processing module 1740 is configured to adjust the second target content in response to the feedback information.
[0334] According to the display device provided in the embodiment of the present application, by establishing a pairing relationship between the second electronic device and the first electronic device, when the second electronic device is the main device, the user can adjust the second target content on the second electronic device accordingly by adjusting the first target content on the first electronic device, thereby significantly improving the coordination of multiple electronic devices, greatly exerting the functionality of the slave devices, and simplifying the user operation process.
[0335] In some embodiments, the sending module 1720 is further used to: send word segmentation information corresponding to the second target content to the first electronic device, wherein the second target content is text information;
[0336] The second receiving module 1730 is further used to: receive feedback information sent by the first electronic device for marking target word segmentation information;
[0337] The second processing module 1740 is further used for: in response to the feedback information, while the second target content is still displayed on the second target interface, marking the target word segmentation information corresponding to the second target content in the background.
[0338] In some embodiments, the second receiving module 1730 is further used to: receive feedback information sent by the first electronic device, where the feedback information is used to synchronously edit the second target content;
[0339] The second processing module 1740 is further configured to: in response to the feedback information, display the second target content after synchronous editing.
[0340] In some embodiments, the second receiving module 1730 is further used to: receive feedback information sent by the first electronic device for displaying other display pages corresponding to the background page tag;
[0341] The second processing module 1740 is further used to: in response to the feedback information, display other display pages corresponding to the background page tag;
[0342] Alternatively, the second receiving module 1730 is further used to: receive feedback information sent by the first electronic device for closing the currently displayed page;
[0343] The second processing module 1740 is further used to: in response to the feedback information, close the currently displayed page;
[0344] Alternatively, the second receiving module 1730 is further used to: receive feedback information for creating a new page sent by the first electronic device;
[0345] The second processing module 1740 is further used to create a new page in response to the feedback information.
[0346] According to the display device provided in the embodiment of the present application, by establishing a pairing relationship between the second electronic device and the first electronic device, when the second electronic device is the main device, the user can adjust the second target content on the second electronic device accordingly by adjusting the first target content on the first electronic device, thereby significantly improving the coordination of multiple electronic devices, greatly exerting the functionality of the slave devices, and simplifying the user operation process.
[0347] The auxiliary input device or display device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a watch, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), or a television (TV), which is not specifically limited in the embodiment of the present application.
[0348] The auxiliary input device or display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0349] The auxiliary input device provided in the embodiment of the present application can achieve Figures 1 to 14 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0350] The display device provided in the embodiment of the present application can achieve Figures 2 to 14 as well as Fig.16 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0351] Alternatively, if Fig.18 As shown, an embodiment of the present application also provides an electronic device 1800, including a processor 1801, a memory 1802, and a program or instruction stored in the memory 1802 and executable on the processor 1801. When the program or instruction is executed by the processor 1701, each process of the above-mentioned auxiliary input method or display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0352] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0353] Fig.19 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0354] The electronic device 1900 includes but is not limited to components such as a radio frequency unit 1901, a network module 1902, an audio output unit 1903, an input unit 1904, a sensor 1905, a display unit 1906, a user input unit 1907, an interface unit 1908, a memory 1909, and a processor 1910.
[0355] Those skilled in the art will appreciate that the electronic device 1900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.19 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0356] The display unit 1906 is used to display the first target content on the first target interface, the first target content corresponds to the second target content displayed on the second electronic device, and the second electronic device has a pairing relationship with the first electronic device;
[0357] The user input unit 1907 is used to receive a first input of a user to a first target interface;
[0358] The processor 1910 is configured to adjust the first target content in response to the first input, and send feedback information for adjusting the second target content to the second electronic device.
[0359] Optional,
[0360] The display unit 1906 is further configured to display the segmentation information corresponding to the second target content on the first target interface, wherein the second target content is text information;
[0361] The user input unit 1907 is further used to: receive a first input of the target word segmentation information in the first target interface by the user;
[0362] The processor 1910 is further configured to mark the target word segmentation information, and send feedback information of the marked target word segmentation information to the second electronic device.
[0363] Optionally, the user input unit 1907 is further configured to receive a first input from a user to the first target interface, including: receiving a first input from a user to a first target content in the first target interface;
[0364] The processor 1910 is further configured to: edit the first target content, and send feedback information to the second electronic device, where the feedback information is used to synchronously edit the second target content.
[0365] Optionally, the display unit 1906 is further configured to display a first target content corresponding to a second target content on the first target interface, the second target content including a target page and a plurality of background page tags, and the first target content including a target page;
[0366] The processor 1910 is further configured to:
[0367] Displaying other display pages corresponding to the background page tag, and sending feedback information for displaying the other display pages corresponding to the background page tag to the second electronic device;
[0368] or closing the currently displayed page, and sending feedback information for closing the currently displayed page to the second electronic device;
[0369] Or create a new page, and send feedback information for the new page to the second electronic device.
[0370] According to the electronic device provided in the embodiment of the present application, by establishing a pairing relationship between a first electronic device and a second electronic device, when the first electronic device is a slave device, a user can adjust the first target content on the first electronic device, which significantly improves the coordination of multiple electronic devices, greatly exerts the functionality of the slave device, and simplifies the user operation process.
[0371] It should be understood that in the embodiment of the present application, the input unit 1904 may include a graphics processor (Graphics Processing Unit, GPU) 19041 and a microphone 19042, and the graphics processor 19041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1906 may include a display panel 19061, and the display panel 19061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1907 includes a touch panel 19071 and other input devices 19072. The touch panel 19071 is also called a touch screen. The touch panel 19071 may include two parts: a touch detection device and a touch controller. Other input devices 19072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 1909 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 1910 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1910.
[0372] Fig. 20 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0373] The electronic device 2000 includes but is not limited to: a radio frequency unit 2001, a network module 2002, an audio output unit 2003, an input unit 2004, a sensor 2005, a display unit 2006, a user input unit 2007, an interface unit 2008, a memory 2009, and a processor 2010 and other components.
[0374] Those skilled in the art will appreciate that the electronic device 2000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 2010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 20 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0375] The display unit 2006 is used to display the second target content on the second target interface;
[0376] The radio frequency unit 2001 is used to send a first target content to a first electronic device, the first target content corresponds to a second target content, and the first electronic device and the second electronic device have a pairing relationship;
[0377] The input unit 2004 is used to receive feedback information sent by the first electronic device;
[0378] The processor 2010 is configured to adjust the second target content in response to the feedback information.
[0379] Optionally, the radio frequency unit 2001 is further used to: send word segmentation information corresponding to the second target content to the first electronic device, wherein the second target content is text information;
[0380] The input unit 2004 is further used to: receive feedback information sent by the first electronic device for marking target word segmentation information;
[0381] The processor 210 is further configured to adjust the second target content in response to the feedback information, including: in response to the feedback information, while the second target content is still displayed on the second target interface, marking the target word segmentation information corresponding to the second target content in the background;
[0382] Optionally, the input unit 2004 is further used to: receive feedback information sent by the first electronic device, where the feedback information is used to synchronously edit the second target content;
[0383] The processor 2010 is further configured to: in response to the feedback information, display the second target content after synchronous editing.
[0384] Optionally, the input unit 2004 is further used to: receive feedback information sent by the first electronic device for displaying other display pages corresponding to the background page tag;
[0385] The processor 2010 is further configured to: in response to the feedback information, display other display pages corresponding to the background page tag.
[0386] Optionally, the input unit 2004 is further used to: receive feedback information sent by the first electronic device for closing the currently displayed page;
[0387] The processor 2010 is further configured to: in response to the feedback information, close the currently displayed page.
[0388] Optionally, the input unit 2004 is further used to: receive feedback information for creating a new page sent by the first electronic device;
[0389] The processor 2010 is further configured to: create a new page in response to the feedback information.
[0390] According to the electronic device provided in the embodiment of the present application, by establishing a pairing relationship between the second electronic device and the first electronic device, the second electronic device can respond to the feedback information, and the user does not need to operate through the second electronic device. The feedback information for editing the first target content on the first electronic device can be synchronously sent to the second electronic device, thereby significantly enhancing the coordination between the electronic devices and improving the functionality of the subordinate electronic device.
[0391] It should be understood that in the embodiment of the present application, the input unit 2004 may include a graphics processor (Graphics Processing Unit, GPU) 20041 and a microphone 20042, and the graphics processor 20041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 2006 may include a display panel 20061, and the display panel 20061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 2007 includes a touch panel 20071 and other input devices 20072. The touch panel 20071 is also called a touch screen. The touch panel 20071 may include two parts, a touch detection device and a touch controller. Other input devices 20072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 2009 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 2010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 2010.
[0392] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned auxiliary input method or display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0393] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0394] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned auxiliary input method or display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0395] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0396] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0397] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0398] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An auxiliary input method, applied to a first electronic device, characterized in that: include: Displaying first target content on a first target interface, the first target content corresponds to second target content displayed on a second electronic device, the second electronic device and the first electronic device have a pairing relationship; the first electronic device is a slave device, and the second electronic device is a master device; Receiving a first input from a user on the first target interface; In response to the first input, adjusting the first target content, and sending feedback information for adjusting the second target content to the second electronic device; The displaying of the first target content on the first target interface includes: displaying word segmentation information corresponding to the second target content on the first target interface, wherein the second target content is text information; The receiving a first input from a user on the first target interface includes: receiving a first input from a user on target word segmentation information in the first target interface; The adjusting of the first target content includes: marking the target word segmentation information, and sending feedback information marking the target word segmentation information to the second electronic device; the feedback information is used to instruct the second electronic device to mark the target word segmentation information corresponding to the second target content in the background while the second target interface keeps displaying the second target content, and the background marking of the target word segmentation information is used for the user to click on the target word segmentation information when reading the text next time, so that the second electronic device jumps to the page where the target word segmentation information is located.
2. The auxiliary input method according to claim 1, characterized in that: The receiving a first input from a user to the first target interface includes: receiving a first input from a user to a first target content in the first target interface; The adjusting the first target content includes: editing the first target content and sending feedback information to the second electronic device, where the feedback information is used for synchronously editing the second target content.
3. The auxiliary input method according to claim 1, characterized in that: Displaying the first target content on the first target interface includes: displaying the first target content corresponding to the second target content on the first target interface, the second target content includes a target page and a plurality of background page tags, and the first target content includes a target page; The adjusting the first target content and sending feedback information for adjusting the second target content to the second electronic device includes: displaying other display pages corresponding to the background page tag, and sending the feedback information for displaying the other display pages corresponding to the background page tag to the second electronic device; or closing the currently displayed page, and sending the feedback information for closing the currently displayed page to the second electronic device; Or create a new page, and send the feedback information for creating the new page to the second electronic device.
4. A display method, applied to a second electronic device, characterized in that: include: Displaying the second target content on the second target interface; Sending a first target content to a first electronic device, the first target content corresponds to the second target content, the first electronic device and the second electronic device have a pairing relationship; the first electronic device is a slave device, and the second electronic device is a master device; receiving feedback information sent by the first electronic device; In response to the feedback information, adjusting the second target content; The sending the first target content to the first electronic device includes: sending word segmentation information corresponding to the second target content to the first electronic device, wherein the second target content is text information; The receiving feedback information sent by the first electronic device includes: receiving feedback information sent by the first electronic device for marking target word segmentation information; The adjusting the second target content in response to the feedback information includes: in response to the feedback information, while the second target interface continues to display the second target content, marking the target word segmentation information corresponding to the second target content in the background; marking the target word segmentation information in the background for the user to click on the target word segmentation information when reading the text next time, so that the second electronic device jumps to the page where the target word segmentation information is located.
5. The display method according to claim 4, characterized in that: The receiving feedback information sent by the first electronic device includes: receiving the feedback information sent by the first electronic device, wherein the feedback information is used for synchronously editing the second target content; The adjusting the second target content in response to the feedback information includes: displaying the second target content after synchronous editing in response to the feedback information.
6. The display method according to claim 4, characterized in that: The receiving feedback information sent by the first electronic device includes: receiving the feedback information sent by the first electronic device for displaying other display pages corresponding to the background page tag; The adjusting the second target content in response to the feedback information includes: displaying another display page corresponding to the background page tag in response to the feedback information; Alternatively, the receiving feedback information sent by the first electronic device includes: receiving the feedback information sent by the first electronic device for closing the currently displayed page; The adjusting the second target content in response to the feedback information includes: closing the currently displayed page in response to the feedback information; Alternatively, the receiving feedback information sent by the first electronic device includes: receiving the feedback information for creating a new page sent by the first electronic device; The adjusting the second target content in response to the feedback information includes: creating a new page in response to the feedback information.
7. An auxiliary input device, applied to a first electronic device, characterized in that: include: Displaying a first target content on a first target interface, the first target content corresponds to a second target content displayed on a second electronic device, the second electronic device and the first electronic device have a pairing relationship; the first electronic device is a slave device, and the second electronic device is a master device; A first receiving module, configured to receive a first input from a user on the first target interface; a first processing module, configured to adjust the first target content in response to the first input, and send feedback information for adjusting the second target content to the second electronic device; The first display module is further used to display the word segmentation information corresponding to the second target content on the first target interface, wherein the second target content is text information; The first receiving module is further used to receive a first input of the target word segmentation information in the first target interface by a user; The first processing module is further used to mark the target word segmentation information and send feedback information marking the target word segmentation information to the second electronic device; the feedback information is used to instruct the second electronic device to mark the target word segmentation information corresponding to the second target content in the background while the second target interface continues to display the second target content, and the background marking of the target word segmentation information is used for the user to click on the target word segmentation information when reading the text next time, and the second electronic device jumps to the page where the target word segmentation information is located.
8. A display device, applied to a second electronic device, characterized in that: include: A second display module, used for displaying the second target content on the second target interface; A sending module, configured to send a first target content to a first electronic device, wherein the first target content corresponds to the second target content, and the first electronic device and the second electronic device have a pairing relationship; the first electronic device is a slave device, and the second electronic device is a master device; A second receiving module, configured to receive feedback information sent by the first electronic device; A second processing module, configured to adjust the second target content in response to the feedback information; The sending module is further used to send word segmentation information corresponding to the second target content to the first electronic device, wherein the second target content is text information; The second receiving module is further used to receive feedback information sent by the first electronic device for marking target word segmentation information; The second processing module is also used to respond to the feedback information and, while the second target interface continues to display the second target content, mark the target word segmentation information corresponding to the second target content in the background; the target word segmentation information is marked in the background so that when the user clicks on the target word segmentation information when reading the text next time, the second electronic device jumps to the page where the target word segmentation information is located.
9. An electronic device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the auxiliary input method as described in any one of claims 1 to 3, or implements the steps of the display method as described in any one of claims 4 to 6.
10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the auxiliary input method as described in any one of claims 1-3 are implemented, or the steps of the display method as described in any one of claims 4-6 are implemented.
Citation Information
Patent Citations
Method and apparatus for controlling contents displayed on device
CN107870754A
Application sharing method and electronic equipment
CN111078819A
Page labeling method and device, equipment and medium
CN112559940A