Interaction method, interaction apparatus, readable storage medium, and electronic device

By using invisible watermark identification and control equipment interactive methods in large-screen display systems, the problem of users' cumbersome modification of browser window content is solved, convenient content updates are achieved, and user experience is improved.

WO2024239670A1PCT designated stage expired Publication Date: 2024-11-28HUAWEI CLOUD COMPUTING TECHNOLOGIES CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/071429
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-08-14
Filing Date
2024-01-09
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

In a large-screen display system, users are cumbersome to modify the content of the browser window, have poor user experience, and it is difficult for the existing technology to achieve convenient content updates.

Method used

By adding invisible watermark web pages to the web pages generated by the server and using the shooting interface of the control device to obtain layout information, users can select the target object area and content object, send instructions to the server to update the URL of the web page area, and realize the display of the target content .

Benefits of technology

It simplifies the process of users updating content on large screens, improves operational convenience and user experience, and avoids the impact of web page identification on user visual effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024071429_28112024_PF_FP_ABST
    Figure CN2024071429_28112024_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of communications, and discloses an interaction method, an interaction apparatus, a readable storage medium, and an electronic device. A first interface displayed by a display device comprises the webpage identifier of a webpage corresponding to the first interface. A client can acquire an interface image of the first interface collected by a control device and identify the webpage identifier in the interface image. Then, the client acquires and displays a layout information interface according to the webpage identifier. Second, the client sends a target area identifier, the webpage identifier of a target webpage and a target address corresponding to target content to a server according to a target object area selected by a user. The server can update a webpage area uniform resource locator address of a target webpage area in the target webpage, so that when the display device updates the display interface, the display device can obtain the target content on the basis of the target address. Therefore, the user can update the first interface by capturing the first interface by means of the control device and selecting the target content and the target object area, and operation is convenient and fast.
Need to check novelty before this filing date? Find Prior Art

Description

Interaction method, interaction device, readable storage medium and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 22, 2023, with application number 202310579652.4 and application name “Interactive method, interactive device, readable storage medium, program product and device”, and the Chinese patent application filed with the China Patent Office on August 14, 2023, with application number 202311020443.2 and application name “Interactive method, interactive device, readable storage medium and electronic device”, all of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to an interaction method, an interaction device, a readable storage medium, and an electronic device. Background Art

[0003] With the development of display technology, large screens are becoming more and more widely used. For example, in scenarios such as smart city intelligent operations centers (IOCs) and exhibition halls, large screens are often used to display interfaces.

[0004] The large-screen display interface typically includes at least one browser window, with the display content of each browser window corresponding to a web page's uniform resource locator (URL). The large-screen control device (e.g., a large-screen splicer) can obtain the display content corresponding to each browser window from a server using the URL address of the web page corresponding to each browser window, and generate the large-screen display interface.

[0005] Generally, the web page corresponding to each browser window includes at least one web page area, and the content of each web page area is determined by a URL address. If a user wants to modify the content of part of the web page or the entire web page area (hereinafter referred to as the target web page area) of a browser window (hereinafter referred to as the target browser window) in the interface displayed on the large screen to the target content, it is necessary to first determine the web page corresponding to the target browser window (hereinafter referred to as the target web page) through the client program corresponding to the large screen control device (hereinafter referred to as the large screen client). Then, the user modifies the URL address corresponding to the target web page area in the target web page to the URL address corresponding to the target content through the client corresponding to the server (hereinafter referred to as the web page client), thereby modifying the content of the target web page area in the target browser window to the target content. This operation is cumbersome and the user experience is poor.

[0006] Summary of the Invention

[0007] In view of this, the present application provides an interaction method, an interaction device, a readable storage medium, and an electronic device.

[0008] In a first aspect, the present application provides an interaction method, which is applied to a content service system, wherein the content service system includes a server and a client, and the server is used to store web pages; and the method includes: the client obtains a first image obtained by a first electronic device shooting a first interface displayed by a second electronic device, wherein the first interface includes N display windows of web pages stored by the server, each display window carries a web page identifier of the displayed web page, and N is a natural number greater than or equal to 1; the client obtains the web page identifiers carried by M display windows included in the first image from the first image, where M is less than or equal to N, and obtains web page layout information of M web pages corresponding to the M display windows from the server based on the web page identifiers carried by the M display windows; the client displays a second interface through the first electronic device based on the web page layout information of the M web pages, wherein the second interface includes an object area corresponding to a content object in each web page; in response to a user's operation of selecting the first object area in the second interface, the client sends a first instruction to the server, wherein the first object area is an object area corresponding to a first content object in the first web page, and the first instruction is used to instruct the server to replace the first content object in the stored first web page with the second content object selected by the user.

[0009] Through this method, a user captures the screen of a second electronic device (e.g., a display device) using a first electronic device (e.g., a control device hereinafter) and selects a second content object (e.g., a target content hereinafter) and a first object area (e.g., a web page area frame corresponding to the target object area hereinafter) on a second interface (e.g., a layout information interface hereinafter) displayed on the first electronic device. The server (e.g., server 02 hereinafter, or the server) can then replace the content corresponding to the web page area carrying the first content object on the first web page with the second content object from the first content object. In this way, in the window of the second electronic device displaying the first web page, the content originally displayed in the area displaying the first content object is also updated to the second content object. This facilitates operation and helps enhance the user's experience of updating the content displayed on the screen of the second electronic device.

[0010] Optionally, the object area in the second interface may include only the frame of the web page area corresponding to each content object, or only the content of each content object, or both the frame of the web page area corresponding to each content object and the content of each content object.

[0011] In a possible implementation of the first aspect, the first instruction includes a first uniform resource locator address corresponding to the second content object, a webpage identifier of the first webpage, and an identifier of the first content object.

[0012] Optionally, the identifier of the first content object may be a URL of the first content object, or a web page area identifier of a web page area corresponding to the first content object.

[0013] In a possible implementation of the first aspect above, the method further includes: the server, in response to the first instruction, modifies the second uniform resource locator address corresponding to the first content object to the first uniform resource locator address in the web page layout information of the first web page based on the web page identifier of the first web page and the identifier of the first content object.

[0014] In other words, the client sends a first instruction to the server storing the first webpage, causing the server to modify the second uniform resource locator address corresponding to the first content object stored in the first webpage to the first uniform resource locator address (e.g., the target URL below). Consequently, when a second electronic device accesses the first webpage via the URL of the first webpage, the content of the webpage area that originally displayed the first content object is the second content object obtained based on the first uniform resource locator address. Thus, the content displayed in the area on the screen of the second electronic device that originally displayed the first content object is updated to the second content object.

[0015] In a possible implementation of the first aspect, the first instruction includes the second content object, the webpage identifier of the first webpage, and the identifier of the first content object.

[0016] In a possible implementation of the first aspect, the method further includes: the server, in response to the first instruction, storing the second content object and generating a second uniform resource locator (URL) corresponding to the second content object; and the server, based on the webpage identifier of the first webpage and the identifier of the first content object, modifying the second uniform resource locator (URL) corresponding to the first content object to the first uniform resource locator (URL) in the webpage layout information of the first webpage.

[0017] In a possible implementation of the first aspect, the method further includes:

[0018] The server superimposes the barcode corresponding to the web page logo on the background image of the corresponding web page in the form of an invisible watermark.

[0019] In other words, when the server generates a webpage, it can superimpose the barcode corresponding to the webpage identifier on the background image of the corresponding webpage as an invisible watermark, so that the background image displayed in the display window of the second electronic device includes the barcode corresponding to the webpage identifier. In this way, because the invisible watermark is invisible to the human eye, the webpage identifier can be prevented from affecting the user's viewing experience.

[0020] In a possible implementation of the first aspect above, the client obtains the first image obtained by the first electronic device shooting the first interface displayed by the second electronic device, including: the client obtains the first image obtained by the first electronic device shooting the first interface displayed by the second electronic device in response to the user's operation of sharing the second content object on the first electronic device.

[0021] That is, the user may first select the second content object on the first electronic device (eg, in the display interface of the client), and then use the first electronic device to capture the first interface displayed by the second electronic device and select the first object area.

[0022] In a possible implementation of the first aspect above, the client sends a first instruction to the server in response to the user's operation of selecting the first object area in the second interface, including: the client displays a third interface on the first electronic device in response to the user's operation of selecting the first object area in the second interface, and the third interface includes at least one content object; the client sends the first instruction to the server in response to the user's operation of selecting a second content object among at least one content object in the third interface.

[0023] That is, after selecting a first object area on the first electronic device, the user can select a second content object to replace the first content object corresponding to the first object area.

[0024] In a second aspect, the present application provides an interactive device, which includes a control module and a service module; the service module is used to store web pages; the control module is used to: obtain a first image obtained by a first electronic device shooting a first interface displayed by a second electronic device, wherein the first interface includes N display windows of web pages stored by the service module, each display window carries a web page identifier of the displayed web page, and N is a natural number greater than or equal to 1; obtain the web page identifiers carried by M display windows included in the first image from the first image, where M is less than or equal to N, and obtain web page layout information of M web pages corresponding to the M display windows from the service module based on the web page identifiers carried by the M display windows; display a second interface through the first electronic device based on the web page layout information of the M web pages, wherein the second interface includes an object area corresponding to a content object in each web page; in response to a user selecting a first object area in the second interface, send a first instruction to the service module, wherein the first object area is an object area corresponding to a first content object in the first web page, and the first instruction is used to instruct the service module to replace the first content object in the stored first web page with the second content object selected by the user.

[0025] Based on this interactive device, a user captures the screen of a second electronic device (e.g., a display device) using a first electronic device (e.g., a control device hereinafter) and selects a second content object (e.g., a target content hereinafter) and a first object area (e.g., a web page area frame corresponding to the target object area hereinafter) on the first electronic device. This allows a service module (e.g., service module 102 hereinafter) to replace the content of the web page area carrying the first content object on the first web page with the second content object. In this way, in the window of the second electronic device displaying the first web page, the content originally displayed in the area displaying the first content object is updated to the second content object. This facilitates operation and improves the user's experience of updating the content displayed on the screen of the second electronic device.

[0026] In a possible implementation of the second aspect, the first instruction includes: a first uniform resource locator address corresponding to the second content object, a webpage identifier of the first webpage, and an identifier of the first content object.

[0027] In a possible implementation of the first aspect above, the above service module is also used to: in response to the first instruction, based on the web page identifier of the first web page and the identifier of the first content object, modify the second uniform resource locator address corresponding to the first content object in the web page layout information of the first web page to the first uniform resource locator address.

[0028] In a possible implementation of the second aspect, the service module is further configured to superimpose the barcode corresponding to the webpage identifier on the background image of the corresponding webpage in the form of an invisible watermark.

[0029] In a possible implementation of the second aspect above, the above-mentioned obtaining of the first image obtained by the first electronic device shooting the first interface displayed by the second electronic device includes: in response to the user's operation of sharing the second content object on the first electronic device, obtaining the first image obtained by the first electronic device shooting the first interface displayed by the second electronic device.

[0030] In a possible implementation of the second aspect above, the above-mentioned response to the user's operation of selecting the first object area in the second interface, sending the first instruction to the service module includes: in response to the user's operation of selecting the first object area in the second interface, displaying a third interface on the first electronic device, the third interface including at least one content object; in response to the user's operation of selecting a second content object among at least one content object in the third interface, sending the first instruction to the service module.

[0031] In a third aspect, the present application provides an interaction method, applied to a first electronic device, the method comprising: photographing a first interface displayed by a second electronic device to obtain a first image, wherein the first interface includes display windows of N web pages stored on a server, each display window carrying a web page identifier of the displayed web page, and N is a natural number greater than or equal to 1; obtaining from the first image the web page identifiers carried by the M display windows included in the first image, where M is less than or equal to N, and obtaining from the server web page layout information of the M web pages corresponding to the M display windows based on the web page identifiers carried by the M display windows; displaying a second interface based on the web page layout information of the M web pages, wherein the second interface includes an object area corresponding to a content object in each web page; in response to an operation of a user selecting the first object area in the second interface, sending a first instruction to the server, wherein the first object area is an object area corresponding to a first content object in the first web page, and the first instruction is used to instruct the server to replace the first content object stored in the first web page with the second content object selected by the user.

[0032] In a possible implementation of the third aspect above, the first instruction includes: the first instruction includes: a first uniform resource locator address corresponding to the second content object, a webpage identifier of the first webpage, and an identifier of the first content object.

[0033] In a possible implementation of the third aspect, the first instruction is used to instruct the server to replace the first content object in the stored first web page with the second content object selected by the user, including: the first instruction is used to instruct the server to modify the second uniform resource locator address corresponding to the first content object to the first uniform resource locator address in the web page layout information of the first web page based on the web page identifier of the first web page and the identifier of the first content object.

[0034] In a possible implementation of the third aspect, the first instruction includes: the second content object, the webpage identifier of the first webpage, and the identifier of the first content object.

[0035] In a possible implementation of the third aspect, the first instruction is used to instruct the server to replace the first content object in the stored first web page with the second content object selected by the user, including: the first instruction is used to instruct the server to store the second content object and generate a first uniform resource locator address corresponding to the second content object; based on the web page identifier of the first web page and the identifier of the first content object, modify the second uniform resource locator address corresponding to the first content object to the first uniform resource locator address in the web page layout information of the first web page.

[0036] In a possible implementation of the third aspect mentioned above, the above-mentioned obtaining the web page logo carried by the M display windows included in the first image from the first image includes: obtaining a barcode corresponding to the web page logo from the background image of the web page, wherein the barcode is superimposed on the background image in the form of an invisible watermark; and obtaining the corresponding web page logo based on the barcode.

[0037] In a possible implementation of the third aspect, the capturing of the first interface displayed on the second electronic device to obtain the first image includes: in response to a user's operation of sharing the second content object on the first electronic device, capturing the first interface displayed on the second electronic device to obtain the first image.

[0038] In a possible implementation of the third aspect, the sending of the first instruction to the server in response to the user selecting the first object area in the second interface includes: displaying a third interface in response to the user selecting the first object area in the second interface, the third interface including at least one content object; and sending the first instruction to the server in response to the user selecting the second content object among the at least one content object in the third interface.

[0039] In a fourth aspect, the present application provides a readable storage medium, which includes instructions. When the instructions are executed by an electronic device, the electronic device implements the interaction method provided by the above-mentioned first aspect and any possible implementation of the above-mentioned first aspect, or the interaction method provided by the above-mentioned third aspect and any possible implementation of the above-mentioned third aspect.

[0040] In a fifth aspect, the present application provides an electronic device, which includes: a memory for storing instructions; a processor for executing instructions to enable the electronic device to implement the above-mentioned third aspect and any possible implementation of the above-mentioned third aspect.

[0041] In a sixth aspect, the present application provides a program product, which, when running on an electronic device, enables the electronic device to implement the interaction method provided by the first aspect and any possible implementation of the first aspect, and the interaction method provided by the third aspect and any possible implementation of the third aspect.

[0042] In a seventh aspect, the present application provides an electronic device, which includes the above-mentioned second aspect and any possible implementation of the above-mentioned second aspect.

[0043] It should be understood that the beneficial effects of the second to seventh aspects mentioned above can be referred to the description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] FIG1 shows a schematic diagram of a scenario in which a large screen 10 displays content according to some embodiments of the present application;

[0045] FIG2A shows a schematic structural diagram of a content service system 00 according to some embodiments of the present application;

[0046] FIG2B shows a schematic diagram of a server 50 adding a webpage identifier corresponding to a webpage to the background of a webpage according to some embodiments of the present application;

[0047] FIG2C shows a schematic diagram of an interface U1 displayed on a large screen 10 according to some embodiments of the present application;

[0048] FIG2D shows a schematic diagram of a user selecting target content according to some embodiments of the present application;

[0049] FIG2E is a schematic diagram showing a user photographing a first interface using a mobile phone 60 to obtain an interface image P1 according to some embodiments of the present application;

[0050] FIG2F shows a schematic diagram of a mobile phone 60 obtaining a webpage identifier based on the interface image P1 according to some embodiments of the present application;

[0051] FIG2G shows a schematic diagram of a mobile phone 60 displaying a layout information interface U4 according to some embodiments of the present application;

[0052] FIG2H shows a schematic diagram of a server 50 updating the content of a web page W2 according to some embodiments of the present application;

[0053] FIG2I shows a schematic diagram of a generation interface U5 according to some embodiments of the present application;

[0054] FIG2J shows a schematic diagram of a layout information interface according to some embodiments of the present application;

[0055] FIG2K is a schematic diagram showing another layout information interface according to some embodiments of the present application;

[0056] FIG3 is a schematic diagram showing an interaction flow of an interaction method according to some embodiments of the present application;

[0057] FIG4 is a schematic diagram showing an interaction flow of another interaction method according to some embodiments of the present application;

[0058] FIG5 shows a schematic diagram of an interface of a smart large-screen application displayed on a mobile phone 60 according to some embodiments of the present application;

[0059] FIG6 shows a schematic diagram of a user selecting target content on an interface of a mobile phone 60 according to some embodiments of the present application;

[0060] FIG7 is a schematic diagram showing a process of an interaction method according to some embodiments of the present application;

[0061] FIG8A shows a schematic diagram of adding a webpage identifier to a webpage according to some embodiments of the present application;

[0062] FIG8B shows a schematic diagram of controlling a device to capture an interface image and obtain a target object area according to some embodiments of the present application;

[0063] FIG9 shows a schematic diagram of an application process of an interaction method according to some embodiments of the present application;

[0064] FIG10 shows a schematic structural diagram of a large screen 10 according to some embodiments of the present application;

[0065] FIG11 shows a schematic structural diagram of a mobile phone 60 according to some embodiments of the present application;

[0066] FIG12 shows a schematic structural diagram of a server 50 according to some embodiments of the present application;

[0067] FIG13 shows a schematic structural diagram of an interaction device 100 according to some embodiments of the present application. DETAILED DESCRIPTION

[0068] Illustrative embodiments of the present application include, but are not limited to, interactive methods, interactive apparatuses, readable storage media, program products, and devices.

[0069] It should be understood that the interaction method provided in the embodiments of the present application can be applied to any electronic device, including but not limited to display devices (such as large screens, display screens, smart TVs), desktop computers, laptop computers, servers, server clusters, mobile phones, tablet computers, mobile electronic devices, reader electronic devices, etc., and the embodiments of the present application are not limited.

[0070] The technical solution of this application is introduced below with reference to the accompanying drawings.

[0071] FIG1 shows a schematic diagram of a scenario in which a large screen 10 displays content according to some embodiments of the present application.

[0072] As shown in FIG1 , the scene includes a large screen 10 , a large screen splicer 20 , a large screen client 30 , a web client 40 and a server 50 .

[0073] At least one web page is stored in the server 50. Each web page includes at least one content object (e.g., image, text, file, video, playback control, animation, etc.), and each content object is hosted by a corresponding web page area. Each web page can be accessed via a URL (hereinafter referred to as the web page URL), and the content of a web page area in a web page is determined by the URL of the content object hosted in the web page area (hereinafter referred to as the web page area URL).

[0074] The large screen splicer 20 is used to obtain the display content of each browser window based on the web page URL corresponding to each browser window of the large screen 10 display interface recorded in the large screen layout information. The large screen splicer 20 is also used to generate a display interface corresponding to the large screen 10 based on the obtained display content and output the display interface to the large screen 10.

[0075] The large screen client 30 is used for interaction with the large screen splicer 20. Users can interact with the large screen splicer 20 through the client 30, set at least one browser window on the interface of the large screen 10, obtain the large screen layout information corresponding to the large screen 10, and store the large screen layout information in the large screen splicer 20.

[0076] It should be understood that the large-screen layout information includes information such as the size and position of each browser window, and the URL of the web page corresponding to each browser window.

[0077] The web client 40 is used to interact with the server 50 . The user can modify the web page layout information of each web page stored in the server 50 through the web client 40 , such as the web page area URL corresponding to each web page area in the web page.

[0078] When generating the display interface of the large screen 10, the large screen splicer 20 can first obtain the webpage URL corresponding to each browser window recorded in the large screen layout information of the large screen 10, and obtain the display content corresponding to each browser window from the server 50. Then, the large screen splicer 20 can generate an interface corresponding to the large screen 10 based on the aforementioned large screen layout information and the display content of each browser window, and output the interface to the large screen 10.

[0079] In some embodiments, if the user needs to update the content of a certain display area in the target browser window to the target content, the user first finds the target web page URL of the target web page corresponding to the target browser window through the large-screen client 30. Then, the user interacts with the server 50 through the web client 40, finds the target web page on the server 50 based on the target web page URL, and modifies the web page area URL of the target web page area corresponding to the display area in the web page layout information corresponding to the target web page to the URL corresponding to the target content (hereinafter referred to as the target URL). As a result, when the large-screen splicer 20 obtains the display content corresponding to the target browser window based on the web page URL of the target browser window, it obtains the content corresponding to the display area based on the target URL. Updating the content of the target web page area in the target browser window in the display interface of the large screen 10 to the target content in the above manner is cumbersome and the user experience is poor.

[0080] To solve the above problem, the present application provides an interactive method, in which the server 50 can add the web page identifier corresponding to each web page to the web page (for example, to an image in the web page) when generating each web page, so that when the large screen splicer 20 obtains the display content corresponding to each browser window, it can obtain the web page identifier corresponding to the web page and add the web page identifier to the display interface and send it to the large screen 10, so that the interface displayed by the large screen 10 includes the web page identifier of the web page corresponding to each browser window. When the user wants to modify the content displayed in a browser window in the large screen 10, he can use a control device, such as a mobile phone, to take a picture of the display interface of the large screen 10. Then, the control device can obtain the web page layout information of each web page based on the web page identifier in the display interface (for example, the distribution of content objects or web page areas in each web page, etc.). Then, the control device can display a layout information interface, which may include object areas corresponding to the content objects in each web page (for example, the specific content of each content object, the web page area frame that carries each content object, etc.). The user can select the target object area where the target content is to be displayed from the layout interface, so that the control device can send the web page area identifier (hereinafter referred to as the target area identifier) ​​of the web page area (hereinafter referred to as the target web page area) that carries the content object corresponding to the target object area, the web page identifier of the target web page (the web page where the content object corresponding to the target object area is located), and the target URL corresponding to the target content to the server 50, so that the server 50 can modify the web page area URL corresponding to the target web page area in the target web page to the target URL.

[0081] It should be understood that the web page identifier may be the URL of a web page, or may be other identifiers that can indicate a web page, which is not limited here.

[0082] In this way, when the large screen splicer 20 obtains the content of the target web page according to the web URL of the target web page, it can obtain the display content (target content) corresponding to the target web page area according to the target URL, so that in the interface displayed by the large screen 10, the content displayed in the display area corresponding to the target web page area is the target content.

[0083] Through the interactive method provided in the present application, the user can update the content of the target web page area by controlling the device to shoot the interface of the large screen 10, and selecting the target object area and target content on the control device, thereby updating the content of the display area displaying the target web page area on the large screen 10. The operation is convenient and conducive to improving the user experience.

[0084] For ease of description, in the following embodiments, the device used to display the interface will be referred to as a display device (such as the aforementioned large screen 10), the device that obtains the content of a web page or file from a server (or other device) via a URL address and generates the interface of the display device based on the obtained content will be referred to as a display device (such as the aforementioned large screen splicer 20), and the device that can capture images and communicate with the server will be referred to as a control device (such as a mobile phone, tablet computer, personal digital assistant (PDA)), etc.).

[0085] 2A shows a schematic structural diagram of a content service system 00 according to some embodiments of the present application. The content service system 00 is used to provide display content to a display device.

[0086] 2A , a content service system 00 may include a client 01 and a server 02 .

[0087] Server 02 runs on a server and can be web page management software. Server 02 can be used to add a web page identifier to the web page's content when generating a web page. For example, the web page identifier can be added to an image on the web page (e.g., the background image) via an invisible watermark. In this way, the display content corresponding to each browser window retrieved from the server by the display device includes the invisible watermark, so that the display interface generated by the display device also includes the invisible watermark corresponding to each web page identifier.

[0088] Client 01 runs on the control device and can be used to:

[0089] The acquisition control device photographs the first interface in response to the user's operation to obtain an interface image, and obtains the web page identifier of the web page corresponding to each browser window in the first interface based on the invisible watermark in the interface image.

[0090] The webpage layout information of the webpage corresponding to each browser window is obtained from the server 02 based on the obtained webpage identifier.

[0091] Based on the acquired web page layout information, a layout information interface is displayed on the control device. The layout information interface may include object areas corresponding to content objects in each web page (such as specific content of each content object, web page area frames carrying each content object, etc.).

[0092] According to the target object area selected by the user in the layout information interface detected by the control device, the target area identifier, the web page identifier of the target web page and the target URL are sent to the server 02, so that the server 02 modifies the web page area URL of the target web page area in the target web page to the target URL.

[0093] In this way, when the display device obtains the content of the target webpage, it can obtain the target content according to the target URL, so that in the interface generated by the display device, the content of the target webpage area is the target content.

[0094] It should be understood that the client 01 can be an independent application, a small program, or a plug-in, etc. The form of the client 01 is not limited here.

[0095] It should be understood that in some embodiments, the display device and the display device may also be integrated into the same device.

[0096] Through the interactive method provided by this application, a user can control a device to capture the interface of a display device and select a target object area and target content. This method can then update the content in the target web page area through the client 01 and the server 02, thereby updating the content in the display area of ​​the display device that displays the target web page area. This is convenient and helps improve the user experience. Furthermore, since the web page identifier corresponding to the web page is added to the content of the web page in the form of an invisible watermark, it will not affect other content on the web page, which helps improve the user experience.

[0097] The following takes the control device as a mobile phone 60, the display device as a large screen 10, the display device as a large screen splicer 20, and the server as a server 50 as an example, and introduces the technical solution of the present application in combination with Figures 2A to 2I.

[0098] It should be understood that the following content with the mobile phone 60 as the execution subject can be executed by the aforementioned client 01; the following content with the server 50 as the execution subject can be executed by the aforementioned server 02.

[0099] According to some embodiments of the present application, Figure 2B shows a schematic diagram of a server 50 adding a web page logo corresponding to a web page to the background of a web page; Figure 2C shows a schematic diagram of an interface U1 displayed on a large screen 10 according to some embodiments of the present application; Figure 2D shows a schematic diagram of a user selecting target content according to some embodiments of the present application; Figure 2E shows a schematic diagram of a user photographing a first interface through a mobile phone 60 to obtain an interface image P1 according to some embodiments of the present application; Figure 2F shows a schematic diagram of a mobile phone 60 obtaining a web page logo based on the interface image P1 according to some embodiments of the present application; Figure 2G shows a schematic diagram of a mobile phone 60 displaying a layout information interface U4 according to some embodiments of the present application; Figure 2H shows a schematic diagram of a server 50 updating the content in a web page W2 according to some embodiments of the present application; Figure 2I shows a schematic diagram of a generation interface U5 according to some embodiments of the present application.

[0100] Referring to Figure 2B, the server 50 stores web page W1, web page W2, and web page W3, wherein web page W2 includes web page area WS1 and web page area WS2. The web page identifier corresponding to web page W1 is "WEB1", the web page identifier corresponding to web page W2 is "WEB2", and the web page identifier corresponding to web page W3 is "WEB3". In the process of generating web page W1, web page W2, and web page W3 according to user operations, the server 02 running in the server 50 can convert "WEB1", "WEB2", and "WEB3" into barcodes Q1, Q2, and Q3, respectively. Then, the server 02 can use an encryption algorithm to superimpose barcodes Q1, Q2, and Q3 onto the background images of web page W1, web page W2, and web page W3, respectively, in the form of invisible watermarks.

[0101] It should be understood that an invisible watermark is a method of adding image B to image A in a manner invisible to the human eye by modifying the values ​​of at least some pixels in image A using an encryption algorithm. Using a corresponding decryption algorithm, the electronic device can decrypt image A with the invisible watermark to obtain image B. Because the invisible watermark is invisible to the human eye, adding the webpage logo corresponding to the browser window to the first interface as an invisible watermark does not affect the user's visual experience when viewing the display device interface.

[0102] It should be understood that when the barcode corresponding to the webpage logo of the webpage is added to the background image of the webpage, only one invisible watermark can be added, or multiple invisible watermarks can be added, which is not limited here. That is, in the interface displayed on the large screen 10, the webpage logo included in a window can be one or more.

[0103] It should be understood that in some embodiments, part of the content in the web page stored in the server 50 may also be stored in other devices, for example, videos, images, audio and other files in the web page may also be stored in other devices, which is not limited here.

[0104] Referring to Figure 2C, the windows corresponding to the interface displayed on the large screen 10 include window WD1, window WD2, and window WD3. The web pages corresponding to window WD1, window WD2, and window WD3 are the aforementioned web page W1, web page W2, and web page W3, respectively. The large screen splicer 20 can obtain the content of web page W1, web page W2, and web page W3 from the server 50 through the web page URLs corresponding to web page W1, web page W2, and web page W3. After obtaining the content of web page W1, web page W2, and web page W3, the large screen 10 can add the content of web page W1, web page W2, and web page W3 to window WD1, window WD2, and window WD3, respectively, to obtain interface U1 (as the first interface). In addition, the interface U1 includes the invisible watermark ID1 corresponding to the web page identifier of web page W1, the invisible watermark ID2 corresponding to the web page identifier of web page W2, and the invisible watermark ID3 corresponding to the web page identifier of web page W1.

[0105] Referring to Figure 2D, the client 01 (e.g., a smart large-screen application) in the mobile phone 60 (as a control device) can display thumbnails of content objects (e.g., web pages, videos, images, web page areas, etc.) that can be added to various web pages in the aforementioned server 50 in the interface U2, such as the thumbnail of the video web page C1 (as the target content). When the mobile phone 60 detects that the user long presses the thumbnail C1, the smart large-screen application displays a prompt box C2 through the mobile phone 60. When the mobile phone 60 detects that the user clicks the "Share" control in the prompt box C2, the smart large-screen application enters the shooting interface U3 shown in Figure 2E, and displays the prompt message "Please point the camera at the large screen and shoot the large screen image" on the shooting interface U3. When the mobile phone 60 detects that the user clicks the shooting control U31, it can capture the interface image P1 corresponding to the first interface.

[0106] Referring to Figure 2F , client 01 (e.g., a smart screen application) in mobile phone 60 can decrypt interface image P1 using a decryption algorithm corresponding to the encryption algorithm used by server 50, obtaining the aforementioned barcodes Q1, Q2, and Q3 corresponding to invisible watermarks ID1, ID2, and ID3, respectively. The smart screen application can then convert barcodes Q1, Q2, and Q3 into webpage identifiers corresponding to webpages W1, W2, and W3, respectively: "WEB1," "WEB2," and "WEB3."

[0107] Referring to FIG2G , the smart large screen application can interact with the server 02 through the web page identifier "WEB1", the web page identifier "WEB2", and the web page identifier "WEB3", obtain the web page layout information of web pages W1, W2, and W3 from the server 50 (for example, the distribution of web page areas in the web page, including the location and size of the web page areas, etc.), and display it in the layout information interface U4 of the mobile phone 60 in a corresponding proportion. In the layout information interface U4, the distribution of the browser window frames (as object areas) corresponding to web pages W1, W2, and W3 (browser window frame B1, browser window frame B2, and browser window frame B3, respectively) is the same as the distribution of web pages W1, W2, and W3 in the first interface. Among them, since web page W2 includes multiple web page areas (web page area WS1 and web page area WS2), the browser window frame B2 includes a web page area frame B21 (as an object area) corresponding to web page area WS1 and a web page area frame B22 (as an object area) corresponding to web page area WS2.

[0108] 2H , the smart large screen application can detect on the mobile phone 60 that the user has selected the web page area box B22 corresponding to the web page area WS2 (as the target object area), and send the web page identifier (WEB2, as the web page identifier of the target web page) corresponding to the web page W2 where the web page area WS2 is located, the area identifier of the web page area WS2 (WS2, as the target area identifier), and the URL (URL1, as the target URL1) corresponding to the video web page C1 to the server 20. The server 20 can modify the web page area URL corresponding to the web page area WS2 in the web page W2 stored in the server 50 to the target URL (URL1).

[0109] Referring to Figure 2I, when the large screen splicer 20 obtains the content of the web page area WS2 based on the URL of the web page W2, it can obtain the video web page C1 based on the target URL (URL1), and obtain the display interface U5 of the large screen 10 based on the video web page C1. In this way, in the interface displayed on the large screen 10, the content corresponding to the web page area WS2 in the web page W2 is updated to the content of the video web page C1.

[0110] Based on the above method, the user can modify the display content of the target web page area by controlling the device to shoot the display interface of the display device, and selecting the target object area and target content in the layout information interface displayed by the control device, thereby updating the content of the display area displaying the target web page area on the display device. The operation is convenient and conducive to improving the user experience.

[0111] It should be understood that the aforementioned layout information interface U4 is only an example, and in other embodiments, the layout information interface may be displayed in other ways. For example, referring to FIG2J , the object area in the layout information interface that can be displayed by the mobile phone 60 may include a frame of a web page area corresponding to the content object (such as a browser window frame B1, a browser window frame B2, a browser window frame B3, a web page area frame B21, and a web page area frame B22), as well as the specific content of the content object carried by the web page area. For another example, referring to FIG2K , the mobile phone 60 may not display the browser window frame and the web page area frame, but only display the content of each web page, that is, the object area may only include the specific content of the content object.

[0112] The technical solution of the present application is introduced below in conjunction with Figures 2B to 2H.

[0113] FIG3 shows a schematic diagram of an interaction flow of an interaction method according to some embodiments of the present application. As shown in FIG3 , the method includes the following steps:

[0114] S301: When generating a web page, the server adds a web page logo to the background image of the web page by means of an invisible watermark.

[0115] The server 02 running in the server can respond to the user's operation on the client 01 and, during the process of generating a web page, add the web page logo to the background image of the web page in the form of an invisible watermark.

[0116] For example, referring to FIG2B , a web page W1, a web page W2, and a web page W3 are stored in the server 50. The web page identifier corresponding to the web page W1 is "WEB1," the web page identifier corresponding to the web page W2 is "WEB2," and the web page identifier corresponding to the web page W3 is "WEB3." In the process of generating the web pages W1, W2, and W3 according to user operations, the server 02 running in the server 50 can convert "WEB1," "WEB2," and "WEB3" into barcodes Q1, Q2, and Q3, respectively. Then, the server 02 running in the server 50 can use an encryption algorithm to superimpose the barcodes Q1, Q2, and Q3 onto the background images of the web pages W1, W2, and W3, respectively, in the form of invisible watermarks.

[0117] It should be understood that the server 02 running in the server can superimpose the barcode corresponding to the webpage logo onto the background image of the webpage in the form of an invisible watermark by any method or algorithm, which is not limited here. For example, the server 02 running in the server can adjust the values ​​of the red channel of the pixels in the area of ​​the background image of the webpage where the QR code needs to be superimposed to odd numbers, and adjust the values ​​of other color channels (such as the blue channel and the yellow channel) to even numbers, so as to superimpose the barcode corresponding to the webpage logo onto the background image of the webpage in the form of an invisible watermark.

[0118] In some embodiments, the server 02 running in the server 50 can re-encode (e.g., encrypt) the webpage identifier of the webpage, convert the re-encoded data into a barcode, and superimpose the barcode on the background image of the webpage in the form of an invisible watermark. This helps to improve data security.

[0119] S302: The display device obtains content of a web page corresponding to at least one window, and generates a first interface based on the obtained content.

[0120] The display device can obtain the content of the webpage corresponding to each window from the server based on the webpage URL of each window in the display interface of the display device, such as images (including background images superimposed with invisible watermarks), text, files (such as audio files, video files, charts, etc.) in the webpage. Then, the display device adds the content corresponding to each window to the corresponding area of ​​the first display interface to obtain the first interface.

[0121] It should be understood that the area corresponding to each browser window in the first interface includes an invisible watermark corresponding to the web page logo corresponding to each web page.

[0122] For example, referring to FIG2C , the large-screen splicer 20 (as a display device) can obtain the contents of web pages W1, W2, and W3 from the server 50, and add the contents of web pages W1, W2, and W3 to windows WD1, WD2, and WD3, respectively, to obtain interface U1 (as a first interface). In addition, interface U1 includes invisible watermark ID1 corresponding to the web page identifier of web page W1, invisible watermark ID2 corresponding to the web page identifier of web page W2, and invisible watermark ID3 corresponding to the web page identifier of web page W3.

[0123] S303: The display sending device sends the first interface to the display device.

[0124] After generating the first interface, the display sending device sends the first interface to the display device.

[0125] For example, in the situation shown in FIG. 2C , the large-screen splicer 20 may send the interface U1 to the large screen 10 .

[0126] S304: The display device displays the first interface.

[0127] The display device displays the first interface.

[0128] For example, in the situation shown in FIG. 2C , the large screen 10 may display the interface U1 .

[0129] S305: Control the device to display a shooting interface in response to the user's first operation of sharing the target content.

[0130] When the user needs to update the target content to the display device, the user can perform a first operation of sharing the target content on the interface of the client 01 running in the control device. The control device can display a shooting interface in response to the first operation of sharing the target content.

[0131] For example, referring to FIG2D , the client 01 (e.g., a smart large screen application) running on the mobile phone 60 (as a control device) can display thumbnails of content (e.g., web pages, videos, images, web page areas, etc.) that can be added to various web pages on the aforementioned server 50, such as a thumbnail of the video web page C1 (as the target content). In response to the user long pressing the thumbnail C1 and then clicking the "Share" control (as a first operation), the mobile phone 60 can display the shooting interface U3 shown in FIG2E .

[0132] It should be understood that in other embodiments, the first operation may also be other operations, which is not limited here.

[0133] S306: The control device captures an interface image corresponding to the first interface in response to the user's shooting operation.

[0134] The control device can collect the interface image corresponding to the first interface in response to the shooting operation on the shooting interface.

[0135] For example, referring to FIG. 2E , the mobile phone 60 may capture the interface image P1 corresponding to the first interface in response to the user clicking the shooting control U31 (as a shooting operation).

[0136] It should be understood that in some embodiments, the interface image corresponding to the first interface captured by the control device may include only part of the content in the first interface, or may include all the content in the first interface, which is not limited here.

[0137] S307: The control device obtains the web page identifier of the web page corresponding to each window in the first interface based on the invisible watermark in the interface image.

[0138] After the control device captures the interface image, the client 01 running in the control device can analyze the interface image to obtain the barcode corresponding to the invisible watermark in the interface image. Then, the client 01 converts the barcode into a corresponding value to obtain the webpage identifier of the webpage corresponding to each window in the first interface.

[0139] For example, referring to FIG2F , client 01 (e.g., a smart large screen application) running on mobile phone 60 can decrypt interface image P1 using a decryption algorithm corresponding to the encryption algorithm used by server 50 to obtain the aforementioned barcodes Q1, Q2, and Q3 corresponding to invisible watermark ID1, ID2, and ID3, respectively. The smart large screen application can then convert barcodes Q1, Q2, and Q3 into web page identifiers corresponding to web pages W1, W2, and W3, namely, "WEB1," "WEB2," and "WEB3," respectively.

[0140] It should be understood that in some embodiments, if the interface image corresponding to the first interface captured by the control device only includes part of the content in the first interface, the web page identifier obtained by the control device is the web page identifier in the part of the content.

[0141] S308: Control the device to obtain webpage layout information of the webpage corresponding to each window in the first interface from the server.

[0142] After obtaining the webpage identifiers of the webpages corresponding to the windows in the first interface, the client 01 running in the control device can obtain webpage layout information of the webpages corresponding to the windows in the first interface from the server based on the webpage identifiers of the webpages.

[0143] It should be understood that the webpage layout information includes the size of the webpage and the distribution of webpage regions in the webpage (eg, the size of the webpage regions, the position of the webpage regions in the webpage, etc.).

[0144] It should be understood that in some embodiments, if the interface image corresponding to the first interface collected by the control device only includes part of the content in the first interface, the web page layout information obtained by the control device may be the web page layout information of the web page corresponding to the web page identifier in the part of the content.

[0145] S309: Control the device to display a layout information interface based on the webpage layout information.

[0146] After obtaining the web page layout information of the web pages corresponding to each window in the first interface, the client 01 running in the control device displays the layout information interface based on the web page layout information. The layout information interface may include object areas corresponding to the content objects in each web page (for example, each content object itself, a web page area frame of the web page area carrying each content object, etc.).

[0147] Exemplarily, the control device may display the layout information interface in a corresponding proportion based on the size of each web page, the size of the web page area in each web page, the position of the web page area in the web page, and the size and position of the browser window corresponding to each web page. The layout information interface includes window frames corresponding to each browser window, web page area frames of the web page area in the web page corresponding to the browser window, etc. In some embodiments, the distribution of each window frame in the layout information interface corresponds to the distribution of each browser window in the first interface (e.g., displayed in equal proportion), and the distribution of each web page area frame in the window frame corresponds to the distribution of each web page area in the corresponding web page (e.g., displayed in equal proportion).

[0148] For example, referring to FIG2G , the client 01 running in the mobile phone 60 can display a layout information interface U4 corresponding to the interface U1 based on the web page layout information of the web page W1, the web page W2, and the web page W3. In the layout information interface U4, the distribution of the browser window frames (as object areas) corresponding to the web pages W1, the web page W2, and the web page W3 (respectively, the browser window frame B1, the browser window frame B2, and the browser window frame B3) is the same as the distribution of the web pages W1, the web page W2, and the web page W3 in the first interface. In particular, since the web page W2 includes multiple web page areas (web page area WS1 and web page area WS2), the browser window frame B2 includes a web page area frame B21 (as an object area) corresponding to the web page area WS1 and a web page area frame B22 (as an object area) corresponding to the web page area WS2.

[0149] It should be understood that in some embodiments, the size and position of the browser window corresponding to each web page can be obtained from the layout information of the display device (such as the aforementioned large-screen layout information).

[0150] It should be understood that in some embodiments, if the interface image corresponding to the first interface captured by the control device only includes part of the content in the first interface, the information interface displayed by the control device may only include the web page layout information of the web page corresponding to the part of the content.

[0151] S310: In response to the user selecting a target object area in the layout information interface, the control device sends a target area identifier, a target webpage identifier, and a target URL to a server.

[0152] After displaying the layout information interface, the client 01 running in the control device may send the target area identifier, the target webpage identifier and the target URL to the server in response to the user selecting the target object area in the layout information interface.

[0153] For example, referring to Figure 2H, the client 01 running in the mobile phone 60 can respond to the user's operation of selecting the web page area box B22 corresponding to the web page area WS2 (as the target object area), and send the web page identifier (WEB2, as the web page identifier of the target web page) corresponding to the web page W2 where the web page area WS2 is located, the area identifier (WS2, as the target area identifier) ​​of the web page area WS2 and the URL (URL1, as the target URL) corresponding to the video web page C1 to the server 50.

[0154] In some embodiments, the control device may also send the target content to the server, which generates a target URL corresponding to the target content and modifies the URL corresponding to the target object area of ​​the target webpage to the target URL generated by the server.

[0155] S311: The server modifies the web page area URL corresponding to the target web page area in the target web page into the target URL.

[0156] After receiving the target area identifier, the target webpage identifier, and the target URL, the server 02 running on the server can find the webpage layout information of the target webpage based on the target webpage identifier. Then, the server can find the target webpage area in the webpage layout information of the target webpage based on the target area identifier and modify the webpage area URL corresponding to the target webpage area to the target URL.

[0157] For example, referring to FIG. 2H , the server 02 running in the server 50 may modify the web page area URL corresponding to the web page area WS2 in the web page W2 to the target URL.

[0158] S312: The display device obtains content of the web page corresponding to at least one window, and generates a second interface based on the obtained content.

[0159] The display device can obtain the content of the web page corresponding to each window from the server based on the web page URL of each window in the layout information of the display device (such as the aforementioned large-screen layout information), such as images (including background images superimposed with invisible watermarks), text, and files (such as audio files, video files, charts, etc.) in the web page. Then, the display device adds the content corresponding to each window to the corresponding area of ​​the display interface to obtain the second interface.

[0160] For example, referring to Figures 2C and 2H , mobile phone 60 can retrieve the content of web pages W1, W2, and W3, where the content in web page area WS2 of web page W2 is obtained based on the target URL (URL1). The display device then adds the content of web pages W1, W2, and W3 to windows WD1, WD2, and WD3, respectively, resulting in display interface U5 (as the second interface). In display interface U5, the content in web page area WS2 is the content of video web page C1.

[0161] S313: The display device outputs the second interface to the display device.

[0162] After generating the second interface, the display sending device sends the second interface to the display device.

[0163] For example, in the situation shown in FIG. 2I , the large-screen splicer 20 may send the interface U5 to the large screen 10 .

[0164] S314: The display device displays the second interface.

[0165] The display device displays the second interface.

[0166] For example, in the situation shown in FIG. 2I , the large screen 10 may display the interface U5 .

[0167] Through the method provided in the embodiment of the present application, the user can modify the display content of the web page area corresponding to the target object area by controlling the device to capture the display interface of the display device and selecting the target object area and target content in the layout information interface displayed by the control device. The operation is convenient and conducive to improving the user experience.

[0168] It should be understood that in some embodiments, the display device and the display device may be the same device, and the same device executes the contents of the aforementioned steps S302 to S304 and steps S311 to S313, which is not limited here.

[0169] It should be understood that the execution order of the steps shown in Figure 3 is only an example. In other embodiments, the execution order of some steps can be adjusted, and some steps can be combined or split, which is not limited here. The embodiment of the present application also provides another interaction method. Compared with the embodiments shown in Figures 2B to 3, in this method, the user can first select the target object area, and then select the target content to be updated to the web page area corresponding to the target object area.

[0170] For example, FIG4 shows a schematic diagram of an interaction process of another interaction method according to some embodiments of the present application. As shown in FIG4 , the method includes the following steps:

[0171] S401: When generating a web page, the server adds a web page logo to the background image of the web page by means of an invisible watermark.

[0172] The server 02 running in the server can respond to the user's operation on the client 01 and, during the webpage generation process, add the webpage logo to the background image of the webpage by invisible watermarking.

[0173] S402: The display device obtains content of a web page corresponding to at least one window, and generates a first interface based on the obtained content.

[0174] The display device can retrieve the webpage content corresponding to each window in the display interface of the display device from the server based on the webpage URL of each window, such as images (including background images superimposed with invisible watermarks), text, and files (such as audio files, video files, and charts) in the webpage. The display device then adds the content corresponding to each window to the corresponding area of ​​the first display interface, thereby obtaining the first interface. For details, please refer to the aforementioned step S302 and will not be repeated here.

[0175] S403: The display sending device sends the first interface to the display device.

[0176] After generating the first interface, the display device sends the first interface to the display device. For example, in the scenario shown in FIG2C , the large screen splicer 20 may send the interface U1 to the large screen 10 .

[0177] S404: The display device displays the first interface.

[0178] The display device displays the first interface. For example, in the situation shown in FIG2C , the large screen 10 may display the interface U1.

[0179] S405: The control device displays a shooting interface in response to the second operation of sharing the content with the display device.

[0180] When the user needs to update the content in the display interface of the display device, the user can perform a second operation of sharing the content to the display device on the client 01 running in the control device. The control device can display the shooting interface in response to the second operation.

[0181] For example, referring to FIG5 , the client 01 (e.g., a smart large screen application) running on the mobile phone 60 (as a control device) can display an interface U6, which includes controls corresponding to various functions in the smart large screen application, such as the "Scan" control U61. In response to the user clicking the "Scan" control U61 (as a second operation), the mobile phone 60 can display the shooting interface U3 shown in FIG2E .

[0182] S406: The control device captures an interface image corresponding to the first interface in response to the user's shooting operation.

[0183] The control device can collect the interface image corresponding to the first interface in response to the shooting operation on the shooting interface.

[0184] For example, referring to FIG. 2E , the mobile phone 60 may capture the interface image P1 corresponding to the first interface in response to the user clicking the shooting control U31 (as a shooting operation).

[0185] It should be understood that in other embodiments, after displaying the shooting interface, the control device may not need to accept the user's shooting operation, but may directly continuously capture images and identify whether the captured images contain an invisible watermark. If the control device identifies that the captured images contain an invisible watermark, the process proceeds to step S407.

[0186] S407: The control device obtains the web page identifier of the web page corresponding to each window in the first interface based on the invisible watermark in the interface image.

[0187] After the control device captures the interface image, client 01 running on the control device can decrypt the interface image to obtain the barcode corresponding to the invisible watermark in the interface image. Client 01 then converts the barcode into a corresponding value to obtain the webpage identifier of the webpage corresponding to each window in the first interface. For details, please refer to the aforementioned step S307 and will not be repeated here.

[0188] S408: Control the device to obtain webpage layout information of the webpage corresponding to each window in the first interface from the server.

[0189] After obtaining the webpage identifiers of the webpages corresponding to the windows in the first interface, the client 01 running in the control device can obtain webpage layout information of the webpages corresponding to the windows in the first interface from the server based on the webpage identifiers of the webpages.

[0190] It should be understood that the webpage layout information includes the size of the webpage, the size of the webpage area in the webpage, the position of the webpage area in the webpage, and the like.

[0191] S409: Control the device to display a layout information interface based on the webpage layout information.

[0192] After acquiring the webpage layout information of the webpages corresponding to the windows in the first interface, the client 01 running in the control device displays the layout information interface on the control device based on the webpage layout information.

[0193] S410: Controlling the device to display a content selection interface in response to a user selecting a target object area on the layout information interface.

[0194] In response to the user selecting the target object area in the layout information interface, the client 01 running in the control device may display a content selection interface that may include thumbnails of content objects that can be shared to the target webpage area corresponding to the target object area.

[0195] For example, referring to FIG6 , in response to a user selecting the web page area box B22 corresponding to the web page area WS2 (as the target object area) in the aforementioned layout information interface U4, the mobile phone 60 may display a content selection interface U7. The interface U7 may include thumbnails of content that can be shared to the target web page area corresponding to the target object area, such as a thumbnail of the aforementioned video web page C1.

[0196] In some embodiments, the thumbnail of the content displayed in the content selection interface may be obtained by the control device from a server or other device.

[0197] S411: In response to the user selecting target content on the content selection interface, the control device sends a target area identifier, a target webpage identifier, and a target URL to the server.

[0198] After displaying the content selection interface, the client 01 running in the control device may send a target area identifier, a target webpage identifier, and a target URL to the server in response to a user selecting target content on the content selection interface.

[0199] For example, referring to Figure 6, the client 01 running in the mobile phone 60 can send the target area identifier (WS2), the web page identifier (WEB2) of the target web page and the target URL (URL1 corresponding to the video web page C1) to the server in response to the user clicking the thumbnail of the video web page C1 (as the target content) in the content selection interface U7.

[0200] S412: The server modifies the web page area URL corresponding to the target web page area in the target web page into the target URL.

[0201] After receiving the target area identifier, the target webpage identifier, and the target URL, the server 02 running on the server can find the webpage layout information of the target webpage based on the target webpage identifier. Then, the server 02 can search the webpage layout information for the target webpage area based on the target area identifier and modify the webpage area URL corresponding to the target webpage area to the target URL.

[0202] For example, referring to FIG. 2H , the server 02 running in the server 50 may modify the web page area URL corresponding to the web page area WS2 in the web page W2 to the target URL (URL1).

[0203] S413: The display device obtains content of the web page corresponding to at least one window, and generates a second interface based on the obtained content.

[0204] The display device can obtain the content of the web page corresponding to each window from the server based on the web page URL of each window in the layout information of the display device (such as the aforementioned large-screen layout information), such as images (including background images superimposed with invisible watermarks), text, and files (such as audio files, video files, charts, etc.) in the web page. Then, the display device adds the content corresponding to each window to the corresponding area of ​​the display interface to obtain the second interface.

[0205] For example, referring to Figures 2C and 2H , mobile phone 60 can retrieve the content of web pages W1, W2, and W3, where the content in web page area WS2 of web page W2 is obtained based on the target URL (URL1). The display device then adds the content of web pages W1, W2, and W3 to windows WD1, WD2, and WD3, respectively, resulting in display interface U5 (as the second interface). In display interface U5, the content in web page area WS2 is the content of video web page C1.

[0206] S414: The display device outputs the second interface to the display device.

[0207] After generating the second interface, the display sending device sends the second interface to the display device.

[0208] For example, in the situation shown in FIG. 2I , the large-screen splicer 20 may send the interface U5 to the large screen 10 .

[0209] S415: The display device displays the second interface.

[0210] The display device displays the second interface.

[0211] For example, in the situation shown in FIG. 2I , the large screen 10 may display the interface U5 .

[0212] Through the method provided in the embodiment of the present application, the user can modify the content of the target web page area by controlling the device to capture the display interface of the display device and selecting the target object area and target content in the layout information interface displayed by the control device, thereby updating the content of the display area displaying the target web page area on the display device. The operation is convenient and conducive to improving the user experience.

[0213] It should be understood that in some embodiments, the display device and the display device may be the same device, and the same device executes the contents of the aforementioned steps S402 to S404 and steps S412 to S414, which is not limited here.

[0214] Furthermore, FIG7 shows a schematic diagram of an interaction process of an interaction method according to some embodiments of the present application.

[0215] As shown in FIG7 , the interaction process may include the following steps:

[0216] S7.1, configure the web page.

[0217] Users can use applications, such as the Web Zero Code Page Configuration Tool, to configure web pages in the web server, such as setting the web page URLs of each web page and the content of the web page (including web page areas in the web page, web page area URLs corresponding to web page areas, etc.).

[0218] When the server 02 running in the web server generates a web page according to a user operation, the web page logo of the web page can be added to the background image of the web page in the form of an invisible watermark.

[0219] For example, referring to FIG8A , when a web page is generated, server 02 running in a web server first determines the web page identifier; then converts the web page identifier into a corresponding barcode; then, adds the barcode to the background image of the web page as an invisible watermark; and finally, adds the background image to the web page to generate the web page. In this way, when a large screen or other electronic device accesses the web page, the web page identifier can be obtained.

[0220] It should be understood that the method in which the web server adds the webpage logo of the webpage to the background image of the webpage in the form of an invisible watermark can refer to the aforementioned step S301 and will not be described in detail here.

[0221] S7.2, display the first interface.

[0222] The large screen can display a first interface, which can include at least one browser window. The background image of the web page in each browser window includes a web page logo of the corresponding web page. The process of generating the first interface can refer to the aforementioned steps S302 and S303, or steps S402 and S403, and will not be repeated here.

[0223] S7.3, collecting interface images, parsing interface images, displaying layout information interface, and obtaining target object areas.

[0224] When a user needs to update the content of a target webpage area in the first interface, the user can capture the first interface through the client 01 (e.g., a smart large-screen application, a mini-program, etc.) running on the control device. The client 01 running on the control device can capture the interface image corresponding to the first interface, parse the interface image to obtain layout information corresponding to the first interface, display the layout information interface, and obtain the target object area corresponding to the target webpage area selected by the user on the layout information interface.

[0225] For example, referring to FIG8B , the process of controlling the device to collect an interface image, analyze the interface image, display a layout information interface, and obtain a target object area may include:

[0226] S7.3.1, Capturing an interface image. The control device may first respond to a user operation by capturing an interface image corresponding to the first interface via a camera.

[0227] S7.3.2, parsing the interface image: The client 01 running in the control device can decrypt the collected interface image to obtain the barcode in the interface image.

[0228] S7.3.3, Decode the barcode. The client 01 running in the control device can decode the barcode to obtain the webpage identifier of each webpage in the first interface.

[0229] S7.3.4, querying web page layout information: The client 01 running in the control device can obtain web page layout information of each web page from the web server according to the web page identifier.

[0230] S7.3.5, displaying the layout information interface. The client 01 running in the control device can obtain and display the layout information interface corresponding to the first interface based on the webpage layout information of each webpage.

[0231] S7.3.6, Acquire Target Object Area: The control device may acquire the target object area selected by the user in response to a user operation.

[0232] It should be understood that in some embodiments, the specific process of controlling the device to collect interface images, analyze interface images, display the layout information interface, and obtain the target object area can refer to the aforementioned steps S305 to S310, or steps S405 to S411, and will not be repeated here.

[0233] S7.4, update the area URL of the target web page area.

[0234] The server 02 running in the web server can modify the area URL of the target web page area to the target URL according to the target area identifier, the web page identifier of the target web page and the target URL corresponding to the target content sent by the control device.

[0235] S7.5, update the interface according to the target content.

[0236] The large screen can update the interface displayed on the large screen based on the target content in the Web server. For details, please refer to the above steps S312 to S314, which will not be described in detail here.

[0237] Based on any of the interaction methods provided in the aforementioned embodiments, referring to Figure 9, the user can control the interface image, select the target content, and select the target object area on the control device, so that the application or applet in the control device can update the target content selected by the user to the large screen based on the collected interface image and user operations. The operation is convenient and helps to improve the user experience.

[0238] Furthermore, FIG10 shows a schematic diagram of the hardware structure of a large screen 10 according to some embodiments of the present application.

[0239] As shown in FIG10 , the large screen 10 may include a processor 110 , a memory 120 , a display screen 130 , a communication module 140 , a power switch 150 , an input / output interface 160 , an audio module 170 , and the like.

[0240] The processor 110 may include one or more processing units. For example, the processor 110 may include a central processing unit (CPU), an application processor (AP), a modem processor, a GPU, an image signal processor (ISP), a microcontroller unit (MCU), a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU), a field programmable gate array (FPGA), etc. In some embodiments, different processing units may be independent devices or integrated into one or more processors.

[0241] In some embodiments, the processor 110 can be used to execute instructions for the interaction methods provided in the aforementioned embodiments. For example, the processor 110 can be used to obtain the content of a web page from a server based on the large-screen layout information and the web page URL corresponding to each browser window, and to generate and display an interface instruction. For another example, the processor 110 can be used to execute instructions for receiving an interface sent by another electronic device (such as a large-screen splicer) and displaying the received interface through the display screen 130.

[0242] The memory 120 can be used to store data and instructions. For example, the memory can be used to store the aforementioned large-screen interface layout information.

[0243] The display screen 130 is used to display images, videos, etc. The display screen 130 includes at least one display panel. In some embodiments, the display screen 130 can be used to output a display interface, such as the aforementioned first display interface, the second display interface, etc.

[0244] The communication module 140 is used to enable communication between the large screen 10 and other electronic devices. The communication module 140 may include a wireless communication module and a wired communication module. In some embodiments, the communication module 140 can be used to obtain data from other electronic devices, such as obtaining a display interface from a large screen splicer or other electronic device, obtaining web page content from a server or other electronic device, and receiving user instructions or large screen layout information from a control device.

[0245] Exemplarily, the communication module 140 may include a wireless communication module that can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), etc., which are applied on the large screen 10. The wireless communication module can be one or more devices that integrate at least one communication processing module. The wireless communication module receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signal, and sends the processed signal to the processor. The wireless communication module can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0246] The power switch 150 is used to turn the large screen 10 on or off.

[0247] The input and output interface 160 includes interfaces for receiving data from other electronic devices (such as large screen splicing devices) or outputting data (such as audio, video, etc.) to other electronic devices, including but not limited to HDMI, S / PDIF (Sony / Philips digital interconnect format, developed by Sony TM and Philips TM Digital audio interface protocol developed by the company) interface, local area network (LAN) interface, universal serial bus (USB) interface, composite video (audio video, AV), etc.

[0248] The audio module 170 is used to implement the audio function of the large screen 10. The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. For example, the audio module 170 may include a speaker, a microphone, etc. The speaker, also known as a "speaker", is used to convert audio electrical signals into sound signals. The microphone 170, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0249] The structure of the large screen 10 shown in the embodiment of the application is only an example. In other embodiments, the large screen 10 may include more or fewer modules, or some modules may be merged or split, which is not limited here.

[0250] Furthermore, FIG11 shows a schematic structural diagram of a mobile phone 60 according to some embodiments of the present application, and the mobile phone 60 can be used to run the aforementioned client 01.

[0251] As shown in Figure 11, the mobile phone 60 may include a processor 610, an external memory interface 620, an internal memory 621, a universal serial bus interface 630, a charging management module 640, a power management module 641, a battery 642, an antenna 1, an antenna 2, a mobile communication module 650, a wireless communication module 660, an audio module 670, a speaker 670A, a receiver 670B, a microphone 670C, an earphone interface 670D, a sensor module 680, a button 690, a motor 691, an indicator 692, a camera 693, a display screen 694, and a subscriber identification module (SIM) card interface 695, etc. Among them, the sensor module 680 can include a pressure sensor 680A, a gyroscope sensor 680B, an air pressure sensor 680C, a magnetic sensor 680D, an acceleration sensor 680E, a distance sensor 680F, a proximity light sensor 680G, a fingerprint sensor 680H, a temperature sensor 680J, a touch sensor 680K, an ambient light sensor 680L, a bone conduction sensor 680M, and the like.

[0252] The processor 610 may include one or more processing units, for example, a central processing unit (CPU), an application processor (APP), a modem (M / D) processor, a GPU (GPU), an image signal processor (ISA), a microcontroller (MCU), a video codec (CODEC), a digital signal processor (DSP), a baseband processor (BPU), a neural network processor (NLP), a field programmable gate array (FPGA), etc. In some embodiments, different processing units may be independent devices or integrated into one or more processors.

[0253] In some embodiments, the processor 610 can be used to execute instructions of the interactive methods provided by the aforementioned embodiments, such as instructions for photographing the display interface of the large screen, instructions for obtaining the web page identifier corresponding to the invisible watermark from the large screen display interface, instructions for obtaining web page layout information based on the web page identifier, instructions for displaying the layout information interface, instructions for sending the web page identifier / target area identifier / target URL of the target web page to other devices in response to user operations, etc.

[0254] USB interface 630 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. USB interface 630 can be used to connect a charger to charge mobile phone 60, and can also be used to transfer data between mobile phone 60 and peripheral devices. For example, this interface can also be used to connect to other devices, such as projectors, smart screens, and other display devices, to obtain data / commands from other devices or send data / commands to other devices through USB interface 630.

[0255] The charging management module 640 is used to receive charging input from the charger. While charging the battery 642 , the charging management module 640 can also provide power to the device through the power management module 641 .

[0256] The power management module 641 is used to connect the battery 642, the charging management module 640 and the processor 610. The power management module 641 receives input from the battery 642 and / or the charging management module 640 to provide power to the processor 610, the internal memory 621, the display 694, the camera 693, and the wireless communication module 660.

[0257] The wireless communication function of the mobile phone 60 can be implemented through antenna 1, antenna 2, mobile communication module 650, wireless communication module 660, modem processor, and baseband processor. In some embodiments, the mobile phone 60 can communicate with other electronic devices such as large screens, large screen splicing devices, servers, etc. through the mobile communication module 650 or the wireless communication module 660.

[0258] Mobile phone 60 implements display functions through a GPU, display screen 694, and an application processor. The GPU is a microprocessor for image processing that connects display screen 694 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 610 may include one or more GPUs that execute program instructions to generate or modify display information.

[0259] Display screen 694 is used to display images, videos, etc. Display screen 694 includes a display panel. In some embodiments, mobile phone 60 may include one or N display screens 694, where N is a positive integer greater than 1. In some embodiments, display screen 694 may be used to display the aforementioned layout information interface, content selection interface, etc.

[0260] The camera 693 is used to capture still images or videos. In some embodiments, the mobile phone 60 may include one or N cameras 693, where N is a positive integer greater than 1. In some embodiments, the camera 693 can be used to capture an interface image corresponding to a display interface of a display device (e.g., a large screen).

[0261] The external memory interface 620 may be used to connect an external memory card.

[0262] The internal memory 621 can be used to store executable program code, which includes instructions. The internal memory 621 may include a program storage area and a data storage area. In some embodiments, the program storage area may store an operating system, an application required for at least one function, etc., such as instructions for the interaction methods provided in the aforementioned embodiments. The data storage area may store data created during the use of the mobile phone 60, such as the aforementioned control parameters. In addition, the internal memory 621 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, etc. The processor 610 executes various functional applications of the mobile phone 60 by running instructions stored in the internal memory 621 and / or instructions stored in a memory provided in the processor 610.

[0263] The mobile phone 60 can implement audio functions through the audio module 670, the speaker 670A, the receiver 670B, the microphone 670C, the headphone jack 670D, and the application processor.

[0264] The audio module 670 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 670 can also be used to encode and decode audio signals. The speaker 670A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 670B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 670C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 670D is used to connect wired headphones. The pressure sensor 680A is used to sense pressure signals and can convert pressure signals into electrical signals.

[0265] Touch sensor 680K, also known as a "touch device," can be mounted on display screen 694. Together, touch sensor 680K and display screen 694 form a touch screen, also known as a "touch screen." Touch sensor 680K detects operations performed on or near it. The touch sensor can transmit the detected operations to the application processor to determine the user's operation, such as the aforementioned first operation, second operation, operation to select a target object area, operation to select target content, and so on.

[0266] Buttons 690 include a power button and volume buttons. Motor 691 can generate vibration prompts. Indicator 692 can be an indicator light that can be used to indicate charging status, power level changes, messages, missed calls, notifications, etc. SIM card interface 695 is used to connect a SIM card.

[0267] It should be understood that the structure of the mobile phone 60 shown in the embodiment of the present application does not constitute a specific limitation on the mobile phone 60. In other embodiments of the present application, the mobile phone 60 may include more or fewer components than shown, or some components may be combined or separated, or the components may be arranged differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0268] The structure of the mobile phone 60 shown in the embodiment of the application is only an example. In other embodiments, the mobile phone 60 may include more or fewer modules, and some modules may be merged or split, which is not limited here.

[0269] Furthermore, FIG12 shows a schematic structural diagram of a server 50 according to some embodiments of the present application, and the server 50 can be used to run the aforementioned server 02.

[0270] As shown in FIG. 12 , the server 50 includes a processor 501 , a memory 502 , a communication module 503 , and a bus 504 .

[0271] The processor 501 may include one or more processing units. For example, the processor 501 may include a CPU, an AP, a GPU, an ISP, a DSP, an NPU, an FPGA, etc. In some embodiments, the different processing units may be independent devices or integrated into one or more processors.

[0272] In some embodiments, the processor 501 can be used to execute instructions of the interaction methods provided in the aforementioned embodiments. For example, the processor 501 can be used to execute instructions for generating a web page based on data sent by another device, for adding a web page identifier to the background image of a web page via an invisible watermark, for updating the web page area URL of a target web page area corresponding to a target object area based on a target area identifier, a web page identifier of a target web page, and a target URL sent by another device.

[0273] The memory 502 can be used to store data and instructions. For example, the memory can be used to store the webpage layout information of the aforementioned webpage.

[0274] The communication module 503 is used to enable communication between the server 50 and other electronic devices. The communication module 503 may include a wireless communication module and / or a wired communication module. In some embodiments, the communication module 503 can be used to send and / or obtain data from other electronic devices. For example, the communication module 503 can be used to obtain a target area identifier, a target webpage identifier, and a target URL. It can also be used to send webpage content, webpage layout information, etc. to other electronic devices.

[0275] The bus 504 is used to connect the processor 501 , the memory 502 and the communication module 503 .

[0276] The structure of the server 50 shown in the embodiment of the application is only an example. In other embodiments, the server 50 may include more or fewer modules, and may also merge or split some modules, which is not limited here.

[0277] An embodiment of the present application also provides a computer program product, which, when executed on an electronic device, can enable the electronic device to implement the interaction methods provided in the aforementioned embodiments.

[0278] An embodiment of the present application further provides a readable storage medium, in which instructions are stored. When the instructions are executed by an electronic device, the electronic device implements the interaction methods provided by the aforementioned embodiments.

[0279] The embodiment of the present application also provides an interactive device 100 .

[0280] As shown in Figure 13, the interactive device 100 includes a control module 101 and a service module 102. The control module 101 can be the client 01 or a control device running the client 01. The service module 102 can be the server 02 or a server running the server 02.

[0281] The control module 101 is used to obtain the control device in response to the user's operation, photograph the first interface to obtain an interface image, and obtain the web page identifier of the web page corresponding to each browser window in the first interface based on the invisible watermark in the interface image. The control module 101 can also be used to obtain and use the control device to display the layout distribution information of each browser window in the first interface (such as the distribution of each web page, the distribution of web page areas in each web page) based on the obtained web page identifier. The control module 101 can also send the area identifier corresponding to the target web page area (i.e., the target area identifier), the web page identifier of the target web page, and the target URL to the service module 102 based on the target object area selected by the user in the layout distribution information detected by the control device.

[0282] It should be understood that the process of the control module 101 implementing the relevant functions can refer to the description of the aforementioned client 01 or the aforementioned mobile phone 60, and will not be repeated here.

[0283] The service module 102 can be used to generate and store web pages, and when generating a web page, add the web page identifier of the web page to the content of the web page. For example, the web page identifier of the web page can be added to an image in the web page (such as the background image of the web page) in the form of an invisible watermark. The display device includes the invisible watermark in the display content corresponding to each browser window obtained from the service module 102, so that the display interface generated by the display device also includes the invisible watermark corresponding to the web page identifier of each web page.

[0284] The service module 102 may also be configured to modify the webpage area URL of the target webpage area in the target webpage to the target URL according to the webpage identifier, target area identifier and target URL of the target webpage sent by the control module 101 .

[0285] It should be understood that the process of the service module 102 implementing related functions can refer to the description of the aforementioned service end 02 or the aforementioned server 50, and will not be repeated here.

[0286] In the accompanying drawings, some structural or method features may be shown in a particular arrangement and / or order. However, it should be understood that such a particular arrangement and / or order may not be required. Rather, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of a structural or method feature in a particular figure does not imply that such feature is required in all embodiments, and in some embodiments, such features may not be included or may be combined with other features.

[0287] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or electronic device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or electronic device. In the absence of further restrictions, an element defined by the sentence "comprises a" does not exclude the presence of additional identical elements in the process, method, article or electronic device that includes the element.

Claims

1. An interactive method, applied to a content service system, characterized in that: The content service system includes a server and a client, the server is used to store web pages, and the method includes: The client obtains a first image obtained by the first electronic device photographing a first interface displayed by the second electronic device, wherein the first interface includes N display windows of web pages stored by the server, each display window carries a web page identifier of the displayed web page, and N is a natural number greater than or equal to 1; The client obtains web page identifiers carried by M display windows included in the first image from the first image, where M is less than or equal to N, and obtains web page layout information of the M web pages corresponding to the M display windows from the server based on the web page identifiers carried by the M display windows; The client displays a second interface through the first electronic device based on the webpage layout information of the M webpages, wherein the second interface includes an object area corresponding to a content object in each webpage; In response to a user selecting a first object area in the second interface, the client sends a first instruction to the server, wherein the first object area is an object area corresponding to a first content object in a first web page, and the first instruction is used to instruct the server to replace the first content object stored in the first web page with a second content object selected by the user.

2. The method according to claim 1, characterized in that The first instruction includes: a first uniform resource locator address corresponding to the second content object, a web page identifier of the first web page, and an identifier of the first content object.

3. The method according to claim 2, characterized in that The method further comprises: In response to the first instruction, the server modifies the second uniform resource locator address corresponding to the first content object to the first uniform resource locator address in the web page layout information of the first web page based on the web page identifier of the first web page and the identifier of the first content object.

4. The method according to claim 1, characterized in that: The method further comprises: The server superimposes the barcode corresponding to the webpage logo on the background image of the corresponding webpage in the form of an invisible watermark.

5. The method according to any one of claims 1 to 4, characterized in that The client obtains a first image obtained by the first electronic device shooting a first interface displayed by the second electronic device, including: In response to a user's operation of sharing the second content object on the first electronic device, the client obtains a first image obtained by the first electronic device photographing a first interface displayed by the second electronic device.

6. The method according to any one of claims 1 to 4, characterized in that The client sends a first instruction to the server in response to a user selecting a first object area in the second interface, including: In response to a user selecting the first object area in the second interface, the client displays a third interface on the first electronic device, wherein the third interface includes at least one content object; The client sends the first instruction to the server in response to a user selecting the second content object among the at least one content object on the third interface.

7. An interactive device, characterized in that: The interactive device includes a control module and a service module; the service module is used to store web pages; The control module is used for: Acquire a first image obtained by photographing a first interface displayed by a second electronic device by the first electronic device, wherein the first interface includes N display windows of web pages stored by the service module, each display window carries a web page identifier of the displayed web page, and N is a natural number greater than or equal to 1; Acquire web page identifiers carried by M display windows included in the first image from the first image, where M is less than or equal to N, and acquire web page layout information of the M web pages corresponding to the M display windows from the service module based on the web page identifiers carried by the M display windows; Based on the webpage layout information of the M webpages, displaying a second interface through the first electronic device, wherein the second interface includes an object area corresponding to the content object in each webpage; In response to the user selecting a first object area in the second interface, a first instruction is sent to the service module, wherein the first object area is an object area corresponding to a first content object in a first web page, and the first instruction is used to instruct the service module to replace the first content object stored in the first web page with a second content object selected by the user.

8. The device according to claim 7, characterized in that The first instruction includes: a first uniform resource locator address corresponding to the second content object, a webpage identifier of the first webpage, and an identifier of the first content object.

9. The device according to claim 8, characterized in that The service module is also used for: In response to the first instruction, based on the webpage identifier of the first webpage and the identifier of the first content object, the second uniform resource locator address corresponding to the first content object in the webpage layout information of the first webpage is modified to the first uniform resource locator address.

10. The device according to claim 7, characterized in that The service module is also used for: The barcode corresponding to the web page logo is superimposed on the background image of the corresponding web page in the form of an invisible watermark.

11. The device according to any one of claims 7 to 10, characterized in that The step of acquiring a first image obtained by capturing a first interface displayed by a second electronic device through the first electronic device includes: In response to a user's operation of sharing the second content object on the first electronic device, a first image obtained by the first electronic device photographing a first interface displayed by the second electronic device is acquired.

12. The device according to any one of claims 7 to 10, characterized in that The sending of a first instruction to the service module in response to a user selecting a first object area in the second interface includes: In response to a user selecting the first object area in the second interface, displaying a third interface on the first electronic device, wherein the third interface includes at least one content object; In response to a user selecting the second content object among the at least one content object on the third interface, the first instruction is sent to the service module.

13. An interaction method, applied to a first electronic device, characterized in that: The method comprises: Shooting a first interface displayed by a second electronic device to obtain a first image, wherein the first interface includes N display windows of web pages stored in a server, each display window carries a web page identifier of a displayed web page, and N is a natural number greater than or equal to 1; Acquire, from the first image, web page identifiers carried by M display windows included in the first image, where M is less than or equal to N, and acquire, from the server based on the web page identifiers carried by the M display windows, web page layout information of the M web pages corresponding to the M display windows; Displaying a second interface based on the webpage layout information of the M webpages, wherein the second interface includes an object area corresponding to a content object in each webpage; In response to a user selecting a first object area in the second interface, a first instruction is sent to the server, wherein the first object area is an object area corresponding to a first content object in a first web page, and the first instruction is used to instruct the server to replace the first content object stored in the first web page with a second content object selected by the user.

14. The method according to claim 13, characterized in that The first instruction includes: the first instruction includes: a first uniform resource locator address corresponding to the second content object, a web page identifier of the first web page, and an identifier of the first content object.

15. The method according to claim 14, characterized in that The first instruction is used to instruct the server to replace the first content object stored in the first webpage with a second content object selected by a user, including: The first instruction is used to instruct the server to modify the second uniform resource locator address corresponding to the first content object to the first uniform resource locator address in the web page layout information of the first web page based on the web page identifier of the first web page and the identifier of the first content object.

16. The method according to claim 13, characterized in that The step of acquiring, from the first image, web page identifiers carried by the M display windows included in the first image comprises: Obtaining a barcode corresponding to the webpage logo from the background image of the webpage, wherein the barcode is superimposed on the background image in the form of an invisible watermark; Based on the barcode, a corresponding web page identifier is obtained.

17. The method according to any one of claims 13 to 16, characterized in that The step of photographing the first interface displayed by the second electronic device to obtain the first image includes: In response to a user's operation of sharing the second content object on the first electronic device, a first interface displayed on the second electronic device is photographed to obtain a first image.

18. The method according to any one of claims 13 to 16, characterized in that In response to a user selecting a first object area in the second interface, sending a first instruction to the server includes: In response to a user selecting a first object area in the second interface, displaying a third interface, wherein the third interface includes at least one content object; In response to a user selecting the second content object among the at least one content object on the third interface, the first instruction is sent to the server.

19. A readable storage medium, characterized in that: The readable storage medium includes instructions, and when the instructions are executed by the electronic device, the electronic device implements the interaction method described in any one of claims 1 to 6, or the interaction method described in any one of claims 13 to 18.

20. An electronic device, characterized in that: include: A memory for storing instructions; A processor, configured to execute the instructions so that the electronic device implements the interaction method described in any one of claims 13 to 18.

Citation Information

Patent Citations

  • Method and apparatus for displaying page contents

    CN104850296A

  • Page updating method and device, equipment, medium and computer program product

    CN114443108A

  • Information interaction method and electronic equipment

    CN116016418A

  • Fractional download based on currently presented portions from large content pages

    US20110083082A1