Data interaction method and electronic device

Through interface data synchronization and voice interaction between the first electronic device and the second electronic device, the problem that customer service personnel cannot intuitively perceive user problems is solved, and efficient user support services are achieved.

CN114637940BActive Publication Date: 2025-09-16ZHONGAN ONLINE P&C INSURANCE CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210284656.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-22
Publication Date
2025-09-16
Estimated Expiration
2042-03-22

AI Technical Summary

Technical Problem

In the prior art, customer service personnel of an application cannot intuitively perceive the problems encountered by users during use, resulting in an inability to provide accurate and efficient assistance.

Method used

The first electronic device sends a request to the second electronic device to obtain interface data, and displays it locally, while performing voice interaction with the user to achieve synchronous display of interface data and voice call.

Benefits of technology

Customer service staff can intuitively understand the content users browse, answer user questions accurately and efficiently, protect user privacy and optimize data transmission efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114637940B_ABST
    Figure CN114637940B_ABST
Patent Text Reader

Abstract

The present application provides a data interaction method and an electronic device, which relate to the field of data transmission. In the data interaction method provided by the present application, when a user is using a second electronic device to browse a first interface, the first electronic device determines that the second electronic device displays the first interface and sends a first request to the first electronic device. The first electronic device receives the interface data of the first interface sent by the second electronic device in response to the first request. In this way, the first electronic device can display the interface data of the first interface on the second interface. In this way, the customer service personnel who maintain the first electronic device can intuitively see the content browsed by the user holding the first electronic device. The first electronic device also interacts with the first electronic device by voice in response to the confirmation operation of the second request. The customer service personnel can interact with the user by voice while browsing the first interface, so as to accurately and efficiently answer the user's questions encountered when browsing the first interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data transmission, and in particular to a data interaction method and electronic device. Background Art

[0002] At present, with the development of science and technology, electronic devices have become a part of people's work and life. Generally, electronic devices can be installed with various applications, which can allow users to realize functions such as data browsing, insurance, financial management, and shopping.

[0003] In some cases, when users are using an app to browse data, apply for insurance, manage finances, or shop, and have questions about the content on the app's interface, the app's customer service staff may not be able to intuitively understand the user's problem. As a result, the app's customer service staff cannot accurately and efficiently help users solve their problems. Summary of the Invention

[0004] In a first aspect, the present application provides a data interaction method, which is applied to a communication system, wherein the communication system includes a first electronic device and a second electronic device. The data interaction method provided by the present application includes:

[0005] When the first electronic device determines that the second electronic device displays the first interface, the first electronic device sends a first request to the second electronic device, where the first request is used to instruct the acquisition of interface data of the first interface;

[0006] The first electronic device receives the interface data of the first interface sent by the second electronic device in response to the first request;

[0007] The first electronic device displays the interface data of the first interface on the second interface;

[0008] The first electronic device receives a second request from the second electronic device, where the second request is used to indicate a voice call;

[0009] The first electronic device performs voice interaction with the second electronic device in response to a confirmation operation on the second request.

[0010] In a second aspect, the present application also provides another data interaction method, which includes:

[0011] The second electronic device displays the first interface of the first application;

[0012] In response to a trigger operation by the user, the second electronic device sends a first request to the first electronic device, where the first request is used to instruct the first electronic device to transmit interface data of the first interface to the first electronic device;

[0013] The second electronic device receives a second instruction sent by the first electronic device in response to a confirmation operation on the first request, where the second instruction is used to indicate permission to transmit the interface data of the first interface;

[0014] The second electronic device sends the interface data of the first interface to the second interface of the first electronic device for display in response to the second instruction;

[0015] The second electronic device sends a second request to the first electronic device in response to a trigger operation of the user, where the second request is used to indicate a voice call;

[0016] After the first electronic device confirms the second request, the second electronic device interacts with the first electronic device through voice.

[0017] In a third aspect, the present application also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the electronic device executes the method of the first aspect.

[0018] The data interaction method and electronic device provided by the present application are such that when a user is using a second electronic device to browse a first interface, the first electronic device determines that the second electronic device displays the first interface and sends a first request to the first electronic device. The first electronic device receives the interface data of the first interface sent by the second electronic device in response to the first request. In this way, the first electronic device can display the interface data of the first interface on the second interface. In this way, the customer service personnel who maintain the first electronic device can intuitively know the content browsed by the user holding the first electronic device. Furthermore, the first electronic device also interacts with the first electronic device by voice in response to the confirmation operation of the second request. In this way, the customer service personnel can interact with the user holding the second electronic device by voice while browsing the first interface, so as to accurately and efficiently answer questions encountered by the user when browsing the first interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0020] Figure 1 Schematic diagram of the interaction between the cloud server provided in the embodiment of the present application and the first electronic device and the second electronic device respectively;

[0021] Figure 2 One of the flow charts of the data interaction method provided in an embodiment of the present application;

[0022] Figure 3 A schematic diagram of a second interface displayed by a first electronic device according to an embodiment of the present application;

[0023] Figure 4 A schematic diagram of an interface in which, when a second electronic device displays a first interface, the first electronic device also displays interface data of the first interface on a second interface provided by an embodiment of the present application;

[0024] Figure 5 A schematic diagram of an interface in which the first information in the first interface is coded when the second electronic device displays the first interface provided by an embodiment of the present application;

[0025] Figure 6 A flowchart of an embodiment of the present application showing that when a second electronic device updates a first interface, the first electronic device also updates the first interface;

[0026] Figure 7 A flowchart of an embodiment of the present application showing that when a first electronic device updates a first interface, a second electronic device also updates the first interface;

[0027] Figure 8 A schematic diagram of a second electronic device receiving user's voice data and querying a cloud server for an answer associated with the voice data;

[0028] Figure 9 The second flowchart of the data interaction method provided in the embodiment of the present application;

[0029] Figure 10 A schematic diagram of the functional modules of the data interaction device provided in an embodiment of the present application;

[0030] Figure 11 This is a circuit connection block diagram of the electronic device provided in an embodiment of the present application.

[0031] The above drawings illustrate specific embodiments of the present application, which will be described in more detail below. These drawings and the textual description are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0032] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0033] The data interaction method provided in the embodiment of the present application is applied to a communication system. Figure 1As shown, the communication system includes a first electronic device 100, a cloud server 300, and a second electronic device 200. The first electronic device 100 may be an office computer of a customer service staff, and the second electronic device 200 may be a user's mobile phone. Figure 2 As shown, a data interaction method provided in an embodiment of the present application includes:

[0034] S201: The first electronic device 100 sends a website link of a first interface of a first application to the second electronic device 200.

[0035] For example, the first interface of the first application may be an interface for purchasing financial products of a financial application, or an interface for purchasing insurance of an insurance application, etc., which is not limited here.

[0036] In response to a triggering operation by the customer service staff, the first electronic device 100 can send a URL link of the first interface to the cloud server 300. The cloud server 300 can send a short message to the second electronic device 200 based on a pre-recorded phone number, wherein the short message includes the URL link of the first interface. The pre-recorded phone number can be the one entered by the user when registering an account with the first application.

[0037] S202: The second electronic device 200 displays the first interface of the first application in response to the user triggering the website link.

[0038] When the user is interested in the first interface of the first application, the second electronic device 200 obtains page data of the first interface from the site in response to the user's triggering operation on the URL link, and displays the first interface of the first application using the obtained page data so that the user can browse the first interface.

[0039] S203 : The second electronic device 200 sends second information to the first electronic device 100 .

[0040] The second electronic device 200 may send a second message to the cloud server 300, wherein the second message may carry the interface identifier of the first interface of the first application, and the second message is used to indicate that the second electronic device 200 is displaying the first interface. The cloud server 300 may assign a device based on the interface identifier in the first message. In this embodiment of the present application, the device assigned by the cloud server 300 is the first electronic device 100. In turn, the cloud server 300 forwards the first message to the first electronic device 100.

[0041] S204: The first electronic device 100 determines that the second electronic device 200 displays the first interface in response to the second information.

[0042] Among them, the above-mentioned S201-S204 can be omitted.

[0043] S205: When the first electronic device 100 determines that the second electronic device 200 displays the first interface, the first electronic device 100 sends a first request to the second electronic device 200, where the first request is used to instruct to obtain interface data of the first interface.

[0044] For example, Figure 3 As shown, the first electronic device 100 can display the second interface 201, which includes the text prompt "The second electronic device 200 is displaying the first interface" and a "Request Shared Screen" control 202. In response to the customer service staff triggering the "Request Shared Screen" control 202, the first electronic device 100 can send a first request to the cloud server 300. In turn, the cloud server 300 sends the first request to the second electronic device 200.

[0045] S206: The first electronic device 100 receives the interface data of the first interface sent by the second electronic device 200 in response to the first request.

[0046] After receiving the first request, the second electronic device 200 displays a prompt message "The other party requests to share the same screen" on the first interface, along with a control for indicating approval and a control for indicating rejection. After the first electronic device 100 responds to the user triggering the control indicating approval, it can send the interface data of the first interface to the first electronic device 100.

[0047] S207: The first electronic device 100 displays the interface data of the first interface on the second interface.

[0048] like Figure 4 As shown, when the second electronic device 200 is displaying the interface data of the first interface 201, the first electronic device 100 also displays the interface data of the first interface 201 on the second interface 101. In addition, the second electronic device 200 can also display a text message "This interface is on the same screen" on the first interface 201 to remind the user that the first electronic device 100 is also displaying the interface data of the first interface 201.

[0049] In addition, when the first electronic device 100 also displays the interface data of the first interface 201 on the second interface 101, the cloud server 300 will serialize the page data, compress the nodes, attributes, behaviors, and other structures of the page data according to a specified format, and then enter them into the cloud server 300. The page data can be forwarded from the second electronic device 200 to the second electronic device 200 via the cloud server 300 at predetermined intervals. The cloud server 300 can filter and clean the received data that is identical to the previous data, thereby reducing the data volume and saving storage space and computing resources.

[0050] S208: The first electronic device 100 receives a second request from the second electronic device 200, where the second request is used to indicate a voice call.

[0051] For example, the first interface of the second electronic device 200 includes a control 202 for instructing to initiate a voice call. In response to a user triggering the control 202 for initiating a voice call, the second electronic device 200 sends a second request to the cloud server 300. The cloud server 300 sends the second request to the first electronic device 100.

[0052] S209 : The first electronic device 100 interacts with the second electronic device 200 through voice in response to the confirmation operation on the second request.

[0053] For example, after receiving the second request, the first electronic device 100 may display a text message "Do you agree to voice communication?", as well as a control for indicating approval of voice communication and a control for indicating rejection of voice communication. In response to the user triggering an operation on the control for indicating approval of voice communication, the first electronic device 100 may interact with the second electronic device 200 via voice.

[0054] It should be noted that the voice data exchanged between the first electronic device 100 and the second electronic device 200 needs to be forwarded via the cloud server 300 .

[0055] In summary, the data interaction method provided by the present application is that when a user is using the second electronic device 200 to browse the first interface, the first electronic device 100 determines that the second electronic device 200 displays the first interface and sends a first request to the first electronic device 100. The first electronic device 100 receives the interface data of the first interface sent by the second electronic device 200 in response to the first request. In this way, the first electronic device 100 can display the interface data of the first interface on the second interface. In this way, the customer service personnel who maintain the first electronic device 100 can intuitively know the content browsed by the user holding the first electronic device 100. Furthermore, the first electronic device 100 also interacts with the first electronic device 100 by voice in response to the confirmation operation of the second request. In this way, the customer service personnel can interact with the user holding the second electronic device 200 by voice while browsing the first interface, so as to accurately and efficiently answer the user's questions encountered when browsing the first interface.

[0056] In addition, after the user and the customer service staff have completed the interaction through the first electronic device 100 and the second electronic device 200, the second electronic device 200 can stop sending the page data of the first interface to the first electronic device 100 in response to the user's triggering operation on the control for indicating the end of transmitting page data. Alternatively, the first electronic device 100 stops receiving the page data of the first interface to the second electronic device 100 in response to the customer service staff's triggering operation on the control for indicating the end of transmitting page data.

[0057] Alternatively, Figure 2 As shown, the method provided by the present application may also include:

[0058] S210 : The first electronic device 100 receives a first instruction sent by the second electronic device 200 after the second electronic device 200 updates the page data of the first interface 201 , where the first instruction is used to instruct to update the page data of the first interface 201 in the second interface 101 .

[0059] For example, the second electronic device 200 can update the page data of the first interface 201 in response to a trigger operation. The trigger operation includes at least one of a click operation in the first interface 201, a scroll operation, a click operation on the control 205 for indicating a mark in the first interface 201, and an operation of inputting information in the first interface 201, which is not limited here. In this way, the second electronic device 200 sends the first instruction to the first electronic device 100.

[0060] S211 : The first electronic device 100 updates the page data of the first interface 201 on the second interface 101 in response to the first instruction.

[0061] The updated page data of the first interface 201 on the first electronic device 100 is identical to the updated page data of the first interface 201 on the second electronic device 200. This allows the second electronic device 200 to synchronize the page data of the first interface 201 with the first electronic device 100. This allows the user to update the page data of the first interface 201 while customer service personnel are explaining the first interface 201 to the user, such as by scrolling the first interface 201 or marking key information on the first interface 201. This makes it easier for customer service personnel to help the user answer questions.

[0062] It should be noted that the interface data of the first interface 201 displayed on the second electronic device 200 includes the first information, and the first information is coded or deleted in the second interface 101.

[0063] Specifically, the second electronic device 200 may mark the DOM node of the first information in the page data of the first interface 201 with a first identifier, where the first identifier is used to indicate that the first information is to be coded or deleted. Before sending the page data of the first interface 201 to the first electronic device 100, the second electronic device 200 will traverse all DOM nodes and code or delete the first information of the DOM nodes with the first identifier. However, it will then send the page data of the first interface 201 to the first electronic device 100.

[0064] For example, the first information may be the user's private information such as ID number, mobile phone number, name, etc. Figure 5 As shown, the first interface 201 of the second electronic device 200 includes the user's private information, such as the ID number, mobile phone number, and name. When the user's private information, such as the ID number, mobile phone number, and name, in the first interface 201 is displayed on the second interface 101 of the second electronic device 200, the ID number, mobile phone number, and name are censored. Furthermore, the ID number, mobile phone number, and name can be deleted so that the ID number, mobile phone number, and name are not displayed on the second interface 101 of the second electronic device 200. This protects the user's privacy from being leaked.

[0065] In addition, as Figure 4 As shown, the second interface 101 includes a first control 103, and the first control 103 is used to instruct control of the second electronic device 200. After the above S207, as shown in FIG. Figure 6 As shown, the method provided by this application also includes:

[0066] S501: The first electronic device 100 sends a third request to the second electronic device 200 in response to a triggering operation on the first control, where the third request is used to instruct to control the second electronic device 200.

[0067] S502: The first electronic device 100 receives a first instruction sent by the second electronic device 200 after obtaining a confirmation operation on the third request, where the first instruction is used to indicate permission to control the second electronic device 200.

[0068] After receiving the third request, the second electronic device 200 may display a text message "Other party requests control interface" and a control for indicating control approval and a control for indicating control rejection on the first interface 201. In response to the triggering operation for the control for indicating control approval, the second electronic device 200 may send a first instruction to the first electronic device 100.

[0069] S503: The first electronic device 100 updates the page data of the first interface 201 in response to the triggering operation.

[0070] For example, the first electronic device 100 updates the page data of the first interface 201 in response to a trigger operation. The trigger operation includes at least one of a click operation in the first interface 201, a scroll operation, a click operation on the control 205 for indicating a mark in the first interface 201, and an operation of inputting information in the first interface 201, which is not limited here.

[0071] In an optional embodiment, the first electronic device 100 needs to send a page update request to the second electronic device 200. Only after the second electronic device 200 receives a confirmation operation on the page update request can the first electronic device 100 update the page data of the first interface 201.

[0072] S504: The first electronic device 100 controls the second electronic device 200 to update the interface data of the first interface 201 , wherein the updated page data of the second electronic device 200 is the same as the updated page data of the first electronic device 100 .

[0073] In this way, when the customer service staff uses the second electronic device 200 to update the page data of the first page, the first electronic device 100 synchronously updates the page data of the first interface 201, so that the customer service staff can answer questions for users more conveniently.

[0074] In another embodiment, the second electronic device 200 includes a first control 203, and the first control 203 is used to instruct control of the second electronic device 200. Figure 7 As shown, the method provided by this application may also include:

[0075] S601 : The first electronic device 100 receives a third request from the second electronic device 200 , where the third request is used to instruct to control the second electronic device 200 .

[0076] The second electronic device 200 may send a third request to the first electronic device 100 in response to the user's triggering operation on the first control 203 .

[0077] S602: After responding to the confirmation operation of the third request, the second electronic device 200 sends a first instruction to the first electronic device 100, where the first instruction is used to indicate permission to control the second electronic device 200.

[0078] After receiving the third request, the first electronic device 100 may display a text message "Other party requests control interface" and a control for indicating control approval and a control for indicating control rejection on the second interface 101. In response to the triggering operation for the control for indicating control approval, the first electronic device 100 may send a first instruction to the second electronic device 200.

[0079] S603: The first electronic device 100 updates the page data of the first interface 201 in response to the triggering operation.

[0080] The trigger operation includes at least one of a click operation in the first interface 201 , a scroll operation, a marking operation on the first interface 201 , and an operation of inputting information in the first interface 201 , which is not limited here.

[0081] S604: The first electronic device 100 controls the second electronic device 200 to update the interface data of the first interface 201 , wherein the updated page data of the second electronic device 200 is the same as the updated page data of the first electronic device 100 .

[0082] It should be noted that the above Figure 6 and Figure 7 The interactive data between the first electronic device 100 and the second electronic device 200 need to be transferred through the cloud server 300. Figure 6 and Figure 7 On the basis of the corresponding embodiment, in addition, after the user and the customer service personnel complete the interaction through the first electronic device 100 and the second electronic device 200, the first electronic device 100 can stop receiving page data from the first interface 201 of the second electronic device 200 in response to the customer service personnel's triggering operation of the control for indicating the end of transmitting page data.

[0083] In this way, when the customer service staff uses the second electronic device 200 to update the page data of the first page, the first electronic device 100 synchronously updates the page data of the first interface 201, so that the customer service staff can answer questions for users more conveniently.

[0084] The first interface 201 includes a second control, which is used to indicate voice questions and answers, such as Figure 8 As shown, the method provided by this application may also include:

[0085] S701: The second electronic device 200 collects user voice data in response to a triggering operation on a second control.

[0086] The triggering operation in S701 may be a long press operation, a click operation, etc., which are not limited here. The user's voice data may be used to indicate the question the user wants to ask.

[0087] S702 : The second electronic device 200 converts the voice data into text information and sends the text information to the cloud server 300 .

[0088] S703: The cloud server 300 searches for answers associated with the text information in a preset database based on the text information.

[0089] S704: The second electronic device 200 receives and outputs the answer from the cloud server 300.

[0090] The second electronic device 200 may output the answer in the form of voice playback or text, which is not limited here.

[0091] Through the above S701-S704, users can automatically ask questions to the database, which is convenient and fast.

[0092] In addition, the method provided in the embodiment of the present application also includes:

[0093] The cloud server 300 receives the interface data of the first interface 201 from the second electronic device 200, as well as the audio when the second electronic device 200 interacts with the first electronic device 100 by voice. The cloud server 300 obtains and stores the video data based on the interface data and audio of the first interface 201. Exemplarily, the method of generating video data can be: the data used to update the first interface 201 after the user inputs operations such as scrolling, information input, and clicking in the first interface 201 can be used as an event sequence, and each event records the time of occurrence. In this way, the event sequence and the recorded time of each event can generate video data.

[0094] This way, when a communication problem occurs between customer service personnel and users, supervisors can extract the recorded video data and play it back. This allows monitoring personnel to identify the party responsible for the problem between the customer service personnel and the user from the played video data.

[0095] In addition, the cloud server 300 can also determine the moment when the video data is generated, record the storage address of the video data, and obtain the identity information (such as the number) of the customer service personnel from the first electronic device 100, wherein the storage address of the video data, the moment when the video data is generated, and the identity information of the customer service personnel correspond one to one. In this way, when there is a problem in the communication between the customer service personnel and the user, the supervisor can retrieve the storage address of the video data based on the identity information of the customer service personnel and the moment when the video data is generated, and the retrieval efficiency is high. In this way, the supervisor can quickly find the video data and play it based on the storage address of the video data. In addition, in order to ensure the integrity and non-tamperability of the video data, the video data is decentralized blockchain management, and a blockchain token is generated, so that the video data can be quickly retrieved.

[0096] It should be noted that the second electronic device 200 also includes: a control 206 for indicating the addition of additional functions. In the above embodiment, the first interface 201 of the second electronic device 200 includes a control 202 for indicating the initiation of voice, a first control 203, a second control 204, and a control 205 for indicating a mark in the first interface 201. After the second electronic device 200 responds to the user's triggering operation on the control 206 indicating the addition of additional functions, the first electronic device 100 loads and displays the plug-ins corresponding to the controls 202, 203, 204, and 205, respectively. In this way, when the page data of the first page obtained by the first electronic device 100 from the site does not include the plug-ins corresponding to the controls 202, 203, 204, and 205, respectively, the risk of blocking the page data of the first interface 201 can be reduced.

[0097] See also Figure 9 , the embodiment of the present application also provides another data interaction method, which is applied to a communication system. Figure 1 As shown, the communication system includes a first electronic device 100, a cloud server 300, and a second electronic device 200. The cloud server 300 is connected to the first electronic device 100 and the second electronic device 200 for communication. The first electronic device 100 can be a customer service staff's office computer, and the second electronic device 200 can be a user's mobile phone. Figure 9 As shown, a data interaction method provided in an embodiment of the present application includes:

[0098] S801: The second electronic device 200 displays a first interface of a first application.

[0099] S802: The second electronic device 200 sends a first request to the first electronic device 100 in response to a triggering operation of the user, where the first request is used to instruct the transmission of interface data of the first interface to the first electronic device 100.

[0100] S803: The second electronic device 200 receives a second instruction sent by the first electronic device 100 in response to a confirmation operation on the first request, where the second instruction is used to indicate permission to transmit the interface data of the first interface.

[0101] S804: The second electronic device 200 sends the interface data of the first interface to the second interface of the first electronic device 100 for display in response to the second instruction.

[0102] S805: The second electronic device 200 sends a second request to the first electronic device 100 in response to a triggering operation by the user, where the second request is used to indicate a voice call.

[0103] S806: After the first electronic device 100 confirms the second request, the second electronic device 200 interacts with the first electronic device 100 through voice.

[0104] With the above Figure 2 The difference between the embodiments described is that Figure 2 The embodiment described is that the customer service staff requests the first electronic device 100 to obtain the page data of the first interface of the second electronic device 200, and realizes the synchronous display of the page data of the first interface of the second electronic device 200 on the first electronic device 100. Figure 9 In the embodiment described, the user requests the second electronic device 200 to transmit the page data of the first interface to the first electronic device 100, so that the first electronic device 100 can synchronously display the page data of the first interface of the second electronic device 200. It can be understood that Figure 9 The principles and Figure 2 The principles and effects of the embodiments introduced are similar and will not be described in detail here.

[0105] See also Figure 10 , the present application also provides a data interaction device 1000, which is applied to a first electronic device 100. The first electronic device 100 and the second electronic device 200 are connected in communication via a cloud server 300. It should be noted that the basic principles and technical effects of the data interaction device 1000 provided in the embodiment of the present application are the same as those of the above embodiment. For the sake of brief description, for any part not mentioned in the embodiment of the present application, reference can be made to the corresponding content in the above embodiment. The data interaction device 1000 includes:

[0106] The communication unit 1001, when determining that the second electronic device 200 displays the first interface, sends a first request to the second electronic device 200, where the first request is used to indicate the acquisition of interface data of the first interface. The communication unit 1001 is also used to receive the interface data of the first interface sent by the second electronic device 200 in response to the first request. The display unit 1003 is used to display the interface data of the first interface on the second interface. The communication unit 1001 is also used to receive a second request from the second electronic device 200, where the second request is used to indicate a voice call. The processing unit 1002 is used to respond to the confirmation operation of the second request; the communication unit 1001 is also used for voice interaction with the second electronic device 200.

[0107] In an optional embodiment, the communication unit 1001 is further used to receive a first instruction sent by the second electronic device 200 after updating the page data of the first interface, and the first instruction is used to instruct to update the page data of the first interface in the second interface.

[0108] The display unit 1003 is further configured to update the page data of the first interface on the second interface in response to the first instruction. The page data of the first interface updated by the first electronic device 100 is the same as the page data of the first interface updated by the second electronic device 200.

[0109] In an optional implementation, the interface data of the first interface displayed on the second electronic device 200 includes first information, and the first information is coded or deleted in the second interface.

[0110] In an optional embodiment, the second interface includes a first control, and the first control is used to instruct the control of the second electronic device 200. The communication unit 1001 is also used to send a third request to the second electronic device 200 in response to a trigger operation on the first control, and the third request is used to instruct the control of the second electronic device 200. The communication unit 1001 is also used to receive a first instruction sent by the second electronic device 200 after obtaining a confirmation operation on the third request, and the first instruction is used to indicate that the control of the second electronic device 200 is allowed. The communication unit 1001 is also used to update the page data of the first interface in response to the trigger operation. The communication unit 1001 is also used to control the second electronic device 200 to update the interface data of the first interface. The updated page data of the second electronic device 200 is the same as the updated page data of the first electronic device 100.

[0111] The trigger operation includes at least one of a click operation in the first interface, a scroll operation, a marking operation on the first interface, and an operation of inputting information in the first interface.

[0112] Figure 11 FIG1 is a block diagram of an electronic device 1100 according to an exemplary embodiment. The electronic device 1100 may be a computer. The computer may include one or more of the following components: a processing component 1102, a memory 1104, a power component 1106, a multimedia component 1108, an audio component 1110, an input / output (I / O) interface 1112, a sensor component 1114, and a communication component 1116.

[0113] When the processing component 1102 executes the computer program, it causes the computer to perform the data interaction method described in the above embodiment. The processing component 1102 generally controls the overall operation of the electronic device 1100, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 1102 may include one or more processors 1120 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 1102 may include one or more modules to facilitate interaction between the processing component 1102 and other components. For example, the processing component 1102 may include a multimedia module to facilitate interaction between the multimedia component 1108 and the processing component 1102.

[0114] The memory 1104 is configured to store various types of data to support operations on the electronic device 1100. Examples of such data include instructions for any application or method operating on the electronic device 1100, contact data, phone book data, messages, pictures, videos, etc. The memory 1104 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0115] The power supply component 1106 provides power to the various components of the electronic device 1100. The power supply component 1106 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 1100.

[0116] The multimedia component 1108 includes a screen that provides an output interface between the electronic device 1100 and the user. In an embodiment of the present application, the screen includes a main in-vehicle screen and at least one secondary in-vehicle screen. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1108 includes a front camera and / or a rear camera. When the electronic device 1100 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0117] The audio component 1110 is configured to output and / or input audio signals. For example, the audio component 1110 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 1100 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio component 1110 also includes a speaker for outputting audio signals.

[0118] I / O interface 1112 provides an interface between processing component 1102 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0119] The sensor assembly 1114 includes one or more sensors for providing various aspects of the status assessment of the electronic device 1100. For example, the sensor assembly 1114 can detect the open / closed state of the electronic device 1100, the relative positioning of components, such as the display and keypad of the electronic device 1100. The sensor assembly 1114 can also detect changes in the position of the electronic device 1100 or a component of the electronic device 1100, the presence or absence of user contact with the electronic device 1100, the orientation or acceleration / deceleration of the electronic device 1100, and changes in the temperature of the electronic device 1100. The sensor assembly 1114 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1114 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1114 can also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0120] The communication component 1116 is configured to facilitate wired or wireless communication between the electronic device 1100 and other devices. The electronic device 1100 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1116 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1116 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0121] In an exemplary embodiment, the electronic device 1100 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described methods.

[0122] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1104 including instructions, and the instructions can be executed by the processor 1120 of the electronic device 1100 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device. When the instructions in the non-transitory computer-readable storage medium are executed by the processor of the terminal device, the electronic device 1100 can perform Figure 2 The data interaction method shown.

[0123] The present application also provides a computer program product, comprising a computer program, which, when executed by a processor, Figure 2 The data interaction method shown.

[0124] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0125] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A data interaction method, characterized in that: Applied to a communication system, the communication system includes a first electronic device and a second electronic device, the method includes: When determining that the second electronic device displays the first interface, the first electronic device sends a first request to the second electronic device, where the first request is used to instruct to obtain interface data of the first interface; receiving, by the first electronic device, interface data of the first interface sent by the second electronic device in response to the first request; The first electronic device displays the interface data of the first interface on the second interface; the first electronic device controls the second electronic device to update the interface data of the first interface on the second interface; The first electronic device receives a second request from the second electronic device, the second request being used to indicate a voice call; the interface of the second electronic device includes a control for initiating a voice call, and in response to a user operating the control, the second electronic device sends the second request; The first electronic device interacts with the second electronic device via voice in response to a confirmation operation on the second request; The second electronic device marks the first information's DOM node with the first identifier. Before sending the page data of the first interface to the first electronic device, the second electronic device traverses all DOM nodes and encodes or deletes the first information of the DOM node marked with the first identifier.

2. The method according to claim 1, characterized in that After the first electronic device displays the interface data of the first interface on the second interface, the method further includes: The first electronic device receives a first instruction sent by the second electronic device after the second electronic device updates the page data of the first interface, where the first instruction is used to instruct to update the page data of the first interface in the second interface; The first electronic device updates the page data of the first interface on the second interface in response to the first instruction, wherein the page data of the first interface after being updated by the first electronic device is the same as the page data of the first interface after being updated by the second electronic device.

3. The method according to claim 1, characterized in that The second interface includes a first control, the first control being used to instruct control of the second electronic device. After the first electronic device displays interface data of the first interface on the second interface, the method further includes: In response to the triggering operation on the first control, the first electronic device sends a third request to the second electronic device, where the third request is used to instruct to control the second electronic device; The first electronic device receives, after the second electronic device obtains a confirmation operation on the third request, a first instruction sent by the first electronic device, where the first instruction is used to indicate permission to control the second electronic device; The first electronic device updates page data of the first interface in response to the triggering operation; The first electronic device controls the second electronic device to update interface data of a first interface, wherein the updated page data of the second electronic device is the same as the updated page data of the first electronic device.

4. The method according to claim 1, wherein After the first electronic device displays the interface data of the first interface on the second interface, the method further includes: The first electronic device receives a third request from the second electronic device, where the third request is used to instruct to control the second electronic device; After the second electronic device responds to a confirmation operation on the third request, the first electronic device sends a first instruction to the first electronic device, where the first instruction is used to indicate permission to control the second electronic device; The first electronic device updates page data of the first interface in response to the triggering operation; The first electronic device controls the second electronic device to update interface data of the first interface, wherein the updated page data of the second electronic device is the same as the updated page data of the first electronic device.

5. The method according to claim 3 or 4, characterized in that The trigger operation includes at least one of a click operation in the first interface, a scroll operation, a marking operation on the first interface, and an operation of inputting information in the first interface.

6. The method according to claim 1, characterized in that The communication system further includes a cloud server, the cloud server being in communication with the second electronic device, the first interface including a second control, the second control being used to indicate a voice question and answer, and the method further including: The second electronic device collects user voice data in response to a triggering operation on the second control; The second electronic device converts the voice data into text information and sends the text information to the cloud server; The cloud server searches a preset database for an answer associated with the text information based on the text information; The second electronic device receives and outputs the answer from the cloud server.

7. The method according to claim 1, characterized in that The communication system further includes a cloud server, the cloud server being communicatively connected to the second electronic device, and the method further includes: The cloud server receives interface data of the first interface from the second electronic device, and audio of the second electronic device interacting with the first electronic device by voice; The cloud server obtains and stores video data based on the interface data of the first interface and the audio.

8. The method according to claim 7, characterized in that The communication system further includes a cloud server, the cloud server being communicatively connected to the second electronic device, and the method further includes: The cloud server determines the time when the video data is generated, records the storage address of the video data and the identity information of the customer service personnel obtained from the first electronic device, wherein the storage address of the video data, the time when the video data is generated and the identity information of the customer service personnel correspond one to one.

9. A data interaction method, characterized in that: The method comprises: The second electronic device displays the first interface of the first application; The second electronic device sends a first request to the first electronic device in response to a trigger operation of the user, where the first request is used to instruct to transmit interface data of the first interface to the first electronic device; The second electronic device receives a second instruction sent by the first electronic device in response to a confirmation operation on the first request, where the second instruction is used to indicate permission to transmit the interface data of the first interface; The second electronic device sends the interface data of the first interface to the second interface of the first electronic device for display in response to the second instruction; the first electronic device controls the second electronic device to update the interface data of the first interface on the second interface; The interface of the second electronic device includes a control for initiating a voice call, and the second electronic device sends a second request to the first electronic device in response to a user triggering the control, where the second request is used to indicate the voice call; After the first electronic device confirms the second request, the second electronic device interacts with the first electronic device via voice; The second electronic device marks the first information's DOM node with the first identifier. Before sending the page data of the first interface to the first electronic device, the second electronic device traverses all DOM nodes and encodes or deletes the first information of the DOM node marked with the first identifier.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the electronic device is caused to perform the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Screen transfer display method and device

    CN104238986A

  • A remote desktop control method, apparatus, system, device, and storage medium

    CN110582749A

  • Question and answer control method, device and system

    CN110970021A

  • Screen sharing method and device and electronic equipment

    CN113891128A