Display method and device

Abstract

The invention provides a display method, which can be applied to the technical field of content display, and comprises the following steps: in response to a received generation request, obtaining generated content, the generated content being generated by an artificial intelligence model of a first display device; based on adaptive connection of the first display device and the second display device, a first display instruction is generated, the first display instruction comprises target content and a target display position, the target display position corresponds to a display area used for displaying the target content in the second display device, and the target content is at least one part of generated content; and sending the first display instruction to the second display device.

Description

Technical Field

[0001] The present disclosure relates to the technical field of content display, and more specifically, to a display method and device. Background Art

[0002] With the development of artificial intelligence and information technology, the number and types of display devices are increasing, and it is becoming increasingly common for users to process and operate information on multiple screens. However, in actual applications, when users add a new screen, they often face the problem that the information display logic between different screens is not clear enough, which makes it difficult for users to quickly understand the relevance and content flow between different screens when using multiple screens, affecting the efficiency of users' information acquisition and increasing their cognitive burden. Summary of the invention

[0003] In view of this, the present disclosure provides a display method, device, apparatus and medium.

[0004] One aspect of the present disclosure provides a display method for a first display device, comprising: in response to receiving a generation request, obtaining generated content, the generated content being generated by an artificial intelligence model of the first display device; based on the adaptive connection between the first display device and the second display device, generating a first display instruction, the first display instruction including target content and a target display position, the target display position corresponding to a display area in the second display device for displaying the target content, the target content being at least a part of the generated content; and sending the first display instruction to the second display device.

[0005] According to an embodiment of the present disclosure, a first display instruction is generated based on the adaptive connection between the first display device and the second display device, including: judging the generated content and / or user operation based on the adaptive connection between the first display device and the second display device; and generating the first display instruction based on the result of the judgment.

[0006] According to an embodiment of the present disclosure, judging the generated content includes: judging that the generated content does not match the display area of ​​the first display device; and / or judging that the attribute priority of the generated content is higher than a preset threshold.

[0007] According to an embodiment of the present disclosure, determining the user operation includes: determining that the user cursor is located in a display area of ​​the first display device or the second display device.

[0008] According to an embodiment of the present disclosure, the target display position is adapted to the position of the first display area of ​​the first display device, and the first display area is used to display part of the generated content associated with the target content.

[0009] According to an embodiment of the present disclosure, based on the adaptive connection between the first display device and the second display device, a first display instruction is generated, including: based on the adaptive connection between the first display device and the second display device, obtaining a setting instruction, the setting instruction including display setting information of the second display device and user history setting information; based on the setting instruction, generating the first display instruction.

[0010] According to an embodiment of the present disclosure, the display method further includes: acquiring a second display instruction, the second display instruction including adjustment information of the first display instruction, the adjustment information being generated by the second display device based on the display area and the user's display settings.

[0011] Another aspect of the present disclosure provides a display method for a second display device, including: obtaining a first display instruction, the first display instruction including target content and a target display position, the target display position corresponding to a display area in the second display device for displaying the target content, the target content being at least a part of generated content, and the generated content being generated by an artificial intelligence model of the first display device; and executing a display operation corresponding to the first display instruction.

[0012] According to an embodiment of the present disclosure, the display method also includes: generating a second display instruction based on the execution result of the first display instruction, the second display instruction including adjustment information of the first display instruction, the adjustment information being generated by the second display device based on the display area and the display settings of the user; and sending the second display instruction to the first display device.

[0013] Another aspect of the present disclosure provides a first display device, comprising: at least one processor; and a memory connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the above method.

[0014] Another aspect of the present disclosure provides a second display device, comprising: at least one processor; and a memory connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the above method.

[0015] Another aspect of the present disclosure provides a display device for a first display device, including: a generated content acquisition module, used to obtain generated content in response to receiving a generation request, where the generated content is generated by an artificial intelligence model of the first display device; a first display instruction generation module, used to generate a first display instruction based on the adaptive connection between the first display device and the second display device, the first display instruction including target content and a target display position, the target display position corresponding to a display area in the second display device for displaying the target content, and the target content is at least a part of the generated content; a first display instruction sending module, used to send the first display instruction to the second display device.

[0016] Another aspect of the present disclosure provides a display device for a second display device, including: a first display instruction acquisition module, used to acquire a first display instruction, the first display instruction includes target content and a target display position, the target display position corresponds to a display area in the second display device for displaying the target content, the target content is at least a part of generated content, and the generated content is generated by an artificial intelligence model of the first display device; a first display instruction operation module, used to execute a display operation corresponding to the first display instruction.

[0017] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.

[0018] Another aspect of the present disclosure provides a computer program product, which includes computer executable instructions, and the instructions are used to implement the above method when executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0020] Figure 1 One of the application scenario diagrams to which the display method can be applied according to an embodiment of the present disclosure is schematically shown;

[0021] Figure 2 A flowchart of a display method for a first display device according to an embodiment of the present disclosure is schematically shown;

[0022] Figure 3 The second application scenario diagram schematically shows a display method according to an embodiment of the present disclosure;

[0023] Figure 4 A flowchart of a first display instruction generating method according to an embodiment of the present disclosure is schematically shown;

[0024] Figure 5Schematically shows one of the application scenario diagrams for generating content judgment according to an embodiment of the present disclosure;

[0025] Figure 6 The second application scenario diagram of generating content judgment according to an embodiment of the present disclosure is schematically shown;

[0026] Figure 7 A diagram schematically shows an application scenario of user operation judgment according to an embodiment of the present disclosure;

[0027] Figure 8 One of the application scenario diagrams of the target display position according to an embodiment of the present disclosure is schematically shown;

[0028] Fig. 9 A second application scenario diagram of a target display position according to an embodiment of the present disclosure is schematically shown;

[0029] Fig.10 Another flow chart of the method for generating a first display instruction according to an embodiment of the present disclosure is schematically shown;

[0030] Fig.11 The third application scenario diagram schematically shows the application scenario diagram of the display method according to the embodiment of the present disclosure;

[0031] Fig.12 A flowchart of a display method for a second display device according to an embodiment of the present disclosure is schematically shown;

[0032] Fig.13 A block diagram schematically shows a display device for a first display device according to an embodiment of the present disclosure;

[0033] Fig.14 A block diagram schematically shows a display device for a second display apparatus according to an embodiment of the present disclosure; and

[0034] Fig.15 A block diagram of a display device suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0035] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0036] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0037] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0038] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0039] In the embodiments of the present disclosure, the collection, updating, analysis, processing, use, transmission, provision, disclosure, storage, etc. of the data involved (for example, including but not limited to user personal information) are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security, and national security.

[0040] In the embodiments of the present disclosure, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.

[0041] An embodiment of the present disclosure provides a display method for a first display device, comprising: in response to receiving a generation request, obtaining generated content, the generated content being generated by an artificial intelligence model of the first display device; based on the adaptive connection between the first display device and the second display device, generating a first display instruction, the first display instruction including target content and a target display position, the target display position corresponding to a display area in the second display device for displaying the target content, the target content being at least a part of the generated content; and sending the first display instruction to the second display device.

[0042] An embodiment of the present disclosure also provides a display method for a second display device, including: obtaining a first display instruction, the first display instruction including target content and a target display position, the target display position corresponding to a display area in the second display device for displaying the target content, the target content being at least a part of generated content, and the generated content being generated by an artificial intelligence model of the first display device; and executing a display operation corresponding to the first display instruction.

[0043] Through the embodiments of the present disclosure, the above display method improves the user's information acquisition efficiency in a multi-screen environment, reduces cognitive burden, and enhances user experience.

[0044] Figure 1 One of the application scenarios to which the display method can be applied according to an embodiment of the present disclosure is schematically shown. It should be noted that: Figure 1 What is shown is merely an example of an application scenario diagram to which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0045] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a terminal first display device 1101, a network 1201 and a server 1301. The network 1201 is used to provide a medium for a communication link between the first display device 1101 and the server 1301. The network 1201 may include various connection types, such as wired and / or wireless communication links, etc.

[0046] like Figure 1 As shown, the application scenario 100 according to this embodiment may also include a terminal second display device 1102, a network 1202 and a server 1302. The network 1202 is used to provide a medium for a communication link between the second display device 1102 and the server 1302. The network 1202 may include various connection types, such as wired and / or wireless communication links, etc.

[0047] Please continue reading Figure 1 The first display device 1101 and the second display device 1102 may be connected via a network 1203 , and the network 1203 may include various connection types, such as wired and / or wireless communication links, etc.

[0048] The first display device 1101 and the second display device 1102 may be provided with an artificial intelligence model, and users may use the artificial intelligence model to manage daily tasks, organize information, and recommend personalized content. The artificial intelligence model can respond to the needs of users. The artificial intelligence model can be an independent application, a functional module embedded in an application, or a functional module embedded in a terminal device system to provide large model functions for various applications in the terminal device.

[0049] The first display device 1101 and the second display device 1102 can be various electronic devices with display screens and supporting web browsing, including but not limited to display extension screens, display screen accessories, smart phones, tablet computers, laptop computers, desktop computers, etc.

[0050] Server 1301 and server 1302 can both be servers that provide various services. The server can analyze and process the data in the terminal device connected to it, and feed back the processing results to the terminal device.

[0051] It should be noted that the display method provided in the embodiment of the present disclosure can generally be executed by a terminal device. The display method provided in the embodiment of the present disclosure can also be executed by a server or other terminal device that is different from the terminal device and can communicate with the terminal device. Correspondingly, or, the display method provided in the embodiment of the present disclosure can also be jointly executed by the terminal device and the server.

[0052] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0053] The following will be passed Figure 2 to Figure 12 The display method of the disclosed embodiment is described in detail.

[0054] Figure 2 The flowchart of the display method for the first display device according to the embodiment of the present disclosure is schematically shown. Figure 3 The second application scenario diagram to which the display method according to the embodiment of the present disclosure can be applied is schematically shown.

[0055] like Figure 2 As shown, the display method for the first display device may include operations S210 to S230.

[0056] In operation S210, in response to receiving a generation request, generated content is obtained, where the generated content is generated by an artificial intelligence model of the first display device.

[0057] Exemplarily, the first display device may be any electronic device having a display screen and supporting web browsing, including but not limited to a display extension screen, a smart phone, a tablet computer, a laptop computer, a desktop computer, etc. The embodiments of the present disclosure do not impose any special restrictions on the specific device form of the first display device.

[0058] For example, take the first display device as an extended display as an example for explanation, referring to Figure 3 The display extension screen 1 and its corresponding server are connected via a network and provide a communication link, wherein the network may include various connection types, such as wired and / or wireless communication links, etc.

[0059] An artificial intelligence model is provided on the first display device. It should be noted that the artificial intelligence model can be an independent application, a functional module embedded in an application, or a functional module embedded in a terminal device system to provide a large model function for each application in the terminal device. For example, the artificial intelligence model can be an independent AI application, such as Figure 3 , the display area 11 of the AI ​​application in the display extension screen is a user interaction box, which is used to display the user's interaction information. When the user enters request information in the display area 11 or issues a request after waking up the application by voice, after the application receives the user's request, the generated content output by the artificial intelligence model will be displayed in the display area 11. In addition, there is no special restriction on the form of the generated content, which can be any form of content.

[0060] It should be noted that the first display device may also be provided with multiple other applications and AI applications at the same time, and other applications may also output generated content, such as Figure 3 , that is, the display extension screen 1 may also include multiple display areas for other applications, such as display area 12 and display area 13.

[0061] Exemplarily, the second display device may also be various electronic devices having a display screen and supporting web browsing, including but not limited to display extension screens, smart phones, tablet computers, laptop computers, and desktop computers, etc. The embodiments of the present disclosure do not impose any special restrictions on the specific device form of the second display device.

[0062] For example, take the second display device as a notebook computer as an example for explanation, referring to Figure 3 The laptop computer has a display screen 2, and the laptop computer and its corresponding server are connected and provide a communication link through a network, wherein the network may include various connection types, such as wired and / or wireless communication links, etc. It should be noted that the second display device may also be provided with an artificial intelligence model and other applications, and the display screen 2 may also display display areas of multiple different applications.

[0063] As described above, in operation S220, based on the adaptive connection between the first display device and the second display device, a first display instruction is generated, the first display instruction includes target content and a target display position, the target display position corresponds to a display area in the second display device for displaying the target content, and the target content is at least a part of the generated content.

[0064] Exemplarily, the adaptive connection between the first display device and the second display device includes but is not limited to a physical connection and a network connection. For example, the display extension screen 1 and the display screen 2 may be connected via a network, and the network may include various connection types, such as wired and / or wireless communication links, etc. For another example, Figure 3 As shown, the display extension screen 1 and the display screen 2 can also be in contact with each other through a contact point, and the display extension screen 1 can be adsorbed on the display screen 2, so that the two screens can display content together. It should be noted that the display extension screen 1 here is not only adsorbed on the top of the display screen 2, but also can be adsorbed on other outer frame positions of the display screen 2.

[0065] Figure 4 The flowchart of the first display instruction generating method according to the embodiment of the present disclosure is schematically shown. Figure 5 One of the application scenario diagrams for generating content judgment according to an embodiment of the present disclosure is schematically shown. Figure 6 The second application scenario diagram for generating content judgment according to an embodiment of the present disclosure is schematically shown. Figure 7 An application scenario diagram of user operation judgment according to an embodiment of the present disclosure is schematically shown.

[0066] like Figure 4 As shown, the first display instruction generating method may include operations S410 to S420.

[0067] In operation S410, based on the adaptive connection between the first display device and the second display device, the generated content and / or the user operation is judged.

[0068] In an embodiment of the present disclosure, after the first display device and the second display device complete the adaptation connection, the first display device will judge the generated content output by the application. The judgment condition can, for example, judge the matching between the generated content and the display area of ​​the first display device.

[0069] For example, Figure 5As shown, when the display extension screen 1 is adsorbed on the display screen 2, the matching between the generated content output by the AI ​​application and the display area 11 is determined in the display extension screen 1. The matching here may refer to whether the generated content can be fully displayed in the display area 11. For example, when the user inputs a question in the display area 11 of the AI ​​application, the answer details generated by the AI ​​application cannot be fully displayed in the display area 11, and there is a lack of generated content or language.

[0070] In some embodiments, the judgment condition may also be to judge the attribute priority of the generated content.

[0071] For example, refer to Figure 6 When the display extension screen 1 is attached to the display screen 2 of the laptop, the user is using the display extension screen 1 to participate in the conference application and using the laptop to display the page report. At this time, it is judged whether the content generated by the AI ​​application is related to the office content or meeting of the laptop. For another example, the display extension screen 1 may not display the generated content output by the AI ​​application, but displays messages sent by other messaging applications such as WeChat and email in the display extension screen 1. At this time, it is judged whether the message content is important. Figure 6 When the extended screen 1 displays an important email, the email content is displayed in the specific display area 21 of the display screen 2.

[0072] In some embodiments, the judgment condition may also be to simultaneously judge the matching between the generated content and the display area of ​​the first display device, and the attribute priority of the generated content.

[0073] In other embodiments, after the first display device and the second display device complete the adaptation connection, it is also determined based on the user's operation on the first display device or the second display device to determine whether the current user cursor is located in the display area of ​​the first display device or the second display device.

[0074] For example, refer to Figure 7 When the display extension screen 1 is adsorbed on the display screen 2 of the notebook computer, it is determined whether the mouse is located in the display extension screen 1 or in the display screen 2 to identify the current user's focus.

[0075] It should be noted that the judgment of the generated content and the judgment of the user operation can be performed at the same time; or, the generated content can be judged first, and then the user operation can be judged; or, the user operation can be judged first, and then the generated content can be judged. Figure 5~Figure 6 The corresponding embodiments are not limited to a single judgment scenario, and the generated content and user operation can be judged simultaneously in one scenario.

[0076] In operation S420, based on the result of the determination, a first display instruction is generated.

[0077] In an embodiment of the present disclosure, a judgment is made according to the above judgment condition to obtain a judgment result, and a first display instruction is generated based on the judgment result. The first display instruction includes target content and a target display position, the target display position corresponds to a display area in the second display device for displaying the target content, and the target content is at least a part of the generated content.

[0078] For example, when it is determined based on the above that the generated content does not match the display area of ​​the first display device, that is, the generated content output by the AI ​​application or other application in the display extension screen 1 cannot be completely displayed in the corresponding display area, and the displayed generated content has a certain amount of missing content, and the missing content is the target content. Based on this judgment result, a first display instruction is generated in the display extension screen 1, and the first display instruction is used to display the above-mentioned missing content in a specific display area of ​​the display screen 2.

[0079] Exemplarily, based on the above judgment, when the attribute priority of the generated content is higher than the preset threshold, that is, when it is judged that the generated content is an important message content sent by an AI application or other application and needs to be displayed in the second display device, the important message content is the target content, and at this time, a first display instruction is generated in the display extension screen 1, and the first display instruction is used to display the above important message content in a specific display area of ​​the display screen 2. Figure 6 When the extended screen 1 displays an important email, the email content is displayed in the specific display area 21 of the display screen 2.

[0080] For example, based on the above judgment that the user's cursor is on the display extension screen 1, it can be determined that the user's focus is on the display content on the display extension screen 1, and the display content can be the content of a certain application. At this time, when the user needs to read the generated content of another associated application on the display extension screen 1, a first display instruction is generated, and the first display instruction is used to display the generated content of the other associated application in a specific display area of ​​the display screen 2, so that the user can efficiently view the contents of the two associated applications at the same time.

[0081] It should be noted that, in some other embodiments, after the first display device is adapted to be connected with the second display device, the first display device does not perform the above judgment, but directly generates a first display instruction to enable the second display device to display the target content.

[0082] Exemplarily, when the display extension screen 1 is adsorbed on the display screen 2, the target content output by the AI ​​application or other application in the display extension screen 1 needs to be displayed on the display screen 2. For example, when a user is using the AI ​​application of the display extension screen 1, the user inputs a voice request, and the request is to open a related web page in the display screen 2. At this time, the display extension screen 1 generates a first display instruction, and the first display instruction is used to open the related web page in the second display device.

[0083] Based on the generation of the first display instruction, the target display position in the first display instruction, that is, the position of the specific display area for displaying the target content in the second display device, is described in detail below.

[0084] Figure 8 One of the application scenario diagrams of the target display position according to an embodiment of the present disclosure is schematically shown. Fig. 9 The second application scenario diagram of the target display position according to the embodiment of the present disclosure is schematically shown.

[0085] In an embodiment of the present disclosure, the target display position is matched with the position of the first display area of ​​the first display device, and the first display area is used to display part of the generated content associated with the target content.

[0086] For example, Figure 8 As shown, based on the above judgment, when the generated content does not match the display area of ​​the first display device, that is, the generated content output by the AI ​​application or other application in the display extension screen 1 cannot be fully displayed in the corresponding display area 11, the missing content is displayed in the specific display area 21 of the display screen 2. The specific display area 21 can be located immediately below the display area 11 and suspended on the display area of ​​other applications of the display screen 2. In this way, the display areas of the upper and lower screens can jointly display the generated content, so that the user can clearly understand the generated content and improve the efficiency of obtaining information.

[0087] It should be noted that the embodiments of the present disclosure do not impose any special restrictions on the adsorption positions of the display extension screen 1 and the display screen 2. Fig. 9 As shown, when the display extension screen 1 is adsorbed on the left side of the display screen 2, the specific display area 21 can be adjacent to the right side of the display area 11 and float above the display area of ​​other applications on the display screen 2, so that the left and right display areas can also display the generated content together.

[0088] Through the embodiments of the present disclosure, the content display on each screen is dynamically adjusted according to the context of generated content and the position of the display area.

[0089] In some other embodiments, the specific display area position may also be located in other area positions in the second display device. For example, based on the above Figure 6In an embodiment, when an important email is sent from the display extension screen 1, the email content is displayed in a specific display area 21 of the display screen 2, and the specific display area 21 is located near the bottom notification bar area of ​​the display screen 2.

[0090] Fig.10 Another flowchart of the first display instruction generating method according to an embodiment of the present disclosure is schematically shown.

[0091] like Fig.10 As shown, based on the adaptive connection between the first display device and the second display device, a first display instruction is generated, and operations S510~S520 are also included.

[0092] In operation S510, based on the adaptive connection between the first display device and the second display device, a setting instruction is acquired, where the setting instruction includes display setting information of the second display device and user history setting information.

[0093] Exemplarily, the setting instruction may include display setting information such as the display screen size, display direction, content display layout, display mode, etc. of the second display device. The setting instruction also includes historical display setting information set by the user on the second display device, and the display setting information is related to the user's display preference information, such as the user's preferred display direction setting, the user's preferred display mode setting, or the user's preferred display resolution setting.

[0094] Based on the above, when the first display device is connected to the second display device, the first display device will obtain the display setting information and the user's historical display preference information sent by the second display device.

[0095] In operation S520, based on the setting instruction, a first display instruction is generated.

[0096] Exemplarily, in the process of generating the first display instruction by the first display device, when performing the above Figure 5~Figure 7 When judging the corresponding embodiment, the judgment is also made based on the display setting information of the second display device and the user's historical display preference information, so that the target content and the target display position in the generated first display instruction can both meet the display setting of the second display device and the user's display preference, thereby improving the user's experience of viewing the displayed generated content and reducing the user's subsequent display settings for the second display device. It should be noted that the setting instruction can be obtained before judging the generated content and user operation.

[0097] Through the embodiments of the present disclosure, by collecting the operation data of users in a multi-screen environment, the joint display of generated content in multiple screens is continuously optimized.

[0098] In operation S230, the first display instruction is sent to the second display device.

[0099] Exemplarily, after the operation of the above-mentioned first display instruction is completed, the first display instruction is sent to the second display device through the network, so that the generated content output by the first display device is displayed in the specific display area of ​​the second display device.

[0100] Fig.11 The third application scenario diagram to which the display method according to the embodiment of the present disclosure can be applied is schematically shown.

[0101] In an embodiment of the present disclosure, the display method for the first display device further includes: obtaining a second display instruction, the second display instruction including adjustment information of the first display instruction, the adjustment information being generated by the second display device based on the display area and the user's display settings.

[0102] Exemplarily, after the first display device generates a first display instruction and sends it to the second display device, the first display device will obtain a second display instruction sent by the second display device, and the second display instruction is used to adjust the first display instruction. That is, after sending the first display instruction, the first display device will obtain the display feedback of the second display device on the target content and the target display position, and the display feedback here can be the user's display operation on the second display device.

[0103] For example, Fig.11 , the user is using a laptop computer, and the specific display area 21 displaying the target content covers the area on the display screen 2 where the user is reading. The user drags the position of the specific display area 21 to facilitate browsing. Based on the user's dragging feedback, the laptop display screen 2 will send the display extension screen 1 a message indicating that the position of the subsequent specific display area 21 needs to be adjusted to facilitate user reading and improve the user's personalized experience.

[0104] Based on the foregoing, an embodiment of the present disclosure further provides a display method for a second display device.

[0105] Fig.12 The flowchart of the display method for the second display device according to the embodiment of the present disclosure is schematically shown.

[0106] like Fig.12 As shown, the display method for the second display device may include operations S610-S620.

[0107] In operation S610, a first display instruction is obtained, where the first display instruction includes target content and a target display position, where the target display position corresponds to a display area in a second display device for displaying the target content, and the target content is at least a part of generated content, which is generated by an artificial intelligence model of the first display device.

[0108] In operation S620, a display operation corresponding to the first display instruction is performed.

[0109] For example, corresponding to Figure 2 In an embodiment, in this embodiment, after the second display device obtains the first display instruction, it will perform a corresponding display operation, that is, it will display the target content in a specific display area, so that the display areas of the two display devices can jointly display the generated content, so that the user can clearly understand the generated content and improve the efficiency of obtaining information.

[0110] In an embodiment of the present disclosure, based on the execution result of the first display instruction, a second display instruction is generated, the second display instruction includes adjustment information of the first display instruction, and the adjustment information is generated by the second display device based on the display area and the user's display settings; the second display instruction is sent to the first display device.

[0111] For example, corresponding to Fig.11 In an embodiment, after the second display device displays the target content in a specific display area, the specific display area or the target content is adjusted based on the user's settings or the display area limitation of the second display device so that the position of the specific display area in the subsequent first display instruction meets the user's requirements.

[0112] In summary, an embodiment of the present disclosure provides a display apparatus for a first display device.

[0113] Fig.13 A block diagram schematically shows a display apparatus for a first display device according to an embodiment of the present disclosure.

[0114] like Fig.13 As shown, the display device 1300 includes a generated content acquisition module 1310 , a first display instruction generation module 1320 and a first display instruction sending module 1330 .

[0115] The generated content acquisition module 1310 is used to obtain the generated content in response to receiving the generation request, and the generated content is generated by the artificial intelligence model of the first display device. In some embodiments, the generated content acquisition module 1310 can be used to perform operation S210 in the aforementioned method, which is not described in detail here.

[0116] The first display instruction generation module 1320 is used to generate a first display instruction based on the adaptive connection between the first display device and the second display device, the first display instruction includes target content and target display position, the target display position corresponds to the display area in the second display device for displaying the target content, and the target content is at least a part of the generated content. In some embodiments, the first display instruction generation module 1320 can be used to perform operation S220 in the aforementioned method, which is not described in detail here.

[0117] The first display instruction sending module 1330 is used to send the first display instruction to the second display device. In some embodiments, the first display instruction sending module 1330 can be used to perform operation S230 in the above method, which will not be described in detail here.

[0118] According to an embodiment of the present disclosure, the first display instruction generating module 1320 may include a generated content judging submodule, which is used to judge whether the generated content does not match the display area of ​​the first display device; and / or, judge whether the attribute priority of the generated content is higher than a preset threshold.

[0119] According to an embodiment of the present disclosure, the first display instruction generating module 1320 may further include a user operation judging submodule. The user operation judging submodule is used to judge whether the user cursor is located in the display area of ​​the first display device or the second display device.

[0120] According to an embodiment of the present disclosure, the first display instruction generating module 1320 may further include a display area position adapting submodule configured to adapt the target display position to the first display area position of the first display device, the first display area being used to display part of the generated content associated with the target content.

[0121] According to an embodiment of the present disclosure, the first display instruction generating module 1320 may further include a setting instruction acquiring submodule. The setting instruction acquiring submodule includes a setting instruction acquiring unit and a first display instruction generating unit.

[0122] The setting instruction acquisition unit is used to acquire the setting instruction based on the adaptive connection between the first display device and the second display device, and the setting instruction includes the display setting information of the second display device and the user history setting information. In some embodiments, the setting instruction acquisition unit can be used to perform operation S510 in the above method, which is not described in detail here.

[0123] The first display instruction generating unit is used to generate a first display instruction based on the setting instruction. In some embodiments, the first display instruction generating unit can be used to perform operation S520 in the above method, which will not be described in detail here.

[0124] According to an embodiment of the present disclosure, the first display instruction generating module 1320 may further include a second display instruction acquiring submodule, which is used to acquire a second display instruction, wherein the second display instruction includes adjustment information of the first display instruction, and the adjustment information is generated by the second display device based on the display area and the user's display settings.

[0125] Fig.14 A block diagram schematically shows a display apparatus for a second display device according to an embodiment of the present disclosure.

[0126] like Fig.14 As shown, the display device 1400 includes a first display instruction acquisition module 1410 and a first display instruction execution module 1420 .

[0127] The first display instruction acquisition module 1410 is used to acquire a first display instruction, the first display instruction includes a target content and a target display position, the target display position corresponds to a display area in the second display device for displaying the target content, the target content is at least a part of the generated content, and the generated content is generated by the artificial intelligence model of the first display device. In some embodiments, the first display instruction acquisition module 1410 can be used to perform operation S610 in the aforementioned method, which is not described in detail here.

[0128] The first display instruction execution module 1420 is used to execute the display operation corresponding to the first display instruction. In some embodiments, the first display instruction execution module 1420 can be used to execute the operation S620 in the above method, which will not be described in detail here.

[0129] According to the embodiments of the present invention, any one or more of the modules, sub-modules, and units, or at least part of the functions of any one of them, can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, sub-modules, and units can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, sub-modules, and units can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application-specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging circuits, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, sub-modules, and units can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0130] For example, any multiple of the generated content acquisition module 1310, the first display instruction generation module 1320, and the first display instruction sending module 1330 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the generated content acquisition module 1310, the first display instruction generation module 1320, and the first display instruction sending module 1330 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or by any one of the three implementation methods of software, hardware, and firmware, or by a suitable combination of any of them. Alternatively, at least one of the generated content acquisition module 1310, the first display instruction generation module 1320 and the first display instruction sending module 1330 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be executed.

[0131] For another example, any multiple of the first display instruction acquisition module 1410 and the first display instruction execution module 1420 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the first display instruction acquisition module 1410 and the first display instruction execution module 1420 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the first display instruction acquisition module 1410 and the first display instruction execution module 1420 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be executed.

[0132] Fig.15 A block diagram of a display device suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown.

[0133] In the embodiments of the present disclosure, both the first display device and the second display device may be described according to the display devices in the embodiments. Fig.15 The display device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0134] like Fig.15 As shown, the display device 1500 according to the embodiment of the present disclosure includes a processor 1501, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1502 or the program loaded from the storage part 1508 to the random access memory (RAM) 1503. The processor 1501 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 1501 may also include an on-board memory for caching purposes. The processor 1501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present disclosure.

[0135] In RAM 1503, various programs and data required for the operation of display device 1500 are stored. Processor 1501, ROM 1502 and RAM 1503 are connected to each other via bus 1504. Processor 1501 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 1502 and / or RAM 1503. It should be noted that the program can also be stored in one or more memories other than ROM 1502 and RAM 1503. Processor 1501 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in one or more memories.

[0136] According to an embodiment of the present disclosure, the display device 1500 may further include an input / output (I / O) interface 1505, which is also connected to the bus 1504. The display device 1500 may further include one or more of the following components connected to the input / output (I / O) interface 1505: an input portion 1506 including a keyboard, a mouse, etc.; an output portion 1507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 1508 including a hard disk, etc.; and a communication portion 1509 including a network interface card such as a LAN card, a modem, etc. The communication portion 1509 performs communication processing via a network such as the Internet. A drive 1510 is also connected to the input / output (I / O) interface 1505 as needed. A removable medium 1515, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1510 as needed, so that a computer program read therefrom is installed into the storage portion 1508 as needed.

[0137] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1509, and / or installed from the removable medium 1515. When the computer program is executed by the processor 1501, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0138] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0139] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0140] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 1502 and / or the RAM 1503 described above and / or one or more memories other than the ROM 1502 and the RAM 1503 .

[0141] An embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method provided by the embodiment of the present disclosure. When the computer program product runs on a display device, the program code is used to enable the display device to implement the display method provided by the embodiment of the present disclosure.

[0142] When the computer program is executed by the processor 1501, the above functions defined in the system / device of the embodiment of the present disclosure are executed. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0143] In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium, and downloaded and installed through the communication part 1509, and / or installed from a removable medium 1515. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0144] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0145] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments of the present disclosure can be combined and / or combined in a variety of ways, even if such a combination or combination is not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0146] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A display method for a first display device, comprising: In response to receiving the generation request, obtaining generated content, where the generated content is generated by an artificial intelligence model of the first display device; Generate a first display instruction based on the adaptive connection between the first display device and the second display device, wherein the first display instruction includes target content and a target display position, wherein the target display position corresponds to a display area in the second display device for displaying the target content, and the target content is at least a part of the generated content; The first display instruction is sent to a second display device.

2. The display method according to claim 1, wherein generating a first display instruction based on the adaptive connection between the first display device and the second display device comprises: Based on the adaptive connection between the first display device and the second display device, judging the generated content and / or the user operation; Based on the result of the determination, a first display instruction is generated.

3. According to the display method of claim 2, judging the generated content comprises: determining that the generated content does not match a display area of ​​the first display device; and / or, It is determined that the attribute priority of the generated content is higher than a preset threshold.

4. The display method according to claim 2, wherein judging the user operation comprises: It is determined that the user cursor is located within the display area of ​​the first display device or the second display device. 5 . The display method according to claim 1 , wherein the target display position is matched with a position of a first display area of ​​the first display device, and the first display area is used to display a portion of generated content associated with the target content.

6. The display method according to claim 1, wherein generating a first display instruction based on the adaptive connection between the first display device and the second display device comprises: Based on the adaptive connection between the first display device and the second display device, acquiring a setting instruction, the setting instruction including display setting information of the second display device and user history setting information; Based on the setting instruction, a first display instruction is generated.

7. The display method according to claim 1, comprising: A second display instruction is acquired, where the second display instruction includes adjustment information of the first display instruction, where the adjustment information is generated by the second display device based on a display area and a display setting of a user.

8. A display method for a second display device, comprising: Acquire a first display instruction, the first display instruction including target content and a target display position, the target display position corresponds to a display area in the second display device for displaying the target content, the target content is at least a part of generated content, and the generated content is generated by an artificial intelligence model of the first display device; Execute a display operation corresponding to the first display instruction.

9. The display method according to claim 8, comprising: Based on the execution result of the first display instruction, generating a second display instruction, wherein the second display instruction includes adjustment information of the first display instruction, wherein the adjustment information is generated by the second display device based on a display area and a display setting of a user; The second display instruction is sent to the first display device.

10. A display device, comprising: at least one processor; as well as A memory connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

Images