Display interaction method and device, equipment and storage medium

Abstract

The invention provides a display interaction method and device, equipment and a storage medium, and the display interaction method comprises the steps: responding to a target display request, and displaying synthetic display data corresponding to the target display request, the synthesized display data comprises first display data displayed on a first display layer and second display data displayed on a second display layer; responding to a display interaction request for the synthetic display data, and obtaining a display interaction instruction corresponding to the synthetic display data; and performing display control on the synthesized display data based on the display interaction instruction to obtain a display interaction result. According to the technical scheme, the display interactivity of the intelligent display terminal can be improved, the interaction interestingness of the intelligent display terminal can be improved, and then the intelligent display terminal use experience of a user is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a display interaction method and device, equipment and storage medium. BACKGROUND

[0002] At present, with the rapid development of the field of intelligent display devices, the types and functions of intelligent display devices are increasingly diversified. For example, an intelligent display device can display a static image or a dynamic image in a standby mode or other operating modes to improve the decoration effect of the intelligent display device. However, the existing intelligent display device can only fixedly display the relevant decoration image and cannot interact, resulting in poor display interaction. SUMMARY

[0003] Embodiments of the present application provide a display interaction method, device, equipment and storage medium, aiming at solving the technical problem that the existing intelligent display device cannot interact in a specified operating mode, resulting in poor display interaction.

[0004] In one aspect, the present application provides a display interaction method, which comprises the following steps:

[0005] In response to a target display request, display the synthesized display data corresponding to the target display request, wherein the synthesized display data comprises first display data displayed on a first display layer and second display data displayed on a second display layer;

[0006] In response to a display interaction request for the synthesized display data, obtain a display interaction instruction corresponding to the synthesized display data;

[0007] Based on the display interaction instruction, perform display control on the synthesized display data to obtain a display interaction result.

[0008] In one possible implementation of the present application, the display of the synthesized display data corresponding to the target display request comprises:

[0009] Obtain first initial display data;

[0010] Render the first initial display data using a display rendering component to obtain first display rendering data;

[0011] Perform display synthesis on the first display rendering data and the second initial display data according to a display synthesis component to obtain synthesized display data;

[0012] Display the synthesized display data in a target display area corresponding to the target display request.

[0013] In a possible implementation manner of the present application, the rendering of the first initial display data by the display rendering component comprises:

[0014] generating a first display area based on display size information of the second display data;

[0015] drawing the first initial display data in the first display area to obtain initial drawing data;

[0016] mask rendering the initial drawing data by the display rendering component to obtain the first display data.

[0017] In a possible implementation manner of the present application, the display interaction instruction corresponding to the synthesized display data comprises:

[0018] acquiring interaction image information of a target interaction object corresponding to the display interaction request;

[0019] performing posture recognition on the target interaction object based on the interaction image information to obtain interaction posture information of the target interaction object;

[0020] determining the display interaction instruction of the target interaction object according to the interaction posture information.

[0021] In a possible implementation manner of the present application, the display interaction instruction of the target interaction object determined according to the interaction posture information comprises:

[0022] acquiring interaction posture type and posture position information corresponding to the interaction posture information;

[0023] accessing an interaction database to acquire a target control instruction corresponding to the interaction posture type;

[0024] positioning a target interaction area in the target display data based on the posture position information;

[0025] generating a display interaction instruction according to the target control instruction and the target interaction area.

[0026] In a possible implementation manner of the present application, the display control of the synthesized display data based on the display interaction instruction comprises:

[0027] displaying a target interaction component in a target interaction area of first display data in the synthesized display data based on the display interaction instruction;

[0028] displaying target display data in the second display data by using the target interaction component;

[0029] The target display data is controlled by using the target control instruction in the display interaction instruction, and a display interaction result is obtained.

[0030] In a possible implementation of the present application, the display interaction result is obtained by controlling the target display data by using the target control instruction in the display interaction instruction, and the controlling comprises:

[0031] The target display data is updated by using the target control instruction, and updated display data is obtained, the target control instruction comprises any one of a zoom control instruction, a play control instruction and a drag control instruction;

[0032] The updated display data is displayed in the target interaction component, and the display interaction result is obtained.

[0033] In another aspect, the present application provides a display interaction device, and the display interaction device comprises:

[0034] A data display module configured to display, in response to a target display request, composite display data corresponding to the target display request, the composite display data comprising first display data displayed on a first display layer and second display data displayed on a second display layer;

[0035] An interaction response module configured to obtain, in response to a display interaction request for the composite display data, display interaction instruction corresponding to the composite display data;

[0036] A display interaction module configured to control the composite display data by using the display interaction instruction, and obtain a display interaction result.

[0037] In another aspect, the present application further provides a display interaction device, and the display interaction device comprises:

[0038] One or more processors;

[0039] A memory; and

[0040] One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the steps of the display interaction method.

[0041] In another aspect, the present application further provides a computer readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to execute the steps of the display interaction method.

[0042] In the present application, in response to a target display request, the synthetic display data corresponding to the target display request is displayed, the synthetic display data includes first display data displayed on a first display layer and second display data displayed on a second display layer; in response to a display interaction request for the synthetic display data, a display interaction instruction corresponding to the synthetic display data is obtained; and the synthetic display data is controlled based on the display interaction instruction to obtain a display interaction result. The synthetic display data composed of the first display data and the second display data is displayed in a specific display mode in the intelligent display terminal, and in response to the display interaction request triggered by the target object through gesture interaction and other interactive operations, the display interaction instruction corresponding to the synthetic display data is obtained, and the display effect of the first display data and / or the second display data in the synthetic display data is controlled by using the display interaction instruction, thereby improving the display interactivity of the intelligent display terminal, improving the interactive interest of the intelligent display terminal, and further improving the user experience of the intelligent display terminal. BRIEF DESCRIPTION OF DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0044] Figure 1 The scene schematic diagram of the display interaction method of the embodiments of the present application is shown.

[0045] Figure 2 The flowchart of one embodiment of the display interaction method in the embodiments of the present application is shown.

[0046] Figure 3 The scene schematic diagram of one embodiment of the display control method provided by the embodiments of the present application is shown.

[0047] Figure 4 The structure schematic diagram of one embodiment of the display interaction device provided by the embodiments of the present application is shown.

[0048] Figure 5 The structure schematic diagram of one embodiment of the display interaction device provided by the embodiments of the present application is shown. DETAILED DESCRIPTION

[0049] With reference to the accompanying drawings, the technical solutions in the embodiments of the present application will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments of the present application, any other embodiments obtained by a person of ordinary skill in the art without creative effort should fall within the scope of the present application.

[0050] In the description of the present application, it should be understood that the orientation or positional relationship indicated by the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second" are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise explicitly and specifically limited.

[0051] In the present application, the word "exemplary" is used to mean "serving as an example, instance, or illustration." Any implementation described as "exemplary" is not necessarily to be construed as preferred or advantageous over other implementations. The following description is presented to enable any person skilled in the art to make and use the application. In the following description, for purposes of explanation, specific details are set forth. It will be apparent to those skilled in the art that the present application can be practiced without the specific details. In other instances, well-known structures and processes are not elaborated in order not to obscure the description of the present application with unnecessary details. Thus, the present application is not intended to be limited by the embodiments shown, but is to be accorded with the full scope consistent with the principles and features disclosed in this application.

[0052] At present, with the rapid development of the field of intelligent display devices, the types and functions of intelligent display devices are also increasingly diversified. For example, an intelligent display device can display a static image or a dynamic image in a standby mode or other operating modes to improve the decoration effect of the intelligent display device. However, the existing intelligent display device can only fixedly display a related decoration image and cannot interact, resulting in poor display interactivity.

[0053] Based on this, the application proposes a display interaction method, device, equipment and computer readable storage medium to solve the technical problem that the intelligent display device cannot interact in the specified running mode in the prior art, resulting in poor display interaction.

[0054] The display interaction method in the embodiment of the application is applied to a display interaction device, which is arranged in a display interaction equipment. The display interaction equipment is provided with one or more processors, a memory and one or more application programs. The one or more application programs are stored in the memory and are configured to be executed by the processor to implement the display interaction method. The display interaction equipment can be a smart terminal, such as a smart television, a mobile phone, a tablet computer, a smart wearable device and a smart computer. Optionally, the display interaction equipment can also be a server or a service cluster composed of multiple servers.

[0055] As shown in the figure, Figure 1 As shown in the figure, Figure 1 The figure shows a scene of the display interaction method of the embodiment of the application. The display interaction scene in the embodiment of the application includes a display interaction equipment 100 (the display interaction device is integrated in the display interaction equipment 100) and a target service terminal 200. The display interaction equipment 100 runs a computer readable storage medium corresponding to the display interaction method to execute the steps of the display interaction method. The target service terminal 200 is a service terminal that is connected to the display interaction equipment 100.

[0056] It can be understood that, Figure 1 The display interaction equipment in the display interaction method scene or the device included in the display interaction equipment does not constitute a limitation on the embodiment of the application, that is, the number and type of the display interaction equipment included in the scene of the display interaction method or the number and type of the devices included in each equipment do not affect the overall implementation of the technical solution in the embodiment of the application, and can be regarded as equivalent replacement or derivation of the technical solution claimed in the embodiment of the application.

[0057] The display interaction equipment 100 in the embodiment of the application is mainly used for: responding to a target display request, displaying the synthesized display data corresponding to the target display request, the synthesized display data including first display data displayed on a first display layer and second display data displayed on a second display layer;

[0058] In response to a display interaction request for the synthesized display data, a display interaction instruction corresponding to the synthesized display data is obtained;

[0059] Based on the display interaction instruction, the synthesized display data is controlled to obtain a display interaction result.

[0060] The display interaction device 100 in the embodiment of the present application can be a stand-alone display interaction device, such as a smart television, a mobile phone, a tablet computer, a virtual reality device (such as AR, VR and XR, etc.), a server and a smart computer, etc. smart terminal, or a display interaction network or display interaction cluster composed of multiple display interaction devices.

[0061] The present application embodiment provides a display interaction method, device, equipment and computer readable storage medium, which are described in detail below.

[0062] Those skilled in the art can understand that, Figure 1 The application environment shown in the above is only one of the application scenarios related to the present application scheme, and does not constitute a limitation on the application scenarios of the present application scheme. Other application environments can also include more or less display interaction devices than Figure 1 The display interaction method shown in the above is only one of the application scenarios related to the present application scheme, and does not constitute a limitation on the application scenarios of the present application scheme. Other application environments can also include more or less display interaction devices than Figure 1 Only one display interaction device is shown in the above, and it can be understood that the scene of the display interaction method can also include one or more display interaction devices, which are not limited in detail. The display interaction device 100 can also include a memory for storing display interaction instructions and other data.

[0063] It should be noted that, Figure 1 The scene diagram of the display interaction method shown in the above is only one example, and the scene of the display interaction method described in the present application embodiment is to more clearly illustrate the technical scheme of the present application embodiment, and does not constitute a limitation on the technical scheme provided by the present application embodiment.

[0064] Based on the above display interaction method, various embodiments of the display interaction method disclosed in the present application are proposed.

[0065] As Figure 2 shown, Figure 2 The display interaction method includes the following steps 201-203:

[0066] 201, in response to a target display request, display the synthesized display data corresponding to the target display request;

[0067] The display interaction method in the present embodiment is applied to a display interaction device, and the type and number of display interaction devices are not limited, that is, the display interaction device can be one or more smart terminals or servers, and in a specific embodiment, the display interaction device is a smart display device.

[0068] Optionally, the synthesized display data comprises at least two overlapped display layers, and the mixed display data is synthesized by at least two display data. The synthesized display data comprises the first display data displayed on the first display layer and the second display data displayed on the second display layer. The first display layer and the second display layer are overlapped display layers of the same size. The first display layer is overlaid on the second display layer. Optionally, in an embodiment, the synthesized display data comprises the first display data and the second display data.

[0069] The first display data is image data displayed on the first display layer. The first display data can be any one or more of static image data, dynamic image data, and video image data in any format.

[0070] The second display data is image data displayed on the first display layer. The second display data can be any one or more of static image data, dynamic image data, and video image data in any format. In an embodiment, the first display data is mask image data overlaid on the second display data. The second display data is video data under the first display data.

[0071] Optionally, in an embodiment, the first display data in the synthesized display data can be any image data, and the second display data in the synthesized display data can be dynamic image data, video data, or the like different from the image data. Optionally, in other embodiments, the first display data and the second display data can also be display image data with different image appearances, such as image color, image contrast, image exposure, and image object.

[0072] Optionally, the display interaction device can receive a target display request during operation. The target display request is a control instruction for controlling the display interaction device to continuously display the synthesized display image or other display image to improve the decoration of the target display terminal. Optionally, the trigger mode of the target display request is not limited herein, i.e., the target display request can be actively triggered by a target object, for example, the target object actively triggers the target display request by clicking the display interaction device or a target display button (which can be a virtual button or a physical button) in communication connection with the display interaction device. Optionally, the target display request can also be automatically triggered by the display interaction device, for example, when the display interaction device switches to a specified operation mode (such as a standby operation mode and a picture frame operation mode), the target display request is automatically triggered to improve the decoration effect of the display interaction device or the target display terminal in communication connection with the display interaction device.

[0073] Optionally, the display interaction device, after obtaining the target display request, obtains the synthesized display data corresponding to the target display request, and displays the synthesized display data corresponding to the target display request on the display interaction device or a target display terminal in communication connection with the display interaction device.

[0074] Optionally, before displaying the synthesized display data, the display interaction device further obtains first initial display data and corresponding second initial display data. The first initial display data is unrendered image data corresponding to the first display data. The first initial display data and the second initial display data can be image material data (including any one or more of static image material, dynamic image material, and video image material) obtained from a preset material library in the display interaction device. In addition, the first initial display data and the second initial display data can also be generated image data automatically generated by a generative model in the display interaction device.

[0075] For example, in a specific embodiment, after obtaining the target display request, the display interaction device further obtains image prompt information corresponding to the target display request. The image prompt information is prompt label information for guiding the generative model corresponding to the display interaction device to generate corresponding image information. The image prompt information can be any label information for guiding the model to generate corresponding generated images as the first initial display data and the second initial display data, such as scene prompt label, character prompt label, author prompt label, and style prompt label.

[0076] Optionally, after obtaining the first initial display data and the second initial display data, the display interaction device renders the first initial display data using a display rendering component to obtain first display rendering data. That is, the display interaction device renders the first initial display data into display data capable of changing images according to interaction instructions using the display rendering component. Optionally, in a specific embodiment, the display interaction device modifies the first initial display data into mask image data using the display rendering component to obtain the first display rendering data. Optionally, in a specific embodiment, the display rendering component can be a canvas rendering component (Canvas API) or other rendering component.

[0077] Optionally, the display interaction device can also add an interactive control in the first initial display data using the display rendering component to generate the first display rendering data. That is, the display interaction device can generate a display control control for adjusting the display state of the first initial display data in the first initial display data using the display rendering component to obtain the first display data, so that the first display rendering data can be modified in the subsequent display interaction process by the display control control to realize interaction control.

[0078] Optionally, the display interaction device generates the first display area based on the display size information of the second initial display data, that is, the display interaction device acquires the display size information of the second initial display data, and configures the initial rendering canvas using the display size information to obtain the first display area. The display size information is size parameter information representing the image size of the second initial display data. For example, the display size information can be any one or more of image height information, image width information, and display ratio information of the second initial display data. The first display area is a canvas area for displaying the first display rendering image.

[0079] Optionally, after generating the first display area, the display interaction device draws the first initial display data in the first display area to obtain initial drawing data, and performs mask rendering on the initial drawing data using the display rendering component to obtain first display rendering data.

[0080] Optionally, after acquiring the first display rendering data, the display interaction device performs display synthesis on the first display rendering data and the second initial display data according to the display synthesis component to obtain synthesis display data. That is, the display interaction device loads the second initial display data in the second display layer using the target loading element, and superimposes and displays the first display rendering data on the first display layer above the second display layer using the display synthesis component, so as to realize superimposed display of the first display rendering data on the second initial display data, and determine the first display rendering data as the first display data and the second initial display data as the second display data to obtain the synthesis display data.

[0081] Optionally, after acquiring the synthesis display data, the display interaction device displays the synthesis display data on the display interaction device or a target display terminal in communication connection with the display interaction device, so as to improve the decoration effect of the display interaction device or the target display terminal in communication connection with the display interaction device, and expand the application scenarios of the display interaction device or the target display terminal in communication connection with the display interaction device.

[0082] 202、in response to a display interaction request for the synthesis display data, acquiring a display interaction instruction corresponding to the synthesis display data;

[0083] Optionally, during the display of the synthesis display image, the display interaction device also acquires a display interaction instruction corresponding to the synthesis display data in response to a display interaction request for the synthesis display data.

[0084] Optionally, the display interaction request is a control request for the target object to interact with the display interaction device for the composite display data. Optionally, the display interaction request can be triggered by the display interaction device, a control device in communication connection with the display interaction device, or a body sense of the target object. For example, the display interaction request can be triggered remotely by a user through the control device, or the display interaction request can also be triggered by a body sense control of the target object on the display interaction device.

[0085] Optionally, in one specific embodiment, the target object can send display interaction information carrying a display interaction instruction to the display interaction device through the control device, and the display interaction device parses the display interaction information to determine the display interaction instruction.

[0086] Optionally, in another specific embodiment, the target object can also execute corresponding gestures or body sense postures, etc. interaction posture information, and the display interaction device collects interaction image information containing the interaction posture information executed by the target object through the image acquisition module, and then extracts the interaction posture information by recognizing the interaction image information, and then determines the display interaction instruction of the target interaction object according to the interaction posture information.

[0087] That is, the display interaction device collects interaction image information of the target interaction object corresponding to the display interaction request in the process of displaying the composite display data. Wherein, the target interaction object is a target user object interacting with the display interaction device. That is, the display interaction device can collect images of the target interaction object through the built-in image acquisition module, or the image acquisition module of other smart home appliances in communication connection with the display interaction device, to obtain the interaction image information of the target interaction object.

[0088] Optionally, after obtaining the interaction image information, the display interaction device also performs posture recognition on the target interaction object based on the interaction image information to obtain the interaction posture information of the target interaction object. That is, the display interaction device can extract and recognize the interaction posture information of the target interaction object using the interaction image information.

[0089] Optionally, in one specific embodiment, the display interaction device can perform posture recognition on the target interaction object using an interaction recognition model, that is, the display interaction device inputs the interaction image information into the interaction recognition model for posture recognition, and obtains the interaction posture information output by the interaction recognition model.

[0090] Optionally, the display interaction device further obtains an interaction gesture type and gesture position information corresponding to the interaction gesture information after obtaining the interaction gesture information. The interaction gesture type represents a gesture category of the gesture action performed by the target interaction object. For example, in an embodiment, the gesture action performed by the target interaction object is a gesture action, and the gesture action includes a click gesture category, a sliding gesture category, a grabbing gesture category, and a pushing and pulling gesture category, which represent the interaction gesture type of specific interaction information.

[0091] Optionally, the gesture position information represents motion key point information corresponding to the gesture action performed by the target interaction object. For example, in an embodiment, the gesture position information can be joint position information or finger position information corresponding to the interaction gesture action performed by the target interaction object.

[0092] Optionally, the display interaction device determines a display interaction instruction according to the interaction gesture type and the gesture position information after obtaining the interaction gesture type and the gesture position information. That is, the display interaction device accesses an interaction database to obtain a target control instruction corresponding to the interaction gesture type, where the interaction database is a database storing a mapping relationship between each interaction gesture type and a target control instruction. The display interaction device inputs the interaction gesture type into the interaction database to obtain the target control instruction corresponding to the interaction gesture type in the interaction database. In an embodiment, the target control instruction corresponding to the interaction gesture type includes a display zoom instruction, a display movement instruction, and a playback control instruction. Different interaction gesture types correspond to a target control instruction.

[0093] Optionally, the display interaction device further locates a target interaction region in the target display data based on the gesture position information. That is, the display interaction device maps the gesture position information to a corresponding display position in the composite display data to determine the target interaction region in the composite display data after obtaining the gesture position information. That is, the display interaction device performs coordinate conversion on the gesture position information to determine conversion position information of the gesture position information in the composite display data, and determines the target interaction region according to the target interaction range and the conversion position information. In an embodiment, the display interaction device can determine the conversion position information as a midpoint region of the target interaction range to determine the target interaction region. The target interaction range is an interaction control region configured by the display interaction device according to different target control instructions.

[0094] Optionally, the display interaction device generates a display interaction instruction according to the target control instruction and the target interaction region after obtaining the target control instruction and the target interaction region. That is, the display interaction device determines the target control instruction and the target interaction region as a display interaction instruction of the composite display data.

[0095] 203、based on the display interaction instruction, display control is performed on the synthesized display data to obtain a display interaction result.

[0096] Optionally, after obtaining the display interaction instruction, the display interaction device further performs display control on the synthesized display data based on the display interaction instruction to obtain a display interaction result. That is, the display interaction device performs display control on the first display data and / or the second display data in the synthesized display data by using the display interaction instruction, thereby realizing interaction control on the synthesized display data, improving the interactivity and interest of the synthesized display data, and obtaining a display interaction result.

[0097] Optionally, the display interaction device displays a target interaction component in the target interaction region of the first display data in the synthesized display data based on the display interaction instruction, that is, the display interaction device obtains the target interaction region associated with the synthesized display data in the display interaction instruction, and displays a target interaction component in the target interaction region, where the target interaction component is a window interaction rendering component for interacting with the target interaction region in the synthesized display data. Optionally, as shown in Figure 3 , Figure 3 The scene schematic diagram of one embodiment of the display control method provided by the embodiments of the present application is shown in Figure 3 The target interaction component can be a circular light ring component in the embodiment shown. Optionally, in other embodiments, the target interaction component can also be an interaction component of other shapes, and the embodiments are not limited in particular. Optionally, in one specific embodiment, the component size of the target interaction component is the same as the size of the target interaction region.

[0098] Optionally, after displaying the target interaction component in the target interaction region of the first display data in the synthesized display data, the display interaction device displays target display data in the second display data by using the target interaction component, and performs display control on the target display data by using the target control instruction in the display interaction instruction to obtain a display interaction result.

[0099] Optionally, the display interaction device can adjust the image transparency of the mask image data corresponding to the first display data in the target interaction region by using the target interaction component in the target interaction region, so that the display interaction device can display target display data in the second display data in the target interaction region, where the target display data is part of the second display data displayed in the target interaction region and to be interacted with in the display interaction process.

[0100] Optionally, after obtaining the target display data, the display interaction device further performs display control on the target display data by using the target control instruction in the display interaction instruction, thereby adjusting the display state of the target display data to obtain a display interaction result.

[0101] Optionally, the display interaction device can update the display state of the target display data by using the target control instruction to obtain a display interaction result. For example, the display control device can control the target display data to play by using the play control instruction in the target control instruction, so as to watch the dynamic playing of the target display data and obtain a display interaction result.

[0102] Optionally, the display interaction device can also update the target display data by using the target control instruction to obtain updated display data. For example, the display control device can control the target display data to zoom by using the zoom control instruction in the target control instruction, so as to update the size of the target display data and obtain updated display data.

[0103] Optionally, the display interaction device can also update the target display data by using the target control instruction to obtain updated display data. For example, the display control device can move the second display data in the target display area by using the drag instruction in the target control instruction to select new target display data in the target display area and determine the new target display data in the target display area as the updated display data.

[0104] Optionally, the display interaction device can display the updated display data in the target interaction component after obtaining the updated display data to obtain a display interaction result.

[0105] Optionally, the display interaction device can also update and render the appearance of the target interaction component during the interaction process to obtain an updated target interaction component, so as to enhance the interaction perception. For example, the display interaction device can add a gradient transparent effect to the target interaction component during the interaction process to improve the visual fluency during the interaction process.

[0106] In this embodiment, the display interaction device displays the composite display data corresponding to the target display request by responding to the target display request, the composite display data including first display data displayed on a first display layer and second display data displayed on a second display layer; the display interaction device acquires display interaction instructions corresponding to the composite display data by responding to a display interaction request for the composite display data; and the display interaction device performs display control on the composite display data based on the display interaction instructions to obtain a display interaction result. In this way, the smart display terminal can display the composite display data composed of the first display data and the second display data in a specific display mode, and can respond to a display interaction request for the composite display data triggered by a target object through gesture interaction or other interactive operations, acquire display interaction instructions corresponding to the composite display data, and control the display effect of the first display data and / or the second display data in the composite display data by using the display interaction instructions, thereby improving the display interactivity of the smart display terminal, improving the interactive interest of the smart display terminal, and further improving the user experience of the smart display terminal.

[0107] To better implement the display interaction method in the embodiments of the present application, on the basis of the display interaction method, the embodiments of the present application further provide a display interaction device, as shown in Figure 4 Figure 4 FIG. 1 is a structural schematic diagram of one embodiment of the display interaction device provided by the embodiments of the present application. Specifically, the display interaction device 300 includes:

[0108] The data display module 301 is configured to display the composite display data corresponding to the target display request by responding to the target display request, the composite display data including first display data displayed on a first display layer and second display data displayed on a second display layer.

[0109] The interaction response module 302 is configured to acquire the display interaction instructions corresponding to the composite display data by responding to the display interaction request for the composite display data.

[0110] The display interaction module 303 is configured to perform display control on the composite display data based on the display interaction instructions to obtain a display interaction result.

[0111] In one possible implementation manner of the embodiments, the display interaction device displays the composite display data corresponding to the target display request by responding to the target display request, and the method includes:

[0112] acquiring first initial display data;

[0113] rendering the first initial display data by using a display rendering component to obtain first display rendering data;

[0114] ​The first display rendering data and the second initial display data are combined using the display compositing component to obtain composite display data.

[0115] The composite display data is displayed in the target display area corresponding to the target display request.

[0116] In one possible implementation of this embodiment, the display interaction device uses a display rendering component to render the first initial display data to obtain first display rendering data, including:

[0117] A first display area is generated based on the display size information of the second display data;

[0118] The first initial display data is drawn in the first display area to obtain the initial drawing data;

[0119] The initial drawing data is masked and rendered using the display rendering component to obtain the first display data.

[0120] In one possible implementation of this embodiment, the display interaction device acquires a display interaction instruction corresponding to the synthesized display data, including:

[0121] Collect the interactive image information of the target interactive object corresponding to the display interaction request;

[0122] Based on the interactive image information, the target interactive object is subjected to posture recognition to obtain the interactive posture information of the target interactive object;

[0123] The display interaction command for the target interactive object is determined based on the interaction posture information.

[0124] In one possible implementation of this embodiment, the display interaction device determines the display interaction instruction of the target interaction object based on the interaction posture information, including:

[0125] Obtain the interaction posture type and posture position information corresponding to the interaction posture information;

[0126] Access the interaction database to obtain the target control command corresponding to the interaction posture type;

[0127] Based on the posture and position information, locate the target interactive area in the target display data;

[0128] Display interaction instructions are generated based on the target control instructions and the target interaction area.

[0129] In one possible implementation of this embodiment, the display interaction device controls the display of the synthesized display data based on the display interaction command to obtain a display interaction result, including:

[0130] display a target interaction component in a target interaction area of the first display data in the composite display data based on the display interaction instruction;

[0131] display target display data in the second display data by using the target interaction component;

[0132] perform display control on the target display data by using a target control instruction in the display interaction instruction, to obtain a display interaction result.

[0133] In a possible implementation manner of the display interaction apparatus, the display control on the target display data by using the target control instruction in the display interaction instruction to obtain the display interaction result includes:

[0134] updating the target display data by using the target control instruction corresponding to the target control instruction, to obtain updated display data, the target control instruction including any one of a zoom target control instruction and a drag instruction type;

[0135] displaying the updated display data in the target interaction component to obtain the display interaction result.

[0136] In the embodiment, the display interaction apparatus displays the composite display data corresponding to a target display request by responding to the target display request, the composite display data including first display data displayed on a first display layer and second display data displayed on a second display layer; acquires a display interaction instruction corresponding to the composite display data by responding to a display interaction request for the composite display data; and performs display control on the composite display data based on the display interaction instruction, to obtain a display interaction result. The display interaction apparatus can realize the following functions: the smart display terminal displays the composite display data composed of the first display data and the second display data in a specific display mode, and responds to a display interaction request for the composite display data triggered by a target object through a gesture interaction or other interaction operations, acquires a display interaction instruction corresponding to the composite display data, and controls the display effect of the first display data and / or the second display data in the composite display data by using the display interaction instruction, thereby improving the display interactivity of the smart display terminal, improving the interaction interest of the smart display terminal, and further improving the user experience of the smart display terminal.

[0137] The display interaction apparatus provided in the embodiment of the present application includes the display interaction device provided in the embodiment of the present application. Figure 5 The display interaction apparatus provided in the embodiment of the present application includes the display interaction device provided in the embodiment of the present application. Figure 5 The display interaction apparatus provided in the embodiment of the present application includes the display interaction device provided in the embodiment of the present application.

[0138] The display interaction apparatus provided in the embodiment of the present application includes the display interaction device provided in the embodiment of the present application.

[0139] one or more processors;

[0140] a memory; and

[0141] one or more application programs, wherein the one or more application programs are stored in the memory and configured to perform the steps of the display interaction method in any of the display interaction method embodiments described above by the processor.

[0142] In particular, the display interaction device can include a processor 401 with one or more processing cores, a memory 402 with one or more computer readable storage media, a power supply 403, and an input unit 404, etc. Those skilled in the art can understand that the display interaction device structure shown in the figure does not constitute a limitation on the display interaction device, and can include more or fewer components than those shown, or combine certain components, or different component arrangements. Among them: Figure 5 The processor 401 is the control center of the display interaction device, which connects various parts of the display interaction device through various interfaces and lines, and performs various functions of the display interaction device and processes data by running or executing software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, thereby overall monitoring the display interaction device. Optionally, the processor 401 can include one or more processing cores; preferably, the processor 401 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application program, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 401.

[0143] The memory 402 can be used to store software programs and modules, and the processor 401 performs various function applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 can mainly include a program storage area and a data storage area, wherein the program storage area can store the operating system, at least one application program required by the function (such as sound playing function, image playing function, etc.), etc.; the data storage area can store data created according to the use of the display interaction device, etc. In addition, the memory 402 can include a high-speed random access memory, and can also include a non-volatile memory, for example, at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 402 can also include a memory controller to provide access for the processor 401 to the memory 402.

[0144]

[0145] ​The display interaction device further comprises a power supply 403 for powering the various components. Preferably, the power supply 403 is logically connected to the processor 401 through a power management system, so that the power management system can be used to manage charging, discharging, power consumption management, etc. The power supply 403 can further comprise one or more DC or AC power sources, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, etc.

[0146] The display interaction device can further comprise an input unit 404 for receiving inputted digital or character information, and generating keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0147] Although not shown, the display interaction device can further comprise a display unit, etc., which will not be described here. In the present embodiment, the processor 401 in the display interaction device loads one or more executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and runs the application programs stored in the memory 402 by the processor 401, so as to implement various functions, such as:

[0148] in response to a target display request, displaying synthetic display data corresponding to the target display request, the synthetic display data comprising first display data displayed on a first display layer and second display data displayed on a second display layer;

[0149] in response to a display interaction request for the synthetic display data, obtaining a display interaction instruction corresponding to the synthetic display data;

[0150] based on the display interaction instruction, performing display control on the synthetic display data to obtain a display interaction result.

[0151] To this end, the embodiment of the present application provides a computer readable storage medium, which can include a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc. A computer program is stored on the computer readable storage medium, and the computer program is loaded by a processor to execute the steps of any one of the display interaction methods provided by the embodiment of the present application. For example, the computer program loaded by the processor can execute the following steps:

[0152] in response to a target display request, displaying synthetic display data corresponding to the target display request, the synthetic display data comprising first display data displayed on a first display layer and second display data displayed on a second display layer;

[0153] In response to a display interaction request for the synthesized display data, a display interaction instruction corresponding to the synthesized display data is acquired;

[0154] Based on the display interaction instruction, the synthesized display data is controlled to obtain a display interaction result.

[0155] In the above embodiments, the description of each embodiment has its own focus. The parts not described in detail in a certain embodiment can be referred to the detailed description of other embodiments above, which will not be described here again.

[0156] In the implementation, each unit or structure above can be implemented as an independent entity, or can be combined as the same or several entities. The specific implementation of each unit or structure can be referred to the method embodiments above, which will not be described here again.

[0157] The specific implementation of each operation above can be referred to the embodiments above, which will not be described here again.

[0158] The display interaction method provided by the embodiments of the present application is described in detail above. The principles and implementation manners of the present application are described by applying specific embodiments. The above embodiment descriptions are only used to help understand the method of the present application and its core idea. Meanwhile, for those skilled in the art, the specific implementation manners and application ranges will be changed according to the idea of the present application. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A display interaction method, characterized in that, The display interaction method comprises: in response to a target display request, displaying the synthetic display data corresponding to the target display request, the synthetic display data comprising first display data displayed on a first display layer and second display data displayed on a second display layer; in response to a display interaction request for the synthetic display data, obtaining display interaction instructions corresponding to the synthetic display data; based on the display interaction instructions, performing display control on the synthetic display data to obtain a display interaction result.

2. The display interaction method of claim 1, wherein, The display of the synthetic display data corresponding to the target display request comprises: obtaining first initial display data and corresponding second initial display data; rendering the first initial display data using a display rendering component to obtain first display rendering data; performing display synthesis on the first display rendering data and the second initial display data according to a display synthesis component to obtain synthetic display data; displaying the synthetic display data in a target display area corresponding to the target display request.

3. The display interaction method of claim 2, wherein, The rendering of the first initial display data using a display rendering component to obtain first display rendering data comprises: generating a first display area based on display size information of the second initial display data; drawing the first initial display data in the first display area to obtain initial drawing data; performing mask rendering on the initial drawing data using the display rendering component to obtain first display rendering data.

4. The display interaction method of claim 1, wherein, The obtaining of display interaction instructions corresponding to the synthetic display data comprises: collecting interaction image information of a target interaction object corresponding to the display interaction request; based on the interaction image information, performing posture recognition on the target interaction object to obtain interaction posture information of the target interaction object; determining display interaction instructions of the target interaction object according to the interaction posture information.

5. The display interaction method of claim 4, wherein, The determination of display interaction instructions of the target interaction object according to the interaction posture information comprises: obtaining interaction posture type and posture position information corresponding to the interaction posture information; accessing an interaction database to obtain target control instructions corresponding to the interaction posture type; based on the posture position information, locating a target interaction area in the synthetic display data; generating display interaction instructions according to the target control instructions and the target interaction area.

6. The display interaction method of claim 1, wherein, The display control on the synthetic display data based on the display interaction instructions to obtain a display interaction result comprises: based on the display interaction instructions, displaying a target interaction component in a target interaction area of the first display data in the synthetic display data; displaying target display data in the second display data using the target interaction component; performing display control on the target display data using target control instructions in the display interaction instructions to obtain a display interaction result.

7. The display interaction method of claim 6, wherein, The display control on the target display data using target control instructions in the display interaction instructions to obtain a display interaction result comprises: updating the target display data using the target control instructions to obtain updated display data, the target control instructions comprising any one of a zoom control instruction, a play control instruction and a drag control instruction; The target interaction component displays the updated display data, and obtains a display interaction result.

8. A display interaction device, characterized by The display interaction apparatus comprises: a data display module configured to display, in response to a target display request, composite display data corresponding to the target display request, the composite display data comprising first display data displayed on a first display layer and second display data displayed on a second display layer; an interaction response module configured to obtain a display interaction instruction corresponding to the composite display data in response to a display interaction request for the composite display data; a display interaction module configured to perform display control on the composite display data based on the display interaction instruction, and obtain a display interaction result.

9. A display interaction device, characterized by The display interaction apparatus comprises: one or more processors; a memory; and one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the steps of the display interaction method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the display interaction method according to any one of claims 1 to 7.

Images