Interaction control method and electronic equipment

Abstract

The invention provides an interaction control method and electronic equipment, and the method comprises the steps: obtaining target to-be-displayed content in response to a target trigger event, the target to-be-displayed content being display data to be output by target wearable equipment; determining a target display area based on the relative position information between the target wearable device and the electronic device, wherein the target display area comprises a screen area, used for presenting the to-be-displayed content, of the electronic device; the electronic equipment is controlled to output target to-be-displayed content in the target display area, and the target to-be-displayed content and original display content on a display screen of the electronic equipment are located on the same layer or different layers.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an interactive control method and electronic device. Background Technology

[0002] Currently, wearable devices can have built-in smart assistants and be used in conjunction with electronic devices. However, the display function of wearable devices still faces some technical bottlenecks, and the cost of display functions is relatively high. Therefore, how to display the data to be output by wearable devices is an urgent problem to be solved. Summary of the Invention

[0003] This application provides an interactive control method and an electronic device.

[0004] According to a first aspect of this application, an interactive control method is provided, applied to an electronic device, the method comprising: In response to a target trigger event, obtain the target content to be displayed, which is the display data to be output by the target wearable device; The target display area is determined based on the relative position information between the target wearable device and the electronic device. The target display area includes the screen area of ​​the electronic device used to present the content to be displayed. The electronic device is controlled to output the target content to be displayed in the target display area, wherein the target content to be displayed is located on the same layer or a different layer from the original display content on the display screen of the electronic device.

[0005] According to one embodiment of this application, the method further includes: Adjust the display parameters of the target display area and / or update the target content to be displayed based on the motion data of the target wearable device; The display parameters include at least one of the following: display position of the target display area, display mode, display size, display refresh rate, display transparency, display brightness, and display identifier. The target content to be displayed may or may not be related to the original content to be displayed.

[0006] According to one embodiment of this application, in response to a target triggering event, the target content to be displayed is obtained, including at least one of the following: In response to receiving the first instruction to invoke the smart assistant built into the target wearable device, the target interactive interface of the smart assistant is used as the target content to be displayed; In response to obtaining a second instruction to invoke the target function service of the smart assistant built into the target wearable device, the processing result of the target original content on the display screen of the electronic device by invoking the target function service is used as the target content to be displayed; In response to the target wearable device switching to wearing mode, the target interactive interface of the smart assistant built into the target wearable device is used as the target content to be displayed, or the processing result of the target wearable device on the display screen of the electronic device is used as the target content to be displayed. In response to the electronic device running the target application, the processing result of the target wearable device on the target original content on the display screen is used as the target content to be displayed.

[0007] According to one embodiment of this application, determining a target display area based on the relative position information between the target wearable device and the electronic device includes: Obtain the relative coordinates between the center of the target display screen of the electronic device and the corresponding sensing center of the target sensor of the target wearable device on the target display screen; The target display area is determined based on relative coordinates and the relative distance between the target wearable device and the target display screen; The target sensing device includes at least one of an image sensor, an ultra-wideband sensor, a time-of-flight sensor, a radar sensor, and an ultrasonic sensor.

[0008] According to one embodiment of this application, determining a target display area based on the relative position information between the target wearable device and the electronic device includes at least one of the following: The target display area is determined based on the source information and relative position information of the target content to be displayed; The target display area is determined based on the correlation and relative position information between the target content to be displayed and the original display content; Obtain user profile information of the target user, and determine the target display area based on the user profile information and relative location information; Obtain the display layout information of the original display content of the target display screen of the electronic device, and determine the target display area based on the display layout information and relative position information; Obtain the attribute information of the target wearable device, and determine the target display area based on the attribute information and relative position information.

[0009] According to one embodiment of this application, adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion data of the target wearable device includes at least one of the following: When the target content to be displayed comes from the target interactive interface of the smart assistant built into the target wearable device, the display parameters of the target display area or the target projection window therein are adjusted and / or the target content to be displayed is updated based on the motion trajectory of the target wearable device. When the target content to be displayed comes from the processing result of the target wearable device on the display screen of the electronic device, the coordinate change information transmitted by the target wearable device is obtained. Based on the target triggering conditions satisfied by the coordinate change information, the display parameters of the target display area or the target projection window therein are adjusted and / or the target content to be displayed is updated. Here, the coordinate change information is the change data of the center coordinates of the target sensor of the target wearable device on the target display screen of the electronic device. Among them, the target projection window is the window corresponding to the target wearable device used to display the target content on the display screen of the electronic device.

[0010] According to one embodiment of this application, adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion trajectory of the target wearable device includes at least one of the following: If the motion trajectory of the target wearable device belongs to the first type of trajectory, adjust the display parameters of the target display area or the target projection window therein based on the adjustment parameters corresponding to the motion trajectory. If the movement trajectory of the target wearable device belongs to the second type of trajectory, update the target content to be displayed based on the switching command corresponding to the movement trajectory; When the motion trajectory of the target wearable device belongs to the third type of trajectory, adjust the display parameters of the target display area or the target projection window therein based on the adjustment parameters corresponding to the motion trajectory, and update the target content to be displayed based on the switching command corresponding to the motion trajectory. And / or, Based on the target triggering conditions satisfied by the coordinate change information, adjust the display parameters of the target display area and / or update the target content to be displayed, including at least one of the following: If the coordinate change information meets the first triggering condition, adjust the display parameters of the target display area or the target projection window within it based on the coordinate change information; or, If the coordinate change information meets the second trigger condition, update the target content to be displayed; or, If the coordinate change information meets the third triggering condition, adjust the display parameters of the target display area or the target projection window within it and update the target content to be displayed.

[0011] According to one embodiment of this application, adjusting the display parameters of the target display area based on the motion data of the target wearable device includes: Obtain the display layout information of the original display content of the target display screen of the electronic device; Based on the display layout information and motion data, the target projection window in the target display area is controlled to output the target content to be displayed in an embedded, floating, or 3D projection manner.

[0012] According to one embodiment of this application, the method further includes: Determine the relationship between the target content to be displayed and the original displayed content; When there is a correlation between the target content to be displayed and the original display content, the target content to be displayed and the original display content are controlled to move synchronously based on motion data; When there is no correlation between the target content to be displayed and the original display content, the movement of only the target display area is controlled based on motion data.

[0013] According to a second aspect of this application, an electronic device is provided, comprising: At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the following operations: In response to a target trigger event, obtain the target content to be displayed, which is the display data to be output by the target wearable device; The target display area is determined based on the relative position information between the target wearable device and the electronic device. The target display area includes the screen area of ​​the electronic device used to present the content to be displayed. Control the electronic device to output the target content to be displayed in the target display area, wherein the target content to be displayed is located on the same layer or a different layer from the original display content on the display screen of the electronic device; The electronic device includes a first body and a second body that are rotatably connected, and the electronic device includes a first screen area and a second screen area. The target display area is at least a portion of the first screen area and / or the second screen area. The first screen area is displayed on the first side of the first body, and the second screen area is stored in the first body or the second body. The electronic device has a first device form and a second device form. In the first device form, the second screen area is pulled out from the first body or the second body, and in the second device form, it is stored in the first body or the second body. or, The first screen area is located on the second side of the first body, and the second screen area is located on the third side of the second body. The included angle between the second side and the third side is 0 degrees to 360 degrees. or, The first screen area and the second screen area are both located on the second side of the first body, and the third side of the second body is provided with a keyboard and / or touchpad.

[0014] It should be understood that the teachings of this application are not required to achieve all the beneficial effects described above, but rather that a specific technical solution can achieve a specific technical effect, and other embodiments of this application can also achieve beneficial effects not mentioned above. Attached Figure Description

[0015] The above and other objects, features, and advantages of exemplary embodiments of this application will become readily apparent from the following detailed description taken in conjunction with the accompanying drawings. Several embodiments of this application are illustrated in the drawings by way of example and not limitation, in which: In the accompanying drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

[0016] Figure 1 This application illustrates a schematic diagram of the processing flow of the interactive control method provided in an embodiment. Figure 1 ; Figure 2 This illustration shows a schematic diagram of a first image captured by a target wearable device according to an embodiment of this application; Figure 3 This application illustrates a schematic diagram of the processing flow of the interactive control method provided in an embodiment. Figure 2 ; Figure 4 This application illustrates a schematic diagram of the processing flow of the interactive control method provided in an embodiment. Figure 3 ; Figure 5 This application illustrates a schematic diagram of the processing flow of the interactive control method provided in an embodiment. Figure 4 ; Figure 6 This application illustrates a schematic diagram of the processing flow of the interactive control method provided in an embodiment. Figure 5 ; Figure 7 A schematic diagram of the composition structure of the electronic device provided in the embodiments of this application is shown. Detailed Implementation

[0017] To make the objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0018] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0019] In the following description, the terms "first" and "second" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first" and "second" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0021] This application provides an interactive control method applied to electronic devices, such as... Figure 1 As shown, the interactive control methods include: S101, in response to the target trigger event, obtain the target content to be displayed, which is the display data to be output by the target wearable device.

[0022] In this embodiment, the electronic device is communicatively connected to the target wearable device, which can be used in conjunction with the electronic device. The target wearable device can be smart glasses, a smart ring, a smartwatch, etc. The electronic device can be a smartphone, tablet, all-in-one computer, smart TV, smart display, or laptop computer, etc.

[0023] In this embodiment, a target triggering event refers to a specific operation or condition that can activate display collaboration between the wearable device and the electronic device. Specifically, it can be implemented by activating a smart assistant, detecting the wearing status of the wearable device, or running a target application. This is used to match user interaction needs in real time and trigger the acquisition of the target content to be displayed. For example, a target triggering event could be waking up a smart assistant or invoking a specific function of the smart assistant, such as smart translation or smart interaction; or detecting the user wearing the target wearable device, such as detecting the user wearing smart glasses or a smart ring; or the electronic device running a specific application, such as an application that requires translation or a presentation.

[0024] In this embodiment, the target content to be displayed is the content to be projected onto the screen, which can be data generated by the target wearable device or electronic device and needs to be displayed on the screen of the electronic device. The target content to be displayed may or may not be related to the currently displayed content on the screen of the electronic device. For example, it may only be the interaction interface of a smart assistant, or a translation, extended report, or summary of the currently displayed content on the screen of the electronic device, etc. When the target data to be displayed is generated by the target wearable device, the electronic device can obtain the target content to be displayed by either the target wearable device actively sending the content to be displayed to the electronic device, or by the electronic device sending a request to the target wearable device to send the target content to be displayed to the electronic device.

[0025] S102, the target display area is determined based on the relative position information between the target wearable device and the electronic device. The target display area includes the screen area of ​​the electronic device used to present the content to be displayed.

[0026] In this embodiment, relative position information refers to spatial relationship data between the wearable device and the electronic device, such as relative distance, relative angle, relative radiation range, etc.

[0027] In some implementations, the relative position information between the target wearable device and the electronic device can be determined by measuring distance and angle using image sensors, ultra-wideband sensors, gyroscopes, or accelerometers in the target wearable device.

[0028] In some implementations, the target wearable device can send relative location information to an electronic device.

[0029] In some implementations, considering that cameras are relatively power-intensive components, the AI ​​calculation method for the target wearable device's edges should be configured to identify and calculate the edge coordinates of the image captured by the target wearable device and the edge coordinates of the display screen. Only the image edge coordinates and display screen edge coordinates are transmitted to the electronic device, instead of transmitting the camera image. The electronic device then calculates the relative position information based on the image edge coordinates and display screen edge coordinates. Furthermore, the frame rate of the camera can be minimized, such as once per second to once every 3 seconds.

[0030] In some implementations, determining the relative position information between the target wearable device and the electronic device includes: acquiring a first image of the display screen of the electronic device based on an image sensor on the target wearable device; identifying the first image to obtain the screen center coordinates corresponding to the display screen in the first image; and determining the relative position information between the electronic device and the target wearable device based on the geometric relationship between the image acquisition center coordinates of the image sensor and the screen center coordinates corresponding to the display screen. The relative position information may include directional and distance relationships. Therefore, a target display area can be determined based on this relative position information.

[0031] For example, the first image is as follows Figure 2 As shown, the coordinates of the image acquisition center A of the image sensor can be determined through the first image. By recognizing the first image, the coordinates of the screen center a corresponding to the display screen (physical screen) in the first image can be obtained. Thus, the directional relationship and distance relationship between point A and point a can be calculated, and a screen area including point A and point a can be used as the target display area.

[0032] In some implementations, the target display area can be further determined based on attribute parameters of the target content to be displayed, such as source information (application, fixed content, static content, or dynamically changing content), its relevance to the currently displayed content, user habits and preferences, the display layout information of the currently displayed content, and the type of the target wearable device.

[0033] In this embodiment, the target display area can be the main screen area, secondary screen area, or extended screen area of ​​the electronic device; it can also be the entire area or part of the screen.

[0034] S103, control the electronic device to output the target content to be displayed in the target display area, wherein the target content to be displayed is located on the same layer or a different layer from the original display content on the display screen of the electronic device.

[0035] In this embodiment, when outputting the content to be displayed, it can be floating output, embedded tiling output, naked-eye 3D projection output, etc.

[0036] In this embodiment, when the target content to be displayed and the original content displayed on the screen of the electronic device are on the same layer, it can be embedded display. When the target content to be displayed and the original content displayed on the screen of the electronic device are on different layers, it can be floating display.

[0037] The interactive control method provided in this application realizes real-time projection of the content to be displayed on the target wearable device onto the display screen of the electronic device. This allows the content to be displayed on the target wearable device to be displayed on the display screen of the electronic device, thereby solving the problems of display function bottleneck and high cost of the target wearable device and enhancing the spatial perception consistency of human-computer interaction. Furthermore, the target display area determination mechanism based on relative position information enables the target content to be displayed to adaptively adjust with changes in the user's viewing angle, providing an intuitive interactive experience. At the same time, layer management enables effective differentiation and collaborative display between the target content to be displayed and the original display content, avoiding visual interference.

[0038] In an optional embodiment, such as Figure 3 As shown, the interactive control method also includes: S104, adjust the display parameters of the target display area and / or update the target content to be displayed based on the motion data of the target wearable device; wherein, the display parameters include at least one of the following: display position, display mode, display size, display refresh rate, display transparency, display brightness, and display identifier of the target display area; the target content to be displayed may or may not be related to the original display content.

[0039] In this embodiment, the target wearable device can transmit motion data to the electronic device, or it can transmit coordinate change information calculated based on the motion data to the electronic device.

[0040] In this embodiment, motion data may include distance traveled, deflection angle, spatial height, etc.

[0041] In this embodiment, when adjusting the display parameters of the target display area, only the display parameters of the target projection window can be adjusted. The target projection window is the window corresponding to the target wearable device used to display the target content to be displayed on the display screen of the electronic device.

[0042] In this embodiment, the display method includes floating display, embedded display, or 3D projection display, etc.

[0043] In this embodiment, the display identifiers include edge identifiers (edge ​​boundaries) of the target display area, background identifiers (background color, background texture pattern, etc.), and additional identifiers (specific marks such as illustrations, etc.).

[0044] In this embodiment, when the target wearable device moves, the original display content captured by the target wearable device may change, or the movement of the target wearable device may trigger a switch in the smart assistant interface, thus requiring an update of the target content to be displayed.

[0045] In this embodiment, the adjustment of display parameters can be achieved in various ways. For example, the display position can be adjusted in real time based on the coordinate change information corresponding to the motion data, so that the target display area always moves with the user's viewpoint; the display mode can be switched to floating display, embedded display, or 3D projection display to adapt to different interaction scenarios; the display size can be dynamically scaled according to the distance parameter in the motion data to ensure content visibility. The adjustment of the display identifier may include changing the edge boundary color or background texture pattern to enhance visual differentiation. The update of the target content to be displayed can be based on the coordinate change information corresponding to the motion data to capture the corresponding original display content or obtain the corresponding new interactive interface; for example, the target content to be displayed is updated to a smart assistant interface associated with the coordinate change information or processed screen content.

[0046] In some implementations, adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion data of the target wearable device includes: adjusting the relative position information between the target wearable device and the electronic device based on the motion data of the wearable device; and adjusting the display position of the target content to be displayed on the display screen and / or updating the target content to be displayed based on the adjusted relative position information.

[0047] In specific implementation, the relative position information between the target wearable device and the electronic device is adjusted based on the motion data of the wearable device. This includes: determining the displacement of the user's wearing part based on motion data collected by the displacement sensor on the target wearable device; adjusting the relative position information between the target wearable device and the electronic device based on the displacement of the wearing part; or determining the change in the positional characteristics of the display screen within the image acquisition range of the image sensor based on image data collected by the image sensor on the target wearable device; adjusting the relative position information between the target wearable device and the electronic device based on the change in positional characteristics; or determining the eye movement data of the user wearing the wearable device based on image data collected by the image sensor located at a first position on the target wearable device; and adjusting the relative position information between the target wearable device and the electronic device based on the eye movement data. The first position is the side of the target wearable device facing the user's eyeball.

[0048] For example, using accelerometers or gyroscopes (collectively referred to as inertial measurement units) in smart glasses, the direction of the user's head (viewpoint) movement can be determined based on the readings of the inertial measurement units, thereby adjusting the relative position information between the target wearable device and the electronic device; or using a camera in the smart glasses to capture images of the electronic device's display screen, the direction and trend of the display screen's position change within the camera's field of view can be determined based on the images, thereby adjusting the relative position information between the target wearable device and the electronic device. ;orA camera is installed inside the smart glasses to detect the user's eye movements, helping to determine changes in the user's focus on the display screen and adjust the relative position between the wearable device and the electronic device accordingly. 。

[0049] In this embodiment, the target display area and the target content to be displayed are dynamically adjusted according to the movement of the target wearable device. This solves the adaptation problem of static display solutions in scenarios where the target wearable device is in motion, avoiding display misalignment or occlusion caused by the displacement of the target wearable device. Simultaneously, by adjusting a combination of multi-dimensional parameters, the flexibility and adaptability of the interactive interface in different scenarios are improved. Furthermore, the dynamic updating of the content to be displayed further enhances the coherence and intelligence of the interaction. Overall, this solution significantly improves the user experience of collaborative display between wearable devices and electronic devices.

[0050] In an optional embodiment, step S101, in response to a target triggering event, obtains the target content to be displayed, including at least one of the following: In response to receiving a first instruction to invoke the smart assistant built into the target wearable device, the target interactive interface of the smart assistant is used as the target content to be displayed; in response to receiving a second instruction to invoke the target function service of the smart assistant built into the target wearable device, the processing result of the target original content on the display screen of the electronic device by invoking the target function service is used as the target content to be displayed; in response to the target wearable device switching to a wearing state, the target interactive interface of the smart assistant built into the target wearable device is used as the target content to be displayed, or the processing result of the target wearable device on the display screen of the electronic device is used as the target content to be displayed; in response to the electronic device running the target application, the processing result of the target wearable device on the display screen of the target original content is used as the target content to be displayed.

[0051] In this embodiment, the intelligent assistant can be an artificial intelligence (AI) assistant or an AI agent. The first instruction can be to activate the intelligent assistant itself or to activate a specific function or service of the intelligent assistant. The first and second instructions can be voice commands, specific button triggers, gesture commands, or string commands, etc. For example, a user can trigger the interactive interface by double-tapping the temple of the smart glasses. The target interactive interface can be the main interface of the AI ​​assistant or AI agent or the interface of a specific function or service.

[0052] In this embodiment, the target service functions include, for example, translation, summarization, content expansion, association mapping (such as explanations corresponding to PPT slides), polishing, and related search (retrieving or enhancing related content). The target original content is at least a portion of the original content displayed on the screen, such as the part to be translated, the image part, the text part, or the outline part of the PPT slide. The processing results include, for example, translation results, polishing results, summary processing results, expansion results, and search results.

[0053] In this embodiment, the target wearable device can be switched to wearing state by recognizing the trigger action of the user putting on smart glasses or a smart ring.

[0054] In this embodiment, when the target wearable device is in a wearing state, it may be necessary to activate the smart assistant, thereby using the target interactive interface of the smart assistant built into the target wearable device as the target content to be displayed. Alternatively, it may be necessary to activate the target service function of the smart assistant, thereby using the processing result of the target wearable device on the display screen of the electronic device as the target content to be displayed.

[0055] In this embodiment, the target application may include a conferencing application, an email application, etc. When the electronic device is running a conferencing application, it may need to share presentation content, so the processing result of the target wearable device on the target original content on the display screen can be used as the target content to be displayed; when running an email application, it may need to translate or give a presentation, so the processing result of the target wearable device on the target original content on the display screen can be used as the target content to be displayed.

[0056] In this embodiment, the target triggering event can include various types: The first type involves obtaining the initial command to activate the smart assistant built into the target wearable device. For example, a user can trigger it via the voice command "Open the smart assistant." In this case, the target interactive interface of the smart assistant is used as the content to be displayed. The target interactive interface may include the smart assistant's dialog boxes, function menus, etc.

[0057] The second type involves obtaining a second instruction that invokes the target function service of the smart assistant built into the wearable device. For example, a user can trigger this by saying "Translate this text." In this case, the translation function is invoked to process the original target content on the electronic device's display screen, and the processing result is used as the target content to be displayed. The original target content can be a piece of text on the screen to be translated, and the processing result is the translated text.

[0058] The third type is when the target wearable device switches to a wearing state. For example, this is triggered when smart glasses detect that the device is being worn. In this case, you can choose to use the target interaction interface of the smart assistant as the target content to be displayed, or you can choose to use the result of the target wearable device processing the original content on the electronic device's display screen as the target content to be displayed.

[0059] The fourth type involves the electronic device running the target application. For example, this is triggered when the electronic device opens a presentation application. In this case, the result of the target wearable device's processing of the original content on the display screen is used as the target content to be displayed. The original content can be the content of the presentation, and the processing result can be the corresponding explanation.

[0060] Through the above technical solutions, this application implements association rules between various triggering events and target content to be displayed, expanding the triggering scenarios and target content generation logic for interaction between wearable devices and electronic devices. By flexibly matching triggering events with target content generation logic, it solves the problem of limited interaction scenarios caused by a single triggering mechanism; it achieves adaptive and diversified cross-device content generation, improving the flexibility and diversity of the interactive experience. For example, in a presentation scenario, users can quickly invoke the translation function through voice commands to translate the presentation content and display it on the electronic device screen, improving presentation efficiency. Similarly, when users wear smart glasses, the system can automatically display the smart assistant interface or processed screen content, reducing manual operation by the user. These diverse interaction methods adapt to the needs of users in different scenarios and enhance the collaborative capabilities between devices.

[0061] In an optional embodiment, such as Figure 4 As shown, step S102, determining the target display area based on the relative position information between the target wearable device and the electronic device, includes: S1021, obtain the relative coordinates between the center of the target display screen of the electronic device and the corresponding sensing center of the target sensor of the target wearable device on the target display screen.

[0062] S1022, the target display area is determined based on the relative coordinates and the relative distance between the target wearable device and the target display screen; wherein, the target sensing device includes at least one of an image sensor, an ultra-wideband sensor, a time-of-flight sensor, a radar sensor, and an ultrasonic sensor.

[0063] In this embodiment, when the target wearable device is smart glasses, an image sensor such as a camera can be considered as the target sensing element; when the target wearable device is a smart ring, an ultra-wideband sensor can be considered as the target sensing element.

[0064] In this embodiment, for S1021, the relative coordinates between the screen center and the sensing center can be achieved by constructing a planar coordinate system of the target display screen, for example, establishing a two-dimensional coordinate system with the lower left corner of the screen as the origin. The coordinates of the sensing center can be obtained by mapping the spatial positioning data of the target sensing device to this planar coordinate system. For example, the coordinates of the sensing center can be determined by transforming the center point of the image captured by the camera of the target wearable device. The measurement of relative distance can be achieved by emitting light pulses using a time-of-flight sensor and calculating the reflection time difference. Different sensor types have different applicable scenarios. For example, smart glasses preferentially use image sensors to capture screen feature points, while smartwatches use ultra-wideband sensors to achieve centimeter-level positioning.

[0065] In this embodiment, for S1022, the user's gaze point (e.g., the sensing center) on the target display screen can be determined based on the relative coordinates in the planar coordinate system, and then the radiation range of the gaze point can be set as the target display area by combining the relative distance between the target wearable device and the target display screen.

[0066] In some implementations, the target wearable device can send relative coordinates to the electronic device, or send spatial positioning data of the target sensor to the electronic device, so that the electronic device can calculate the relative coordinates based on the spatial positioning data of the target sensor. The target wearable device can also generate a first control command and send it to the electronic device, causing the electronic device to suspend the content to be displayed on top of the original display content; the target wearable device can also generate a second control command and send it to the electronic device, causing the electronic device to display a first control on the first layer; the first control represents the user's gaze point on the display screen; the first control is used to control the electronic device to display the first layer on top of the electronic device. Generating the second control command may include: determining the coordinate relationship between the screen center coordinates of the display screen and the image acquisition center coordinates of the image sensor on the wearable device based on the relative coordinates; determining the control display position based on the coordinate relationship; the control display position represents the display position of the first control on the display screen; the coordinate relationship includes at least a directional relationship and a distance relationship; and generating the second control command based on the control display position.

[0067] The determination of the control display position includes: based on a first model, identifying image data including the display screen collected by the image sensor to obtain the screen center coordinates of the display screen and the image acquisition center coordinates of the image sensor on the target wearable device; based on a second model, calculating the difference between the screen center coordinates and the image acquisition center coordinates, and determining the control display position based on the difference; the first model and the second model are set in the processor of the wearable device; or at a first moment, based on the image data collected by the image sensor, determining the coordinate position relationship between the screen center coordinates of the display screen and the image acquisition center coordinates of the image sensor on the target wearable device, and determining the control display position based on the coordinate position relationship; at a second moment, updating the control display position based on the motion data collected by the displacement sensor on the wearable device and the control display position determined at the first moment; before the second moment, the image sensor does not collect image data at the second moment.

[0068] In this embodiment, by obtaining the planar relative coordinates and relative distance, the position of the target display area on the display screen can be accurately located. This positioning method based on multi-dimensional data, compared with methods that rely on only single-dimensional data, can more accurately determine the display area, improving the accuracy of the target content to be displayed and the user experience.

[0069] In an optional embodiment, step S102, determining the target display area based on the relative position information between the target wearable device and the electronic device, includes at least one of the following: The target display area is determined based on the source information and relative position information of the target content to be displayed; the target display area is determined based on the correlation between the target content to be displayed and the original display content, as well as the relative position information; user profile information of the target user is obtained, and the target display area is determined based on the user profile information and the relative position information; the display layout information of the original display content of the target display screen of the electronic device is obtained, and the target display area is determined based on the display layout information and the relative position information; the attribute information of the target wearable device is obtained, and the target display area is determined based on the attribute information and the relative position information.

[0070] In this embodiment, the source of content refers to whether the content to be displayed comes from the interactive interface of the smart assistant or from the processing result of the original target content. If it is an interactive interface, the interface size can be further determined based on the relative position information, thereby determining the area range of the target display area. If it is a processing result, the relative position information and the position of the original target content can be further considered to determine whether it is displayed independently or embedded (such as displaying a translation window independently or embedding the translation result below or above the original content). For example, when the target content to be displayed comes from the interactive interface of the smart assistant, the target display area is set as a floating window in the central area of ​​the screen, and the window size is dynamically adjusted based on the relative distance. When the target content to be displayed comes from the processing result of the original target content, the target display area is an embedded window below the original target content, and the window size is dynamically adjusted to the maximum usable area where the original display content is not obscured.

[0071] In this embodiment, relevance is defined as either related or unrelated. When the target content to be displayed is an independent intelligent assistant's interactive interface, it is considered unrelated. When the target content to be displayed is the processing result of the original target content, it is considered related. When determining the display area based on content relevance, the spatial distribution of related and unrelated content can be differentiated. For example, the coordinate offset between the translation result and the original text is controlled within a preset threshold, and the display area of ​​unrelated content is allocated to the screen edge area.

[0072] When determining the display area based on user profile information, user habit parameters can be invoked. For example, the display area coordinates for a left-handed user are set to the left half of the screen, and if the user prefers a large floating window display, then a large floating window display will be implemented. For instance, when the user profile information includes vision parameters, the minimum font size of the display area is calculated as an inverse proportional function of the vision parameters, and the window size is adjusted accordingly to meet readability requirements. When determining the display area based on display layout information, it can be considered whether the target display area determined by relative position information is a blank area. If it is a blank area, it can be embedded; if it is not a blank area, it can be floating. For instance, when the target original content is detected to occupy the upper half of the screen based on display layout information, and the area below the target original content in the target display area is determined based on relative position information, then the target display area is a blank area, and it can be embedded, with the window height limited to no more than 80% of the blank area height. When determining the display area based on attribute information, the main consideration is whether the target wearable device is smart glasses or a smart ring to determine whether a 3D display can be constructed. For instance, when the target wearable device is smart glasses, the target display area will be displayed in 3D. When the target wearable device is a smart ring, a 2D display is used.

[0073] Through the above technical solution, this application achieves dynamic adaptation of the target display area. By introducing a collaborative decision-making mechanism based on multi-dimensional parameters and relative position information, the adaptability and interaction logic of the target display area are improved. For example, based on content source information, different window shapes and functional requirements can be matched; based on content relevance, spatial fragmentation of related content can be avoided; based on user profile information, personalized experience can be enhanced; based on display layout information, efficient use of screen space can be achieved; and based on wearable device attribute information, interactive security and smoothness can be ensured. This multi-dimensional dynamic adaptation mechanism effectively solves the problem of insufficient adaptability between the display area and the content to be displayed that may result from relying solely on relative position information, improving the flexibility of content projection and user experience.

[0074] In an optional embodiment, step S104, adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion data of the target wearable device, includes at least one of the following: When the target content to be displayed comes from the target interactive interface of the smart assistant built into the target wearable device, the display parameters of the target display area or the target projection window therein are adjusted and / or the target content to be displayed is updated based on the motion trajectory of the target wearable device; when the target content to be displayed comes from the processing result of the target original content on the display screen of the electronic device by the target wearable device, the coordinate change information transmitted by the target wearable device is obtained, and the display parameters of the target display area or the target projection window therein are adjusted and / or the target content to be displayed is updated based on the target triggering conditions satisfied by the coordinate change information. Here, the coordinate change information is the change data of the center coordinates of the target sensor of the target wearable device on the target display screen of the electronic device; and the target projection window is the window corresponding to the target wearable device used to display the target content to be displayed on the display screen of the electronic device.

[0075] In this embodiment, motion data may include distance traveled, deflection angle, and spatial height. Spatial height can indicate whether the user is sitting or standing, etc.

[0076] In this embodiment, when the target wearable device moves, the original display content captured by the target wearable device may change, or the movement of the target wearable device may trigger a switch in the smart assistant interface, thus requiring an update of the target content to be displayed.

[0077] In this embodiment, when adjusting the display parameters of the target display area or the target projection window therein and / or updating the target content to be displayed based on the motion trajectory of the target wearable device, if the motion trajectory of the target wearable device meets a first specific trajectory, only the content to be displayed can be updated, such as page turning or switching display interfaces; if the motion trajectory of the target wearable device meets a second specific trajectory, only the display parameters of the display area can be adjusted, such as size, position, refresh rate, brightness, etc.; if the motion trajectory of the target wearable device meets a third specific trajectory, both the display parameters of the display area can be adjusted and the target content to be displayed can be updated simultaneously.

[0078] In this embodiment, the target triggering condition based on coordinate change information refers to whether processing of new target original content is triggered. If processing of new original display content is involved, the target content to be displayed will be updated; if processing of new original display content is not involved, only display parameters will be adjusted. For example, if the user turns their head, causing the target wearable device to deflect at an angle, thus involving processing of new original display content, the display parameters will be adjusted and the target content to be displayed will be updated synchronously. For instance, when it is detected that the user's head has turned 20 degrees to the left for 2 seconds, processing of new target original content is triggered. The projection window will then be shifted 20 degrees to the left, and the window size will be reduced to 80% of its original size to fit the new display area. Simultaneously, the update of the target content to be displayed is achieved through an asynchronous rendering mechanism, prioritizing the update of the projection window content after the processing result of the new original display content is generated. When it is detected that the user's head has turned 5 degrees to the left, processing of new target original content is not triggered, and the projection window is only shifted 5 degrees to the left.

[0079] In this embodiment, when processing new target original content is triggered, the center coordinates of the target sensor of the target wearable device on the target display screen of the electronic device can be determined based on coordinate change information to cover the new target original content.

[0080] Through the above technical solutions, this application implements a differentiated display parameter adjustment and content update mechanism for different content source types. For the intelligent assistant interaction interface, spatial consistency between the displayed content and the user's line of sight is achieved based on motion trajectory. For the processing results of the original content of the target on the screen, a condition judgment mechanism triggered by coordinate change information ensures the visual relevance between the processing results and the original content of the target. This scene-specific processing mechanism effectively solves the differentiated needs of different content sources for display parameter adjustment logic and improves the matching accuracy between the displayed content and the user's operation intention. Layered management of the displayed content is achieved through the independent definition of the target projection window, avoiding visual interference when displaying multiple content sources.

[0081] In an optional embodiment, adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion trajectory of the target wearable device includes at least one of the following: If the target wearable device's motion trajectory belongs to the first type of trajectory, adjust the display parameters of the target display area or the target projection window within it based on the adjustment parameters corresponding to the motion trajectory; if the target wearable device's motion trajectory belongs to the second type of trajectory, update the target content to be displayed based on the switching command corresponding to the motion trajectory; if the target wearable device's motion trajectory belongs to the third type of trajectory, adjust the display parameters of the target display area or the target projection window within it based on the adjustment parameters corresponding to the motion trajectory, and update the target content to be displayed based on the switching command corresponding to the motion trajectory.

[0082] And / or, based on the target triggering conditions satisfied by the coordinate change information, adjust the display parameters of the target display area and / or update the target content to be displayed, including at least one of the following: If the coordinate change information meets the first triggering condition, adjust the display parameters of the target display area or the target projection window therein based on the coordinate change information; or, if the coordinate change information meets the second triggering condition, update the target content to be displayed; or, if the coordinate change information meets the third triggering condition, adjust the display parameters of the target display area or the target projection window therein and update the target content to be displayed.

[0083] In this embodiment, the first type of trajectory can be a trajectory type that does not meet the requirements for switching interfaces; or a trajectory type that meets the requirements for adjusting display parameters, such as left and right yaw of 1~45°, or other angles; or a specific trajectory type to meet the requirements for adjusting different types of display parameters, such as U-shaped adjustment of brightness, V-shaped adjustment of refresh rate, arc adjustment of position, etc. The adjustment parameters corresponding to the motion trajectory may include different position changes, size changes, brightness changes, refresh rate changes, and other display parameters corresponding to different angles. For example, when the user's head turns 15 degrees to the left, the motion trajectory of the target wearable device belongs to the first type of trajectory, then the projection window moves 10% of the screen width along the negative X-axis to maintain the visual following effect.

[0084] In this embodiment, the second type of trajectory corresponds to different interface switching instructions, such as switching between different levels of interfaces or switching between different functional interfaces at the same level. The second type of trajectory can be considered as a deflection trajectory that quickly changes from 0 to 60 degrees and then back to 0, that is, it mainly considers the case where the final angle change is small or unchanged. For example, when the user quickly turns their head to the left and then quickly returns to the original position, the movement trajectory of the target wearable device belongs to the second type of trajectory, triggering the page turning of different levels of interfaces in the smart assistant interaction interface; when the user quickly turns their head downward and then quickly returns to the original position, the movement trajectory of the target wearable device belongs to the second type of trajectory, triggering the page turning of different functional interfaces at the same level in the smart assistant interaction interface.

[0085] In this embodiment, the third type of trajectory is a trajectory change that simultaneously satisfies interface switching and display parameter adjustment. The third type of trajectory can be a composite motion trajectory, such as a spiral motion trajectory or a trajectory that rotates left and right simultaneously. For example, when a user's head rotates 90 degrees left and right, both display parameters can be adjusted and the interface can be switched. For example, when a user's head rotates spirally, the motion trajectory of the target wearable device belongs to the third type of trajectory. While the window transparency is adjusted to 50%, the new target content to be displayed gradually covers the original target content to be displayed.

[0086] In this embodiment, the first triggering condition can be that the sensing center of the target sensor has not moved to the new original display content, that is, no processing of the new target original content is triggered. For example, the first triggering condition can be set to a coordinate offset of less than 20 pixels. When the coordinate offset of the sensing center of the target sensor is less than 20 pixels, the coordinate change information satisfies the first triggering condition, and only the target projection window is fine-tuned. The second triggering condition triggers the processing of the new original display content, requiring the output display of the new processing result. For example, the second triggering condition can be set to a coordinate crossing 50% of the boundary of the target screen area. When the coordinate of the sensing center of the target sensor crosses 50% of the boundary of the target screen area, the coordinate change information satisfies the second triggering condition, triggering the switching of the target content to be displayed. The third triggering condition is a change in position that triggers the processing of the new original content. For example, the third triggering condition can be set to a coordinate change of more than 100 pixels within 0.5 seconds. When the coordinate of the sensing center of the target sensor changes by more than 100 pixels within 0.5 seconds, the coordinate change information satisfies the third triggering condition, and the target display area or the target projection window therein is shifted and the target content to be displayed is updated.

[0087] Through the above technical solution, this application implements a dynamic adaptation and adjustment strategy based on motion trajectory type and coordinate change conditions. For different types of user actions, the system can flexibly adjust display parameters or update display content, improving the flexibility and accuracy of interactive control. For example, for translational actions, the window position can be adjusted in real time; for switching actions, content can be updated promptly; and for compound actions, both position and content can be adjusted simultaneously. Furthermore, by introducing a coordinate change trigger mechanism, the adjustment logic is further refined, allowing different response strategies to be adopted based on the degree of coordinate change. This multi-layered adaptation mechanism enables a more precise match between displayed content and user action intent, enhancing the human-computer interaction experience. Simultaneously, the combination of motion trajectory and coordinate change triggering methods allows the system to adapt to different application scenarios and hardware configurations, ensuring interaction accuracy while also considering device performance and power consumption requirements.

[0088] In an optional embodiment, step S104, adjusting the display parameters of the target display area based on the motion data of the target wearable device, includes: Obtain the display layout information of the original display content of the target display screen of the electronic device; Based on the display layout information and motion data, the target projection window in the target display area is controlled to output the target content to be displayed in an embedded, floating, or 3D projection manner.

[0089] In this embodiment, the display layout information indicates whether the target display area determined by the relative position information is a blank area. If it is a blank area, the target projection window can be embedded; if it is a non-blank area, the target projection window can be displayed floating.

[0090] Specifically, if the target display area does not obscure the original display content on the target display screen of the electronic device based on the display layout information, the target display area and the original display content are controlled to be on the same layer and displayed in an embedded manner. If the target display area obscures the original display content on the target display screen of the electronic device based on the display layout information, the target display area and the original display content are controlled to be on different layers and displayed in a floating manner. For example, if the coordinates of key controls in the original display content are continuously monitored, and the overlap area between the real-time coordinates of the target display area and the coordinates of the key controls exceeds a preset ratio, then the target display area obscures the original display content on the target display screen of the electronic device, and the target display area and the original display content are controlled to be on different layers and displayed in a floating manner. If the overlap area between the real-time coordinates of the target display area and the coordinates of the key controls does not exceed a preset ratio, then the target display area does not obscure the original display content on the target display screen of the electronic device, and the target display area and the original display content are controlled to be on the same layer and displayed in an embedded manner.

[0091] In specific implementation, if the target projection window does not obscure the original display content on the target screen of the electronic device based on the display layout information, the target projection window and the original display content are controlled to be on the same layer; if the target projection window obscures the original display content on the target screen of the electronic device based on the display layout information, the target projection window is controlled to float. For example, when a user is using a laptop while wearing smart glasses, the system obtains the layout information of the currently displayed document editing interface in real time. This interface includes a top toolbar, a left navigation bar, and a central editing area. When the user turns their head to the right, triggering a change in motion data, the system recognizes a blank area on the right side of the screen and inserts the translation result window generated by the smart glasses into the blank area on the right side of the document interface in an embedded manner; when the user tilts their head upward, the system detects that the top toolbar is a high-frequency operation area, and therefore switches the translation result window to a semi-transparent floating mode.

[0092] In this embodiment, the spatial adaptation problem of multi-source display content is effectively solved. By dynamically sensing the distribution characteristics of the original display content and the user's movement trend, the window presentation mode and spatial position are intelligently selected, which can provide a better user experience.

[0093] In an optional embodiment, the interactive control method is as follows: Figure 5 As shown, it also includes: S105, Determine the correlation between the target content to be displayed and the original display content.

[0094] S106, when there is a correlation between the target content to be displayed and the original display content, control the target content to be displayed and the original display content to move synchronously based on motion data.

[0095] S107, when there is no correlation between the target content to be displayed and the original display content, only the target display area is moved based on motion data.

[0096] In this embodiment, the correlation determination can be achieved by parsing the data coupling relationship. For example, if the target content to be displayed is the processing result of the original display content, it is determined to be correlated. If the target content to be displayed is correlated with the original display content, the target content to be displayed and the original display content can be moved synchronously; if they are not correlated, only the target display area is moved.

[0097] For example, in a scenario where smart glasses and a laptop work together, when a user triggers the translation function while wearing the smart glasses, the laptop analyzes the target content to be displayed as a real-time translation of the original text paragraph and determines that there is a content relevance. Then, it activates the synchronous motion control module. When the user's head turns, causing the smart glasses' motion sensor to detect an X-axis offset exceeding 5°, it synchronously adjusts the display position of the translation pop-up window and the original text paragraph on the display screen to maintain relative coordinate alignment.

[0098] Through the above technical solutions, in content-related scenarios, by controlling the target content to be displayed and the original display content to move synchronously based on motion data, it is possible to ensure that semantically related display elements form a visual whole and eliminate the information misalignment caused by user head movements. In non-related scenarios, by controlling only the target display area to move based on motion data, it is possible to achieve precise pose adjustment of the independent display area and avoid the waste of graphics processor resources caused by forced synchronization.

[0099] In an optional embodiment, the interactive control method is as follows: Figure 6 As shown, it also includes: S108, when the motion data meets the preset shutdown conditions, control the target display area to switch to the off state.

[0100] S109, if the motion data meets the screen switching conditions, control the target display area to switch from the current first screen to the second screen.

[0101] In this embodiment, motion data meeting preset shutdown conditions may include: the target wearable device moving to the edge or corner of the display screen, or moving away from the display screen.

[0102] In practice, the determination of preset shutdown conditions can be achieved by combining the posture sensor of the target wearable device. For example, when the accelerometer detects that the user's head is continuously moving away from the screen, the motion trajectory data is processed to generate a deviation index. If the deviation index exceeds a threshold and the duration reaches a set value, the preset shutdown condition is determined to be met, triggering a shutdown command for the target display area. For example, a shutdown operation is triggered when the relative angle between the target wearable device and the display screen deviates from the initial value by more than 30 degrees. The determination of screen switching conditions can integrate multi-source data, including the target wearable device's turning angle exceeding a preset threshold, the coordinate range of eye-tracking data pointing to the second screen, and the physical location information of the second screen. For example, when a user wearing smart glasses turns from the main screen of a laptop to the external monitor on the right, the target display area gradually shifts to the second screen, maintaining the content size and aspect ratio unchanged during the process, thereby achieving a seamless cross-screen switching.

[0103] Through the above technical solution, this application achieves intelligent management of the target display area, effectively avoiding the waste of screen resources and increased device power consumption caused by prolonged user inactivity. In multi-device collaborative scenarios, by determining whether motion data meets the screen switching conditions, seamless connection of cross-screen display is achieved, eliminating the interaction delay caused by manual switching operations, ensuring spatial consistency between visual focus and displayed content, and significantly improving operational efficiency in multi-screen working environments.

[0104] To further illustrate the interactive control method of this application, the following description uses smart glasses as the target wearable device and a laptop computer as the electronic device.

[0105] In this embodiment, the step of making the smart glasses display content dynamically includes: 1. Application triggers the display of prompts / information on smart glasses; 2. The smart glasses recognize the position of the laptop screen in the field of view of the smart glasses' camera, set the initial position of the prompt information window on the laptop screen, and display it as a floating window on the laptop screen; the laptop screen can be the built-in display screen or an external monitor.

[0106] 3. When the smart glasses' camera angle shifts, the position of the notification window adjusts accordingly, causing the smart glasses to move from point A to point B. The projection window generated by the smart glasses' interaction also moves in the same direction. Meanwhile, the content originally displayed on the laptop screen remains unchanged, except for the obstructed areas.

[0107] There are three ways to monitor the visual displacement of smart glasses: a) Using accelerometers or gyroscopes (collectively known as inertial measurement units, IMUs) in the smart glasses, the direction of head (visual field) movement is determined based on the sensor readings; b) The direction and trend of the visual displacement of the smart glasses are determined based on the position change direction and trend of the screen (characteristics such as a rectangular high brightness) in the field of view of the smart glasses camera; c) A camera is set up inside the smart glasses to detect the position of the eyeball rotation, in order to help determine the direction and trend of the position change of the focus point on the screen.

[0108] When adjusting the position of the notification window, a gaze center point can be set. This point is actually displayed on the screen, and the area where the gaze center point is located determines the position of the notification window. When the user slightly turns their head, the gaze center point moves accordingly, thus adjusting the position of the notification window. Specifically, when the notification message is a translation of text on the screen, as the gaze center point changes, the translation of the text around the changed gaze center point becomes the content displayed in the notification window, and a floating window pops up next to the changed gaze center point.

[0109] Among the methods for determining the gaze center point to match its position on the screen, representative methods include: Figure 2 As shown, the gaze center point of the glasses is set based on the difference between the physical center of the screen and the physical field of view of the glasses' camera. Considering that the camera is a relatively power-intensive component, an AI-based edge calculation method should be used to identify and calculate coordinates, transmitting only the coordinates to the laptop instead of the camera image. The laptop then calculates the gaze center point and movement trend. Simultaneously, the frame rate of the camera should be kept as low as possible, such as once per second to once every 3 seconds. During the majority of the time between two camera cycles, data from the motion sensor should be used to detect and map the gaze center point of the glasses.

[0110] According to embodiments of this application, this application also provides an electronic device and a non-transitory computer-readable storage medium.

[0111] An electronic device includes at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the following operations: in response to a target trigger event, obtaining target content to be displayed, the target content to be displayed being display data to be output by a target wearable device; determining a target display area based on relative position information between the target wearable device and the electronic device, the target display area including a screen area of ​​the electronic device for presenting the content to be displayed; controlling the electronic device to output the target content to be displayed in the target display area, wherein the target content to be displayed and the original display content on the display screen of the electronic device are located on the same layer or different layers; wherein the electronic device includes a first book rotatably connected The electronic device includes a first screen area and a second screen area, and a target display area is at least a portion of the first screen area and / or the second screen area; the first screen area is displayed on a first side of the first body, and the second screen area is housed within the first body or the second body; the electronic device has a first device form and a second device form; in the first device form, the second screen area is pulled out from the first body or the second body, and in the second device form, it is housed within the first body or the second body; or, the first screen area is disposed on a second side of the first body, and the second screen area is disposed on a third side of the second body, with an angle between the second side and the third side being 0 degrees to 360 degrees; or, both the first screen area and the second screen area are disposed on the second side of the first body, and a keyboard and / or touchpad are disposed on the third side of the second body.

[0112] In this embodiment, when the first screen area is displayed on the first side of the first body and the second screen area is housed in the first body or the second body, the first body can be the body where the screen of the rollable laptop is located, and the first side can be the B side of the rollable laptop; the second screen area can be housed in the first body, or it can be similar to a rollable screen, with a portion of the flexible screen rolled up in the second body or the hinge cavity between the two.

[0113] In an embodiment, when the first screen area is located on the second side of the first body and the second screen area is located on the third side of the second body, the first body can be one display screen of a dual-screen laptop, the second body can be the other display screen of the dual-screen laptop, the second side can be the B side of the dual-screen laptop, and the third side can be the C side of the dual-screen laptop.

[0114] In this embodiment, when the second screen area and the second screen area are both located on the second side of the first body, and the third side of the second body is provided with a keyboard and / or touchpad, the first body can be the body where the screen of a normal single-screen laptop is located, the second side can be the B side of a normal single-screen laptop, and the third side can be the C side of a normal single-screen laptop.

[0115] Figure 7 A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of this application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the application described and / or claimed herein.

[0116] like Figure 7 As shown, the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes based on a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. The RAM 803 may also store various programs and data required for the operation of the electronic device 800. The computing unit 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0117] Multiple components in electronic device 800 are connected to I / O interface 805, including: input unit 806, such as keyboard, mouse, etc.; output unit 807, such as various types of displays, speakers, etc.; storage unit 808, such as disk, optical disk, etc.; and communication unit 809, such as network card, modem, wireless transceiver, etc. Communication unit 809 allows electronic device 800 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0118] The computing unit 801 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as interactive control methods. For example, in some embodiments, the interactive control method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 800 via ROM 802 and / or communication unit 809. When the computer program is loaded into RAM 803 and executed by the computing unit 801, one or more steps of the interactive control method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform interactive control methods by any other suitable means (e.g., by means of firmware).

[0119] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0120] The program code used to implement the methods of this application may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable interactive control device, such that when executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0121] In the context of this application, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0122] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0123] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0124] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0125] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this application can be achieved, and this is not limited herein.

[0126] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0127] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interactive control method applied to an electronic device, the method comprising: In response to a target trigger event, obtain the target content to be displayed, which is the display data to be output by the target wearable device; The target display area is determined based on the relative position information between the target wearable device and the electronic device, and the target display area includes the screen area of ​​the electronic device used to present the content to be displayed; The electronic device is controlled to output the target content to be displayed in the target display area, wherein the target content to be displayed is located on the same layer or a different layer from the original display content on the display screen of the electronic device.

2. The method according to claim 1, further comprising: Adjust the display parameters of the target display area and / or update the target content to be displayed based on the motion data of the target wearable device; The display parameters include at least one of the following: display position, display mode, display size, display refresh rate, display transparency, display brightness, and display identifier of the target display area. The target content to be displayed may or may not be related to the original display content.

3. The method according to claim 1 or 2, wherein obtaining the target content to be displayed in response to the target triggering event includes at least one of the following: In response to receiving a first instruction to invoke the smart assistant built into the target wearable device, the target interactive interface of the smart assistant is used as the target content to be displayed; In response to obtaining a second instruction to invoke the target function service of the smart assistant built into the target wearable device, the processing result of the target original content on the display screen of the electronic device by invoking the target function service is taken as the target content to be displayed; In response to the target wearable device switching to a wearing state, the target interactive interface of the smart assistant built into the target wearable device is used as the target content to be displayed, or the processing result of the target wearable device on the display screen of the electronic device is used as the target content to be displayed. In response to the electronic device running the target application, the processing result of the target wearable device on the target original content on the display screen is used as the target content to be displayed.

4. The method according to claim 1 or 2, wherein determining the target display area based on the relative position information between the target wearable device and the electronic device includes: Obtain the relative coordinates between the center of the target display screen of the electronic device and the corresponding sensing center of the target sensor of the target wearable device on the target display screen; The target display area is determined based on the relative coordinates and the relative distance between the target wearable device and the target display screen; The target sensing element includes at least one of an image sensor, an ultra-wideband sensor, a time-of-flight sensor, a radar sensor, and an ultrasonic sensor.

5. The method according to claim 1 or 2, wherein determining the target display area based on the relative position information between the target wearable device and the electronic device includes at least one of the following: The target display area is determined based on the source information of the target content to be displayed and the relative position information; The target display area is determined based on the correlation between the target content to be displayed and the original display content, as well as the relative position information. Obtain user profile information of the target user, and determine the target display area based on the user profile information and the relative position information; Obtain display layout information of the original display content of the target display screen of the electronic device, and determine the target display area based on the display layout information and the relative position information; Obtain the attribute information of the target wearable device, and determine the target display area based on the attribute information and the relative position information.

6. The method according to claim 2, wherein adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion data of the target wearable device includes at least one of the following: When the target content to be displayed comes from the target interactive interface of the smart assistant built into the target wearable device, the display parameters of the target display area or the target projection window therein are adjusted and / or the target content to be displayed is updated based on the motion trajectory of the target wearable device; When the target content to be displayed comes from the processing result of the target wearable device's original target content on the electronic device's display screen, coordinate change information transmitted by the target wearable device is obtained. Based on the target triggering conditions satisfied by the coordinate change information, the display parameters of the target display area or the target projection window therein are adjusted and / or the target content to be displayed is updated. The coordinate change information is the change data of the center coordinates of the target sensor of the target wearable device on the target display screen of the electronic device; The target projection window is the window corresponding to the target wearable device used to display the target content on the display screen of the electronic device.

7. The method according to claim 6, wherein, Adjusting the display parameters of the target display area and / or updating the target content to be displayed based on the motion trajectory of the target wearable device includes at least one of the following: If the motion trajectory of the target wearable device belongs to the first type of trajectory, the display parameters of the target display area or the target projection window therein are adjusted based on the adjustment parameters corresponding to the motion trajectory. If the movement trajectory of the target wearable device belongs to the second type of trajectory, the target content to be displayed is updated based on the switching command corresponding to the movement trajectory; If the motion trajectory of the target wearable device belongs to the third type of trajectory, adjust the display parameters of the target display area or the target projection window therein based on the adjustment parameters corresponding to the motion trajectory, and update the target content to be displayed based on the switching command corresponding to the motion trajectory; And / or, Based on the target triggering conditions satisfied by the coordinate change information, adjust the display parameters of the target display area and / or update the target content to be displayed, including at least one of the following: If the coordinate change information satisfies the first triggering condition, adjust the display parameters of the target display area or the target projection window therein based on the coordinate change information; or, If the coordinate change information meets the second triggering condition, update the target content to be displayed; or, If the coordinate change information meets the third triggering condition, adjust the display parameters of the target display area or the target projection window therein and update the target content to be displayed.

8. The method according to claim 2, wherein, Adjusting the display parameters of the target display area based on the motion data of the target wearable device includes: Obtain the display layout information of the original display content of the target display screen of the electronic device; Based on the display layout information and the motion data, the target projection window in the target display area is controlled to output the target content to be displayed in an embedded, floating, or three-dimensional projection manner.

9. The method according to claim 2, further comprising: Determine the correlation between the target content to be displayed and the original displayed content; When there is a correlation between the target content to be displayed and the original display content, the target content to be displayed and the original display content are controlled to move synchronously based on the motion data; If there is no correlation between the target content to be displayed and the original display content, the movement of the target display area is controlled solely based on the motion data.

10. An electronic device, comprising: At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the following operations: In response to a target trigger event, obtain the target content to be displayed, which is the display data to be output by the target wearable device; The target display area is determined based on the relative position information between the target wearable device and the electronic device, and the target display area includes the screen area of ​​the electronic device used to present the content to be displayed; The electronic device is controlled to output the target content to be displayed in the target display area, wherein the target content to be displayed is located on the same layer or a different layer from the original display content on the display screen of the electronic device; The electronic device includes a first body and a second body that are rotatably connected, and the electronic device includes a first screen area and a second screen area. The target display area is at least a portion of the first screen area and / or the second screen area. The first screen area is displayed on the first side of the first body, and the second screen area is stored in the first body or the second body. The electronic device has a first device form and a second device form. In the first device form, the second screen area is pulled out from the first body or the second body, and in the second device form, it is stored in the first body or the second body. or, The first screen area is disposed on the second side of the first body, and the second screen area is disposed on the third side of the second body. The included angle between the second side and the third side is 0 degrees to 360 degrees. or, Both the first screen area and the second screen area are located on the second side of the first body, and the third side of the second body is provided with a keyboard and / or touchpad.

Images