Information processing method and apparatus, storage medium, and electronic device

Abstract

The application discloses an information processing method and device, a storage medium and an electronic device. The information processing method comprises the following steps: establishing a data connection with a second electronic device, and establishing a screen projection data channel and a notification data channel between the first electronic device and the second electronic device based on the data connection; receiving screen projection content generated by the second electronic device through the screen projection data channel; receiving notification information generated by the second electronic device through the notification data channel; and fusing and displaying the notification information in the screen projection content. The application can enable a user to see the content generated by the second electronic device on the first electronic device.

Description

Technical Field

[0001] This application belongs to the field of electronic technology, and in particular relates to an information processing method, apparatus, storage medium and electronic device. Background Technology

[0002] With the development of electronic technology, electronic devices are becoming increasingly widespread and have become an essential part of people's daily lives. In related technologies, the content generated by electronic devices currently in use can be seen by the user in a timely manner, allowing for prompt action. However, the content generated by other electronic devices not currently in use cannot be seen by the user in a timely manner, preventing the user from taking appropriate action. Summary of the Invention

[0003] This application provides an information processing method, apparatus, storage medium, and electronic device, enabling a user to view content generated by a second electronic device on a first electronic device.

[0004] In a first aspect, embodiments of this application provide an information processing method applied to a first electronic device, characterized in that it includes:

[0005] Establish a data connection with the second electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device;

[0006] The screen projection content generated by the second electronic device is received through the screen projection data channel;

[0007] The notification data channel is used to receive notification information generated by the second electronic device.

[0008] The notification information is integrated into the screen projection content for display.

[0009] Secondly, embodiments of this application provide an information processing method applied to a second electronic device, comprising:

[0010] A data connection is established with the first electronic device, and based on the data connection, a screen projection data channel and a notification data channel are established between the first electronic device and the second electronic device.

[0011] The projection data channel transmits the projection content generated by the second electronic device to the first electronic device.

[0012] The notification data channel transmits the notification information generated by the second electronic device to the first electronic device, so that the first electronic device can integrate the notification information into the screen projection content for display.

[0013] Thirdly, embodiments of this application provide an information processing apparatus applied to a first electronic device, comprising:

[0014] The channel establishment module is used to establish a data connection with the second electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device;

[0015] The content receiving module is used to receive the screen projection content generated by the second electronic device through the screen projection data channel;

[0016] The information receiving module is used to receive notification information generated by the second electronic device through the notification data channel;

[0017] The information display module is used to integrate the notification information into the screen projection content for display.

[0018] Fourthly, embodiments of this application provide an information processing apparatus applied to a second electronic device, comprising:

[0019] The channel establishment module is used to establish a data connection with the first electronic device, and based on the data connection, to establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device.

[0020] The content transmission module is used to transmit the screen projection content generated by the second electronic device to the first electronic device through the screen projection data channel.

[0021] The information transmission module is used to transmit notification information generated by the second electronic device to the first electronic device through the notification data channel, so that the first electronic device can integrate the notification information into the screen projection content for display.

[0022] Fifthly, embodiments of this application provide a storage medium storing a computer program thereon, which, when executed on a computer, causes the computer to perform the information processing method provided in embodiments of this application.

[0023] Sixthly, embodiments of this application also provide an electronic device, including a memory and a processor, wherein the processor executes the information processing method provided in embodiments of this application by calling a computer program stored in the memory.

[0024] In this embodiment, the screen projection content generated by the second electronic device is received through the screen projection data channel, and the notification information generated by the second electronic device is received through the notification data channel. The notification information is then integrated into the screen projection content display, so that the user can see the content generated by the second electronic device on the first electronic device. Attached Figure Description

[0025] The technical solution and its beneficial effects will become apparent from the following detailed description of specific embodiments of this application, in conjunction with the accompanying drawings.

[0026] Figure 1 This is a schematic diagram of the architecture of the first electronic device provided in the embodiments of this application.

[0027] Figure 2 A schematic diagram of the architecture of the second electronic device provided in the embodiments of this application.

[0028] Figure 3 This is a flowchart illustrating the information processing method provided in the embodiments of this application.

[0029] Figures 4 to 7 This is a schematic diagram of a scenario for the information processing method provided in the embodiments of this application.

[0030] Figure 8 This is a schematic diagram of the interaction between the first electronic device and the second electronic device provided in the embodiments of this application.

[0031] Figure 9 This is a schematic diagram of the types of the first electronic device and the second electronic device provided in the embodiments of this application.

[0032] Figure 10 This is a flowchart illustrating another information processing method provided in an embodiment of this application.

[0033] Figure 11 This is a schematic diagram of the structure of the information processing device provided in the embodiments of this application.

[0034] Figure 12 This is a schematic diagram of the structure of another information processing device provided in an embodiment of this application.

[0035] Figure 13 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0036] Please refer to the illustrations, where the same component symbols represent the same components. The principles of this application are illustrated by example in a suitable computing environment. The following description is based on the specific embodiments of this application illustrated, and should not be construed as limiting other specific embodiments not detailed herein.

[0037] Please see Figure 1 , Figure 1 This is a schematic diagram of the architecture of the first electronic device provided in the embodiments of this application.

[0038] The first electronic device includes a cross-screen interconnection module and a cross-screen control module.

[0039] The cross-screen interconnection module provides functions for scanning, discovery, and connection between devices. For example, a first electronic device can establish a data connection with a second electronic device through its cross-screen interconnection module, such as a P2P connection or a Bluetooth connection.

[0040] The cross-screen control module is responsible for establishing channels for data transmission between devices. For example, a first electronic device and a second electronic device establish a screen-casting data channel based on their cross-screen control modules, allowing the first electronic device to receive screen-cast content generated by the second electronic device through this channel. Similarly, the first and second electronic devices establish a notification data channel based on their cross-screen control modules, allowing the first electronic device to receive notification information from the second electronic device's notification center through this channel.

[0041] The cross-screen control module is also responsible for processing data transmitted between devices. For example, it can display and control received projected content, as well as display received notifications, and so on.

[0042] Please see Figure 2 , Figure 2 This is a schematic diagram of the architecture of the second electronic device provided in the embodiments of this application.

[0043] The first electronic device includes a cross-screen interconnection module and a cross-screen control module.

[0044] The cross-screen interconnection module provides functions for scanning, discovery, and connection between devices. For example, a first electronic device can establish a data connection with a second electronic device through its cross-screen interconnection module, such as a P2P connection or a Bluetooth connection.

[0045] The cross-screen control module is responsible for establishing channels for data transmission between devices. For example, a first electronic device and a second electronic device establish a screen-casting data channel based on their cross-screen control modules, allowing the second electronic device to transmit its generated screen-casting content to the first electronic device via this channel. Similarly, the first and second electronic devices establish a notification data channel based on their cross-screen control modules, allowing the second electronic device to transmit notification information received from its notification center to the first electronic device.

[0046] Please see Figure 3 , Figure 3This is a flowchart illustrating an information processing method provided in an embodiment of this application. The information processing method is applied to a first electronic device, and the process may include:

[0047] In step 101, a data connection is established with the second electronic device, and based on the data connection, a screen projection data channel and a notification data channel are established between the first electronic device and the second electronic device.

[0048] The second electronic device can be any of the aforementioned second electronic devices, used to transmit the screen-projected content and notification information it generates to the first electronic device. The first electronic device can be any of the aforementioned first electronic devices, used to receive the screen-projected content and notification information generated by the second electronic device. The screen-projected content can be content displayed in the foreground of the second electronic device, or content loaded in the background by the second electronic device. The notification information can be information generated by third-party applications, such as instant messaging information, login prompts, etc. The notification information can also be information generated by system applications, such as low battery warnings, system upgrade prompts, etc.

[0049] In this embodiment, the first electronic device establishes a data connection with the cross-screen interconnection module of the second electronic device via BLE, BT, or P2P. Based on this data connection, the first electronic device establishes a screen projection data channel and a notification data channel between the first and second electronic devices. The screen projection data channel is used to transmit screen projection content, and the notification data channel is used to transmit notification information.

[0050] In 102, the screen projection content generated by the second electronic device is received through the screen projection data channel.

[0051] In this embodiment, after establishing a screen projection data channel with the second electronic device, the first electronic device receives the screen projection content generated by the second electronic device through the screen projection data channel.

[0052] For example, suppose the content displayed in the foreground of the second electronic device is the desktop content of the second electronic device. The second electronic device can use this desktop content as the screen projection content and send it to the first electronic device through the screen projection data channel, so that the first electronic device receives the screen projection content generated by the second electronic device.

[0053] For example, suppose the second electronic device loads the display content of an application interface in the background. The second electronic device can use this display content as the screen projection content and send it to the first electronic device through the screen projection data channel, so that the first electronic device receives the screen projection content generated by the second electronic device.

[0054] It should be noted that the specific content generated by the second electronic device can be set by the user or determined by the electronic device based on certain rules.

[0055] In 103, notification information generated by the second electronic device is received through the notification data channel.

[0056] In this embodiment, the first electronic device receives notification information generated by the second electronic device through a notification data channel.

[0057] For example, suppose that an instant messaging application of a second electronic device receives an instant messaging message, the second electronic device uses it as a notification message and sends it to the first electronic device through a notification data channel, so that the first electronic device receives the notification message generated by the second electronic device.

[0058] For example, suppose the battery application of the second electronic device generates a low battery warning message. The second electronic device sends this message as a notification to the first electronic device through the notification data channel, so that the first electronic device receives the notification message generated by the second electronic device.

[0059] In version 104, notification information is integrated into the screen projection content for display.

[0060] In this embodiment, after receiving the screen projection content and notification information, the first electronic device integrates the notification information into the screen projection content for display.

[0061] For example, such as Figure 4 As shown, the first electronic device can display the screen-projected content in a projection window located on the right side of the first electronic device, and display notification information in any position within the projection window that can cover the screen-projected content. The portion of the screen-projected content covered by the notification information is invisible to the user.

[0062] In some embodiments, the first electronic device can generate a corresponding projection image based on the projection content and a corresponding notification image based on the notification information. The projection image is larger than the notification image. Subsequently, the first electronic device can determine a region in the projection image with the same area as the notification image, crop this region from the projection image, and then merge the cropped projection image with the notification image. That is, the notification image replaces the cropped region in the projection image to obtain the target image. The first electronic device then displays the target image in the projection window.

[0063] In this embodiment, the screen projection content generated by the second electronic device is received through the screen projection data channel, and the notification information generated by the second electronic device is received through the notification data channel. The notification information is then integrated into the screen projection content display, so that the user can see the content generated by the second electronic device on the first electronic device.

[0064] Furthermore, by establishing a screen mirroring data channel and a notification data channel between the user's currently used electronic device and an unused electronic device, the user's currently used electronic device receives screen mirroring content generated by the unused electronic device through the screen mirroring data channel, and receives notification information generated by the unused electronic device through the notification data channel. The notification information is then integrated into the screen mirroring content for display, allowing the user to see the content generated by the unused electronic device, such as screen mirroring content and notification information, on their currently used electronic device in a timely manner, enabling the user to take appropriate actions promptly.

[0065] In an optional embodiment, establishing a notification data channel between the first electronic device and the second electronic device includes:

[0066] Establish a notification data channel between the first electronic device and the first notification center of the second electronic device;

[0067] Receive notification information generated by the second electronic device through the notification data channel, including:

[0068] Notification information is received from the first notification center through the notification data channel.

[0069] In this embodiment, the first electronic device establishes a notification data channel between the first electronic device and the first notification center of the second electronic device, so that the first electronic device receives notification information from the first notification center through the notification data channel.

[0070] Specifically, the first electronic device and the second electronic device establish a notification data channel between the cross-screen control module of the first electronic device and the first notification center of the second electronic device. Thus, the second electronic device transmits notification information from the first notification center through the notification data channel, and the cross-screen control module of the first electronic device receives notification information from the first notification center through the notification data channel.

[0071] It is understandable that notification information generated by the second electronic device is usually sent to the first notification center and displayed through the first notification center, such as on the screen. In this embodiment, a notification data channel is established between the cross-screen control module of the first electronic device and the first notification center, so that the cross-screen control module of the first electronic device can receive the notification information received by the first notification center.

[0072] In an optional embodiment, before integrating the notification information into the projected content for display, the method further includes:

[0073] Determine the usage status of the screen-projected content;

[0074] Integrate notification information into the screen-cast content for display, including:

[0075] If the screen-cast content is already displayed, the notification information will be integrated into the screen-cast content for display.

[0076] The usage status of the screen-projected content includes a displayed state and a non-displayed state, which can be triggered by the user. When the screen-projected content is in the displayed state, the first electronic device displays the screen-projected content. When the screen-projected content is in the non-displayed state, the first electronic device does not display the screen-projected content.

[0077] For example, when the first electronic device displays the screen-projected content (i.e., the screen-projected content is in display mode), a shutdown trigger button is displayed on the first electronic device. When the user triggers this button, the first electronic device stops displaying the screen-projected content (i.e., the screen-projected content enters a non-display state), and a startup trigger button is displayed on the first electronic device. When the user triggers this button, the first electronic device displays the screen-projected content (i.e., the screen-projected content enters display mode).

[0078] In this embodiment, the first electronic device determines the usage status of the screen-projected content to determine whether the content is in a display state or a non-display state. If the screen-projected content is in a display state, the first electronic device integrates the notification information into the screen-projected content for display.

[0079] It should be noted that the specific implementation of "integrating notification information into the screen projection content for display" in this embodiment can be found in the specific implementation of "integrating notification information into the screen projection content for display" in other embodiments, and will not be repeated here.

[0080] In an optional embodiment, after integrating the notification information into the projected content for display, the method further includes:

[0081] In response to a viewing operation of a notification, a viewing instruction is sent to the second electronic device. The viewing instruction is used to instruct the second electronic device to generate and transmit the target screen projection content corresponding to the notification.

[0082] Display the target content to be projected.

[0083] Understandably, after seeing the notification displayed on the first electronic device, the user can view the notification, such as by clicking on it. The first electronic device then receives this viewing request. Since the notification is generated by the second electronic device, in response to the viewing request, the first electronic device sends a viewing instruction to the second electronic device, instructing it to generate and transmit the corresponding target content for the notification.

[0084] For example, suppose the notification is generated by an instant messaging application. In response to a viewing operation on this notification, the first electronic device sends a viewing instruction to the second electronic device. The second electronic device can then launch the instant messaging application and enter the viewing interface for the notification. The second electronic device transmits the content of this viewing interface as the target screen projection content to the first electronic device. After receiving the target screen projection content, the first electronic device displays the target screen projection content on its screen for the user to view.

[0085] In an optional embodiment, before sending the viewing instruction information to the second electronic device, the method further includes:

[0086] If the second electronic device is in a locked state, an unlock instruction message is sent to the second electronic device. The unlock instruction message is used to instruct the second electronic device to output an unlock prompt message.

[0087] Sending viewing instructions to the second electronic device, including:

[0088] After the second electronic device unlocks its screen, a viewing instruction message is sent to the second electronic device.

[0089] Understandably, after seeing the notification displayed on the first electronic device, the user can view it by clicking on it, thus instructing the first electronic device to view the notification. Since this notification is generated by the second electronic device, it needs to be viewed through the second device. If the second electronic device is locked, it must be unlocked to view the notification. Therefore, in response to this viewing operation, the first electronic device first checks if the second electronic device is locked. If it is, the first electronic device sends an unlock instruction to the second electronic device, instructing it to output an unlock prompt, such as aloud and / or displayed, prompting the user to unlock. After the second electronic device unlocks, the first electronic device sends a viewing instruction to the second electronic device, instructing it to generate and transmit the target screen projection content for the corresponding notification. If the second electronic device is unlocked, the first electronic device directly sends the viewing instruction to the second electronic device, instructing it to generate and transmit the target screen projection content for the corresponding notification.

[0090] For example, assuming the notification is generated by an instant messaging application, in response to a viewing operation for this notification, the first electronic device checks whether the second electronic device is locked. If the second electronic device is locked, the first electronic device sends an unlock instruction to the second electronic device, instructing it to output an unlock prompt, such as broadcasting and / or displaying the unlock prompt, thus prompting the user to unlock. After the second electronic device unlocks, the first electronic device sends a viewing instruction to the second electronic device. The second electronic device can then launch the instant messaging application and enter the notification viewing interface. The second electronic device transmits the content of this viewing interface as the target projection content to the first electronic device. Upon receiving the target projection content, the first electronic device displays it on its screen for the user to view. If the second electronic device is unlocked, the first electronic device directly sends a viewing instruction to the second electronic device. The second electronic device can then launch the instant messaging application and enter the notification viewing interface. The second electronic device transmits the content of this viewing interface as the target projection content to the first electronic device. Upon receiving the target projection content, the first electronic device displays it on its screen for the user to view.

[0091] In an optional embodiment, after determining the usage status of the screen-projected content, the method further includes:

[0092] If the screen-cast content is not in a display state, then generate the target notification information corresponding to the notification information;

[0093] The target notification information is displayed through the second notification center of the first electronic device.

[0094] In this embodiment, the first electronic device determines the usage status of the screen-projected content to determine whether the content is in a display state or a non-display state. For example... Figure 5 As shown, if the screen-projected content is not in a display state, the first electronic device generates the target notification information corresponding to the notification information through the cross-screen control module, and sends the target notification information to the second notification center of the first electronic device through the cross-screen control module, and displays the target notification information through the second notification center.

[0095] In an alternative embodiment, such as Figure 6 As shown, when the screen-projected content is not in a display state, if a viewing operation for a target notification is received, such as when the user clicks on the target notification, the first electronic device will cause the screen-projected content to enter the display state, and the screen-projected content will be the target screen-projected content of the corresponding notification.

[0096] For example, suppose the notification is generated by an instant messaging application. In response to a viewing operation for the target notification, the first electronic device will display the projected content and send a viewing instruction to the second electronic device. The second electronic device can then launch the instant messaging application and enter the notification viewing interface. The second electronic device transmits the content of this viewing interface as the target projected content to the first electronic device. After receiving the target projected content, the first electronic device displays it on its screen for the user to view.

[0097] In an alternative embodiment, such as Figure 7 As shown, when the screen-projected content is not displayed, if a viewing operation for a target notification is received, such as when the user clicks on the target notification, the first electronic device will cause the screen-projected content to enter the display state. Since this target notification corresponds to a notification generated by the second electronic device, it needs to be viewed through the second electronic device. However, if the second electronic device is locked, it must be unlocked to view the notification. Therefore, in response to this viewing operation, the first electronic device first checks whether the second electronic device is locked. If the second electronic device is locked, the first electronic device sends an unlock instruction to the second electronic device, instructing it to output an unlock prompt, such as broadcasting and / or displaying the unlock prompt, thus prompting the user to unlock. If the second electronic device displays the unlock prompt, it can also send the content of the unlock prompt's display interface to the first electronic device as screen-projected content. After receiving this screen-projected content, the first electronic device can display it. After the second electronic device unlocks, the first electronic device sends a viewing instruction to the second electronic device, instructing it to generate and transmit the target screen-projected content corresponding to the notification. After receiving the target screen projection content, the first electronic device displays the target screen projection content on its screen for the user to view. If the second electronic device is in an unlocked state, the first electronic device directly sends a viewing instruction to the second electronic device, thereby instructing the second electronic device to generate and transmit the target screen projection content corresponding to the notification information.

[0098] For example, assuming the notification is generated by an instant messaging application, in response to a viewing operation for the target notification, the first electronic device checks whether the second electronic device is locked. If the second electronic device is locked, the first electronic device sends an unlock instruction to the second electronic device, instructing it to output an unlock prompt, such as broadcasting and / or displaying the unlock prompt, thus prompting the user to unlock. After the second electronic device unlocks, the first electronic device sends a viewing instruction to the second electronic device. The second electronic device can then launch the instant messaging application and enter the notification viewing interface. The second electronic device transmits the content of this viewing interface as the target projection content to the first electronic device. Upon receiving the target projection content, the first electronic device displays it on its screen for the user to view. If the second electronic device is unlocked, the first electronic device directly sends a viewing instruction to the second electronic device. The second electronic device can then launch the instant messaging application and enter the notification viewing interface. The second electronic device transmits the content of this viewing interface as the target projection content to the first electronic device. Upon receiving the target projection content, the first electronic device displays it on its screen for the user to view.

[0099] In an optional embodiment, if a removal operation is received for a target notification, the first electronic device will remove the target notification from the second notification center. The first electronic device may also send a removal instruction to the second electronic device. Upon receiving the removal instruction, the second electronic device can remove the notification from the first notification center, thereby removing the notification from the second electronic device by receiving the operation on the first electronic device.

[0100] In an optional embodiment, when the projected content is in a non-display state, the first electronic device receives a notification message and simultaneously receives an operation to enter the display state, such as receiving a trigger operation on the start trigger button. The first electronic device can then generate a target notification message corresponding to the notification message and display the target notification message through the second notification center of the first electronic device. In an optional embodiment, the first electronic device can simultaneously display the target notification message through the second notification center of the first electronic device and integrate the notification message into the projected content for display.

[0101] In an optional embodiment, after receiving the notification information generated by the second electronic device via the notification data channel, the method further includes:

[0102] The notification information is saved to the second notification center of the first electronic device.

[0103] In this embodiment, after receiving the notification information generated by the second electronic device, the first electronic device can save the notification information to the second notification center of the first electronic device, such as saving it to the message list of the second notification center.

[0104] In an optional embodiment, if the projected content is in a display state, the first electronic device can save the notification information to the second notification center. If the projected content is not in a display state, the first electronic device saves the target notification information corresponding to the generated notification information to the second notification center.

[0105] In an optional embodiment, after saving the notification information to the second notification center of the first electronic device, the method further includes:

[0106] In response to a removal operation for a notification message, the notification message is removed from the second notification center.

[0107] Understandably, after seeing the notification displayed on the first electronic device, the user can remove the notification, such as by swiping it. The first electronic device then receives a removal request for the notification. In response to this removal request, the first electronic device removes the notification from the second notification center.

[0108] In an optional embodiment, after saving the notification information to the second notification center of the first electronic device, the method further includes:

[0109] In response to a removal operation for a notification message, a removal instruction message is sent to a second electronic device, which instructs the second electronic device to remove the notification message from the first notification center.

[0110] Understandably, after seeing the notification displayed on the first electronic device, the user can remove the notification, such as by swiping it. The first electronic device then receives this removal request. In response, the first electronic device sends a removal instruction to the second electronic device, instructing it to remove the notification from the first notification center. Upon receiving this instruction, the second electronic device can then remove the notification from the first notification center, thus removing the notification from the second electronic device by receiving the action on the first electronic device.

[0111] In an optional embodiment, in response to a removal operation on a notification message, the first electronic device may send a removal instruction message to the second electronic device while removing the notification message from the second notification center. The removal instruction message is used to instruct the second electronic device to remove the notification message from the first notification center, thereby achieving simultaneous removal of the notification message from the notification centers of the first and second electronic devices, avoiding the need for the user to perform two operations to remove the notification message from the notification centers of the first and second electronic devices.

[0112] In an alternative embodiment, such as Figure 8 As shown, the first and second electronic devices establish a P2P data connection through a cross-screen interconnection module. Based on this data connection, the first and second electronic devices establish a screen projection data channel between their respective cross-screen control modules. Based on this data connection, the first and second electronic devices also establish a notification data channel between their respective cross-screen control modules and the first notification center of the second electronic device. After notification information generated by the application on the second electronic device is sent to the first notification center, the first notification center will invoke the AddNotification() class to send the notification information to the cross-screen control module of the first electronic device through the notification data channel.

[0113] Subsequently, if the projected content is displayed, the cross-screen control module of the first electronic device sends a notification to the second notification center. The second notification center saves this notification and integrates it into the projected content for display, meaning the notification is directly displayed in the projected window where the content is displayed. If a view operation is received for the notification, the first electronic device invokes the `notificationClicked()` method, sending a view instruction to the second electronic device. The second electronic device can then launch the application and enter the view interface for the notification. The second electronic device transmits the content of this view interface as the target projected content to the first electronic device, thus the first electronic device displays the target projected content for the corresponding notification. If a remove operation is received for the notification, the first electronic device removes the notification from the second notification center.

[0114] If the projected content is not in a display state, the cross-screen control module of the first electronic device generates a target notification corresponding to the notification information and sends the target notification information to the second notification center. The second notification center saves the target notification information and displays it. If a view operation is received for the target notification information, the first electronic device will invoke the notificationClicked() method, thereby putting the projected content into display mode, and the projected content will be the target projected content of the corresponding notification information. If a remove operation is received for the target notification information, the first electronic device will remove the target notification information from the second notification center.

[0115] In an optional embodiment, the electronic device may also send a removal instruction to the second electronic device via an established notification data channel. Upon receiving the removal instruction, the second electronic device calls the icdfConsumerDelete() method to remove the notification from the first notification center.

[0116] In an optional embodiment, after the first electronic device establishes a data connection with the second electronic device, and establishes a projection data channel and a notification data channel between the two devices based on this data connection, the second electronic device and the first electronic device enter a cross-screen interconnection state. When the projection data channel and notification data channel between the first and second electronic devices are disconnected, and the data connection is broken, the second electronic device and the first electronic device enter a non-cross-screen interconnection state. Furthermore, if the notification synchronization function of the first electronic device is enabled, when the projection content is not displayed, the first electronic device generates a target notification message corresponding to the notification information and displays the target notification message through the second notification center. If the notification synchronization function of the first electronic device is disabled, no notification information synchronization processing is performed, that is, the first electronic device does not perform any corresponding display processing on the notification information.

[0117] For example, when a second electronic device generates a notification, it determines whether it is in a cross-screen interconnection state with the first electronic device. If the second electronic device and the first electronic device are not in a cross-screen interconnection state, i.e., in a non-cross-screen interconnection state, the second electronic device displays the notification information through the first notification center. If the second electronic device and the first electronic device are in a cross-screen interconnection state, the second electronic device sends the notification information to the first electronic device. The first electronic device determines the display status of the screen-projected content. If the screen-projected content is in a display state, the first electronic device integrates the notification information into the screen-projected content for display, for example, by integrating the notification information into the screen-projected content in a manner similar to how the second electronic device displays the notification information through the first notification center. If the screen-projected content is in a non-display state, the first electronic device determines whether the notification synchronization function is enabled. If the notification synchronization function is enabled, the first electronic device generates the target notification information corresponding to the notification information and displays the target notification information through the second notification center. If the notification synchronization function is disabled, the first electronic device does not perform notification information synchronization processing, i.e., the first electronic device does not perform corresponding display processing for the notification information.

[0118] In an optional embodiment, after integrating the notification information into the projected content for display, the method further includes:

[0119] The notification will be removed once the preset display duration has elapsed.

[0120] In an optional embodiment, the notification information is integrated into the projected content for display, including:

[0121] Acquire images of the human eye;

[0122] The first display area on the screen is determined based on the intersection of the human eye's line of sight and the screen of the first electronic device.

[0123] The notification information is integrated into the screen projection content and displayed in the first display area.

[0124] In this embodiment, the first electronic device acquires an image of a human eye and, based on this image, determines the first display area on the screen where the intersection of the human eye's gaze direction and the screen of the first electronic device is located using a gaze tracking algorithm. Subsequently, the first electronic device integrates notification information into the projected content and displays it in the first display area. This first display area can be a region within a preset range centered on the intersection of the human eye's gaze direction and the screen of the first electronic device. The preset range can be set by the user or generated by the first electronic device based on certain rules.

[0125] In an optional embodiment, the notification information is integrated into the projected content for display, including:

[0126] Based on the information type of the notification message, a second display area is determined from the screen of the first electronic device;

[0127] The notification information is integrated into the screen projection content and displayed in the second display area.

[0128] In this embodiment, the first electronic device pre-classifies different notification information, such as into system application type and third-party application type. If the notification information is generated by a system application, then the notification information type is system application type. If the notification information is generated by a third-party application, then the notification information type is third-party application type. The first electronic device also pre-determines different display areas (including position and / or size) for different information types. Then, after receiving the notification information and the projected content, the first electronic device determines a second display area from its screen according to the information type of the notification information, and merges the notification information into the projected content for display in the second display area.

[0129] In an alternative embodiment, such as Figure 9 As shown, the first electronic device in this application embodiment can be a smartphone, and the second electronic device in this application embodiment can be a television, tablet, desktop computer, laptop, terminal device, PDA, etc.

[0130] In an optional embodiment, the first electronic device in this application embodiment can be at least one of a smartphone, television, tablet, desktop computer, laptop, terminal device, and PDA, and the second electronic device in this application embodiment can be at least one of a smartphone, television, tablet, desktop computer, laptop, terminal device, and PDA, thereby realizing one-to-many cross-terminal interconnection, many-to-one cross-terminal interconnection, and many-to-many cross-terminal interconnection.

[0131] Please see Figure 10 , Figure 10 This is a flowchart illustrating another information processing method provided in an embodiment of this application. The information processing method is applied to a second electronic device, and the process includes:

[0132] In step 201, a data connection is established with the first electronic device, and based on the data connection, a screen projection data channel and a notification data channel are established between the first electronic device and the second electronic device.

[0133] In step 202, the screen projection content generated by the second electronic device is transmitted to the first electronic device through the screen projection data channel.

[0134] In step 203, notification information generated by the second electronic device is transmitted to the first electronic device via a notification data channel, so that the first electronic device can integrate the notification information into the screen projection content for display.

[0135] In an optional embodiment, establishing a notification data channel between the first electronic device and the second electronic device includes:

[0136] Establish a notification data channel between the first electronic device and the first notification center of the second electronic device;

[0137] The notification information generated by the second electronic device is transmitted to the first electronic device via the notification data channel, including:

[0138] Notification information is sent from the first notification center via the notification data channel.

[0139] It is understood that steps 201 to 203 correspond to the steps of the sending end, while steps 101 to 104 correspond to the steps of the receiving end. The processing flow of the two is corresponding. Therefore, the specific implementation of steps 201 to 203 can be found in the specific implementation of the previous embodiments, and will not be repeated here.

[0140] Please see Figure 11 , Figure 11 This is a schematic diagram of the structure of an information processing device provided in an embodiment of this application. The information processing device 300 is applied to a first electronic device and includes: a channel establishment module 301, a content receiving module 302, an information receiving module 303, and an information display module 304.

[0141] The channel establishment module 301 is used to establish a data connection with the second electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device.

[0142] The content receiving module 302 is used to receive the screen projection content generated by the second electronic device through the screen projection data channel.

[0143] The information receiving module 303 is used to receive notification information generated by the second electronic device through the notification data channel.

[0144] The information display module 304 is used to integrate notification information into the screen projection content for display.

[0145] In an optional embodiment, the channel establishment module 301 can be used to: establish a notification data channel between the first electronic device and the first notification center of the second electronic device;

[0146] The information receiving module 303 can be used to receive notification information from the first notification center through the notification data channel.

[0147] In an optional embodiment, the information display module 304 may be used for:

[0148] Determine the usage status of the screen-casting content; if the screen-casting content is in a display state, then integrate the notification information into the screen-casting content for display.

[0149] In an optional embodiment, the information processing device 300 may further include an information viewing module, which may be used to: in response to a viewing operation for notification information, send viewing instruction information to a second electronic device, the viewing instruction information being used to instruct the second electronic device to generate and transmit target projection content corresponding to the notification information; and display the target projection content.

[0150] In an optional embodiment, the information viewing module can be used to: send unlock instruction information to the second electronic device if the second electronic device is in a locked screen state, the unlock instruction information being used to instruct the second electronic device to output unlock prompt information; and send viewing instruction information to the second electronic device after the second electronic device unlocks its screen state.

[0151] In an optional embodiment, the information display module 304 can be used to: generate target notification information corresponding to the screen projection content if the content being projected is not in a display state; and display the target notification information through the second notification center of the first electronic device.

[0152] In an optional embodiment, the information processing device 300 may further include an information storage module, which may be used to: store notification information to a second notification center of the first electronic device.

[0153] In an optional embodiment, the information processing device 300 may further include an information removal module, which may be used to remove the notification information from the second notification center in response to a removal operation on the notification information.

[0154] In an optional embodiment, the information removal module may be configured to: in response to a removal operation for notification information, send removal instruction information to a second electronic device, the removal instruction information being used to instruct the second electronic device to remove the notification information from the first notification center.

[0155] In an optional embodiment, the information display module 304 can be used to: cancel the display of the notification information when the display duration of the notification information reaches a preset duration.

[0156] In an optional embodiment, the information display module 304 can be used to: acquire a human eye image; determine the first display area on the screen where the intersection of the human eye's line of sight and the screen of the first electronic device is located based on the human eye image; and integrate the notification information into the projection content and display it in the first display area.

[0157] In an optional embodiment, the information display module 304 may be used to: determine a second display area from the screen of the first electronic device according to the information type of the notification information; and merge the notification information into the projection content for display in the second display area.

[0158] Please see Figure 12 , Figure 12 This is a schematic diagram of another information processing device provided in an embodiment of this application. The information processing device 400 is applied to a second electronic device and includes: a channel establishment module 401, a content transmission module 402, and an information transmission module 403.

[0159] The channel establishment module 401 is used to establish a data connection with the first electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device.

[0160] The content transmission module 402 is used to transmit the screen projection content generated by the second electronic device to the first electronic device through the screen projection data channel.

[0161] The information transmission module 403 is used to transmit notification information generated by the second electronic device to the first electronic device through the notification data channel, so that the first electronic device can integrate the notification information into the screen projection content for display.

[0162] In an optional embodiment, the channel establishment module 401 can be used to: establish a notification data channel between the first electronic device and the first notification center of the second electronic device;

[0163] The information transmission module 403 can be used to send notification information from the first notification center through the notification data channel.

[0164] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed on a computer, causes the computer to perform the information processing method provided in this embodiment.

[0165] This application also provides an electronic device, including a memory and a processor, wherein the processor executes the information processing method provided in this embodiment by calling a computer program stored in the memory.

[0166] For example, the aforementioned electronic device could be a mobile terminal such as a tablet or smartphone. See also... Figure 13 , Figure 13 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0167] The electronic device 500 may include components such as a processor 501 and a memory 502. Those skilled in the art will understand that... Figure 13 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. For example, electronic device 500 may also include a screen.

[0168] The processor 501 is the control center of the electronic device. It connects various parts of the electronic device through various interfaces and lines. By running or executing the application program stored in the memory 502 and calling the data stored in the memory 502, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole.

[0169] Memory 502 can be used to store applications and data. The applications stored in memory 502 contain executable code. Applications can be composed of various functional modules. Processor 501 executes various functional applications and data processing by running the applications stored in memory 502.

[0170] In this embodiment, the processor 501 in the electronic device loads the executable code corresponding to the process of one or more applications into the memory 502 according to the following instructions, and the processor 501 runs the applications stored in the memory 502, thereby realizing the information processing method described in any embodiment of this application.

[0171] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed description of the information processing method above, which will not be repeated here.

[0172] The information processing device provided in this application embodiment belongs to the same concept as the information processing method in the above embodiment. Any method provided in the information processing method embodiment can be run on the information processing device. For details of its specific implementation process, please refer to the information processing method embodiment, which will not be repeated here.

[0173] It should be noted that, for the information processing method of the embodiments of this application, those skilled in the art will understand that all or part of the process of the information processing method of the embodiments of this application can be implemented by a computer program controlling related hardware. The computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor. During execution, it can include the process of the embodiments of the information processing method. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), random access memory (RUM), etc.

[0174] It is understood that in the specific implementation of this application, user information, such as application usage behavior data, logs and other related data, is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0175] For the information processing apparatus of this application embodiment, its functional modules can be integrated into a single processing chip, or each module can exist physically separately, or two or more modules can be integrated into a single module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0176] The above provides a detailed description of an information processing method, apparatus, storage medium, and electronic device provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An information processing method applied to a first electronic device, characterized in that, include: Establish a data connection with the second electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device; The screen projection content generated by the second electronic device is received through the screen projection data channel; The notification data channel is used to receive notification information generated by the second electronic device. When the screen projection content is in the display state, the notification information is integrated into the screen projection content for display. In response to the viewing operation of the notification information in the screen projection content, a viewing instruction information is sent to the second electronic device. The viewing instruction information is used to instruct the second electronic device to generate and transmit the target screen projection content corresponding to the notification information. If the screen-projected content is not displayed, the first electronic device determines whether the notification synchronization function is enabled. If the notification synchronization function is enabled, the target notification information corresponding to the notification information will be generated. Display target notification information through a second notification center; When the second electronic device is in a locked state, in response to a viewing operation of the target notification information, an unlock instruction message is sent to the second electronic device, and the screen projection content is controlled to be displayed; after the second electronic device is unlocked, a viewing instruction message is sent to the second electronic device. Display the target screen-projected content; The first electronic device also displays a power off trigger button or a power on trigger button; the power off trigger control is used to switch the screen projection content from a display state to a non-display state, and the power on trigger control is used to switch the screen projection content from a non-display state to a display state.

2. The information processing method according to claim 1, characterized in that, Establishing a notification data channel between the first electronic device and the second electronic device includes: Establish a notification data channel between the first electronic device and the first notification center of the second electronic device; Receiving notification information generated by the second electronic device through the notification data channel includes: The notification information is received from the first notification center through the notification data channel.

3. The information processing method according to claim 1, characterized in that, Before integrating the notification information into the projected content for display, the method further includes: Determine the usage status of the screen-projected content; The step of integrating the notification information into the screen projection content for display includes: If the screen-projected content is in a display state, the notification information will be integrated into the screen-projected content for display.

4. The information processing method according to claim 3, characterized in that, After integrating the notification information into the screen projection content for display, the method further includes: In response to a viewing operation of the notification information, a viewing instruction message is sent to the second electronic device, the viewing instruction message being used to instruct the second electronic device to generate and transmit target projection content corresponding to the notification information; Display the target content to be projected.

5. The information processing method according to claim 4, characterized in that, Before sending the viewing instruction information to the second electronic device, the method further includes: If the second electronic device is in a locked state, an unlock instruction message is sent to the second electronic device, which is used to instruct the second electronic device to output an unlock prompt message; Sending the viewing instruction information to the second electronic device includes: After the second electronic device unlocks its screen, the viewing instruction information is sent to the second electronic device.

6. The information processing method according to claim 3, characterized in that, After determining the usage status of the screen-projected content, the process also includes: If the screen-projected content is not in a display state, then a target notification message corresponding to the notification information is generated; The target notification information is displayed through the second notification center of the first electronic device.

7. The information processing method according to claim 2, characterized in that, After receiving the notification information generated by the second electronic device through the notification data channel, the method further includes: The notification information is saved to the second notification center of the first electronic device.

8. The information processing method according to claim 7, characterized in that, After saving the notification information to the second notification center of the first electronic device, the method further includes: In response to the removal operation for the notification information, the notification information is removed from the second notification center.

9. The information processing method according to claim 7, characterized in that, After saving the notification information to the second notification center of the first electronic device, the method further includes: In response to the removal operation of the notification information, a removal instruction message is sent to the second electronic device, the removal instruction message being used to instruct the second electronic device to remove the notification information from the first notification center.

10. The information processing method according to any one of claims 1 to 9, characterized in that, After integrating the notification information into the screen projection content for display, the method further includes: When the display duration of the notification information reaches the preset duration, the display of the notification information is canceled.

11. The information processing method according to any one of claims 1 to 9, characterized in that, The step of integrating the notification information into the screen projection content for display includes: Acquire images of the human eye; The first display area on the screen is determined based on the human eye image, which is the intersection of the human eye's line of sight and the screen of the first electronic device. The notification information is integrated into the screen projection content and displayed in the first display area.

12. The information processing method according to any one of claims 1 to 9, characterized in that, The step of integrating the notification information into the screen projection content for display includes: Based on the information type of the notification information, a second display area is determined from the screen of the first electronic device; The notification information is integrated into the screen projection content and displayed in the second display area.

13. An information processing method applied to a second electronic device, characterized in that, include: Establish a data connection with the first electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device; The projection data channel transmits the projection content generated by the second electronic device to the first electronic device; The notification data channel transmits notification information generated by the second electronic device to the first electronic device, enabling the first electronic device to integrate the notification information into the projected content for display. This includes: when the projected content is in a display state, integrating the notification information into the projected content for display; responding to a viewing operation of the notification information in the projected content, sending viewing instruction information to the second electronic device, the viewing instruction information instructing the second electronic device to generate and transmit target projected content corresponding to the notification information; when the projected content is not in a display state, the first electronic device determines whether the notification synchronization function is enabled; if the notification synchronization function is enabled... In the enabled state, a target notification is generated; the target notification is displayed through the second notification center; when the second electronic device is in a locked state, in response to a viewing operation of the target notification, an unlock instruction is sent to the second electronic device, and the projected content is controlled to be displayed; after the second electronic device is unlocked, a viewing instruction is sent to the second electronic device; the target projected content is displayed; the first electronic device also displays a close trigger button or a close trigger button; the close trigger control is used to switch the projected content from a displayed state to a non-displayed state, and the close trigger control is used to switch the projected content from a non-displayed state to a displayed state.

14. The information processing method according to claim 13, characterized in that, Establishing a notification data channel between the first electronic device and the second electronic device includes: Establish a notification data channel between the first electronic device and the first notification center of the second electronic device; The step of transmitting the notification information generated by the second electronic device to the first electronic device through the notification data channel includes: The notification information is sent from the first notification center through the notification data channel.

15. An information processing device, applied to a first electronic device, characterized in that, include: The channel establishment module is used to establish a data connection with the second electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device; The content receiving module is used to receive the screen projection content generated by the second electronic device through the screen projection data channel; The information receiving module is used to receive notification information generated by the second electronic device through the notification data channel; The information display module is used to integrate notification information into the screen projection content for display when the screen projection content is in a display state. In response to a viewing operation of the notification information in the screen projection content, it sends viewing instruction information to the second electronic device. The viewing instruction information is used to instruct the second electronic device to generate and transmit the target screen projection content corresponding to the notification information. When the screen projection content is not in a display state, the first electronic device determines whether the notification synchronization function is enabled. If the notification synchronization function is enabled, the target notification information corresponding to the notification information will be generated. Display target notification information through a second notification center; When the second electronic device is in a locked state, in response to a viewing operation of the target notification information, an unlock instruction is sent to the second electronic device, and the screen-projected content is controlled to be displayed; after the second electronic device is unlocked, a viewing instruction is sent to the second electronic device; the target screen-projected content is displayed; the first electronic device also displays a close trigger button or an open trigger button; the close trigger control is used to switch the screen-projected content from the displayed state to the non-displayed state, and the open trigger control is used to switch the screen-projected content from the non-displayed state to the displayed state.

16. An information processing device, applied to a second electronic device, characterized in that, include: The channel establishment module is used to establish a data connection with the first electronic device, and based on the data connection, establish a screen projection data channel and a notification data channel between the first electronic device and the second electronic device; The content transmission module is used to transmit the screen projection content generated by the second electronic device to the first electronic device through the screen projection data channel; The information transmission module is used to transmit notification information generated by the second electronic device to the first electronic device through the notification data channel, so that the first electronic device integrates the notification information into the screen projection content for display. This includes: when the screen projection content is in a display state, integrating the notification information into the screen projection content for display; responding to a viewing operation of the notification information in the screen projection content, sending viewing instruction information to the second electronic device, the viewing instruction information instructing the second electronic device to generate and transmit target screen projection content corresponding to the notification information; when the screen projection content is not in a display state, the first electronic device determines whether the notification synchronization function is enabled; if the notification synchronization function is enabled... If the device is in an on state, a target notification is generated; the target notification is displayed through the second notification center; if the second electronic device is in a locked state, in response to a viewing operation of the target notification, an unlock instruction is sent to the second electronic device, and the projected content is controlled to be displayed; after the second electronic device is unlocked, a viewing instruction is sent to the second electronic device; the target projected content is displayed; the first electronic device also displays a close trigger button or a close trigger button; the close trigger control is used to switch the projected content from a displayed state to a non-displayed state, and the close trigger control is used to switch the projected content from a non-displayed state to a displayed state.

17. A storage medium, characterized in that, The storage medium stores a computer program that, when run on a computer, causes the computer to perform the information processing method according to any one of claims 1 to 12 or any one of claims 13 to 14.

18. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing a computer program, and the processor executing the information processing method according to any one of claims 1 to 12 or any one of claims 13 to 14 by calling the computer program stored in the memory.

Images