A multi-screen interaction system, method, device and medium based on cloud collaboration

Abstract

This invention relates to a cloud-based collaborative multi-screen interaction system, method, device, and medium. The method includes a camera module intermittently capturing images of the interacting user and intermittently packaging the latest captured data and corresponding interactive screen identity tags into data packets, which are then transmitted to a data transmission module. The data transmission module uploads the latest acquired data packets to a cloud server. Based on the captured data, interactive screen identity tags, and the content currently displayed on all interactive screens in each newly received data packet, the cloud server determines the data stream that needs to be forwarded by the data transmission module for each data packet's corresponding interactive screen and sends it to the data transmission module. The data transmission module continuously forwards the data streams sent by the cloud server to the corresponding interactive screens to achieve content rendering at the interactive screens. This provides a collaborative control scheme for multi-screen interaction systems that coordinates the overall user state and can respond in real-time to changes in individual user interactions.

Description

Technical Field

[0001] Several embodiments of this specification relate to the field of information processing technology, specifically to a cloud-based collaborative multi-screen interaction system, method, device, and medium. Background Technology

[0002] With the rapid development of human-computer interaction technology, interactive devices have been widely used in many scenarios such as daily displays, commercial advertising, and medical guidance. In order to meet the needs of displaying more information or providing services from multiple angles, existing interactive systems usually have multiple interactive screens.

[0003] However, existing multi-screen interaction systems have significant shortcomings in practical applications. Current data push strategies for multi-screen interaction are typically in an "island-like" single-control state, meaning that data is pushed independently only for user activity detected on a single interactive screen. Specifically, when a camera in front of an interactive screen detects a user, the system triggers an independent push process only for that specific screen, lacking linkage and information exchange between different interactive screens. This island-like push mechanism leads to two serious problems:

[0004] First, the interaction process lacks dynamic adaptability, resulting in poor user interaction. During user interaction, it's impossible to adjust subsequent push data in a timely and dynamic manner based on real-time user feedback. This rigid "one-stop" approach fails to adapt content to changing needs.

[0005] Secondly, in scenarios with densely deployed interactive screens, there is significant interference and impact between multiple users. When multiple users stand in front of different interactive screens, the dense arrangement of these screens in physical space makes it highly susceptible to conflicts in sound, light, shadow, and visual content displayed on different screens. Existing systems cannot perceive and coordinate the user states between these adjacent screens, resulting in the push content on one screen potentially causing distraction or visual interference for users on adjacent screens.

[0006] In summary, existing multi-screen interaction systems lack a collaborative control scheme that can coordinate the overall user status and respond in real time to changes in individual user interactions, and urgently needs improvement. Summary of the Invention

[0007] This specification provides a cloud-based collaborative multi-screen interaction system, method, device, and medium, and offers a collaborative control scheme for multi-screen interaction systems that can coordinate the overall user status and respond in real time to changes in individual user interactions.

[0008] The technical solution is as follows:

[0009] In a first aspect, embodiments of this specification provide a cloud-based collaborative multi-screen interaction system, including: a multi-screen interaction device and a cloud server. The multi-screen interaction device includes a device body, multiple interactive screens uniformly arranged around the outer wall of the device body, a data transmission module connected to the multiple interactive screens respectively, and a power supply module connected to the data transmission module and the multiple interactive screens respectively. Each interactive screen is equipped with a camera module. The cloud server is connected to the data transmission module.

[0010] The camera module intermittently captures images of users in front of its interactive screen, and intermittently packages the latest captured data and the interactive screen's identification tag into a data packet and transmits it to the data transmission module. The interactive screen identification tag can indicate the position of the interactive screen on the main body of the device.

[0011] The data transmission module uploads the latest acquired data packets to the cloud server;

[0012] The cloud server, based on the captured data, interactive screen identification tags, and the content currently being displayed on all interactive screens in each newly received data packet, determines the data stream that needs to be forwarded through the data transmission module for each data packet corresponding to the interactive screen, and sends it to the data transmission module.

[0013] The data transmission module also continuously forwards the data streams sent from the cloud server to the corresponding interactive screen to enable content rendering on the interactive screen.

[0014] As a preferred solution, the cloud server determines the data stream that needs to be sent to the corresponding interactive screen through the data transmission module for each data packet based on the shooting data, interactive screen identification mark, remaining power of the power supply module, and the content currently being displayed on all interactive screens in each newly received data packet.

[0015] As a preferred solution, the cloud server determines the data stream that needs to be sent to each interactive screen via the data transmission module for each data packet based on the captured data, interactive screen identification markers, data transmission bandwidth of the data transmission module, and the content currently being displayed on all interactive screens in each newly received data packet.

[0016] As a preferred solution, the cloud server, based on the captured data, interactive screen identification tags, content delivery requirements, and the content currently being displayed on all interactive screens in each newly received data packet, determines the data stream that needs to be forwarded by the data transmission module for each data packet corresponding to the interactive screen, and then sends it to the data transmission module.

[0017] As a preferred solution, the data transmission module encrypts the latest acquired data packets and uploads them to the cloud server.

[0018] As a preferred solution, the data transmission module encrypts the captured data in the newly acquired data packet using an encryption key corresponding to the interactive screen identity tag in the data packet, and then uploads it to the cloud server;

[0019] The cloud server decrypts the encrypted captured data in each data packet based on the decryption key corresponding to the interactive screen identity tag in each newly received data packet.

[0020] As a preferred embodiment, the main body of the device includes a base and a transparent surrounding plate disposed above the base and arranged around the outer edge of the base to form an accommodating space above the base, with multiple interactive screens evenly arranged around the outer wall of the transparent surrounding plate.

[0021] Secondly, embodiments of this specification provide a cloud-based collaborative multi-screen interaction method, based on the cloud-based collaborative multi-screen interaction system described in the first aspect above, comprising:

[0022] When there is an interactive user in front of the interactive screen to which the camera module belongs, the camera module will intermittently take pictures of the interactive user and intermittently package the latest captured data and the interactive screen identification mark of the interactive screen to which the camera module belongs into a data packet and transmit it to the data transmission module. The interactive screen identification mark can reflect the position of the interactive screen on the main body of the device.

[0023] The data transmission module uploads the latest acquired data packets to the cloud server;

[0024] Based on the captured data, interactive screen identification tags, and the content currently displayed on all interactive screens in each newly received data packet, the cloud server determines the data stream that needs to be forwarded by the data transmission module for each data packet corresponding to the interactive screen, and sends it to the data transmission module.

[0025] The data transmission module continuously forwards the data stream sent by the cloud server to the corresponding interactive screen to realize the content rendering at the interactive screen.

[0026] Thirdly, embodiments of this specification provide an electronic device, including a processor and a memory; the processor is connected to the memory; the memory is used to store executable program code; the processor reads the executable program code stored in the memory to run a program corresponding to the executable program code, so as to perform the steps described in the second aspect of the above embodiments.

[0027] Fourthly, embodiments of this specification provide a computer storage medium storing a plurality of instructions adapted for loading by a processor and executing the steps described in the second aspect of the above embodiments.

[0028] The beneficial effects of the technical solutions provided in some embodiments of this specification include at least the following:

[0029] This invention, by configuring a camera module for each interactive screen and introducing a data packet reporting mechanism with location attributes (interactive screen identification tags), enables the cloud server to monitor the interactive user situation at each screen and the location of all interactive users across the multi-screen interactive devices in real time. Based on this, when making data stream distribution decisions, the cloud is no longer limited to isolated judgments of a single screen. This collaborative control mechanism not only adjusts subsequent push content based on users' real-time gaze, actions, and other interactive information, achieving a personalized, on-demand real-time interactive response, but also effectively avoids light, shadow, sound, and visual interference between adjacent users in dense multi-screen scenarios, ensuring the overall experience quality during multi-user parallel interaction.

[0030] In traditional local standalone control schemes, content switching logic is typically hard-coded into the local terminal, making it difficult to modify at any time. This invention, however, adopts a cloud-based collaborative model of "lightweight edge-side perception + heavy cloud-based decision-making," migrating the core scheduling logic to a cloud server. This means that the recommendation strategy for interactive content can be updated and dynamically configured in the cloud at any time, without requiring any changes to local hardware. This architecture completely breaks through the limitations of local storage and computing power, giving the multi-screen interactive content ecosystem extremely strong scalability and flexibility.

[0031] In scenarios with densely deployed multi-screen environments, simultaneously processing video streams from multiple cameras and running complex joint decision-making algorithms combining global state and individual features places extremely high demands on the data processing capabilities of the local main control chip. Limited by device size, heat dissipation, and cost, the local device typically cannot handle such high-concurrency computational loads, easily leading to critical issues such as screen stuttering and response latency. This invention, through cloud collaboration, offloads the most computationally intensive image analysis and global planning tasks to a cloud server. Leveraging the powerful massive data processing capabilities and abundant computing resources of the cloud server, the system can easily handle real-time processing of multiple high-concurrency data streams. While ensuring extremely high decision-making accuracy, it frees up the local device to handle only lightweight data packaging and final rendering, thus ensuring that the entire multi-screen interactive system maintains a smooth, lag-free interactive experience even in complex scenarios. Attached Figure Description

[0032] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0033] Figure 1 A schematic diagram of the structure of a cloud-based collaborative multi-screen interactive system disclosed herein is shown.

[0034] Figure 2 A flowchart illustrating a cloud-based collaborative multi-screen interaction method according to some embodiments of this disclosure is shown.

[0035] Figure 3 A schematic block diagram of an electronic device according to some embodiments of the present disclosure is shown.

[0036] In the diagram: 11. Base; 12. Transparent surrounding panel; 13. Power supply module; 14. Data transmission module; 15. Interactive screen; 16. Casters; 2. Prize; 3. Cloud server; 4. Interactive user. Detailed Implementation

[0037] The technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings.

[0038] The terms "first," "second," "third," etc., in the description, claims, and accompanying drawings are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such processes, methods, products, or apparatus.

[0039] The following description provides examples and does not limit the scope, applicability, or examples set forth in the claims. Changes may be made to the function and arrangement of the described elements without departing from the scope of this specification. Various processes or components may be appropriately omitted, substituted, or added to the examples. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Furthermore, features described with respect to some examples may be combined into other examples.

[0040] Figure 1A schematic diagram of the structure of a cloud-based collaborative multi-screen interaction system, representing some embodiments of this disclosure, is shown. For example... Figure 1 As shown, a cloud-based collaborative multi-screen interaction system may include at least a multi-screen interaction device and a cloud server 3. The multi-screen interaction device includes a device body, multiple interactive screens 15 evenly arranged around the outer wall of the device body, a data transmission module 14 connected to the multiple interactive screens 15 respectively, and a power supply module 13 connected to the data transmission module 14 and the multiple interactive screens 15 respectively. Each interactive screen 15 is equipped with a camera module. The cloud server 3 is connected to the data transmission module 14.

[0041] The camera module, when there is an interactive user 4 in front of its interactive screen 15, intermittently takes pictures of the interactive user 4, and intermittently packages the latest captured data and the interactive screen identity mark of its interactive screen 15 into a data packet and transmits it to the data transmission module 14. The interactive screen identity mark can reflect the position of the interactive screen 15 on the main body of the device.

[0042] The data transmission module uploads the latest acquired data packets to the cloud server 3;

[0043] The cloud server 3, based on the shooting data, interactive screen identity markers, and the content currently being presented by all interactive screens 15 in each newly received data packet, determines the data stream that needs to be forwarded by the data transmission module 14 for each data packet corresponding to the interactive screen 15, and sends it to the data transmission module 14.

[0044] The data transmission module 14 also continuously forwards the data stream sent by the cloud server 3 to the corresponding interactive screen 15 in order to realize the content rendering at the interactive screen 15.

[0045] Understandable:

[0046] This invention, by configuring a camera module for each interactive screen 15 and introducing a data packet reporting mechanism with location attributes (interactive screen identification tags), enables the cloud server 3 to monitor in real time the status of each interactive user 4 on all interactive screens 15 and the location of each interactive user 4 on the multi-screen interactive device. Based on this, when making data stream distribution decisions, the cloud is no longer limited to isolated judgments on a single screen. This collaborative control mechanism can not only adjust subsequent push content based on users' real-time gaze, actions, and other interactive information, achieving a personalized, on-demand real-time interactive response, but also effectively avoid light, shadow, sound, and visual interference between adjacent users in dense multi-screen scenarios, ensuring the overall experience quality during multi-user parallel interaction.

[0047] In traditional local standalone control schemes, content switching logic is typically hard-coded into the local terminal, making it difficult to modify at any time. This invention, however, adopts a cloud-based collaborative model of "lightweight edge-side perception + heavy cloud-based decision-making," migrating the core scheduling logic to the cloud server. This means that the recommendation strategy for interactive content can be updated and dynamically configured in the cloud at any time, without requiring any changes to the local hardware. This architecture completely breaks through the limitations of local storage and computing power, giving the multi-screen interactive content ecosystem extremely strong scalability and flexibility.

[0048] In scenarios with densely deployed multi-screen environments, simultaneously processing video streams from multiple cameras and running complex joint decision-making algorithms combining global state and individual features places extremely high demands on the data processing capabilities of the local main control chip. Limited by device size, heat dissipation, and cost, the local device typically cannot handle such high-concurrency computational loads, easily leading to critical issues such as screen stuttering and response latency. This invention addresses this by offloading the most computationally intensive image analysis and global coordination tasks to a cloud server through cloud collaboration. Leveraging the powerful massive data processing capabilities and abundant computing resources of the cloud server, the system can easily handle real-time processing of multiple high-concurrency data streams. While ensuring extremely high decision-making accuracy, it frees up the local device to handle only lightweight data packaging and final rendering, thus ensuring a smooth, lag-free interactive experience even in complex scenarios.

[0049] It should be noted that the cloud server 3 can identify the characteristics of the interactive users 4 based on the shooting data, including but not limited to non-sensitive information such as age, gender, and dwell time. The AI ​​model of the cloud server 3 analyzes this data and dynamically adjusts, generates, or matches advertising or game content that is more in line with the current interactive user's interests, thereby achieving precise and personalized content delivery.

[0050] In some embodiments of this specification, the cloud server 3 determines the data stream that needs to be sent to the corresponding interactive screen 15 for each data packet through the data transmission module 14, based on the shooting data, interactive screen identity marker, remaining power of the power supply module 13, and the content currently being displayed on all interactive screens 15 in each newly received data packet.

[0051] Understandably, by incorporating the remaining power level of the power supply module 13 into the decision-making process of the cloud server 3, the multi-screen interactive system is endowed with the ability to "survive and protect itself" in unattended scenarios. The cloud can intelligently switch the system's power consumption strategy based on the current power threshold—for example, when the power is low, it can proactively reduce the bitrate of the data stream (reducing screen brightness and rendering power consumption), or reduce unnecessary dynamic content pushes on the interactive screen 15. This dynamic power management mechanism effectively avoids sudden system crashes due to battery depletion, greatly extending the battery life and continuous service capability of mobile or multi-screen interactive devices without external power supply.

[0052] In some embodiments of this specification, the cloud server 3 determines the data stream that needs to be sent to the corresponding interactive screen 15 through the data transmission module 14 for each data packet based on the shooting data in each newly received data packet, the interactive screen identity marker, the transmission bandwidth of the data transmission module 14, and the content currently being presented by all interactive screens 15.

[0053] Understandably, by using the transmission bandwidth of the data transmission module 14 as a constraint on content delivery, the system achieves adaptive resistance to complex network environments. When multiple screens are densely deployed and simultaneously experiencing high concurrency interactions, localized network congestion or bandwidth fluctuations are highly likely to occur. When the cloud detects limited transmission bandwidth, it can dynamically adjust its delivery strategy. For example, it can prioritize ensuring high-definition data streams for the core interactive screen 15, while downgrading the data streams for edge interactive screens 15 to low bitrate or static images. It can also reduce unnecessary dynamic content pushes to the interactive screens 15. This mechanism effectively avoids data packet loss, screen stuttering, or delayed response to interactive commands due to insufficient bandwidth.

[0054] In some embodiments of this specification, the cloud server 3, based on the captured data, interactive screen identity marker, content delivery request information, and the content currently being presented by all interactive screens 15 in each newly received data packet, determines the data stream that needs to be forwarded by the data transmission module for each data packet corresponding to the interactive screen 15, and sends it to the data transmission module.

[0055] It should be noted that the content delivery request information can be, but is not limited to, advertising request information from merchants, such as brand information to be promoted, target audience characteristics information, promotional activity information, etc.

[0056] In some embodiments of this specification, the data transmission module 14 encrypts the newly acquired data packet and uploads it to the cloud server 3.

[0057] Understandably, encrypting the uploaded data packets establishes basic link security for the multi-screen interaction system. Since multi-screen interaction devices are typically deployed in public environments such as shopping malls and exhibition halls, the facial and behavioral data collected by the camera module constitutes highly sensitive privacy information (Note: It should be noted that the camera module described in this specification requires the consent of the user 4 on the interactive screen 15 before taking any photos or videos). By converting the raw data into encrypted text on the device side before transmitting it over the network, it is possible to effectively prevent malicious interception and eavesdropping by third parties during public network transmission, avoiding the risk of user privacy leakage and ensuring that the entire cloud-based collaborative interaction process meets basic data compliance and secure transmission requirements.

[0058] In some embodiments of this specification, the data transmission module 14 encrypts the captured data in the newly acquired data packet using an encryption key corresponding to the interactive screen identity tag in the data packet, and then uploads it to the cloud server 3.

[0059] Cloud server 3 decrypts the encrypted captured data in each data packet based on the decryption key corresponding to the interactive screen identity tag in each of the latest received data packets.

[0060] Understandably, by introducing a mechanism that maps interactive screen identities to encryption keys one-to-one, "physical-level" data isolation is achieved for dense multi-screen scenarios. Even if the encryption key of a specific interactive screen 15 is compromised, the attacker can only decrypt the captured data corresponding to that single screen and cannot laterally crack the ciphertext of other interactive screens 15. This "one screen, one key" design provides higher security for complex interactive scenarios with multiple concurrent users.

[0061] In some embodiments of this specification, the main body of the device includes a base 11 and a transparent surrounding plate 12 disposed above the base 11 and surrounding the outer edge of the base 11 to form an accommodating space above the base 11. A plurality of interactive screens 15 are evenly arranged around the outer wall of the transparent surrounding plate 15.

[0062] Understandably, since the space formed by the transparent surrounding panel 12 is translucent, the mutual influence of the light colors emitted by each interactive screen 15 will be higher when the interactive user 4 interacts. Because this transparent environment makes the light color conflict and interference between adjacent interactive users 4 more serious, it is particularly necessary to coordinate and distribute the data stream through the cloud server 3.

[0063] It should be noted that prizes (such as blind balls) can be placed in the containment space formed by the transparent surrounding plate 12. After the interactive user 4 completes the interaction through the interactive screen 15, he / she can obtain the corresponding prize placed in the containment space.

[0064] Figure 2 This document illustrates a flowchart of a cloud-based collaborative multi-screen interaction method according to some embodiments of the present disclosure. The various embodiments in this specification are described in a progressive manner, with reference allowed for interchangeable parts. Each embodiment focuses on its differences from other embodiments. In particular, the multi-screen interaction method embodiments are largely similar to the multi-screen interaction system embodiments, and therefore the description is relatively simple; relevant details can be found in the descriptions of the multi-screen interaction system embodiments.

[0065] like Figure 2 As shown, a cloud-based collaborative multi-screen interaction method may include at least:

[0066] When there is an interactive user 4 in front of the interactive screen 15 to which the camera module belongs, the camera module takes intermittent pictures of the interactive user 4 and intermittently packages the latest captured data and the interactive screen identity mark of the interactive screen 15 to which the camera module belongs into a data packet and transmits it to the data transmission module 14. The interactive screen identity mark can reflect the position of the interactive screen 15 on the main body of the device.

[0067] The data transmission module 14 uploads the latest acquired data packet to the cloud server 3;

[0068] Based on the captured data, interactive screen identification mark, and the content currently being displayed on all interactive screens 15 in each newly received data packet, the cloud server 3 determines the data stream that needs to be forwarded by the data transmission module 14 for each data packet corresponding to the interactive screen 15, and sends it to the data transmission module 14.

[0069] The data transmission module 14 continuously forwards the data stream sent by the cloud server 3 to the corresponding interactive screen 15 to realize the content rendering at the interactive screen 15.

[0070] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this specification are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in or transmitted through a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., Digital Versatile Discs (DVDs)), or semiconductor media (e.g., Solid State Disks (SSDs)).

[0071] Figure 3 A block diagram of an electronic device 300 that can implement various embodiments of the present disclosure is shown. For example... Figure 3 As shown, the electronic device 300 includes a processor 310, a disk drive 320, an input / output interface 330, a network interface 340, and a memory 350. The processor 310, disk drive 320, input / output interface 330, network interface 340, and memory 350 can communicate with each other via a communication bus 360.

[0072] The processor 310 can be implemented using a general-purpose CPU, microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits to execute relevant programs in order to implement the technical solution provided in this application.

[0073] The memory 350 can be implemented in the form of ROM (Read Only Memory), RAM (Read Access Memory), static memory, dynamic storage devices, etc. The memory 350 can store the operating system 351 used to control the operation of the electronic device 300, and the basic input / output system (BIOS) 352 used to control the low-level operations of the electronic device 300. Additionally, it can store a web browser 353, a data storage management system 354, etc. In summary, when the technical solution provided in this application is implemented through software or firmware, the relevant program code is stored in the memory 350 and is called and executed by the processor 310.

[0074] Input / output interface 330 is used to connect input / output modules to realize information input and output. Input / output modules can be configured as components in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Input devices may include keyboards, mice, touch screens, microphones, various sensors, etc., and output devices may include displays, speakers, vibrators, indicator lights, etc.

[0075] Network interface 340 is used to connect a communication module (not shown in the figure) to enable communication and interaction between the device and other devices. The communication module can communicate via wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0076] Bus 360 includes a pathway for transmitting information between various components of the device, such as processor 310, disk drive 320, input / input interface 330, network interface 340, and memory 350.

[0077] It should be noted that although the above-described device only shows the processor 310, disk drive 320, input / output interface 330, network interface 340, memory 350, bus 360, etc., in specific implementations, the device may also include other components necessary for normal operation. Furthermore, those skilled in the art will understand that the above-described device may only include the components necessary for implementing the method of this application, and does not necessarily include all the components shown in the figures.

[0078] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0079] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. Furthermore, although operations are depicted in a specific order, this should be understood as requiring that such operations be performed in the specific order shown or in sequential order, or requiring that all illustrated operations be performed to achieve the desired result. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the foregoing discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single implementation. Conversely, various features described in the context of a single implementation may also be implemented individually or in any suitable sub-combination in multiple implementations.

[0080] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A cloud-based collaborative multi-screen interactive system, characterized in that, The device includes a multi-screen interactive device and a cloud server. The multi-screen interactive device includes a main body, multiple interactive screens evenly arranged around the outer wall of the main body, a data transmission module connected to the multiple interactive screens, and a power supply module connected to the data transmission module and the multiple interactive screens. Each interactive screen is equipped with a camera module. The cloud server is connected to the data transmission module; The camera module intermittently captures images of users in front of its interactive screen, and intermittently packages the latest captured data and the interactive screen's identification tag into a data packet and transmits it to the data transmission module. The interactive screen identification tag can indicate the position of the interactive screen on the main body of the device. The data transmission module uploads the latest acquired data packets to the cloud server; The cloud server, based on the captured data, interactive screen identification tags, and the content currently being displayed on all interactive screens in each newly received data packet, determines the data stream that needs to be forwarded through the data transmission module for each data packet corresponding to the interactive screen, and sends it to the data transmission module. The data transmission module also continuously forwards the data streams sent from the cloud server to the corresponding interactive screen to enable content rendering on the interactive screen.

2. The multi-screen interactive system based on cloud collaboration according to claim 1, characterized in that, The cloud server, based on the captured data, interactive screen identification tags, remaining power of the power supply module, and the content currently displayed on all interactive screens in each newly received data packet, determines the data stream that needs to be sent to the corresponding interactive screen through the data transmission module for each data packet.

3. The multi-screen interactive system based on cloud collaboration according to claim 1, characterized in that, The cloud server, based on the captured data, interactive screen identification tags, data transmission bandwidth of the data transmission module, and the content currently being displayed on all interactive screens in each newly received data packet, determines the data stream that needs to be sent to the corresponding interactive screen through the data transmission module for each data packet.

4. A cloud-based collaborative multi-screen interaction system according to claim 1, characterized in that, The cloud server, based on the captured data, interactive screen identification tags, content delivery requirements, and the content currently being displayed on all interactive screens in each newly received data packet, determines the data stream that needs to be forwarded through the data transmission module for each data packet corresponding to the interactive screen, and then sends it to the data transmission module.

5. A cloud-based collaborative multi-screen interaction system according to claim 1, characterized in that, The data transmission module encrypts the latest acquired data packets and uploads them to the cloud server.

6. A cloud-based collaborative multi-screen interaction system according to claim 5, characterized in that, The data transmission module encrypts the captured data in the newly acquired data packet using an encryption key corresponding to the interactive screen identity tag in the data packet, and then uploads it to the cloud server. The cloud server decrypts the encrypted captured data in each data packet based on the decryption key corresponding to the interactive screen identity tag in each newly received data packet.

7. A cloud-based collaborative multi-screen interaction system according to claim 1, characterized in that, The main body of the device includes a base and a transparent surrounding plate that is set above the base and surrounds the outer edge of the base to form an accommodating space above the base. Multiple interactive screens are evenly arranged around the outer wall of the transparent surrounding plate.

8. A cloud-based collaborative multi-screen interaction method, based on the cloud-based collaborative multi-screen interaction device according to any one of claims 1 to 7, characterized in that, include: When there is an interactive user in front of the interactive screen to which the camera module belongs, the camera module will intermittently take pictures of the interactive user and intermittently package the latest captured data and the interactive screen identification mark of the interactive screen to which the camera module belongs into a data packet and transmit it to the data transmission module. The interactive screen identification mark can reflect the position of the interactive screen on the main body of the device. The data transmission module uploads the latest acquired data packets to the cloud server; Based on the captured data, interactive screen identification tags, and the content currently displayed on all interactive screens in each newly received data packet, the cloud server determines the data stream that needs to be forwarded by the data transmission module for each data packet corresponding to the interactive screen, and sends it to the data transmission module. The data transmission module continuously forwards the data stream sent by the cloud server to the corresponding interactive screen to realize the content rendering at the interactive screen.

9. An electronic device, characterized in that, include: One or more processors, and A memory associated with the one or more processors, the memory being used to store program information, which, when read and executed by the one or more processors, performs the steps of the method of claim 8.

10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method according to claim 8.

Images