Distributed interactive control method and system for multi-projector fusion device

Abstract

The application relates to a distributed interactive control method and system of a multi-projector fusion device. The method receives radar data sent by a radar; obtains coordinate data according to the radar data, and judges whether the coordinate data needs to be processed; if the coordinate data needs to be processed, calculates update data according to generated interactive behaviors, synchronizes the update data among devices, determines display data required by a corresponding to-be-displayed area according to the update data, updates the to-be-displayed area according to the display data, fuses and corrects update output content, receives synchronization information if the coordinate data does not need to be processed, determines display data required by the to-be-displayed area according to the synchronization information, updates the to-be-displayed area according to the display data, fuses and corrects update output content, and the method has the advantages of reducing hardware cost, improving expansibility, and fully utilizing hardware resources of sub-devices.

Description

Technical Field

[0001] This invention relates to the field of Internet technology applications, and in particular to a distributed interactive control method and system for a multi-projector fusion device. Background Technology

[0002] Existing multi-projector projection fusion interactive games consist of a radar, a game console, and multiple sub-devices. The radar is used to monitor the input of the game interaction area; the game console is responsible for receiving radar data, running the game logic, and cutting the output content; and the multiple sub-devices are used to display the content cut by the game console in the projection area, thus completing the game output.

[0003] In existing technologies, the main processing logic is concentrated on the game center server. The overall architecture is similar to a star topology. After receiving the touch information sent by the radar, the game center server at the center performs logical calculations on the game based on the radar coordinates. After determining the content that each sub-device needs to display, it updates the content to the corresponding device.

[0004] However, in existing technologies, using a dedicated game center server to handle game logic processing increases the system deployment cost. Furthermore, the cutting, transformation, and merging of output content are handled by the game center server, requiring specialized hardware. Limited by the processing power of the game center server, the number of devices that can be merged for display is capped, resulting in a limited display area in practical applications. Since the main function of the sub-devices is display and they do not participate in game logic processing, their hardware capabilities cannot be fully utilized.

[0005] Currently, no effective solutions have been proposed for the problems of high hardware costs, limited scalability, and underutilization of sub-device hardware resources caused by the centralized processing architecture in related technologies. Summary of the Invention

[0006] The purpose of this invention is to address the shortcomings of existing technologies by providing a distributed interactive control method and system for multi-projector fusion devices, thereby solving the technical problems of high hardware costs, limited scalability, and underutilization of sub-device hardware resources caused by the use of centralized processing architecture in related technologies.

[0007] To achieve the above objectives, the technical solution adopted by the present invention is as follows:

[0008] This invention provides a distributed interactive control system for a multi-projector fusion device, comprising: a radar and at least two other devices. The radar monitors for touch events; if a touch event occurs, it sends radar data corresponding to the touch event to the at least two devices. The at least two devices receive the radar data, acquire coordinate data based on the radar data, determine whether the coordinate data needs processing, and if processing is required, calculate update data based on the generated interactive behavior, synchronize the update data between the devices, determine the required display data for the corresponding display area based on the update data, update the display area based on the display data, and perform fusion correction and update of the output content. If the coordinate data does not require processing, the devices receive synchronization information, determine the required display data for the display area based on the synchronization information, update the display area based on the display data, and perform fusion correction and update of the output content.

[0009] Optionally, at least two devices are also used to establish a broadcast data channel between the devices for data synchronization between them.

[0010] Optionally, the radar data includes point cloud data of the area to be displayed, wherein the point cloud data includes: the size, coordinates, direction of movement, and intensity of the touch point.

[0011] Furthermore, optionally, at least two devices are also used to convert radar data into standard TUIO touch protocol data to obtain normalized coordinate data.

[0012] This invention provides a distributed interactive control method for a multi-projector projection fusion device, comprising: receiving radar data transmitted by a radar; obtaining coordinate data based on the radar data and determining whether the coordinate data needs to be processed; if the coordinate data needs to be processed, calculating update data based on the generated interactive behavior, synchronizing the update data among the devices, determining the display data required for the corresponding display area based on the update data; updating the display area based on the display data, and fusion correcting and updating the output content; if the coordinate data does not need to be processed, receiving synchronization information, determining the display data required for the display area based on the synchronization information, updating the display area based on the display data, and fusion correcting and updating the output content.

[0013] Optionally, obtaining coordinate data based on radar data includes converting radar data into standard TUIO touch protocol data to obtain normalized coordinate data.

[0014] Optionally, after determining whether the coordinate data needs to be processed, the method further includes: establishing a broadcast data channel between devices to synchronize data between devices.

[0015] This invention employs the above technical solution, which involves receiving radar data transmitted by a radar; obtaining coordinate data based on the radar data; determining whether the coordinate data needs processing; if the coordinate data needs processing, calculating update data based on the generated interactive behavior; synchronizing the update data between devices; determining the display data required for the corresponding display area based on the update data; updating the display area based on the display data; and fusing and correcting the updated output content. If the coordinate data does not need processing, receiving synchronization information; determining the display data required for the display area based on the synchronization information; updating the display area based on the display data; and fusing and correcting the updated output content. Compared with existing technologies, this invention has the following technical advantages: reduced hardware costs, improved scalability, and full utilization of sub-device hardware resources. Attached Figure Description

[0016] Figure 1 This is a schematic diagram of a distributed interactive control system for a multi-projector fusion device according to Embodiment 1 of the present invention;

[0017] Figure 2 This is a schematic diagram of data interaction in a distributed interactive control system of a multi-machine projection fusion device according to Embodiment 1 of the present invention;

[0018] Figure 3 This is a schematic diagram of the interaction between devices and radar in a distributed interactive control system of a multi-machine projection fusion device according to Embodiment 1 of the present invention;

[0019] Figure 4 This is a flowchart illustrating a distributed interactive control method for a multi-projector fusion device according to Embodiment 2 of the present invention;

[0020] Figure 5 This is a schematic diagram of the data processing flow of a sub-device in a distributed interactive control method for a multi-machine projection fusion device according to Embodiment 2 of the present invention. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of this application clearer, the application is described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0022] Obviously, the accompanying drawings described below are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar scenarios based on these drawings without any inventive effort. Furthermore, it is understood that although the efforts made in this development process may be complex and lengthy, for those skilled in the art related to the content disclosed in this application, any changes to design, manufacturing, or production based on the technical content disclosed in this application are merely conventional technical means and should not be construed as insufficient disclosure of the content of this application.

[0023] In this application, the reference to "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment that is mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0024] Unless otherwise defined, the technical or scientific terms used in this application shall have the ordinary meaning understood by one of ordinary skill in the art to which this application pertains. The terms “a,” “an,” “an,” “the,” and similar words used in this application do not indicate quantity limitation and may indicate singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that includes a series of steps or units (elements) is not limited to the listed steps or units, but may also include steps or units not listed, or may include other steps or units inherent to these processes, methods, products, or devices. The terms “connected,” “linked,” “coupled,” and similar words used in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The terms “multiple” / “several” used in this application refer to two or more. “And / or” describes the relationship between related objects, indicating that three relationships may exist; for example, “A and / or B” can indicate: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following objects are in an "or" relationship. The terms "first," "second," and "third" used in this application are merely to distinguish similar objects and do not represent a specific ordering of the objects.

[0025] Example 1

[0026] An illustrative embodiment of the present invention, such as Figure 1 As shown, Figure 1This is a schematic diagram of a distributed interactive control system for a multi-projector projection fusion device according to Embodiment 1 of the present invention. The distributed interactive control system for a multi-projector projection fusion device provided in this application includes:

[0027] The system includes a radar 12 and at least two devices 14. The radar 12 monitors for touch events. If a touch event occurs, the radar 12 data corresponding to the touch event is sent to the at least two devices 14. The at least two devices 14 receive the radar 12 data, obtain coordinate data based on the radar 12 data, determine whether the coordinate data needs processing, and if the coordinate data needs processing, calculate update data based on the generated interaction behavior, synchronize the update data between the devices, determine the display data required for the corresponding display area based on the update data, update the display area based on the display data, and merge and correct the updated output content. If the coordinate data does not need processing, the system receives synchronization information, determines the display data required for the display area based on the synchronization information, updates the display area based on the display data, and merges and corrects the updated output content.

[0028] Optionally, at least two devices 14 are also used to establish a broadcast data channel between the devices and to synchronize data between the devices via the broadcast data channel.

[0029] Optionally, the radar 12 data includes point cloud data of the area to be displayed, wherein the point cloud data includes: the size, coordinates, direction of movement, and intensity of the touch point.

[0030] Furthermore, optionally, at least two devices 14 are also used to convert radar 12 data into standard TUIO touch protocol data to obtain normalized coordinate data.

[0031] Specifically, such as Figure 2 As shown, Figure 2 This is a schematic diagram of data interaction in a distributed interactive control system of a multi-projector fusion device according to Embodiment 1 of the present invention. The distributed interactive control system of the multi-projector fusion device provided in this application embodiment can be applied to game interaction scenarios. Radar 12 obtains radar data by monitoring touch events. Radar 12 sends the obtained radar data to device 1. Device 1, device 2... device n synchronize radar data to device 2... device n through data channels. Each device outputs the game display result to be displayed in the corresponding projection area of ​​each device based on the radar data and the game execution logic.

[0032] Depend on Figure 2As can be seen, the distributed interactive control system of the multi-machine projection fusion device provided in this application embodiment eliminates the game center server, and the reception of radar events is handled by one of the sub-devices; touch coordinate events are synchronized among all sub-devices, and after receiving the coordinate event, the sub-device decides how to process the game logic and update the display content based on the display area information currently handled by the device; a data channel is introduced between the various devices, which can synchronize not only coordinate data, but also changes in element information of game content, such as actions, directions, game backgrounds, game scores, etc.

[0033] In a preferred example, such as Figure 3 As shown, Figure 3 This is a schematic diagram of the interaction between devices and radar in a distributed interactive control system of a multi-projection fusion device according to Embodiment 1 of the present invention. Radar 12 performs radar monitoring and sends radar data to device 1. Device 1 synchronizes the radar data to device 2 and device n. Based on the generated interactive behavior, game logic calculates updated data and synchronizes the updated data between devices through a data channel (i.e., the broadcast data channel in this embodiment). Based on the updated data, the display data required for the corresponding display area is determined. The display area is updated based on the display data, and the fusion correction update output content is performed.

[0034] This invention employs the above technical solution, which involves receiving radar data transmitted by a radar; obtaining coordinate data based on the radar data; determining whether the coordinate data needs processing; if the coordinate data needs processing, calculating update data based on the generated interactive behavior; synchronizing the update data between devices; determining the display data required for the corresponding display area based on the update data; updating the display area based on the display data; and fusing and correcting the updated output content. If the coordinate data does not need processing, receiving synchronization information; determining the display data required for the display area based on the synchronization information; updating the display area based on the display data; and fusing and correcting the updated output content. Compared with existing technologies, this invention has the following technical advantages: reduced hardware costs, improved scalability, and full utilization of sub-device hardware resources.

[0035] Example 2

[0036] An illustrative embodiment of the present invention, such as Figure 4 As shown, Figure 4 This is a flowchart illustrating a distributed interactive control method for a multi-projector fusion device according to Embodiment 2 of the present invention. Applied to the distributed interactive control system of the multi-projector fusion device in Embodiment 1, on the device side, the distributed interactive control method for a multi-projector fusion device provided in this application includes:

[0037] Step S400: Receive radar data transmitted by the radar;

[0038] Step S402: Obtain coordinate data based on radar data and determine whether the coordinate data needs to be processed;

[0039] Optionally, obtaining coordinate data based on radar data in step S402 includes converting radar data into standard TUIO touch protocol data to obtain normalized coordinate data.

[0040] Step S404: If the coordinate data needs to be processed, calculate the updated data based on the generated interactive behavior, synchronize the updated data between devices, determine the display data required for the corresponding display area based on the updated data, update the display area based on the display data, and merge and correct the updated output content.

[0041] Optionally, after determining whether the coordinate data needs to be processed, the distributed interactive control method for a multi-machine projection fusion device provided in this application embodiment further includes: establishing a broadcast data channel between the devices and synchronizing data between the devices through the broadcast data channel.

[0042] Step S406: If the coordinate data does not need to be processed, receive the synchronization information, determine the display data required for the area to be displayed based on the synchronization information, update the area to be displayed based on the display data, and merge and correct the updated output content.

[0043] Specifically, such as Figure 5 As shown, Figure 5 This is a schematic diagram of the data processing flow of a sub-device in a distributed interactive control method for a multi-machine projection fusion device according to Embodiment 2 of the present invention;

[0044] 1. The radar monitoring sub-devices (i.e., device 1, device 2... device n in embodiment 1) receive raw point cloud data from the radar, including the size, coordinates, movement direction, and touch intensity of the touch point. This data is then converted into standard TUIO touch protocol data (two-dimensional normalized coordinates) for use by the game.

[0045] 2. The radar monitoring sub-device distributes the converted touch coordinate data within the system. Taking a 2x2 device as an example, when the radar detects a touch event in the upper right area, the touch event only needs to be sent to devices numbered 1-2 for processing.

[0046] 3. After the game console is removed, the game's logic processing is handled collaboratively by all sub-devices, requiring continuous data synchronization between them. From a game implementation perspective, its basic elements mainly include: background, elements, and interactive behaviors. Taking the simplest beach walking game as an example, the beach is the game's background and remains largely unchanged during gameplay; the footprints that appear on the beach after being touched are the game's basic element; crabs on the beach are a different type of game element. When a footprint is created by touching it, the crabs around it will run away; this is defined as the game's interactive behavior. During gameplay, the following data needs to be processed and synchronized throughout the system:

[0047] (1) In which area does the touch occur, and which sub-device is responsible for handling the interaction logic?

[0048] (2) How game elements change (e.g., change color) and move (e.g., smoothly move from the touch point on the current device to an area on another device) after a touch event occurs.

[0049] (3) How to correctly display changes in game elements on sub-devices (such as moving across devices from left to right).

[0050] (4) After all the displayed content of the sub-device has been determined, the content currently handled by the sub-device is then fused and corrected.

[0051] 4. In practice, data synchronization between different devices can be achieved by establishing a broadcast data channel. The communication content includes what was mentioned above:

[0052] (1) Message timestamp

[0053] (2) Touch normalized coordinate information

[0054] (3) Game element coordinates and status information

[0055] (4) Game Interaction Information

[0056] The above information is broadcast to all sub-devices via the system's data channel. Upon receiving the information, each sub-device selects its corresponding content to process and executes the appropriate logic. After processing, the result is then synchronized to other devices via the data channel.

[0057] This application provides a distributed interactive control method for a multi-projection fusion device that eliminates the need for a game center server. Instead, it achieves game data sharing by establishing data channels between devices. Furthermore, different sub-devices jointly process game data, and the data generated by each sub-device is synchronized across all devices as needed. After the game logic processing is complete, each sub-device is only responsible for updating its assigned area.

[0058] This application provides a distributed interactive control method for a multi-projection fusion device. By removing the game center server, it saves on system deployment hardware costs; reduces dependence on the central node, increasing the upper limit of the number of fusion devices; and adopts a distributed architecture, ensuring the integrity and synchronized display of game images by continuously synchronizing game data among sub-devices. Furthermore, under this architecture, the system can increase the number of devices to expand the game display area according to actual needs, improving system scalability.

[0059] The distributed interactive control method for a multi-machine projection fusion device provided in this application applies to a system in which all devices are identical (the radar data receiving device is selected and determined, and each device can perform this function; the software and hardware of the sub-device receiving radar data are the same as those of other devices). When one of the sub-devices fails, a backup device can be quickly used to restore the system, which reduces system downtime and increases fault tolerance.

[0060] This invention employs the above technical solution, which involves receiving radar data transmitted by a radar; obtaining coordinate data based on the radar data; determining whether the coordinate data needs processing; if the coordinate data needs processing, calculating update data based on the generated interactive behavior; synchronizing the update data between devices; determining the display data required for the corresponding display area based on the update data; updating the display area based on the display data; and fusing and correcting the updated output content. If the coordinate data does not need processing, receiving synchronization information; determining the display data required for the display area based on the synchronization information; updating the display area based on the display data; and fusing and correcting the updated output content. Compared with existing technologies, this invention has the following technical advantages: reduced hardware costs, improved scalability, and full utilization of sub-device hardware resources.

[0061] The above description is merely a preferred embodiment of the present invention and does not limit the implementation and protection scope of the present invention. Those skilled in the art should realize that any equivalent substitutions and obvious changes made based on the description and illustrations of the present invention should be included within the protection scope of the present invention.

Claims

1. A distributed interactive control system for a multi-projector projection fusion device, characterized in that, Applied to game interaction scenarios, including: Radar and at least two other devices, of which, The radar is used to monitor whether a touch event exists. If a touch event exists, the radar data corresponding to the touch event is sent to the at least two devices. The at least two devices are configured to receive the radar data, acquire coordinate data based on the radar data, determine whether the coordinate data needs processing, and if the coordinate data needs processing, calculate update data based on the generated interaction behavior, synchronize the update data between the devices, determine the display data required for the corresponding display area based on the update data, update the display area based on the display data, and merge and correct the updated output content; if the coordinate data does not need processing, receive synchronization information, determine the display data required for the display area based on the synchronization information, update the display area based on the display data, and merge and correct the updated output content. The at least two devices are identical, and the radar data receiving device is selected and determined. Each device is capable of performing radar data receiving functions, and the software and hardware of the sub-device receiving the radar data are the same as those of other devices. The at least two devices are also used to establish a broadcast data channel between the devices and to perform data synchronization between the devices through the broadcast data channel; The distributed interactive control system of the multi-projector fusion device eliminates the game center server; radar event reception is handled by one of the sub-devices. Touch coordinate events are synchronized across all sub-devices. Upon receiving the coordinate event, each sub-device determines its own game logic and updates the displayed content based on the display area it is responsible for. A data channel is introduced between the devices to synchronize not only coordinate data but also changes in game content element information, including actions, directions, game background, and game score. The radar listening sub-device distributes the converted touch coordinate data within the system. When at least two devices are 2x2 devices, when the radar detects a touch event in the upper right area, the touch event only needs to be sent to devices numbered 1 to 2 for processing. After all the displayed content has been determined, the sub-device performs fusion correction processing on the content currently being handled by the device.

2. The distributed interactive control system for the multi-projector fusion device according to claim 1, characterized in that, The radar data includes point cloud data of the area to be displayed, wherein the point cloud data includes: the size, coordinates, direction of movement, and intensity of the touch point.

3. The distributed interactive control system for the multi-projector fusion device according to claim 2, characterized in that, The at least two devices are also used to convert the radar data into standard TUIO touch protocol data to obtain normalized coordinate data.

4. A distributed interactive control method for a multi-projector fusion device, characterized in that, A distributed interactive control system applied to the multi-projector fusion device according to any one of claims 1 to 3, comprising: Receive radar data transmitted by the radar; Based on the radar data, obtain coordinate data and determine whether the coordinate data needs to be processed; If the coordinate data needs to be processed, update data is calculated based on the generated interactive behavior, the update data is synchronized between devices, and the display data required for the corresponding display area is determined based on the update data; the display area is updated based on the display data, and the updated output content is merged and corrected. If the coordinate data does not need to be processed, then receive synchronization information, determine the display data required for the area to be displayed based on the synchronization information, update the area to be displayed based on the display data, and merge, correct, and update the output content.

5. The distributed interactive control method for a multi-projector fusion device according to claim 4, characterized in that, The process of obtaining coordinate data based on the radar data includes: The radar data is converted into standard TUIO touch protocol data to obtain the normalized coordinate data.

6. The distributed interactive control method for a multi-projector fusion device according to claim 4, characterized in that, After determining whether the coordinate data needs to be processed, the method further includes: A broadcast data channel is established between the devices, and data synchronization is performed between the devices through the broadcast data channel.

Images