System and method for realizing contextual image show

Abstract

The invention relates to an implementation system and method for contextual image show, and belongs to the technical field of building projection, and the system comprises an acquisition module which is used for obtaining scene data of an image show scene; the control module is connected with the acquisition module and is used for generating an image show program list based on the scene data and generating a control instruction based on the image show program list; and the presentation module is connected with the control module and is used for receiving the control instruction and carrying out picture projection on the landscape surface based on the control instruction. According to the invention, through modular system setting, the operation and maintenance cost of the contextual image show presentation is reduced while the presentation effect of the contextual image show is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of architectural projection, and in particular to a system and method for realizing an ambient image show. Background Art

[0002] Traditional light and shadow shows generally use a solution of laying out light emitting diode (LED) screens or LED strips on the exterior surface of the building and a solution of long-distance large-format projection using multiple engineering projectors.

[0003] The LED system display solution has low reliability. Random power failures at local points in the system can easily form black spots, and the maintenance cost is high and difficult. At the same time, the LED system has limited light and shadow presentation forms, and the system needs to be updated frequently.

[0004] The long-distance and large-format projection solution of engineering projectors requires manual collection of building surface materials, on-site lighting conditions, and manual debugging. The entire process is not automated and cannot meet some needs for fast light and shadow scene construction. The creation of light and shadow show materials through photos taken by cameras does not conform to the actual situation well and requires complex debugging. The entire light and shadow show production process requires a lot of manpower and is costly.

[0005] Therefore, how to reduce the operation and maintenance costs of the light and shadow show while ensuring the presentation effect has become a technical problem that needs to be solved urgently. Summary of the invention

[0006] In view of this, it is necessary to provide a system and method for realizing a scene-based image show to solve the problem of excessively high operating and maintenance costs of current light and shadow show presentation solutions.

[0007] In order to solve the above problems, the present invention provides a system for realizing a scene-based image show, comprising: The acquisition module is used to obtain scene data of the video show; A control module, connected to the acquisition module, for generating a video show program table based on the scene data, and generating a control instruction based on the video show program table; The presentation module is connected to the control module and is used to receive the control instruction and project the image on the landscape surface based on the control instruction.

[0008] In a possible implementation, the presentation module includes: Multiple AGVs, multi-DOF robotic arms, and projection modules; The multi-degree-of-freedom mechanical arm is arranged on the AGV, and the projection module is arranged at the end of the multi-degree-of-freedom mechanical arm; The control instructions include a first control instruction, a second control instruction and a third control instruction; The first control instruction is used to control the AGV to move on the ground according to a preset route; The second control instruction is used to control the multi-degree-of-freedom robotic arm to move along a preset trajectory in the horizontal direction and the vertical direction; The third control instruction is used to control the projection module to play a preset projection picture.

[0009] In a possible implementation, the presentation module further includes: A navigation module, used to provide location guidance for the AGV based on the preset route; A posture perception module, used to perceive the posture of the AGV and the multi-degree-of-freedom robotic arm, and the projection angle of the projection module, and send them to the control module; An anti-collision module, used to assist the AGV in avoiding obstacles; A visual module for identifying the baseline of the building to be projected; A thermal control module, used to maintain the normal operating temperature of the multi-degree-of-freedom robotic arm and the projection module; The control module is also used to adjust the control instructions based on the posture of the AGV and the multi-degree-of-freedom robotic arm, and the projection angle of the projection module.

[0010] In a possible implementation, the system further includes: a reflection module connected to the control module; The acquisition module is also used to obtain environmental change information at the image show site; The control module is also used to generate an adjustment instruction based on the environmental change information; The reflection module is used to receive the adjustment instruction and adjust the projection brightness and projection color of the landscape surface based on the adjustment instruction.

[0011] The present invention also provides a method for implementing a context-sensitive image show, which is applied to a control module in the context-sensitive image show implementation system as described above, and includes: Controlling the acquisition module to acquire scene data of the video show, and generating a video show program list based on the scene data; A control instruction is generated based on the video show program list, and based on the control instruction, the presentation module is controlled to perform dynamic projection on the surface of the building to be projected.

[0012] In a possible implementation manner, the scene data includes three-dimensional information of the building to be projected and spatial environment information around the building to be projected.

[0013] In a possible implementation, generating a video show schedule based on the scene data includes: Based on the three-dimensional information of the building to be projected and the spatial environment information around the building to be projected, the projection picture, dynamic light and shadow trajectory and interaction time period are determined.

[0014] In a possible implementation, the generating of the control instruction based on the video show program list includes: Based on the dynamic light and shadow trajectory and the interactive time period, the motion trajectory of the AGV and the multi-degree-of-freedom robotic arm is determined.

[0015] In a possible implementation, the method further includes: Based on the three-dimensional information of the building to be projected, construct a baseline of the building to be projected; The projection picture is segmented based on the baseline of the building to be projected.

[0016] In a possible implementation, the method further includes: Controlling the acquisition module to obtain environmental change information at the image show site; The control instructions are adjusted based on the environmental change information at the video show site.

[0017] The beneficial effects of the present invention are as follows: the system and method for realizing the context-dependent image show provided by the present invention first generate an image show program list according to the scene data of the image show site, then generate a control instruction through the image show program list, and control the presentation module to perform screen projection according to the control instruction to realize the context-dependent image show. The present invention reduces the operation and maintenance costs of the context-dependent image show presentation while ensuring the presentation effect of the context-dependent image show through a modular system setting. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A structural diagram of an embodiment of a system for implementing a scene-based image show provided by the present invention; Figure 2 A schematic diagram of a flow chart of an embodiment of a method for implementing a scene-based image show provided by the present invention; Figure 3 A schematic diagram of a flow chart of an embodiment of a context-sensitive image show presentation process provided by the present invention; Figure 4 A structural schematic diagram of another embodiment of the system for implementing the context-dependent image show provided by the present invention; Figure 5 A schematic diagram of an embodiment of a presentation scene of a context-sensitive image show provided by the present invention; Figure 6 A schematic structural diagram of an embodiment of the AGV door provided by the present invention when closed; Figure 7 A schematic structural diagram of an embodiment of a multi-degree-of-freedom robotic arm provided by the present invention; Figure 8 A schematic diagram of the structure of an embodiment of the AGV provided by the present invention when it is working; Fig. 9 A schematic diagram of an embodiment of a multi-projection fusion solution provided by the present invention; Fig.10 The present invention provides a flowchart of an embodiment of the process of video show and audience interaction. DETAILED DESCRIPTION

[0019] The preferred embodiments of the present invention are described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of this application and are used together with the embodiments of the present invention to illustrate the principles of the present invention, but are not used to limit the scope of the present invention.

[0020] In the description of the present invention, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0021] In the description of the present invention, reference to an "embodiment" means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the described embodiments may be combined with other embodiments.

[0022] Traditional light and shadow shows generally use LED screens or LED strips on the exterior surface of buildings and multiple engineering projectors for long-distance large-format projection.

[0023] The LED system display solution has low reliability. Random power failures at local points in the system can easily form black spots, and the maintenance cost is high and difficult. At the same time, the LED system has limited light and shadow presentation forms, and the system needs to be updated frequently.

[0024] The long-distance and large-format projection solution of engineering projectors requires manual collection of building surface materials, on-site lighting conditions, and manual debugging. The entire process is not automated and cannot meet some needs for fast light and shadow scene construction. The creation of light and shadow show materials through photos taken by cameras does not conform to the actual situation well and requires complex debugging. The entire light and shadow show production process requires a lot of manpower and is costly.

[0025] In order to solve the above problems, the present invention provides a system for realizing an ambient image show.

[0026] The specific embodiments are described in detail below: The embodiment of the present invention provides a system for realizing a scene-based image show, combining Figure 1 Come and see, Figure 1 The structure diagram of an embodiment of a system for implementing a context-sensitive image show provided by the present invention is as follows. The system 100 for implementing a context-sensitive image show includes: The acquisition module 101 is used to acquire scene data of the video show; The control module 102 is connected to the acquisition module 101 and is used to generate a video show program table based on the scene data and generate a control instruction based on the video show program table; The presentation module 103 is connected to the control module 102 and is used to receive the control instruction and project a picture on the landscape surface based on the control instruction.

[0027] During implementation, the control module can first control the acquisition module to obtain the scene data of the image show site, and then control the construction module to generate an image show program list based on the scene data of the image show site. Then the control module can generate control instructions based on the image show program list, and control the presentation module to project the image on the landscape surface based on the control instructions.

[0028] It should be noted that the implementation system of the ambient image show can be applied to the light and shadow show presentation scene of the city at night, and can also be applied to the advertisement presentation scene of the city during the day, and the present invention does not make specific limitations on this.

[0029] Compared with the prior art, the system for realizing the adaptive image show provided by the present embodiment first generates an image show program table according to the scene data of the image show site, and then generates a control instruction through the image show program table, and controls the presentation module to perform screen projection according to the control instruction to realize the adaptive image show. The present invention reduces the operation and maintenance costs of the adaptive image show presentation while ensuring the presentation effect of the adaptive image show through a modular system setting.

[0030] Exemplarily, the presentation module includes: Multiple AGVs, multi-DOF robotic arms, and projection modules; The multi-degree-of-freedom mechanical arm is arranged on the AGV, and the projection module is arranged at the end of the multi-degree-of-freedom mechanical arm; The control instructions include a first control instruction, a second control instruction and a third control instruction; The first control instruction is used to control the AGV to move on the ground according to a preset route; The second control instruction is used to control the multi-degree-of-freedom robotic arm to move along a preset trajectory in the horizontal direction and the vertical direction; The third control instruction is used to control the projection module to play a preset projection picture.

[0031] Specifically, the presentation module may further include a plurality of automated guided vehicles (AGVs), a multi-degree-of-freedom robotic arm may be disposed on the AGV, and a projection module may be disposed at the end of the multi-degree-of-freedom robotic arm.

[0032] When performing image projection, multiple AGVs can first be transported to the work site by transport vehicles, and then the AGVs can move according to the trajectory designed in the first control instruction. At the same time, the multi-degree-of-freedom robotic arm can also adjust the projection angle of the projection module according to the trajectory designed in the second control instruction, and the projection module can realize image projection according to the projection picture preset in the third control instruction.

[0033] Exemplarily, the presentation module also includes: A navigation module, used to provide location guidance for the AGV based on the preset route; A posture perception module, used to perceive the posture of the AGV and the multi-degree-of-freedom robotic arm, and the projection angle of the projection module, and send them to the control module; An anti-collision module, used to assist the AGV in avoiding obstacles; A visual module for identifying the baseline of the building to be projected; A thermal control module, used to maintain the normal operating temperature of the multi-degree-of-freedom robotic arm and the projection module; The control module is also used to adjust the control instructions based on the posture of the AGV and the multi-degree-of-freedom robotic arm, and the projection angle of the projection module.

[0034] Specifically, the presentation module may further include a navigation module. The navigation system in the navigation module may be a global positioning system (GPS) and positioning systems of various countries, which are used to guide the position of the AGV.

[0035] The presentation module may also include a posture perception module, which senses the posture of the robotic arm and AGV, as well as the projection angle of the stage light. The auxiliary control module performs parameter correction on the projection angle based on the parameters obtained by this module.

[0036] The presentation module can also include an anti-collision module, which can be composed of laser radar, long-range radar, medium-range radar, and ultrasonic radar. By arranging these radars around the vehicle body, it can complete the measurement of surrounding obstacles and other coordinated motion equipment, comprehensively judge the surrounding road conditions, and help the AGV avoid obstacles. At the same time, the module can also set an emergency stop function, based on the operator's prejudgment of danger, control the AGV to stop urgently, and further avoid collision and stall movement.

[0037] The presentation module can also include a visual module, which can sense the building baseline to help the robotic arm drive the projection module to accurately project onto the corresponding building, identify the projection screen and screen dividing lines, and transmit the information back to the control module for geometric correction, color correction, and brightness correction to achieve multi-projection fusion.

[0038] The presentation module may also include a thermal control module to maintain the normal operating temperature of the multi-degree-of-freedom robotic arm and the projection module. The thermal control module may include active thermal control and passive thermal control. Passive thermal control is used for the exterior of the equipment, switches, connectors and peripheral wires. It uses non-volatile, non-toxic, non-polluting, non-corrosive, fast and long-lasting antifreeze additives to form an extremely thin hydrophobic antifreeze protective film on the surface of the object, keeping the surface of the object from frost and fog, and preventing frost from crystallizing and growing, thus achieving an anti-icing effect. At the same time, multi-layer insulation and low thermal conductivity materials are used to protect switches, connectors, wires, etc. Electrical equipment is designed according to temperature requirements, and low-temperature resistant grease is used at the joints.

[0039] Active thermal control is used to prevent freezing of the kinematic pair of the robot arm joint. The LED heating unit is installed in the kinematic pair of the robot arm joint. When the temperature is lower than the preset value, the LED heating unit can actively heat the temperature of the kinematic pair to meet the requirements and keep the temperature of the kinematic pair constant.

[0040] Exemplarily, the system further includes: a reflection module connected to the control module; The acquisition module is also used to obtain environmental change information at the image show site; The control module is also used to generate an adjustment instruction based on the environmental change information; The reflection module is used to receive the adjustment instruction and adjust the projection brightness and projection color of the landscape surface based on the adjustment instruction.

[0041] Specifically, when performing image projection, the control module can also control the acquisition module to obtain environmental change information of the image show scene, further generate adjustment instructions according to the environmental change information of the image show scene, and control the reflection module to adjust the projection brightness and projection color of the landscape surface according to the adjustment instructions to optimize the projection effect. The reflection module can be composed of electrochromic thin film materials, and the control module can achieve the best projection effect by controlling the projection brightness and the reflection condition of the electrochromic material.

[0042] A specific embodiment of the present invention also discloses a method for realizing a scene-based image show, which is applied to a control module in the above-mentioned scene-based image show realization system, and combined with Figure 2 Come and see, Figure 2 The flowchart of an embodiment of a method for implementing a scene-based image show provided by the present invention includes step S201 and step S202, wherein: In step S201, the acquisition module is controlled to obtain scene data of the video show, and a video show program list is generated based on the scene data; In step S202, a control instruction is generated based on the video show program list, and based on the control instruction, the presentation module is controlled to perform dynamic projection on the surface of the building to be projected.

[0043] During implementation, the control module can first control the acquisition module to obtain the scene data of the image show site, and generate an image show program list based on the scene data of the image show site, and then generate a control instruction based on the image show program list, and send the control instruction to the presentation module. The control instruction controls the presentation module to control multiple AGVs and the multi-degree-of-freedom robotic arms and projection modules they carry to perform dynamic projection on the surface of the building to be projected according to the image show program list.

[0044] The method for realizing the ambient image show provided by the present invention can be applied to the light and shadow show presentation scene of the city at night, and can also be applied to the advertisement presentation scene of the city during the day, and the present invention does not make any specific limitation to this.

[0045] Compared with the prior art, the implementation method of the scene-based image show provided in this embodiment first generates a scene show program list based on the scene data of the scene show, and then projects the screen through the scene show program list to realize the scene-based image show. The present invention reduces the operation and maintenance costs of the scene-based image show presentation while ensuring the presentation effect of the scene-based image show through modular system settings.

[0046] Exemplarily, the scene data of the image show site includes three-dimensional information of the building to be projected and spatial environment information around the building to be projected.

[0047] Specifically, the scene data of the image show site may include three-dimensional information of the building to be projected and spatial environment information around the building to be projected. Based on the scene data of the image show site, the building to be projected and the spatial environment around the building to be projected can be modeled to facilitate subsequent program schedule generation.

[0048] Exemplarily, generating a video show schedule based on the scene data includes: Based on the three-dimensional information of the building to be projected and the spatial environment information around the building to be projected, the projection picture, dynamic light and shadow trajectory and interaction time period are determined.

[0049] Specifically, when generating a video show program schedule based on the scene data of the video show site, the projection images and dynamic light and shadow trajectories presented in each time period can be designed according to the three-dimensional information of the building to be projected and the spatial environment information around the building to be projected, combined with the performance timing requirements, and the interactive time period can be designed.

[0050] Exemplarily, the generating of the control instruction based on the video show program list includes: Based on the dynamic light and shadow trajectory and the interactive time period, the motion trajectory of the AGV and the multi-degree-of-freedom robotic arm is determined.

[0051] Specifically, when generating control instructions based on the video show program schedule, the motion trajectory of the AGV and the multi-degree-of-freedom robotic arm can be determined based on the dynamic light and shadow trajectory and the interactive time period. For example, the image splicing and separation points at each moment, as well as the AGV stations and quantity at each moment can be determined based on the content presentation requirements of each time period.

[0052] Then, dynamic projection can be performed on the surface of the building to be projected through the movement of AGV and multi-degree-of-freedom robotic arms.

[0053] Exemplarily, the method further includes: Based on the three-dimensional information of the building to be projected, construct a baseline of the building to be projected; The projection picture is segmented based on the baseline of the building to be projected.

[0054] Specifically, before projecting the picture, the baseline of the building to be projected can be constructed according to the three-dimensional information of the building to be projected, so that the AGV can accurately reach the building during movement. When the picture dividing line is designed, the picture dividing line is identified, and then each projection surface reaches the predetermined area. At the same time, the visual module collects the projection picture information and transmits it back to the control module for picture correction, such as the fitting of complex surfaces and edge fusion between multiple projection surfaces.

[0055] Exemplarily, the method further includes: Controlling the acquisition module to obtain environmental change information at the image show site; The control instructions are adjusted based on the environmental change information at the video show site.

[0056] Specifically, when the image is projected, the movement trajectory of the AGV can also be adjusted according to the environmental change information at the image show site.

[0057] For example, for individual behavior, the light and shadow show can present interactive effects similar to barrage and live broadcast interaction, and for group applause behavior, the light and shadow show can make corresponding changes.

[0058] The following is a specific application scenario to better illustrate the technical solution of the present invention: Combination Figure 3 Come and see, Figure 3 This is a flow chart of an embodiment of a random image show presentation process provided by the present invention. The specific steps of the process are as follows: 1. 3D real-time landscape collection.

[0059] In the early stage, a drone equipped with a compound eye camera system went to the light and shadow show operation site to carry out three-dimensional physical landscape modeling, quickly model the operation targets, and model the surrounding space environment at the same time, generating a digital model and importing it into the intelligent creative platform.

[0060] 2. Intelligent creative platform design.

[0061] Intelligent creative platform design refers to the design based on the three-dimensional solid model of the working area, including: light and shadow show three-dimensional material design, robot trajectory and screen splicing design, and interactive design.

[0062] Unlike a proscenium stage that has only one side for the audience, the urban space has many audiences at all angles and heights. We can only try to consider the area with the most concentrated audience to ensure the visual effect. After collecting the three-dimensional scene, we determine the best audience concentration area based on the urban space.

[0063] According to the theme of the light and shadow show, combined with the actual situation of the building and the audience's perspective, the light and shadow show image materials are created through image creation software.

[0064] According to the resolution requirements and performance budget, the actual situation of the building (such as surface geometry, building facade area, etc.) and the content of the screen presentation, the building baselines of different image screens are designed so that the equipment movement process can accurately track the building body, and the screen allocation plan and screen division boundaries are designed so that each device can accurately present the screen projection it is responsible for in the correct position, thereby determining the number and equipment sites of "AGV+multi-degree-of-freedom robotic arm+engineering projection system" required for each screen.

[0065] Design the CUE table of the light and shadow show according to the performance sequence requirements, design the projection images and dynamic light and shadow trajectories for each time period, and design the interactive time period. Determine the image splicing and separation points at each moment, and the robot stations and quantities at each moment according to the content requirements for each time period.

[0066] According to the requirements of the light and shadow show CUE table, the robot motion trajectory is designed based on the three-dimensional real-time scene model, including the motion trajectory of the AGV between each station; the motion trajectory of the AGV and the robotic arm is constructed when the dynamic light and shadow trajectory is constructed, and the building baseline is designed according to the trajectory motion requirements to ensure that the robot can accurately identify the building during the movement and accurately project the projection image onto the corresponding landscape surface. Finally, the motion trajectory data and image allocation data are formed into an instruction set and distributed to each device.

[0067] The interactive program is designed according to the interactive time period and performance requirements of the CUE table. The interactive program is designed according to the different actions of the audience. The interactive program design is completed through visual programming, and a set of instructions is formed and distributed to each device.

[0068] 3. Robotic presentation.

[0069] (1) Debugging: According to the established design instructions, make corresponding adjustments on site based on the light and shadow show presentation effects.

[0070] (2) Construction.

[0071] Each device is transported to the performance venue by large trucks over long distances and arrives at its initial predetermined position under the guidance of a navigation system according to established procedures.

[0072] The building reference line and screen dividing line are marked on the projection facade through a fixing device.

[0073] The drone is equipped with a compound eye camera to reach the predetermined location, monitor the light and shadow performance system, sense changes in the on-site environment and audience information, and feed back to the central control system to make corresponding changes in control parameters.

[0074] The performance begins. During the movement, the AGV's visual module identifies the building's baseline and guides the robot to accurately complete the projection of the light and shadow picture by calculating the position between the screen dividing line and the robot. The compound eye system collects changes in the on-site lighting environment and transmits them to the central control system. The building surface reflection system cooperates with the projection to adjust the projection brightness to achieve the best effect. During the interaction stage, each sub-eye of the compound eye system monitors the audience information in the optimal audience area and sends it to the central control system. The central control system comprehensively judges the audience behavior and, based on the predetermined interaction design, the robot makes corresponding changes to complete the interaction.

[0075] After the performance, the equipment returned to the large truck for automatic charging, and the drone equipped with the compound eye camera returned to its position, completing the performance.

[0076] In the above process, if the power of the device is insufficient to support continued operation, it can be replaced by a backup device and cyclically charged to achieve the purpose of cyclic long-term operation.

[0077] Combination Figure 4 Come and see, Figure 4 This is a structural diagram of another embodiment of the implementation system of the contextual image show provided by the present invention. The central control system has multiple processors and multiple image processors built in for parallel processing, and can coordinate and control the "three-dimensional real-time landscape acquisition system based on compound eyes" (hereinafter referred to as the compound eye system), "three-dimensional real-scene light and shadow show construction platform system" (hereinafter referred to as the construction platform), "image presentation system based on 'AGV+multi-degree-of-freedom robotic arm+engineering projection system'" (hereinafter referred to as the image presentation system), and "building surface reflection system based on electrochromic thin film materials" (hereinafter referred to as the reflection system), as follows: 1. Based on the environmental change information sent back by the "compound eye system" (such as changes in functional lighting conditions on site, sudden appearance of obstructions on the projection path, etc.), it can intelligently calculate the best adaptation plan based on a certain computer algorithm and send it to the "image presentation system" to adjust the relative position of the projection and achieve adaptation to the environment.

[0078] 2. When the "image presentation system" is working with multiple machines, the central control system can accurately distribute commands through predetermined parameters and parameters generated by adapting to the environment, accurately allocate the images to each device, and coordinate and control the collaborative work of each device in the "image presentation system".

[0079] 3. After receiving the environmental information collected by the "compound eye system", the "reflection system" can, as needed, under the coordinated control of the central control system, comprehensively control the projection brightness and the reflection status of the electrochromic material to achieve the best effect.

[0080] 4. After the designers create the light and shadow show materials through the "construction platform" on the operating terminal, the central control system can accurately process the image information and render the output.

[0081] Combination Figure 5 Come and see, Figure 5 It is a schematic diagram of an embodiment of a presentation scene of a context-sensitive image show provided by the present invention, where image presentation devices 501 are distributed around a building complex 502 to collaboratively form context-sensitive images of buildings.

[0082] Combination Figure 6 Come and see, Figure 6This is a structural schematic diagram of an embodiment of the AGV door provided by the present invention when it is closed. The "AGV+multi-degree-of-freedom robotic arm+engineering projection system" in a non-working state includes a cabin cover 601, a light and shadow cabin 602 and a crawler AGV 603.

[0083] Combination Figure 7 Come and see, Figure 7 This is a schematic diagram of the structure of an embodiment of a multi-degree-of-freedom robotic arm provided by the present invention. The end of the robotic arm is fixedly connected to an engineering projection system 701 for ambient image presentation. The base 702 is connected to a guide rail 703 to increase the degree of freedom of movement of the entire mechanism, thereby facilitating compensation for the situation where the AGV cannot reach the target projection due to navigation errors.

[0084] After the cabin door is opened, the "AGV+multi-degree-of-freedom robotic arm+engineering projection system" is in working condition. Figure 8 Come and see, Figure 8 This is a structural schematic diagram of an embodiment of the AGV provided by the present invention when it is working.

[0085] Combination Fig. 9 Come and see, Fig. 9 This is a schematic diagram of an embodiment of the multi-projection fusion solution provided by the present invention. The visual module first identifies the building baseline to facilitate the device to accurately locate the building during movement. The screen dividing line is identified when the screen dividing line is designed. Then, each projection surface reaches the predetermined area. At the same time, the visual module collects the projection screen information and transmits it back to the central control system for screen correction, including the fitting of complex surfaces and the edge fusion between multiple projection surfaces.

[0086] Combination Fig.10 Come and see, Fig.10 This is a flow chart of an embodiment of the process of image show and audience interaction provided by the present invention, and the process includes the following steps: 1. After collecting the three-dimensional scene of the light and shadow operation area, determine the best concentrated audience area according to the three-dimensional scene of the operation space, and design image materials based on the best audience area.

[0087] 2. After determining the theme and content of the light and shadow show, the interactive program is designed to form an interactive program instruction set. The interactive program includes judging the audience's wishes based on the audience's behavior, realizing single response for group behavior and multiple responses for individual behavior.

[0088] 3. During the light show construction process, the compound eye camera system reaches the predetermined area, and each sub-eye identifies the network dividing the concentrated audience area.

[0089] 4. Transmit the identification information back to the central control system for processing.

[0090] 5. For individual behaviors, the light and shadow show will have interactive effects similar to barrage and live broadcast interactions. For group applause behaviors, the light and shadow show will make corresponding changes.

[0091] The advantage of the present invention is that the light and shadow show technology model of "AGV+multi-degree-of-freedom robotic arm+engineering projection system" can well adapt to the needs of quickly building light and shadow scenes in some cities and can respond quickly. The whole process requires fewer operators and has lower requirements for operators, allowing operators to quickly complete the construction of lighting scenes. There is no need to lay a large amount of infrastructure in the early stage, which saves economic costs and eliminates the safety hazards caused by laying infrastructure. The use of "AGV+multi-degree-of-freedom robotic arm" makes the light and shadow show more changeable, and designers have more room to play and can have more forms of expression. The light and shadow show is no longer a pre-made image, but a large-scale light and shadow show that can be interactively changed according to the wishes of the audience.

[0092] The present invention discloses a system and method for realizing an image show according to the scene data of the image show site. First, an image show program list is generated according to the scene data of the image show site, and then a control instruction is generated through the image show program list. According to the control instruction, a presentation module is controlled to perform screen projection to realize the image show according to the scene. The present invention reduces the operation and maintenance cost of the image show presentation according to the modular system setting while ensuring the presentation effect of the image show according to the scene.

[0093] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention.

Claims

1. A system for realizing a scene-based image show, characterized in that: include: The acquisition module is used to obtain scene data of the video show; A control module, connected to the acquisition module, for generating a video show program table based on the scene data, and generating a control instruction based on the video show program table; The presentation module is connected to the control module and is used to receive the control instruction and project the image on the landscape surface based on the control instruction.

2. The system for realizing the random image show according to claim 1, characterized in that: The presenting module includes: Multiple AGVs, multi-DOF robotic arms, and projection modules; The multi-degree-of-freedom mechanical arm is arranged on the AGV, and the projection module is arranged at the end of the multi-degree-of-freedom mechanical arm; The control instructions include a first control instruction, a second control instruction and a third control instruction; The first control instruction is used to control the AGV to move on the ground according to a preset route; The second control instruction is used to control the multi-degree-of-freedom robotic arm to move along a preset trajectory in the horizontal direction and the vertical direction; The third control instruction is used to control the projection module to play a preset projection picture.

3. The system for realizing the random image show according to claim 2, characterized in that: The presenting module also includes: A navigation module, used to provide location guidance for the AGV based on the preset route; A posture perception module, used to perceive the posture of the AGV and the multi-degree-of-freedom robotic arm, and the projection angle of the projection module, and send them to the control module; An anti-collision module, used to assist the AGV in avoiding obstacles; A visual module for identifying the baseline of the building to be projected; A thermal control module, used to maintain the normal operating temperature of the multi-degree-of-freedom robotic arm and the projection module; The control module is also used to adjust the control instructions based on the posture of the AGV and the multi-degree-of-freedom robotic arm, and the projection angle of the projection module.

4. The system for realizing the contextual image show according to claim 3, characterized in that: The system also includes: a reflection module connected to the control module; The acquisition module is also used to obtain environmental change information at the image show site; The control module is also used to generate an adjustment instruction based on the environmental change information; The reflection module is used to receive the adjustment instruction and adjust the projection brightness and projection color of the landscape surface based on the adjustment instruction.

5. A method for realizing a scene-based image show, characterized in that: The control module used in the system for realizing the contextual image show as claimed in claim 4 comprises: Controlling the acquisition module to acquire scene data of the video show, and generating a video show program list based on the scene data; A control instruction is generated based on the video show program list, and based on the control instruction, the presentation module is controlled to perform dynamic projection on the surface of the building to be projected.

6. The method for realizing the contextual image show according to claim 5, characterized in that: The scene data includes three-dimensional information of the building to be projected and spatial environment information around the building to be projected.

7. The method for realizing the contextual image show according to claim 6, characterized in that: The generating of a video show schedule based on the scene data comprises: Based on the three-dimensional information of the building to be projected and the spatial environment information around the building to be projected, the projection picture, dynamic light and shadow trajectory and interaction time period are determined.

8. The method for realizing the contextual image show according to claim 7, characterized in that: The generating of control instructions based on the video show program list includes: Based on the dynamic light and shadow trajectory and the interactive time period, the motion trajectory of the AGV and the multi-degree-of-freedom robotic arm is determined.

9. The method for realizing the contextual image show according to claim 8, characterized in that: The method further comprises: Based on the three-dimensional information of the building to be projected, construct a baseline of the building to be projected; The projection picture is segmented based on the baseline of the building to be projected.

10. The method for realizing the contextual image show according to claim 8, characterized in that: The method further comprises: Controlling the acquisition module to obtain environmental change information at the image show site; The control instructions are adjusted based on the environmental change information at the video show site.

Images