Scene projection method and apparatus, electronic device, and computer-readable storage medium
By acquiring projection equipment data and scene content, extracting local water wave image features, determining water wave and light and shadow parameters, and controlling projection lamp parameters, the problem of inconsistent projection effects in large scenes was solved, achieving consistent and smooth projection effects across multiple scene spaces, enhancing viewing experience and immersion.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GUANGZHOU LEAFUN CULTURE SCI & TECH
- Filing Date
- 2025-10-15
- Publication Date
- 2026-07-07
AI Technical Summary
In large-scale scenes, traditional lighting projection methods cannot meet the diverse projection effect requirements of scene spaces, resulting in fragmented and inconsistent projection effects.
By acquiring device data from the projector and scene content, local water wave image features are extracted, water wave and light and shadow parameters are determined, and the projection parameters of the projector are controlled to deeply integrate the projected content with the scene space, ensuring consistent and smooth projection effects across multiple scene spaces.
It achieves projection effects that match the scene in multiple spaces, avoiding fragmented projection and enhancing the viewing experience and immersion.
Smart Images

Figure CN121487085B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of lighting effect control technology, specifically to a scene projection method, device, electronic device, and computer-readable storage medium. Background Technology
[0002] Currently, in landscape lighting, exhibitions, and performances, light projection plays a crucial role in enhancing the overall effect and atmosphere. This is especially true in large-scale settings such as large cultural and tourism scenic areas and theme parks with complex and diverse spatial environments, where high-quality projection is essential for enhancing visual appeal and engagement. Water ripples, in particular, are frequently used due to their ability to create a gently flowing visual effect. However, as large-scale settings increasingly encompass diverse spatial elements, traditional, single projection methods are insufficient to meet the specific projection requirements of various spaces within a single large-scale setting. Summary of the Invention
[0003] This application discloses a scene projection method, apparatus, electronic device, and computer-readable storage medium, which can present a water wave projection effect that matches the scene space in multiple scene spaces.
[0004] This application discloses a scene projection method applied to an electronic device, wherein the electronic device is communicatively connected to multiple projection lights; the multiple projection lights are disposed within one or more scene spaces; the method includes:
[0005] Obtain device data corresponding to each of the projection lamps, wherein the device data includes the location information of the projection lamps and the device hardware parameters;
[0006] Acquire dynamic water wave images of the target and the scene content corresponding to each of the aforementioned scene spaces;
[0007] Based on the scene content corresponding to the first scene space, extract the local water wave image corresponding to the first scene space from the target dynamic water wave image, wherein the first scene space is any of the scene spaces.
[0008] Feature extraction is performed on the local water wave image to obtain image features, and based on the image features and the scene content corresponding to the first scene space, the first water wave parameters and the first light and shadow parameters corresponding to the first scene space are determined.
[0009] Based on the position information of multiple target projection lights set in the first scene space, the multiple target projection lights are mapped onto the local water wave image to obtain the projection content corresponding to the multiple target projection lights.
[0010] Based on the first water wave parameters, the first light and shadow parameters, and the device hardware parameters corresponding to the plurality of target projection lights, the projection parameters corresponding to the plurality of target projection lights are determined.
[0011] Each of the target projection lights is controlled to project its corresponding content according to its corresponding projection parameters.
[0012] This application discloses a scene projection device applied to an electronic device, wherein the electronic device is communicatively connected to multiple projection lights; the multiple projection lights are disposed within one or more scene spaces; the device includes:
[0013] The data acquisition module is used to acquire device data corresponding to each of the projection lamps, the device data including the position information of the projection lamp and the device hardware parameters;
[0014] The data acquisition module is also used to acquire the target dynamic water wave image and the scene content corresponding to each scene space;
[0015] The image generation module is used to extract a local water wave image corresponding to the first scene space from the target dynamic water wave image based on the scene content corresponding to the first scene space, wherein the first scene space is any of the scene spaces.
[0016] The scene parameter generation module is used to extract features from the local water wave image to obtain image features, and determine the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space.
[0017] The projection parameter generation module is used to map the multiple target projection lights onto the local water wave image based on the position information of the multiple target projection lights set in the first scene space, so as to obtain the projection content corresponding to the multiple target projection lights respectively.
[0018] The projection parameter generation module is further configured to determine the projection parameters corresponding to the plurality of target projection lamps based on the first water wave parameters, the first light and shadow parameters, and the device hardware parameters corresponding to the plurality of target projection lamps respectively.
[0019] The projection control module is used to control each of the target projection lamps to project the corresponding content according to the corresponding projection parameters.
[0020] This application discloses an electronic device, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor causes the processor to implement the method described in any of the above embodiments.
[0021] This application discloses a computer-readable storage medium that stores a computer program, which, when executed by a processor, implements the methods described in any of the above embodiments.
[0022] This application discloses a computer program product, including a computer program, wherein when the computer program is executed by a processor, it implements the method described in any of the above embodiments.
[0023] The scene projection method, apparatus, electronic device, and computer-readable storage medium disclosed in this application include: the electronic device acquiring device data corresponding to each projection lamp; acquiring a target dynamic water wave image and scene content corresponding to each scene space; extracting a local water wave image corresponding to the first scene space from the target dynamic water wave image based on the scene content corresponding to the first scene space; determining a first water wave parameter and a first light and shadow parameter corresponding to the first scene space based on the local water wave image and the scene content corresponding to the first scene space; determining the projection content and projection parameters corresponding to multiple target projection lamps set in the first scene space based on the first water wave parameter and the first light and shadow parameter; and controlling each target projection lamp to project its corresponding projection content according to its corresponding projection parameters.
[0024] In this embodiment, the electronic device extracts local water wave images corresponding to different scene spaces and determines the corresponding water wave parameters and light and shadow parameters, so that the projection content and projection parameters of the projector lamp are deeply integrated with the scene space, so that the projector lamp presents a projection effect with aesthetic appeal and immersion. At the same time, by combining the position of the projector lamp and the hardware parameters of the projector lamp to allocate the projection content and projection parameters, it can ensure that the images of each scene space projected by multiple projector lamps are consistent and coordinated, avoiding the phenomenon of the projection effect presented by multiple scene spaces being fragmented again. Thus, multiple projector lamps can present water wave effects that match multiple scene spaces, and can also ensure smooth water wave images projected in different scene spaces. Attached Figure Description
[0025] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0026] Figure 1A This is an application scenario diagram of the scene projection method in one embodiment;
[0027] Figure 1B This is an application scenario diagram of the scene projection method in a specific embodiment;
[0028] Figure 1C This is a projection effect diagram of the scene space in one embodiment;
[0029] Figure 2 Here is a flowchart of a scene projection method in one embodiment;
[0030] Figure 3 This is a flowchart illustrating the determination of first water wave parameters and first light and shadow parameters in one embodiment;
[0031] Figure 4 A flowchart for generating a local water wave image in one embodiment;
[0032] Figure 5 Here is a flowchart of a scene projection method in one embodiment;
[0033] Figure 6 Here is a flowchart of a scene projection method in one embodiment;
[0034] Figure 7 Here is a flowchart of a scene projection method in one embodiment;
[0035] Figure 8 Here is a flowchart of a scene projection method in one embodiment;
[0036] Figure 9 Here is a flowchart of a scene projection method in one embodiment;
[0037] Figure 10 This is a block diagram of a scene projection device in one embodiment;
[0038] Figure 11 This is a structural block diagram of an electronic device in one embodiment. Detailed Implementation
[0039] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0040] It is understood that the terms “first,” “second,” etc., used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another.
[0041] This application discloses a scene projection method, apparatus, electronic device, and computer-readable storage medium, which enables the projected image to present a water wave effect that matches multiple scene spaces.
[0042] Figure 1A This is an application scenario diagram of the scene projection method in one embodiment, presented from a top-down perspective. The scene projection method of this application can be applied to a large projection scene 100. Figure 1A As shown, a large projection scene 100 may include an electronic device 110 and multiple projection lamps 120, and the projection scene 100 may also have one or more scene spaces 130. The electronic device 110 is communicatively connected to the multiple projection lamps 120; the multiple projection lamps 120 are disposed within one or more scene spaces 130. Figure 1A The document only labels three projector lights 120 located in one scene space 130; other projector lights in that scene space and in other scene spaces are not listed. Figure 1A (Above annotation).
[0043] Electronic device 110 is used to control multiple projection lamps 120 in a unified manner; electronic device 110 may include, but is not limited to, mobile phones, smart wearable devices, tablets, PCs (Personal Computers), computers, etc. Electronic device 110 achieves the control of the projection effect of each projection lamp 120 through a series of operations such as data acquisition, parameter calculation, and projection command issuance.
[0044] Projector lamps 120 are devices used to project light and shadow onto a specific area (large projection scene 100) to create visual effects. Multiple projector lamps can project onto the large projection scene 100, making the entire large projection scene 100 present a water ripple image effect. It should be noted that projector lamps 120 can also be installed in blank areas outside the scene space within the large projection scene 100.
[0045] Optionally, the water ripple effect projected by the projector lamp 120 can also include rotation, shaking, floating shadows, and ripples, which users can set according to their actual needs to create richer, more diverse, and dynamically varied projected images. In addition, the projector lamp 120 can also adjust parameters such as projection range and projection angle. For example, the size of the projection range can be adjusted through the built-in lens zoom mechanism or mechanical structure, and the projection angle can be changed using a rotatable or tiltable stand, thus flexibly adapting to the projection needs of different scene spaces.
[0046] In some embodiments, the electronic device 110 can establish a communication connection with the projection lamp 120 via wired or wireless means. Wired connection may include, but is not limited to, using physical lines such as network cables or data cables; wireless connection may include, but is not limited to, using wireless communication technologies such as Wi-Fi, Bluetooth, or ZigBee.
[0047] Optionally, if the electronic device 110 establishes a wireless communication connection with each projection lamp 120, the electronic device 110 may not be in the large projection scene 100, but may remotely control each projection lamp 120 to project.
[0048] Large-scale projection scenes 100 may include, but are not limited to, large-scale cultural and tourism scenic spots, theme parks, cultural squares, and cultural and creative squares. In these large-scale projection scenes 100, due to their large scale, corresponding spatial areas are usually divided by one or more thematic elements or functions, thus forming multiple different scene spaces 130 in the large-scale projection scene 100.
[0049] Therefore, scene space 130 refers to a relatively independent area within the large projection scene 100, divided based on specific themes, functions, or visual presentation needs. Each scene space 130 can have a unique theme, content, or interactive format. Different lighting effects projected by the projector lamps 120 can further enhance its thematic characteristics and create distinct atmospheres. At the same time, multiple scene spaces 130 belonging to the same large projection scene 100 are connected by a core content, avoiding obvious fragmentation within the same large projection scene 100.
[0050] For example, in large cultural and tourism scenic areas, different themed areas (such as ancient style architecture area, fairy tale forest area, science fiction future area, etc.) are different scene spaces; in theme parks, the areas where various amusement projects are located, the areas around performance venues, etc. can also be divided into different scene spaces.
[0051] Taking a large-scale projection scene of 100 as an example, such as a cultural square, Figure 1B As shown, the large projection scene 100 can be a cultural square centered on the famous "Eight Views of Xiaoxiang" of a certain region. According to the content of the "Eight Views of Xiaoxiang", the cultural square can have 8 scene spaces, namely, Evening Bell at Misty Temple 130a, Wild Geese Descending on Sandbar 130b, Autumn Moon over Dongting Lake 130c, Evening Snow on the River and Sky 130d, Sunset Glow over Fishing Village 130e, Clear Mist over Mountain City 130f, Night Rain over Xiaoxiang 130g, and Returning Sails on Distant Shores 130h.
[0052] It should be noted that, in order to ensure that each scene space 130 can obtain a complete projection presentation, the projection range of the projection lamps 120 set in each scene space 130 needs to be able to fully cover the planar range of each scene space 130.
[0053] For example, in some small, relatively simple scene spaces, a single projector can completely cover the planar area of the scene space with its suitable projection angle and wide coverage. However, in larger, more complex, or content-rich scene spaces, two or more projectors often need to work together to completely cover the entire planar area. By projecting from multiple projectors at different angles, their projection ranges connect and complement each other, forming a seamless projection network that ensures the scene space is completely covered.
[0054] Optionally, when the projection range of the projector 120 is wide and the two scene spaces 130 are adjacent, one projector 120 can project onto two adjacent scene spaces 130 simultaneously. In this case, it is necessary to ensure that the projection content of the projector 120 can meet the needs of both scene spaces 130 at the same time without causing visual conflict or confusion.
[0055] In some embodiments, the two scene spaces 130 in the large projection scene 100 may be located adjacent to each other (e.g., Figure 1B Scene spaces 130e and 130f; the two scene spaces 130 may not be adjacent, separated by a blank area (e.g., Figure 1B Scene space 130a and scene space 130h in the context of the scene.
[0056] When two scene spaces 130 are adjacent, the projection ranges of the projectors placed in these two scene spaces 130 may partially overlap, resulting in overlapping projections in the overlapping area. Therefore, when controlling the projectors 120 for projection, this overlapping phenomenon needs to be controlled to avoid content misalignment or wave pattern conflicts in the projected image. For example, in two adjacent scene spaces, one creates a tranquil lake atmosphere, while the other creates a turbulent ocean atmosphere. If the overlapping area of the projection range is not properly handled, the superposition of two different styles of water wave projection effects will create visual confusion.
[0057] Optionally, the electronic device 110 can control the rotation of the projection lamps 120 in the two scene spaces 130 to adjust the illumination direction of the projection lamps whose projection ranges intersect, change their projection paths, and thus reduce or even eliminate the intersecting projection ranges. Optionally, the electronic device 110 can also control the projection content of the projection lamps 120 whose projection ranges intersect, so that the projection content presented in the intersecting area has a gradient effect, making the image transition in the intersecting area natural, as if it were a natural connection between the two scene spaces.
[0058] When two adjacent scene spaces 130 are not adjacent and have blank areas, the projection ranges of the projectors within the two adjacent scene spaces 130 usually do not intersect. However, if the blank areas are ignored, the entire projected image may abruptly stop, creating a visual disjointedness and disrupting the continuity and integrity of the scene. To make the projection effect more natural and smooth, and enhance the audience's immersion, electronic devices can control the projectors to create a water ripple effect when projecting onto blank areas, gradually fading and disappearing.
[0059] In some embodiments, the scene space also includes scene content, which refers to physical objects within the scene space used to construct a specific culture, theme, create a unique atmosphere, or showcase a specific scene appearance. These are indispensable physical elements within the scene space, and the scene content includes one or more scene markers, which are representative and easily identifiable objects within the scene space. For example, in Figure 1B In the scene space shown in "Returning Sails at the Distant Shore 130h", the sailboat can be used as a scene marker.
[0060] In real-world scenarios, water ripples change when they encounter physical objects, such as being blocked, reflected, or refracted, creating a unique ripple effect. Therefore, to improve the realism of the projection, the electronic device 110 can precisely control the projection content and parameters of the projection lamp 120 when controlling the projection, so that the projected water ripple image presents realistic water ripple changes near the scene landmarks.
[0061] For example, such as Figure 1C As shown, in a scene space 130, when the scene marker 140 is not encountered, the water ripple image presents a regular, smooth and evenly diffused form, like ripples naturally rippling on a calm lake surface (as shown in the first water ripple 150 in the figure); however, when the scene marker 140 is encountered, the water ripple image will change accordingly, producing a ripple effect after interacting with the real scene object, such as water ripples in all directions after encountering a sailboat (as shown in the second water ripple 160 in the figure).
[0062] Optionally, the water ripples produced by different scene landmarks will also vary. For example, when the scene landmark is a bridge, the water ripples will create a swirling ripple effect around the bridge, while the bridge's reflection will be mirrored on the water ripples. When the scene landmark is reeds, the water ripples will be partially absorbed and weakened, and the flow will become relatively gentle.
[0063] In this embodiment, the electronic device 110 acquires the position information and device hardware parameters corresponding to each projection lamp 120, and acquires the target dynamic water wave image and the scene content corresponding to each scene space 130. Based on the scene content corresponding to the first scene space, the electronic device 110 extracts the local water wave image corresponding to the first scene space from the target dynamic water wave image, performs feature extraction on the local water wave image to obtain image features, and determines the first water wave parameter and the first light and shadow parameter corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space. The electronic device 110 also maps the multiple target projection lamps to the local water wave image based on the position information of the multiple target projection lamps set in the first scene space, obtaining the projection content corresponding to each of the multiple target projection lamps, and determines the projection parameters corresponding to each of the multiple target projection lamps based on the first water wave parameter, the first light and shadow parameter, and the device hardware parameters corresponding to each of the multiple target projection lamps. The electronic device 110 controls each target projection lamp to project the corresponding projection content according to the corresponding projection parameters, so as to project and display the corresponding local water wave image in the first scene space.
[0064] like Figure 2 As shown, in one embodiment, a scene projection method is provided, which can be applied to the aforementioned electronic device. The method may include steps 210 to 270.
[0065] Step 210: Obtain the device data corresponding to each projection lamp.
[0066] The device data includes the location information of the projector lamp and the device's hardware parameters. Location information refers to the projector lamp's distribution position in the projection scene, which may include the scene space where the projector lamp is located. Device hardware parameters refer to the projector lamp's various performance indicators and configuration information, including but not limited to zoom capability, supported projection angles, and maximum rotation angle. Zoom capability refers to the ability of the projector lamp to change the size of the projected image through adjustments of its internal optical system without moving its physical position, thereby achieving the functions of focusing at different distances and scaling the image. Supported projection angles refer to the range of angles at which the projector lamp can project a clear and complete image, which may include both horizontal and vertical projection angles. Maximum rotation angle refers to the maximum range of angles at which the projector lamp can rotate in the horizontal and vertical directions.
[0067] In some embodiments, each projector lamp may possess a unique identifier, which is then sent to an electronic device. Upon receiving these identifiers, the electronic device interacts with a pre-established database related to the projectors. This database stores detailed information about all projectors, including hardware parameters, installation time, maintenance records, and location information. By searching the database for records matching the received unique identifiers, the electronic device can quickly and accurately obtain the device data corresponding to each projector lamp. Optionally, in addition to querying based on unique identifiers, the electronic device can also directly receive device data actively sent by each projector lamp. The electronic device can also obtain the device data corresponding to each projector lamp through user input.
[0068] Step 220: Obtain the target dynamic water wave image and the scene content corresponding to each scene space.
[0069] Target dynamic water ripple images refer to a collection of images used to simulate the dynamic changes in water ripples within a large projection scene. Target dynamic water ripple images are not simply static images, but can consist of a series of continuous, varied, multi-frame images. For example, when simulating a tranquil water surface, target dynamic water ripple images would depict a gentle scene of a breeze creating delicate ripples.
[0070] The scene content corresponding to each scene space refers to the physical objects in that scene space, which are used to construct a specific culture, theme, create a unique atmosphere, or showcase a specific scene style. They are indispensable physical elements in the scene space. The scene content includes one or more scene markers, which are representative and easily identifiable objects in the scene space.
[0071] Step 230: Based on the scene content corresponding to the first scene space, extract the local water wave image corresponding to the first scene space from the target dynamic water wave image.
[0072] The first scene space is any scene space.
[0073] In some embodiments, the electronic device can perform feature recognition on the target dynamic water wave image to obtain visual features, and perform feature recognition on the scene content of the first scene space to obtain key features. Using image recognition algorithms and machine learning models, the electronic device compares and matches the visual features in the target dynamic water wave image with the key features of the scene content of the first scene space to determine which parts of the target dynamic water wave image best match the scene content of the first scene space in terms of visual features. Then, based on the area of the first scene space relative to the entire large projection scene, the specific region of the first scene space in the target dynamic water wave image is determined. This specific region is then segmented to obtain the local water wave image corresponding to the first scene space. This ensures that the extracted local water wave image can highly reproduce the water wave effect expected to be presented in the first scene space.
[0074] Step 240: Extract features from the local water wave image to obtain image features, and determine the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space.
[0075] Water wave parameters are quantitative indicators used to accurately describe the dynamic characteristics and physical properties of water waves. These parameters determine the specific manifestation and visual effect of water waves in a scene. Water wave parameters may include at least one of the following: wave frequency, water flow direction, ripple density, and wave morphology.
[0076] Wave frequency refers to the number of times a water wave completes a full periodic oscillation per unit of time; the frequency of the wave directly affects the rhythm of the water wave's movement and its visual perception. For example, high-frequency waves (such as multiple oscillations per second) will appear turbulent and rapidly undulating; low-frequency waves (such as once per second or even slower) will appear calm and gentle.
[0077] Water flow direction refers to the path and trend of water waves in space. Ripple density refers to the number of water ripples per unit area, reflecting the complexity and fineness of the water surface; for example, high ripple density means that the water surface is covered with dense, fine ripples, which can create a delicate effect of a gentle breeze and shimmering water. Water wave morphology refers to the various geometric shapes and structural features that water waves exhibit in space, such as circular, elliptical, wave-like, and vortex-like shapes.
[0078] Lighting parameters describe the changes in light and shadow produced by scene content on the water's surface, contributing to atmosphere and realism. These parameters may include, but are not limited to, the color and extent of shadows cast by scene content on the water. Specifically, shadow color refers to the color characteristics of the shadows cast by scene content on the water; shadow extent refers to the size and shape of the area covered by the shadows on the water's surface.
[0079] Step 250: Based on the position information of the multiple target projectors set in the first scene space, the multiple target projectors are mapped onto the local water wave image to obtain the projection content corresponding to the multiple target projectors.
[0080] Projected content refers to the specific visual information presented when a target projector shines on the corresponding area of a local water ripple image. Projected content may include, but is not limited to, dynamic textures of water ripples, gradient effects of light and shadow, and special light and shadow patterns (such as twinkling starlight or flowing lines).
[0081] In some embodiments, the electronic device can map the projection range of the target projector onto a local water ripple image using a projection transformation algorithm (such as perspective projection, parallel projection, etc.) based on the position coordinates and projection direction vector of the target projector. The projection range mapped onto the local water ripple image is then segmented into multiple sub-regions based on the number of target projectors and projection requirements, with each sub-region corresponding to one target projector. The electronic device then generates projection content corresponding to each target projector for each sub-region, combining the features of the local water ripple image and the scene content of the first scene space.
[0082] Step 260: Determine the projection parameters corresponding to the multiple target projection lights based on the first water wave parameters, the first light and shadow parameters, and the device hardware parameters corresponding to the multiple target projection lights.
[0083] Projection parameters refer to the quantitative indicators that control the working status and projection effect of the target projector. Projection parameters may include, but are not limited to, brightness, color temperature, contrast ratio, refresh rate, projection angle and range, distortion correction value, edge blending weight, dynamic effects, zoom magnification, and other multi-dimensional parameters, which together determine the presentation effect of the projected content in the first scene after being projected by the target projector.
[0084] In some embodiments, the electronic device can construct a water wave-projection mapping model, a light and shadow-projection fusion model, and a hardware-parameter adaptation model; the water wave-projection mapping model contains the mapping relationship between water wave parameters and projection parameters; the light and shadow-projection fusion model can adjust the projection parameters by analyzing the light and shadow parameters in the scene, so that the light and shadow effect of the projected content is close to the target effect; the hardware-parameter adaptation model can limit the projection parameters to the achievable range of the projection lamp.
[0085] Optionally, the electronic device can input the first water wave parameter into the water wave-projection mapping model. Based on the correlation in the model, it calculates the initial values of the projection parameters, such as the preliminary range of parameters like brightness, contrast, and projection angle, that are compatible with the first water wave parameter. Then, the first light and shadow parameter is substituted into the light and shadow-projection fusion model. Combining the results of the water wave-projection mapping model, the projection parameters are further adjusted to better integrate the projected content with the actual light and shadow environment. The electronic device also matches and adapts the calculated projection parameters with the hardware parameters of the target projector lamps. This optimizes and adjusts the projection parameters without exceeding the hardware performance limitations of the projector lamps, ensuring that the projection parameters can be implemented on the actual device, thus obtaining optimized and adjusted projection parameters for multiple target projector lamps.
[0086] Step 270: Control each target projection lamp to project the corresponding content according to the corresponding projection parameters.
[0087] In some embodiments, the electronic device can generate control commands for each target projector lamp according to the projection content and projection parameters corresponding to each target projector lamp, and send the control commands for each target projector lamp to the corresponding target projector lamp, so that each target projector lamp projects the corresponding projection content according to the corresponding projection parameters, thereby displaying the corresponding local water wave image in the first scene space.
[0088] In this embodiment, the electronic device extracts local water wave images corresponding to different scene spaces and determines the corresponding water wave parameters and light and shadow parameters, so that the projection content and projection parameters of the projector lamp are deeply integrated with the scene space, so that the projector lamp presents a projection effect with aesthetic appeal and immersion. At the same time, by combining the position of the projector lamp and the hardware parameters of the projector lamp to allocate the projection content and projection parameters, it can ensure that the images of each scene space projected by multiple projector lamps are consistent and coordinated, avoiding the phenomenon of the projection effect presented by multiple scene spaces being fragmented again. Thus, multiple projector lamps can present water wave effects that match multiple scene spaces, and can also ensure smooth water wave images projected in different scene spaces.
[0089] In some embodiments, such as Figure 3 As shown, the steps determine the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space, and may also include steps 302 to 304.
[0090] Step 302: Determine the water wave region in the local water wave image based on the image features, and determine the first water wave parameter corresponding to the first scene space based on the image features of the water wave region.
[0091] The water wave region refers to the image area in a local water wave image that presents dynamic characteristics of water waves (such as undulation, changes in reflected light and shadow, etc.).
[0092] In some embodiments, the electronic device can use frequency domain analysis (e.g., Fourier transform) to determine the frequency, period, and wavelength of the first water wave parameters corresponding to the first scene space; then use texture direction or motion vector statistics to determine the water flow direction, and estimate the reflectivity and transmittance based on the light reflection and transmission phenomena combined with the principles of radiometry, thereby comprehensively obtaining water wave parameters that reflect the dynamics, morphology, and optical properties of water waves.
[0093] Step 304: Based on the ray tracing algorithm, simulate the light and shadow reflection between the scene content and the water wave area corresponding to the first scene space, according to the scene content and water wave area corresponding to the first scene space, so as to obtain the first light and shadow parameters corresponding to the first scene space.
[0094] Ray tracing is an algorithm that calculates the lighting effects on the surface of an object by simulating the path of light rays. Starting from the viewpoint (the water ripple area), ray tracing can emit rays into the scene content of the first scene space, recursively tracing reflected and refracted rays to simulate the reflection, refraction, and absorption effects of light and shadow on the water ripple area and the scene content.
[0095] Optionally, the light and shadow reflection is quantized based on the simulated scene content and the light and shadow reflection between the water wave area to obtain the first light and shadow parameters corresponding to the first scene space.
[0096] In this embodiment, the electronic device accurately locates the water wave region in a local water wave image through image features, and then obtains accurate first water wave parameters by comprehensively applying frequency domain analysis; and simulates the complex light and shadow interaction (reflection, refraction, absorption, etc.) between the water wave region and the scene content through a ray tracing algorithm to obtain accurate first light and shadow parameters, providing reliable and accurate data support for the subsequent calculation of projection content and projection parameters.
[0097] In some embodiments, such as Figure 4 As shown, the steps include extracting the local water wave image corresponding to the first scene space from the target dynamic water wave image based on the scene content corresponding to the first scene space, and may also include steps 402 to 406.
[0098] Step 402: Obtain the type and position coordinates on the horizontal plane of each scene marker contained in the first scene space.
[0099] The types of scene markers can include, but are not limited to, vehicles, buildings, and plants. For example, the types of scene markers, such as straw boats and bamboo rafts, are both vehicles; the type of scene marker, such as bridges, is a building; and the type of scene marker, such as reeds, is a plant.
[0100] Optionally, different types of landmarks in different scenes will produce different water ripples and light and shadow on the water surface.
[0101] Taking a bridge as a landmark in the scene as an example, since the bridge changes the direction and speed of local water flow, eddies and complex water wave patterns will be formed around the bridge piers; and the bridge's blocking and reflection of light will also create alternating light and shadow areas on the water surface.
[0102] Alternatively, even landmarks of the same type may produce different water ripples and lighting effects. For example, bridges of different architectural styles (such as arch bridges and beam bridges) and materials (such as stone bridges and steel bridges) will produce different water ripple and lighting effects.
[0103] In some embodiments, the electronic device can establish a two-dimensional Cartesian coordinate system from a top-down perspective, using a specific reference point (such as the lower left corner vertex or center point of the scene) as the origin, to obtain the position coordinates of each scene marker on the horizontal plane.
[0104] Step 404: Based on the location information of the first scene space in one or more scene spaces, segment the target dynamic water wave image to obtain the first water wave image corresponding to the first scene space.
[0105] The first water wave image is a subset of the target dynamic water wave image, containing dynamic water wave information within the area where the first scene space is located.
[0106] Because various scene markers exist in the scene space, these markers will generate complex water wave disturbances and influences on the water surface, thus causing changes in the water waves. If the first water wave image obtained by directly segmenting the target dynamic water wave image based on the location information of the first scene space is taken as a local water wave scene, only the spatial correspondence is considered, ignoring the actual effect of scene markers on the water waves. This results in the projection of the subsequent target projector not being able to match the scene markers in the first scene space.
[0107] Step 406: Based on the type and location coordinates of each scene marker, process the first water wave image to generate a local water wave image corresponding to the first scene space. The local water wave image contains water ripples centered on each scene marker.
[0108] In some embodiments, the electronic device can correct and optimize parameters such as the water wave morphology, wave intensity, and propagation direction in the first water wave image based on the type and location coordinates of the scene markers and the interaction rules between the scene markers and the water surface, so as to generate a local water wave image that is more consistent with the first scene space.
[0109] Optionally, if the distance between two scene markers is less than a preset distance, the water ripples centered on these two scene markers will merge and form new ripples. In this case, when generating the local water ripple image corresponding to the first scene space, the first water ripple image needs to be adjusted to include the merged water ripples.
[0110] In this embodiment, the electronic device first segments the first water wave image corresponding to the first scene space by using the type and position coordinates of scene markers in the first scene space. Then, it combines the marker type, position and interaction rules to modify and optimize the generation of a local water wave image that is highly consistent with the first scene space and includes the water ripples at the center of the marker. This ensures that the subsequent projection is accurately matched with the scene markers, improves the realism and accuracy of the water wave simulation, and enhances the immersion and visual effect of the relevant scene space.
[0111] like Figure 5 As shown, in one embodiment, a scene projection method is provided, which can be applied to the aforementioned electronic device. The method may include steps 502 to 510.
[0112] Step 502: Receive distance data sent by each scene marker. The distance data is collected by distance sensors installed in the scene markers.
[0113] In some embodiments, distance sensors may be installed on various scene markers to detect the distance between visitors and scene markers within a preset range. Available distance sensors include, but are not limited to, ultrasonic sensors, infrared sensors, and lidar.
[0114] Optionally, distance sensors installed in the scene markers can transmit the collected distances between all tourists and the scene markers within a preset range to electronic devices.
[0115] Step 504: Determine the minimum distance between each scene marker and the tourist based on the distance data corresponding to each scene marker.
[0116] Optionally, for each scene marker, the electronic device can sort the distance data sent in ascending order of distance to determine the minimum distance between each scene marker and the visitor.
[0117] Step 506: If the minimum distance to the target scene marker is less than the distance threshold, obtain the preset projection image corresponding to the target scene marker; the target scene marker is any scene marker in the first scene space.
[0118] If the minimum distance to the target scene landmark is less than the distance value, it indicates that a tourist is approaching and viewing the target scene landmark, which means that the tourist is interested in the target scene landmark. In this case, a preset projection image corresponding to the target scene landmark can be shown to the tourist to introduce relevant information about the target scene landmark or scene space, thereby enhancing the tourist's awareness and experience of the scene landmark.
[0119] Step 508: Adjust the projection parameters and projection content of each target projection lamp according to the image parameters corresponding to the preset projection image and the device hardware parameters corresponding to the multiple target projection lamps.
[0120] The adjustment of the projection parameters and projection content corresponding to each target projection lamp in step 508 can be referred to the relevant descriptions of generating the projection parameters and projection content corresponding to each target projection lamp in steps 250 to 250 above, and will not be repeated here.
[0121] Step 510: Control each target projection lamp to project the adjusted content according to the adjusted projection parameters.
[0122] The electronic device sends control commands to each target projection lamp so that each target projection lamp projects the adjusted projection content according to the adjusted projection parameters, and displays the preset projection image corresponding to the target scene landmark around the target scene landmark.
[0123] In this embodiment, when the electronic device detects that a tourist is approaching a target scene landmark (i.e., the minimum distance is less than the preset distance), it controls the target projection lamp to display a preset projection image by dynamically adjusting the projection parameters and projection content. This achieves precise interactive projection for the tourist's points of interest, enhancing the tourist's cognitive experience of the scene landmark and the sense of immersion in the tour.
[0124] like Figure 6 As shown, in one embodiment, a scene projection method is provided, which can be applied to the aforementioned electronic device. The method may include steps 602 to 608.
[0125] Step 602: Obtain the current environmental data of the first scene space.
[0126] Environmental data refers to parameters that reflect the natural environmental conditions of the primary scene space. Environmental data may include, but is not limited to, wind speed, wind volume, and wind direction.
[0127] In real-world scenarios, environmental factors can affect the actual water surface, causing changes in water waves. For example, higher wind speeds and stronger winds result in higher wave frequencies and greater ripple density; wind direction can also influence water flow direction. Therefore, in some embodiments, sensors can be placed in various scene spaces. When the sensors detect changes in the collected environmental data, they send the environmental data to electronic devices, enabling the electronic devices to adjust the water wave image based on the received environmental data. Suitable sensors include wind speed sensors and wind direction sensors.
[0128] Step 604: Adjust the local water wave image corresponding to the first scene space based on the environmental data to construct a new dynamic water wave image for the first scene space.
[0129] In some embodiments, the electronic device can adjust the local water wave image of the first scene space based on the impact of various environmental data on water waves. For example, the water flow direction can be adjusted according to the wind direction so that the adjusted water flow direction is the same as the wind direction.
[0130] Step 606: Based on the new dynamic water wave image in the first scene space, dynamically adjust the first water wave parameters and the first light and shadow parameters corresponding to the first scene space.
[0131] The description of generating the first water wave parameters and the first light and shadow parameters based on the new dynamic water wave image in step 606 can be referred to the description of generating the first water wave parameters and the first light and shadow parameters based on the local water wave image in step 240 of the above embodiment, and will not be repeated here.
[0132] Step 608: Based on the first water wave parameters and first light and shadow parameters adjusted in the first scene space, adjust the projection content and projection parameters corresponding to the multiple target projectors respectively, and control each target projector to project the adjusted projection content according to the adjusted projection parameters, so that the first scene space presents a new dynamic water wave image.
[0133] In this embodiment of the application, the electronic device acquires environmental data and performs more accurate simulation and processing of the water wave image in the first scene space based on this environmental data, so that the water wave image generated by the projection lamp is more in line with the actual water wave changes in the scene, thereby improving the visual effect and immersion of the entire scene space.
[0134] like Figure 7 As shown, in one embodiment, a scene projection method is provided, which can be applied to the aforementioned electronic device. The method may include steps 702 to 708.
[0135] Step 702: Obtain the working status of each projection lamp according to a preset time interval.
[0136] The working status of a projector lamp refers to the various operating indicators that the projector lamp exhibits during the projection process. The working status may include, but is not limited to, the device operation status (whether the projector lamp is powered on normally, whether it is in standby mode, whether it has been unexpectedly shut down, etc.), the optical performance status (such as brightness, contrast, color saturation, color temperature, etc.), the timing control status (the state in which the projector lamp performs projection work according to the preset timing logic), the heat dissipation status, and the communication status.
[0137] In some embodiments, each projection lamp can send information containing its operating status to the electronic device at preset time intervals. This allows the electronic device to obtain the corresponding operating status of each projection lamp according to the preset time intervals, enabling the electronic device to monitor the operation of the projection lamps in real time and dynamically, and to promptly detect potential problems. Regular monitoring can detect trends of performance degradation in the projection lamps in advance, such as a gradual decrease in brightness, allowing for timely maintenance. It also enables rapid response to sudden faults, allowing immediate measures to be taken when a projection lamp malfunctions, preventing the fault from escalating and affecting the projection effect of the entire scene space.
[0138] Step 704: If the working state of the first projection lamp does not meet the projection conditions, determine one or more second projection lamps adjacent to the first projection lamp.
[0139] The first projection lamp can be any projection lamp; and the projection range of one or more second projection lamps covers the projection range of the first projection lamp. The operating state of the first projection lamp does not meet the projection condition indication, and the operating status of the first projection lamp can no longer meet the performance and functional requirements for normal projection.
[0140] Unsuitable projection conditions can fall into two main categories: hardware malfunctions and software malfunctions. Hardware malfunctions refer to damage or abnormalities in the projector's own hardware. Examples include a damaged light source (bulb, laser diode, etc.) preventing light emission; broken, displaced, or contaminated optical components (lens, mirrors, etc.) affecting image formation; open circuits, short circuits, or aging components in the circuit system (power supply, drive, control circuits, etc.); and overheating protection shutdown due to a failed cooling system. Software malfunctions refer to problems in the projector's software operation or control mechanisms. Examples include a timing control module malfunction causing abnormal image switching; communication errors interrupting command transmission; and color correction deviations causing color distortion.
[0141] At this point, in order to avoid situations such as blank areas, abnormal images, or inconsistencies with the overall scene caused by the failure of the first projection lamp, which would disrupt the visual continuity and immersion of the entire scene space and reduce the viewing experience for the audience, the electronic device can identify one or more second projection lamps whose projection range covers the projection range of the first projection lamp. By using one or more second projection lamps that cover the projection range of the first projection lamp, the projection loss or abnormality caused by the failure of the first projection lamp can be compensated, ensuring that the projected content can be displayed normally in that area and maintaining the integrity and consistency of the projection effect of the entire scene.
[0142] Step 706: Adjust the projection parameters and projection content of each second projection lamp according to the device hardware parameters corresponding to each second projection lamp.
[0143] The adjustment of the projection parameters and projection content corresponding to each second projection lamp in step 706 can be referred to the relevant descriptions of generating the projection parameters and projection content corresponding to each target projection lamp in steps 250 to 250 above, and will not be repeated here.
[0144] Step 708: Control each second projection lamp to project the adjusted content according to the adjusted projection parameters.
[0145] After adjusting the projection parameters and projection content corresponding to each of the second projection lamps, the electronic device can control each of the second projection lamps to project the content according to the adjusted projection parameters, so that each of the second projection lamps can replace the first projection lamp for projection.
[0146] In this embodiment, the electronic device dynamically acquires the working status of the projection lamps, enabling it to monitor the operation of each lamp in real time, anticipate performance degradation trends for timely maintenance, and quickly respond to sudden failures to prevent escalation of the impact. Furthermore, when the electronic device detects that the working status of a projection lamp does not meet projection conditions, it quickly identifies an adjacent second projection lamp whose projection range covers the faulty lamp (first projection lamp), and controls the second projection lamp to replace the faulty lamp in projection. This effectively compensates for projection gaps or anomalies, maintains the integrity and consistency of scene projection, improves the emergency handling capabilities of the electronic device, and ensures that the projection effect remains consistent even in complex and ever-changing scenes, providing viewers with a smooth and immersive viewing experience.
[0147] like Figure 8 As shown, in one embodiment, a scene projection method is provided, which can be applied to the aforementioned electronic device. The method may include steps 802 to 810.
[0148] Step 802: Receive movement data of the target tourist within the first scene space collected by the camera and / or radar.
[0149] Multiple cameras or radars can be set up in large projection scenes to monitor the dynamics of tourists in various scene spaces from multiple angles.
[0150] In some embodiments, a camera or radar may randomly select a tourist as a target tourist within a first scene space and send the movement data of the target tourist within the first scene space to an electronic device so that the electronic device can receive the movement data corresponding to the target tourist.
[0151] Optionally, the camera or radar can also target N tourists. However, in order to avoid data interference, inaccurate collection, and unstable tracking caused by focusing on multiple similar targets, the distance between these N target tourists needs to be greater than the tourist distance threshold.
[0152] The movement data corresponding to the target tourist refers to the data set that reflects the behavioral characteristics of the target tourist, such as movement trajectory, speed, direction, and dwell position within the first scene space. Movement data may include, but is not limited to, location coordinate data, movement speed data, movement direction data, and dwell time data.
[0153] Step 804: Based on the movement data corresponding to the target tourist, perform motion prediction on the water wave region in the current local water wave image to obtain the next frame of local water wave image.
[0154] In a real aquatic environment, the movement of tourists (such as stepping into the water or paddling in the water) will cause water waves to be generated and propagate. The water waves will exhibit a dynamic and continuous change process depending on factors such as the amplitude, direction, and location of the tourist's movements. When simulating water wave effects in a projection scene, in order to reproduce this realistic experience, it is necessary to predict the motion of the water wave area in the current local water wave image based on the movement data of the target tourist.
[0155] In some embodiments, the electronic device can construct a virtual projection scene and use the shallow water wave equation to simulate water waves. When a target tourist is detected stepping into the water, the location where the tourist steps into the water is taken as the initial disturbance source of the water waves, and the force of the step is converted into an external force term in the equation. The shallow water wave equation is numerically solved using the finite difference method to calculate the change in water level at each grid point. Then, a water wave image with a ripple effect is generated based on the water level, thus obtaining the local water wave image of the next frame.
[0156] Step 806: Based on the local water wave image of the next frame, determine the second water wave parameters and the second light and shadow parameters corresponding to the first scene space.
[0157] The description of generating the second water wave parameters and the second light and shadow parameters based on the local water wave image of the next frame in step 806 can be found in the description of generating the first water wave parameters and the first light and shadow parameters based on the local water wave image in step 240 of the above embodiment, and will not be repeated here.
[0158] Step 808: Based on the second water wave parameters, the second light and shadow parameters, and the device hardware parameters corresponding to the multiple target projection lights, determine the next projection content and the next projection parameters corresponding to the multiple target projection lights.
[0159] The generation of the next projection parameters and the next projection content for each target projection lamp in step 808 can be referred to the relevant descriptions in steps 250 to 260 above, and will not be repeated here.
[0160] Step 810: Control each target projection lamp to project the corresponding next projection content according to the corresponding next projection parameters.
[0161] Electronic devices can control each target projection lamp to project the corresponding next projection content according to the corresponding next projection parameters through control commands, so as to display the next frame of local water wave image in the first scene space.
[0162] In this embodiment, the electronic device receives the movement data of the target tourist to predict the water wave motion and generate images. Based on this, it dynamically determines the projection parameters and content of the projection lamp, controls the projection lamp to project in real time, restores the real water wave and tourist interaction effect, enhances the immersion, realism and interactivity of the projected scene space, and brings the audience a novel and high-quality viewing experience.
[0163] like Figure 9 As shown, in one embodiment, a scene projection method is provided, which can be applied to the aforementioned electronic device. The method may include steps 902 to 912.
[0164] Step 902: Receive a tapping signal corresponding to the second scene space. The tapping signal is sent by a tapping sensor set in a preset tapping area in the second scene space. The second scene space can be any scene space.
[0165] In some embodiments, to increase interactivity with visitors, the second scene space may be provided with a preset tapping area, which is equipped with a tapping sensor. Visitors can tap the tapping sensor to cause changes in the water ripple image of the second scene space.
[0166] Optionally, the tapping sensor can be placed inside a flexible material with a certain degree of elasticity and cushioning. This design can effectively reduce the impact on the hands of tourists when tapping, prevent tourists from being injured by forceful tapping, and also increase the comfort of tapping.
[0167] Step 904: Obtain the preset water wave image corresponding to the second scene space, and determine the third water wave parameter and the third light and shadow parameter corresponding to the second scene space based on the preset water wave image corresponding to the second scene space.
[0168] The preset water ripple image corresponding to the second scene space is different from the local water ripple image corresponding to the second scene space. The preset water ripple image corresponding to the second scene space refers to the image that is pre-set and used to show the basic shape, dynamic effect and related characteristics of the water ripples when there is tourist interaction or a specific triggering event (such as the tapping event in step 902).
[0169] The description of generating the third water wave parameter and the third light and shadow parameter based on the preset water wave image in step 904 can be referred to the description of generating the first water wave parameter and the first light and shadow parameter based on the local water wave image in step 240 of the above embodiment, and will not be repeated here.
[0170] Step 906: Based on the preset water wave image corresponding to the second scene space and the local water wave images corresponding to each third scene space adjacent to the second scene space, generate the fourth water wave parameters and the fourth light and shadow parameters corresponding to each third scene space.
[0171] In large-scale projection scenarios, the various scene spaces are not isolated but interconnected and mutually influential. When the second scene space changes from a localized water ripple image to a preset water ripple image due to interactive actions such as tapping by visitors, this change, like the propagation of water waves in real water, affects the water ripple image of the adjacent third scene space. To avoid unnatural transitions, conflicting effects, or physical logic errors in the projected water ripple images of adjacent scene spaces (such as the water waves in the second scene space suddenly disappearing at the scene boundary, unreasonable refraction or reflection, etc.), it is necessary to adjust the water ripple image of the third scene space based on the current preset water ripple image state of the second scene space and the original localized water ripple image state of the third scene space. This generates appropriate fourth water ripple parameters and fourth lighting parameters to achieve natural diffusion and transition of the water waves in the second scene space between adjacent scene spaces, maintaining the consistency and coherence of the scene's visual effects.
[0172] Step 908: Based on the third water wave parameters, the third light and shadow parameters, and the device hardware parameters corresponding to the multiple third projection lights set in the second scene space, determine the projection parameters and projection content corresponding to the multiple third projection lights respectively.
[0173] Step 910: Based on the fourth water wave parameters, the corresponding fourth light and shadow parameters, and the device hardware parameters of the multiple fourth projection lights set in each third scene space, determine the projection parameters and projection content of the multiple fourth projection lights respectively.
[0174] The descriptions of the projection parameters and projection content generated for the third projection lamp in step 908, and the descriptions of the projection parameters and projection content generated for the fourth projection lamp in step 910, can all refer to the descriptions of the projection parameters and projection content generated for each target projection lamp in steps 250 to 250 above, and will not be repeated here.
[0175] Step 912: Control each third projection lamp to project the corresponding content according to the corresponding projection parameters, and control each fourth projection lamp to project the corresponding content according to the corresponding projection parameters, so as to display the preset water wave image in the second scene space, and display the water wave image with ripple diffusion in the intersection area of the second scene space and each third scene space.
[0176] In this embodiment, the electronic device triggers water ripple changes in the scene space by receiving tapping signals from tourists, and adapts the water ripple images of adjacent scene spaces to achieve coordinated projection by each projection lamp. While triggering the display of preset water ripple images in the second scene space, a naturally diffused ripple image is presented in the intersection area of the second and third scene spaces, enhancing the interactivity between tourists and the projected scene spaces, making the transition of water ripple effects in different scene spaces natural and coherent, and bringing tourists a more realistic and interesting experience.
[0177] like Figure 10 As shown, in one embodiment, a scene projection device 1000 is provided, which can be applied to the above-mentioned electronic device. The scene projection device 1000 may include a data acquisition module 1010, an image generation module 1020, a scene parameter generation module 1030, a projection parameter generation module 1040, and a projection control module 1050.
[0178] The data acquisition module 1010 is used to acquire device data corresponding to each projection lamp. The device data includes the location information of the projection lamp and the device hardware parameters.
[0179] The data acquisition module 1010 is also used to acquire dynamic water wave images of the target and scene content corresponding to each scene space.
[0180] The image generation module 1020 is used to extract the local water wave image corresponding to the first scene space from the target dynamic water wave image based on the scene content corresponding to the first scene space, where the first scene space is any scene space.
[0181] The scene parameter generation module 1030 is used to extract features from local water wave images to obtain image features, and to determine the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space.
[0182] The projection parameter generation module 1040 is used to map multiple target projection lights onto a local water wave image based on the position information of multiple target projection lights set in the first scene space, so as to obtain the projection content corresponding to each of the multiple target projection lights.
[0183] The projection parameter generation module 1040 is also used to determine the projection parameters corresponding to the multiple target projection lamps based on the first water wave parameters, the first light and shadow parameters, and the device hardware parameters corresponding to the multiple target projection lamps.
[0184] The projection control module 1050 is used to control each target projection lamp to project the corresponding content according to the corresponding projection parameters.
[0185] In some embodiments, the scene parameter generation module 1030 is further configured to determine the water wave region in the local water wave image based on image features, and determine the first water wave parameter corresponding to the first scene space based on the image features of the water wave region; based on the ray tracing algorithm, simulate the light and shadow reflection between the scene content corresponding to the first scene space and the water wave region according to the scene content corresponding to the first scene space, so as to obtain the first light and shadow parameter corresponding to the first scene space; wherein, the water wave parameter includes at least one of wave frequency, water flow direction, ripple density, and water wave shape; the light and shadow parameter includes the shadow color and shadow range of the scene content corresponding to the scene space on the water wave.
[0186] Optionally, the scene content includes one or more scene markers. The image generation module 1020 is further configured to obtain the type and position coordinates on the horizontal plane of each scene marker contained in the first scene space; segment the target dynamic water wave image according to the position information of the first scene space in one or more scene spaces to obtain a first water wave image corresponding to the first scene space; process the first water wave image according to the type and position coordinates of each scene marker to generate a local water wave image corresponding to the first scene space, wherein the local water wave image contains water ripples centered on each scene marker.
[0187] Optionally, the scene markers include distance sensors. In some embodiments, the scene projection device 1000 further includes a receiving module. The receiving module is used to receive distance data transmitted by each scene marker, the distance data being collected by distance sensors disposed in the scene markers.
[0188] Optionally, the image generation module 1020 is also used to determine the minimum distance between each scene marker and the tourist based on the distance data corresponding to each scene marker; and to obtain a preset projection image corresponding to the target scene marker when the minimum distance corresponding to the target scene marker is less than the distance threshold; the target scene marker is any scene marker in the first scene space.
[0189] Optionally, the projection parameter generation module 1040 is also used to adjust the projection parameters and projection content of each target projection lamp according to the image parameters corresponding to the preset projection image and the device hardware parameters corresponding to the multiple target projection lamps.
[0190] Optionally, the projection control module 1050 is also used to control each target projection lamp to project the adjusted projection content according to the adjusted projection parameters.
[0191] In some embodiments, the data acquisition module 1010 is further configured to acquire the current environmental data of the first scene space.
[0192] Optionally, the image generation module 1020 is also used to perform image adjustment on the local water wave image corresponding to the first scene space based on environmental data, and construct a new dynamic water wave image of the first scene space.
[0193] Optionally, the scene parameter generation module 1030 is also used to dynamically adjust the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the new dynamic water wave image of the first scene space.
[0194] Optionally, the projection parameter generation module 1040 is also used to adjust the projection content and projection parameters corresponding to multiple target projection lights based on the first water wave parameters and the first light and shadow parameters adjusted in the first scene space.
[0195] Optionally, the projection control module 1050 is also used to control each target projection lamp to project the adjusted projection content according to the adjusted projection parameters, so that the first scene space presents a new dynamic water wave image.
[0196] In some embodiments, the receiving module is further configured to acquire the working status of each projection lamp according to a preset time interval.
[0197] Optionally, the projection parameter generation module 1040 is further configured to, when detecting that the working state corresponding to the first projection lamp does not meet the projection conditions, determine one or more second projection lamps adjacent to the first projection lamp; the first projection lamp is any projection lamp; the projection range of the one or more second projection lamps covers the projection range of the first projection lamp; and adjust the projection parameters and projection content corresponding to each second projection lamp according to the device hardware parameters corresponding to each second projection lamp.
[0198] Optionally, the projection control module 1050 is also used to control each of the second projection lamps to project the adjusted projection content according to the adjusted projection parameters.
[0199] In some embodiments, the receiving module is further configured to receive movement data of the target tourist within the first scene space collected by the camera and / or radar.
[0200] Optionally, the image generation module 1020 is also used to predict the motion of the water wave region in the current local water wave image based on the movement data corresponding to the target tourist, so as to obtain the local water wave image of the next frame.
[0201] Optionally, the scene parameter generation module 1030 is also used to determine the second water wave parameters and the second light and shadow parameters corresponding to the first scene space based on the local water wave image of the next frame.
[0202] Optionally, the projection parameter generation module 1040 is also used to determine the next projection content and the next projection parameters corresponding to the multiple target projection lamps based on the second water wave parameters, the second light and shadow parameters, and the device hardware parameters corresponding to the multiple target projection lamps respectively.
[0203] Optionally, the projection control module 1050 is also used to control each target projection lamp to project the corresponding next projection content according to the corresponding next projection parameters.
[0204] In some embodiments, the receiving module is further configured to receive a tapping signal corresponding to the second scene space, wherein the tapping signal is sent by a tapping sensor located in a preset tapping area of the second scene space; the second scene space is any scene space.
[0205] Optionally, the scene parameter generation module 1030 is further configured to acquire a preset water wave image corresponding to the second scene space, and determine the third water wave parameter and the third lighting parameter corresponding to the second scene space based on the preset water wave image corresponding to the second scene space; the preset water wave image corresponding to the second scene space is different from the local water wave image corresponding to the second scene space; it is also configured to generate the fourth water wave parameter and the fourth lighting parameter corresponding to each third scene space based on the preset water wave image corresponding to the second scene space and the local water wave images corresponding to each third scene space adjacent to the second scene space.
[0206] Optionally, the projection parameter generation module 1040 is further configured to determine the projection parameters and projection content corresponding to the multiple third projection lamps based on the third water wave parameters, the third light and shadow parameters, and the device hardware parameters corresponding to the multiple third projection lamps set in the second scene space; and to determine the projection parameters and projection content corresponding to the multiple fourth projection lamps based on the fourth water wave parameters, the corresponding fourth light and shadow parameters, and the device hardware parameters corresponding to the multiple fourth projection lamps set in each third scene space.
[0207] Optionally, the projection control module 1050 is also used to control each third projection lamp to project the corresponding projection content according to the corresponding projection parameters, and to control each fourth projection lamp to project the corresponding projection content according to the corresponding projection parameters, so as to display a preset water wave image in the second scene space, and to display a water wave image with ripple diffusion in the intersection area of the second scene space and each third scene space.
[0208] In this embodiment, the electronic device extracts local water wave images corresponding to different scene spaces and determines the corresponding water wave parameters and light and shadow parameters, so that the projection content and projection parameters of the projector lamp are deeply integrated with the scene space, so that the projector lamp presents a projection effect with aesthetic appeal and immersion. At the same time, by combining the position of the projector lamp and the hardware parameters of the projector lamp to allocate the projection content and projection parameters, it can ensure that the images of each scene space projected by multiple projector lamps are consistent and coordinated, avoiding the phenomenon of the projection effect presented by multiple scene spaces being fragmented again. Thus, multiple projector lamps can present water wave effects that match multiple scene spaces, and can also ensure smooth water wave images projected in different scene spaces.
[0209] Figure 11 This is a structural block diagram of an electronic device in one embodiment. The electronic device can be a mobile phone, tablet computer, smart wearable device, etc. Figure 11 As shown, the electronic device 1100 may include one or more of the following components: a processor 1110 and a memory 1120 coupled to the processor 1110, wherein the memory 1120 may store one or more computer programs, which may be configured to implement the methods described in the above embodiments when executed by one or more processors 1110.
[0210] This application discloses a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the methods described in the above embodiments.
[0211] This application discloses a computer program product, including a computer program, which, when executed by a processor, implements the methods described in the above embodiments.
[0212] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), etc.
[0213] It should be understood that the phrase "in one embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Those skilled in the art should also recognize that the embodiments described in the specification are optional embodiments, and the actions and modules involved are not necessarily essential to this application.
[0214] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0215] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-accessible memory. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several requests to cause a computer device (which can be a personal computer, server, or network device, specifically a processor in the computer device) to execute some or all of the steps of the methods described in the various embodiments of this application.
[0216] The foregoing has provided a detailed description of a scene projection method, apparatus, electronic device, and computer-readable storage medium disclosed in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are merely for the purpose of helping to understand the method and its core ideas. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. A scene projection method, characterized in that, Applied to electronic devices, which are communicatively connected to multiple projection lamps; The plurality of projection lights are positioned within one or more scene spaces; the method includes: Obtain device data corresponding to each of the projection lamps, wherein the device data includes the location information of the projection lamps and the device hardware parameters; Acquire dynamic water wave images of the target and the scene content corresponding to each of the aforementioned scene spaces; Based on the scene content corresponding to the first scene space, extract the local water wave image corresponding to the first scene space from the target dynamic water wave image, wherein the first scene space is any of the scene spaces. Feature extraction is performed on the local water wave image to obtain image features, and based on the image features and the scene content corresponding to the first scene space, the first water wave parameters and the first light and shadow parameters corresponding to the first scene space are determined. Based on the position information of multiple target projection lights set in the first scene space, the multiple target projection lights are mapped onto the local water wave image to obtain the projection content corresponding to the multiple target projection lights. Based on the first water wave parameters, the first light and shadow parameters, and the device hardware parameters corresponding to the plurality of target projection lights, the projection parameters corresponding to the plurality of target projection lights are determined. Each of the target projection lights is controlled to project its corresponding content according to its corresponding projection parameters.
2. The method according to claim 1, characterized in that, The step of determining the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space includes: The water wave region in the local water wave image is determined based on the image features, and the first water wave parameter corresponding to the first scene space is determined based on the image features of the water wave region. Based on the ray tracing algorithm, according to the scene content corresponding to the first scene space and the water wave area, the light and shadow reflection between the scene content corresponding to the first scene space and the water wave area is simulated to obtain the first light and shadow parameters corresponding to the first scene space. The water wave parameters include at least one of wave frequency, water flow direction, ripple density, and water wave shape; the light and shadow parameters include the shadow color and shadow range of the scene content corresponding to the scene space on the water waves.
3. The method according to claim 1, characterized in that, The scene content includes one or more scene markers; the step of extracting the local water wave image corresponding to the first scene space from the target dynamic water wave image based on the scene content corresponding to the first scene space includes: Obtain the type and position coordinates on the horizontal plane of each scene marker contained in the first scene space; Based on the location information of the first scene space in the one or more scene spaces, the target dynamic water wave image is segmented to obtain the first water wave image corresponding to the first scene space. Based on the type and location coordinates of each scene marker, the first water wave image is processed to generate a local water wave image corresponding to the first scene space. The local water wave image contains water ripples centered on each scene marker.
4. The method according to claim 3, characterized in that, The scene markers include a distance sensor, and the method further includes: Receive distance data sent by each scene marker, the distance data being collected by distance sensors installed in the scene markers; Based on the distance data corresponding to each scene landmark, determine the minimum distance between each scene landmark and the tourist; If the minimum distance to the target scene marker is less than a distance threshold, a preset projection image corresponding to the target scene marker is acquired; the target scene marker is any scene marker in the first scene space. Based on the image parameters corresponding to the preset projected image and the device hardware parameters corresponding to the multiple target projectors, adjust the projection parameters and projection content of each target projector. Control each of the target projection lights to project the adjusted content according to the adjusted projection parameters.
5. The method according to claim 1, characterized in that, The method further includes: Obtain the current environmental data of the first scene space; Based on the environmental data, the local water wave image corresponding to the first scene space is adjusted to construct a new dynamic water wave image of the first scene space. Based on the new dynamic water wave image of the first scene space, dynamically adjust the first water wave parameters and the first light and shadow parameters corresponding to the first scene space. Based on the first water wave parameters and first light and shadow parameters adjusted in the first scene space, the projection content and projection parameters corresponding to the plurality of target projectors are adjusted respectively, and each of the target projectors is controlled to project the adjusted projection content according to the adjusted projection parameters, so that the first scene space presents a new dynamic water wave image.
6. The method according to claim 1, characterized in that, The method further includes: The working status of each projection lamp is obtained according to a preset time interval; If the working state of the first projection lamp is found to be inconsistent with the projection conditions, one or more second projection lamps adjacent to the first projection lamp are identified; the first projection lamp is any projection lamp; the projection range of the one or more second projection lamps covers the projection range of the first projection lamp. Adjust the projection parameters and projection content of each second projection lamp according to the device hardware parameters of each second projection lamp; Control each of the second projection lamps to project the adjusted content according to the adjusted projection parameters.
7. The method according to claim 1, characterized in that, The method further includes: Receive movement data of the target tourist within the first scene space collected by cameras and / or radar; Based on the movement data corresponding to the target tourist, motion prediction is performed on the water wave region in the current local water wave image to obtain the next frame of local water wave image. Based on the local water wave image of the next frame, determine the second water wave parameters and the second light and shadow parameters corresponding to the first scene space; Based on the second water wave parameter, the second light and shadow parameter, and the device hardware parameters corresponding to the plurality of target projection lights, determine the next projection content and the next projection parameters corresponding to the plurality of target projection lights respectively; Each of the target projection lights is controlled to project the corresponding next projection content according to the corresponding next projection parameters.
8. The method according to claim 1, characterized in that, The method further includes: Receive a tapping signal corresponding to a second scene space, wherein the tapping signal is sent by a tapping sensor set in a preset tapping area of the second scene space; the second scene space can be any scene space; Acquire a preset water wave image corresponding to the second scene space, and determine the third water wave parameters and the third light and shadow parameters corresponding to the second scene space based on the preset water wave image corresponding to the second scene space; the preset water wave image corresponding to the second scene space is different from the local water wave image corresponding to the second scene space. Based on the preset water wave image corresponding to the second scene space and the local water wave images corresponding to each third scene space adjacent to the second scene space, generate the fourth water wave parameters and the fourth light and shadow parameters corresponding to each of the third scene spaces. Based on the third water wave parameters, the third light and shadow parameters, and the device hardware parameters corresponding to the multiple third projection lights set in the second scene space, the projection parameters and projection content corresponding to the multiple third projection lights are determined respectively. Based on the fourth water wave parameters, the fourth light and shadow parameters corresponding to each of the third scene spaces, and the device hardware parameters corresponding to the multiple fourth projection lights set in each of the third scene spaces, the projection parameters and projection content corresponding to the multiple fourth projection lights are determined respectively. Each of the third projection lights is controlled to project its corresponding content according to its corresponding projection parameters, and each of the fourth projection lights is controlled to project its corresponding content according to its corresponding projection parameters, so as to display a preset water ripple image in the second scene space, and to display a water ripple image with ripple diffusion in the intersection area of the second scene space and each of the third scene spaces.
9. A scene projection device, characterized in that, Applied to electronic devices, which are communicatively connected to multiple projection lamps; The plurality of projection lights are positioned within one or more scene spaces; the device includes: The data acquisition module is used to acquire device data corresponding to each of the projection lamps. The device data includes the location information of the projection lamp and the device hardware parameters. The data acquisition module is also used to acquire the target dynamic water wave image and the scene content corresponding to each scene space; The image generation module is used to extract a local water wave image corresponding to the first scene space from the target dynamic water wave image based on the scene content corresponding to the first scene space, wherein the first scene space is any of the scene spaces. The scene parameter generation module is used to extract features from the local water wave image to obtain image features, and determine the first water wave parameters and the first light and shadow parameters corresponding to the first scene space based on the image features and the scene content corresponding to the first scene space. The projection parameter generation module is used to map the multiple target projection lights onto the local water wave image based on the position information of the multiple target projection lights set in the first scene space, so as to obtain the projection content corresponding to the multiple target projection lights respectively. The projection parameter generation module is further configured to determine the projection parameters corresponding to the plurality of target projection lamps based on the first water wave parameters, the first light and shadow parameters, and the device hardware parameters corresponding to the plurality of target projection lamps respectively. The projection control module is used to control each of the target projection lamps to project the corresponding content according to the corresponding projection parameters.
10. An electronic device, characterized in that, The system includes a memory and a processor, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the method as described in any one of claims 1 to 8.