Interactive immersive advertisement playing method

By using motion capture technology and processor modules in advertising, the integration of advertising content and real scenarios is solved, and the problem of lack of targeted interaction methods in the existing technology is solved, which improves the sense of participation and effectiveness of advertising.

CN118982390APending Publication Date: 2024-11-19ZHENGZHOU INST OF TECH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411064740.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

It is difficult for the prior art to achieve effective interaction methods in advertising, especially how to identify and attract target pedestrians, and to effectively integrate interaction technology with advertising content, especially in non-game scenarios.

Method used

Using the display screen, motion capture camera group and processor module, the first interactive player and the second interactive player are superimposed through mask mode, the pedestrian's movements are captured in real time and their trajectory is applied to the advertising screen, and a virtual character is generated to simulate pedestrians. The action of the ad is to achieve the integration of advertising content and real scenes, attract pedestrian attention and enhance the sense of participation.

Benefits of technology

Effectively attract pedestrians' attention, enhance the sense of participation and effect of advertisements, and make pedestrians feel that they are involved in advertising animations, enhancing the attractiveness and favorability of advertisements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118982390A_ABST
    Figure CN118982390A_ABST
Patent Text Reader

Abstract

The invention provides an interactive immersive advertisement playing method, which comprises a display screen, an action capture camera group and a processor module, and is characterized in that the processor module receives a real-time picture acquired by the action capture camera group, and plays the real-time picture in the display screen through a first interactive player, according to the method, an advertisement picture is played in a display screen through a second interactive player, and meanwhile, a processor module establishes a coordinate system according to a display range of the display screen, so that the first interactive player and the second interactive player operate in the same coordinate system, and advertisement putting and playing are carried out through a fusion technology of advertisement content and a real scene; pedestrians are substituted into the advertisement playing content, the sense of participation is improved, and then the advertisement effect is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of computer technology for streaming media advertising, and more specifically, to a method for interactive and immersive advertising playback. Background Technology

[0002] With the widespread use of mobile devices such as smartphones, the intensity of offline advertising has been significantly reduced, especially for mass consumer goods such as fast-moving consumer goods and electronic products. Advertising can only be concentrated in large shopping malls.

[0003] The reason for this is that people's time is becoming increasingly fragmented, and their perception of their surroundings in the real world is declining. To improve the experience of offline advertising, it is first necessary to attract the attention of pedestrians.

[0004] Currently, businesses can only resort to hiring celebrities to shoot advertising videos and increasing the visual appeal of these videos, but these conventional methods are becoming increasingly ineffective.

[0005] With the upgrading of hardware devices, the technology for capturing and simulating human body shapes has become increasingly mature. This interactive technology also has related applications in advertising. Currently, the research and development direction of domestic universities mainly focuses on the research of precise push of interactive content, such as application number CN202311003686.5, entitled: "An interactive and precise push system and method for advertising content, used to analyze content schemes"; or improving the real-time performance of remote networking, such as application number CN202210927054.7, entitled: "A method for an advertising design system based on remote real-time interaction".

[0006] However, there is no technology to improve the interaction method. The fundamental logic of interaction technology is the collection, analysis and simulation of human posture. These technologies are widely used in the game and mobile phone industries. These manufacturers mainly rely on cameras or wearable devices to collect human posture. For the advertising industry, using cameras to capture human movements is one of the forms that can be widely promoted.

[0007] However, in advertising technology, the interaction with pedestrians is random and lacks a clear purpose. How to identify the target is one of the technical problems that needs to be solved.

[0008] Secondly, advertisements are usually displayed using animation and video. How to integrate this format with interactive technology without being limited to game scenarios is the second technical problem that needs to be solved.

[0009] How to solve the above problems is a technical issue that the advertising technology industry urgently needs to overcome. Summary of the Invention

[0010] The purpose of this invention is to address the shortcomings of existing technologies by providing an interactive and immersive advertising method that integrates advertising content with real-world scenarios. This method allows pedestrians to become immersed in the advertising content, enhancing their sense of participation and ultimately improving the advertising effect.

[0011] To achieve the above objectives, the technical solution adopted by this invention is: a method for interactive immersive advertising playback, comprising a display screen, a motion capture camera group, and a processor module. The processor module receives real-time images captured by the motion capture camera group, plays the real-time images on the display screen through a first interactive player, and plays advertising images on the display screen through a second interactive player. Simultaneously, the processor module establishes a coordinate system based on the display area of ​​the display screen, ensuring that the first and second interactive players operate within the same coordinate system. Interaction is achieved through the following steps: Step 1) The display screen is played in mask mode. In mask mode, the display screen is divided into two stacked images. The first interactive player's playback screen is set as the bottom image, which is used to display the live images captured by the motion capture camera group; the second interactive player's playback screen is the top image, which is used to display the advertisement. The top image acts as a mask image, which covers the bottom image so that the bottom image is not displayed in mask mode. Step 2) Preprocess the advertisement screen in the second interactive player. The advertisement screen is set as: an advertisement video screen with the person in the screen as the focus. In the initial state, the focus of the person moves in the coordinate system of the top layer image along a preset activity trajectory or remains stationary until the activity content is displayed and then the video is played in a loop. Step 3) The motion capture camera group captures the pedestrian's movements in the first interactive player in real time. When the target passes by, the camera collects the target's walking trajectory based on the display screen coordinate system in real time and sends the walking trajectory to the processor module. The processor module projects the walking trajectory into the second interactive player and replaces the activity trajectory of the person's focus with the activity trajectory of the target in the first interactive player to attract the pedestrian's attention. Step 4) The motion capture camera group continues to track the current target. When the target stops moving or changes direction from its original walking trajectory by more than a preset angle, and at the same time, all facial features are captured, it is determined that the pedestrian is paying attention to the advertisement and stops to interact. A countdown prompt animation is played to prompt the pedestrian to participate in the interaction. If the length of the pedestrian's walking trajectory exceeds the set value within a preset time, it is determined that the pedestrian has left and the advertisement continues to play. If the length of the pedestrian's walking trajectory does not exceed the set value within a preset time, it is determined that the interactive mode has been entered and Step 5 is executed. Step 5) Remove the mask from the focus area of ​​the top layer image to reveal the bottom layer image, blend the target image in the bottom layer image with the top layer image, and indicate that the animation replay mode is about to begin. Step 6) In animation replay mode, the motion capture camera group uploads the key frame images of the target to the processor module. The processor module identifies gender features, glasses features, hair length features and clothing color features from them. At the same time, it reads the virtual character model in the database and applies the corresponding gender features, glasses features, hair length features and clothing color features to the virtual character model to form a new virtual character. At the same time, it sends the new virtual character to the first interactive player and the second interactive player. Step 7) Remove the mask mode, play only the real-time video of the first interactive player, and cover the target pedestrian image with the virtual character texture. Make the virtual character texture perform the same action according to the collected pedestrian action characteristics. After the first interactive player plays for a set time, the mask mode returns and the video of the second interactive player starts playing. Step 8) On the screen of the second interactive player, the restriction on the virtual character's coordinate focus is lifted, and the virtual character moves according to the preset activity trajectory of the advertisement video screen to complete the playback of the complete advertisement video screen.

[0012] Preferably, in step 5), the mask removal of the focus area is accomplished by adjusting the transparency of the second interactive player in the focus area.

[0013] Preferably, the image data captured by the motion capture camera group is temporarily stored in a cache, the processor module reads the image data from the cache, and the image data in the cache is cleared periodically.

[0014] Preferably, the virtual character model in step 6) is the same model as the initial character model in the advertising video.

[0015] Preferably, after step 8) is completed, the processor module controls the first interactive player and the second interactive player to return to the initial state of steps 1) and 2).

[0016] This invention has outstanding substantive features and significant progress compared to the prior art. Specifically, this invention has the following advantages: 1. Set up a first interactive player and a second interactive player. The first interactive player is used to play live video, and the second interactive player is used to play advertising video. The two are overlaid using a mask mode. By changing the transparency of some or all parts of the second interactive player, the first interactive player and the second interactive player can be directly merged to attract the attention of pedestrians.

[0017] 2. The first interactive player and the second interactive player play the screen based on the same coordinate system. The focus coordinates of the person in the first interactive player are determined by screen recognition, and the focus of the second interactive player is determined by a preset method. The walking trajectory of the focus of the person in the first interactive player is collected and applied to the second interactive player to replace the original focus of the advertisement, so that the advertisement content can follow the change of the focus of the person in the real-time screen, which is used to attract the attention of pedestrians in the initial state.

[0018] 3. The determination of whether a person is locked onto and whether they enter the interaction mode is based on the angle change of the person's movement trajectory. If the movement trajectory does not change, it means the person is moving away quickly, and no further action is taken. If the movement trajectory changes significantly and all facial features are captured, it is determined that the pedestrian is paying attention to the advertisement and is interested. Further, an interaction prompt is initiated. After the prompt begins, the distance traveled by the movement trajectory within a preset time is observed. If the distance exceeds the preset distance, it means the pedestrian is not very interested in participating in the interaction and is preparing to leave. If the distance traveled by the movement trajectory within the preset time does not exceed the preset distance, it is determined that the pedestrian is willing to participate in the interaction, and the next interaction mode is executed.

[0019] 4. In interactive mode, the main execution mode is animation replay. The processor module collects the gender, glasses, hair length, and clothing color features of the target character. This process is only performed in this mode, avoiding resource waste from continuous processor module execution. After generating a virtual character model based on these features, it is integrated into the first and second interactive players as a texture, and played in two segments: the first segment plays a fusion of the virtual character and the real-world scene, with the virtual character simulating the realistic movements of pedestrians; the second segment merges the virtual character with the advertisement, while simultaneously unlocking the focus in the second interactive player, allowing the entire advertisement to play according to the original design. This allows pedestrians to genuinely feel involved in the advertisement animation and appear as the protagonist, enhancing the advertisement's effectiveness and positive perception. Attached Figure Description

[0020] Figure 1 This is a schematic diagram of the player principle for an interactive immersive advertising playback method according to the present invention.

[0021] Figure 2 This is a schematic diagram of the interactive immersive advertising playback method of the present invention.

[0022] Figure 3 This is an execution logic diagram of an interactive immersive advertising playback method according to the present invention. Detailed Implementation

[0023] The technical solution of the present invention will be further described in detail below through specific embodiments.

[0024] like Figures 1-3 As shown, a method for interactive immersive advertising playback includes a display screen, a motion capture camera group, and a processor module. The processor module receives real-time images captured by the motion capture camera group, plays the real-time images on the display screen through a first interactive player, and plays the advertising images on the display screen through a second interactive player. Simultaneously, the processor module establishes a coordinate system based on the display area of ​​the screen, ensuring that the first and second interactive players operate within the same coordinate system. Interaction is achieved through the following steps: Step 1) The display screen is played in mask mode. In mask mode, the display screen is divided into two stacked images. The first interactive player's playback screen is set as the bottom image, which is used to display the live images captured by the motion capture camera group. The second interactive player's playback screen is the top image, which is used to display the advertisement. The top image acts as a mask image, obscuring the bottom image so that the bottom image is not displayed in mask mode. Mask mode is similar to the layer stacking technique in image processing. The transparency of the top image determines the degree to which the bottom image is displayed and the degree of blending between the two. In the initial mode, the second interactive player's screen is always in the display state and rotates in the normal advertisement playback mode.

[0025] Step 2) Preprocess the advertising screen in the second interactive player. The advertising screen is set as an advertising video screen with the person in the screen as the focus. In the initial state, the focus of the person moves along a preset activity trajectory in the coordinate system of the top layer image or remains stationary until the activity content is displayed and then loops. The setting of the focus of the person is preset. The person has a dedicated model, which is stored in the database. The components that can be replaced in the person model include at least gender, hair length and style, clothing color and style, and whether or not glasses are worn, as well as some externally significant features, so that pedestrians can find a sense of identity.

[0026] Step 3) The motion capture camera group captures the pedestrian's movements in the first interactive player in real time. When the target passes by, the camera collects the target's walking trajectory based on the display screen coordinate system in real time and sends the walking trajectory to the processor module. The processor module projects the walking trajectory into the second interactive player and replaces the movement trajectory of the person's focus with the movement trajectory of the target in the first interactive player to attract the pedestrian's attention.

[0027] This step primarily addresses the issue of how to attract pedestrians' attention to the advertising display screen. By linking the pedestrian's walking trajectory with the trajectory of the person in the advertising screen, and ensuring that the walking trajectory of the person in the advertising screen closely matches the walking trajectory of the real person, pedestrians can notice the unusual behavior and subjectively feel that the advertising screen is tracking them, thereby increasing their attention.

[0028] Step 4) The motion capture camera group continues to track the current target. When the target stops moving or turns from the original walking trajectory by a greater than preset angle, and at the same time, captures all the features of the face, it is determined that the pedestrian has noticed the advertisement screen and stopped to interact, indicating that the pedestrian has noticed these changes and has a great interest in observing the changes.

[0029] The processor module controls the second interactive player to play a countdown prompt animation to prompt pedestrians to participate in the interaction. If the length of the pedestrian's walking trajectory exceeds the set value within a preset time, it is determined that the pedestrian has left and the advertisement continues to play. If the length of the pedestrian's walking trajectory does not exceed the set value within a preset time, it is determined that the interactive mode has been entered and step 5 is executed.

[0030] During this process, pedestrians may decide whether to participate due to various factors such as personality, time arrangement, and itinerary. However, since direct communication is not possible, the process is achieved by recognizing pedestrian actions. If a pedestrian walks beyond the preset range in a short period of time, it indicates that the pedestrian is leaving quickly, so the process will not continue and will return to step 3) for recognition. If a pedestrian walks within the preset range in a short period of time, it indicates that the pedestrian has sufficient time and interest to experience the advertising content, so the next step will be performed.

[0031] Step 5) Remove the mask from the focus area of ​​the top layer image to reveal the bottom layer image, blend the target image in the bottom layer image with the top layer image, and indicate that the animation replay mode is about to begin; the mask removal of the focus area is accomplished by adjusting the transparency of the second interactive player in the focus area.

[0032] This step is mainly used to focus on pedestrians, revealing the actual image of themselves packaged in the advertisement, dispelling their doubts and making them realize that the advertisement is indeed paying attention to them and that it is captured by a camera, thus eliminating their inner doubts and fears, and further arousing the pedestrian's interest.

[0033] Step 6) In animation replay mode, the motion capture camera group uploads the keyframe images of the target to the processor module. The processor module identifies gender features, glasses features, hair length features, and clothing color features from these images. At the same time, it reads the virtual character model from the database and applies the corresponding gender features, glasses features, hair length features, and clothing color features to the virtual character model to form a new virtual character. This new virtual character is then sent to the first interactive player and the second interactive player. The virtual character model is the same as the initial character model in the advertising video.

[0034] Step 7) Remove the mask mode, play only the live video of the first interactive player, and cover the target pedestrian image with the virtual character texture. Make the virtual character texture perform the same action according to the collected pedestrian action characteristics. After the first interactive player plays for a set time, the mask mode returns and the video of the second interactive player starts playing.

[0035] In this step, the virtual character moves synchronously with the real-world image, overlapping with it and giving pedestrians the initial feeling of being virtualized.

[0036] Step 8) On the screen of the second interactive player, the restriction on the virtual character's coordinate focus is lifted, and the virtual character moves according to the preset activity trajectory of the advertisement video screen to complete the playback of the complete advertisement video screen.

[0037] In this step, the virtual character moves from the real space to the advertising space, giving pedestrians the feeling of transitioning from the real world to virtual time. At the same time, the virtual character representing them completes the full playback of the advertising video, making pedestrians feel that they are actually participating in the advertisement. As the virtual spokesperson for the advertisement, they gain a further sense of participation, which ultimately enhances their goodwill towards the advertisement.

[0038] Since the virtual characters are created by pasting models, their actions in the original advertisement can be repeated after being pasted into a new image. This technology can be repeatedly executed based on 3D animation technology.

[0039] After execution, the processor module controls the first interactive player and the second interactive player to return to the initial state of steps 1) and 2).

[0040] Throughout the process, the image data collected by the motion capture camera group is temporarily stored in a cache. The processor module reads the image data from the cache, and the image data in the cache is cleared periodically to avoid infringing on pedestrian privacy.

[0041] Finally, it should be noted that: the preferred embodiments of this patent have been described in detail above, but this patent is not limited to the above embodiments. Within the scope of knowledge possessed by those skilled in the art, various changes can be made without departing from the spirit of this patent.

Claims

1. A method for interactive immersive advertising playback, characterized in that: The system comprises a display screen, a motion capture camera group and a processor module, wherein the processor module receives real-time images collected by the motion capture camera group, plays the real-time images on the display screen through a first interactive player, and plays advertisement images on the display screen through a second interactive player. Meanwhile, the processor module establishes a coordinate system according to the display range of the display screen, so that the first interactive player and the second interactive player operate in the same coordinate system; Interaction is accomplished by: Step 1) The display screen of the display screen is played in mask mode. In mask mode, the display screen is divided into two stacked layers of images. The playback screen of the first interactive player is set to the bottom layer image, which is used to display the live image captured by the motion capture camera group; the playback screen of the second interactive player is the top layer image, which is used to display the advertising screen, wherein the top layer image is used as a mask image to cover the bottom layer image so that the bottom layer image is not displayed in the mask mode; Step 2) preprocessing the advertisement screen in the second interactive player, wherein the advertisement screen is set to be an advertisement video screen with a person in the screen as the focus. In the initial state, the focus of the person moves along a preset activity track in the coordinate system of the top-level image or remains stationary until the activity content is displayed and then the carousel loop is played; Step 3) The motion capture camera group captures the movements of pedestrians in the first interactive player in real time. When a target is captured passing by, the walking trajectory of the target based on the display screen coordinate system is collected in real time and sent to the processor module. The processor module puts the walking trajectory into the second interactive player and replaces the activity trajectory of the focus person with the same activity trajectory of the target in the first interactive player to attract the attention of pedestrians. Step 4) The motion capture camera group continues to track the current target. When the target stops moving or turns at a greater than preset angle from the original walking trajectory, and at the same time, all the features of the human face are captured, it is determined that the pedestrian pays attention to the advertising screen and stops to interact. A countdown prompt animation is played to prompt the pedestrian to participate in the interaction. If the length of the pedestrian's walking track exceeds the set value within the preset time, the pedestrian is determined to leave and the advertising screen continues to be played. If the length of the pedestrian's walking track does not exceed the set value within the preset time, it is determined to enter the interactive mode and execute step 5); Step 5) remove the mask of the focus area of ​​the top image to reveal the bottom image, merge the target image in the bottom image with the top image, and prompt that the animation replay mode is about to be entered; Step 6) In the animation replay mode, the motion capture camera group uploads the key frame image of the target to the processor module, and the processor module identifies the gender characteristics, glasses characteristics, hair length characteristics and clothing color characteristics therefrom, and simultaneously reads the virtual character model in the database, applies the corresponding gender characteristics, glasses characteristics, hair length characteristics and clothing color characteristics to the virtual character model, forms a new virtual character, and simultaneously sends it to the first interactive player and the second interactive player; Step 7) Remove the mask mode, play only the real-time image of the first interactive player, and use the virtual character map to cover the target pedestrian image, and make the virtual character map perform the same action according to the collected pedestrian action features. After the first interactive player plays for a set time, the mask mode returns and starts playing the image of the second interactive player; Step 8) On the screen of the second interactive player, the restriction on the virtual character's coordinate focus is released, and the virtual character moves along the preset activity track of the advertisement video screen, completing the playback of the complete advertisement video screen.

2. The method for interactive immersive advertising playback according to claim 1, characterized in that: In step 5), the mask removal of the focus area is completed by adjusting the transparency of the second interactive player in the focus area.

3. The method for interactive immersive advertising playback according to claim 1 or 2, characterized in that: The image data collected by the motion capture camera group is temporarily stored based on the cache, the processor module reads the image data from the cache, and the image data in the cache is cleared periodically.

4. The method for interactive immersive advertising playback according to claim 3, characterized in that: The virtual character model in step 6) is the same as the initial character model in the advertisement video screen.

5. The method for interactive immersive advertising playback according to claim 4, characterized in that: After step 8) is executed, the processor module controls the first interactive player and the second interactive player to return to the initial states of step 1) and step 2).

Citation Information

Patent Citations

  • Advertisement design system based on remote real-time interaction

    CN115269281A

  • Interactive precise advertisement content pushing system and method

    CN116862594A