An interactive processing method and system of a digital media file

Abstract

The application discloses an interactive processing method and system of a digital media file, and relates to the technical field of human-computer interaction.The method comprises the following steps: detecting user positioning information of a target user entering a digital interaction area; generating personalized display parameters for the target user according to a coordinate position, a visual height and a visual orientation angle; selecting corresponding media content in a digital media file library based on a projection center point, a projection size and a projection angle to obtain initial projection content; and generating interactive response content by performing interactive processing based on a gesture interaction action of the target user and the initial projection content in response to the gesture interaction action.The application solves the technical problem that the lack of personalized adaptation of digital media files in the prior art leads to poor user interaction experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of human-computer interaction, and particularly relates to an interactive processing method and system of digital media files. BACKGROUND

[0002] With the rapid development of digital technology, digital media files are increasingly widely applied in fields such as exhibition halls, museums and educational institutions, providing users with rich visual experiences and interactive opportunities. Traditional digital media interactive systems usually rely on fixed display devices and predetermined display content. For example, in some digital art exhibitions, digital art is presented to all users in a unified manner, but this display method ignores the viewing needs and comfort of individual users, resulting in users being unable to obtain the best viewing experience and poor digital media interactive experience. SUMMARY

[0003] The present application provides an interactive processing method and system of digital media files, which is used to solve the technical problem that the lack of personalized adaptation of digital media files in the prior art leads to poor user interactive experience.

[0004] In view of the above problems, the present application provides an interactive processing method and system of digital media files.

[0005] In a first aspect, the present application provides an interactive processing method of digital media files, the method comprising:

[0006] detecting user positioning information of a target user entering a digital interactive area, the user positioning information comprising a coordinate position, a visual height and a visual orientation angle of the target user in the digital interactive area;

[0007] generating personalized display parameters for the target user according to the coordinate position, the visual height and the visual orientation angle, the personalized display parameters comprising a projection center point, a projection size and a projection angle;

[0008] selecting corresponding media content in a digital media file library based on the projection center point, the projection size and the projection angle to process, obtaining initial projection content, the initial projection content comprising a plurality of digital media objects;

[0009] in response to a gesture interactive action of the target user, performing interactive processing based on the gesture interactive action and the initial projection content to generate interactive response content.

[0010] In a second aspect, the present application provides an interactive processing system of digital media files, comprising:

[0011] The user location acquisition module is used to detect the user location information of the target user when entering the digital interaction area. The user location information includes the target user's coordinate position, visual height and visual orientation angle in the digital interaction area.

[0012] The display parameter generation module is used to generate personalized display parameters for the target user based on the coordinate position, the visual height and the visual orientation angle. The personalized display parameters include the projection center point, the projection size and the projection angle.

[0013] The projection content acquisition module is used to select corresponding media content from the digital media file library based on the projection center point, the projection size and the projection angle, and process it to obtain initial projection content, which includes multiple digital media objects.

[0014] The interaction response module is used to respond to the gesture interaction actions of the target user, perform interactive processing based on the gesture interaction actions and the initial projection content, and generate interactive response content.

[0015] One or more technical solutions provided in this application have at least the following technical effects or advantages:

[0016] This application proposes an interactive processing method and system for digital media files. By real-time detection of the target user's coordinate position, visual height, and visual orientation angle within the digital interactive area, and based on this, dynamically generating personalized display parameters including the projection center point, projection size, and projection angle, the system intelligently selects and processes content from a media library to form an initial projection. Finally, it responds to the user's natural gestures and generates corresponding interactive content, significantly improving the personalization level, immersive experience, and natural fluency of the digital media interaction system. Compared to traditional methods, the technical solution provided in this application significantly overcomes the problems of viewing angle deviation, content distortion, and stiff interaction caused by fixed projection modes. It achieves the technical effect of enabling the digital media interaction system to dynamically perceive the user's state, intelligently adapt the displayed content, and accurately respond to natural interaction intentions, providing users with a highly personalized, immersive, and smooth digital media interactive experience. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1This is a flowchart illustrating an interactive processing method for digital media files provided in an embodiment of this application.

[0019] Figure 2 This is a schematic diagram of the structure of an interactive processing system for digital media files provided in an embodiment of this application.

[0020] The components represented by each number in the attached diagram are explained below:

[0021] User location acquisition module 100, display parameter generation module 200, projection content acquisition module 300, and interactive response module 400. Detailed Implementation

[0022] This application provides an interactive processing method and system for digital media files, which addresses the technical problem of poor user interaction experience caused by the lack of personalized adaptation of digital media files in the prior art.

[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0024] It should be noted that the terms "comprising" and "having" are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or modules that are not explicitly listed or that are inherent to these processes, methods, products, or devices.

[0025] Example 1, as Figure 1 As shown, this application provides an interactive processing method for digital media files, wherein the method includes:

[0026] S10: Detect the user positioning information of the target user entering the digital interaction area. The user positioning information includes the target user's coordinate position, visual height, and visual orientation angle in the digital interaction area.

[0027] Traditional digital media display methods can only detect the user's two-dimensional position, but cannot obtain key three-dimensional spatial information such as the user's visual height and head orientation. This makes it impossible for the system to truly understand the user's actual viewing angle, resulting in a lack of accurate data basis for subsequent projection adjustments. The final content may deviate from the user's optimal viewing angle, resulting in a poor viewing experience.

[0028] Step S10 in the method provided in this application embodiment includes:

[0029] A three-dimensional coordinate system for the digital interactive area is established with the central projection device of the digital interactive area as the center point, the preset response distance as the radius, and the preset vertical detection range as the height.

[0030] The position information of the target user in the three-dimensional coordinate system is detected to obtain the coordinate position of the target user in the digital interaction area;

[0031] Detect the head height position of the target user, and determine the visual height of the target user based on the head height position;

[0032] The vertical orientation of the target user's head is detected, and the visual orientation angle of the target user is determined based on the vertical orientation of the head;

[0033] The target user's coordinates, visual height, and visual orientation angle within the digital interaction area are used as the user's positioning information.

[0034] In this embodiment of the application, the user location information of the target user entering the digital interaction area is detected. The user location information includes the target user's coordinate position, visual height, and visual orientation angle in the digital interaction area.

[0035] Specifically, firstly, a three-dimensional coordinate system for the digital interaction area is established, with the central projection device of the digital interaction area as the center point (0,0,0), the preset response distance as the radius, and the preset vertical detection range as the height. The preset response distance is the horizontal range within which the central projection device can respond to user interactions, obtained based on its own response performance, for example, 5 meters; the preset vertical detection range is the horizontal distance within which the central projection device can respond to user interactions, obtained based on its own response performance, for example, 2.5 meters.

[0036] Furthermore, the target user's position information in the three-dimensional coordinate system is detected to obtain the target user's coordinate position in the digital interaction area. For example, the position of the target user's torso in space is captured in real time by a spatial tracking locator. This position is mapped to the established three-dimensional coordinate system, and the X-axis and Y-axis coordinates of the user's current position relative to the origin of the coordinate system are calculated, for example, obtaining a coordinate value such as (1.3, 1.5), which is used as the coordinate position.

[0037] Furthermore, the target user's head height position is detected, and the target user's visual height is determined based on the head height position. For example, image detection is performed using a camera to identify the key node on the target user's head, namely the position between the eyes, and the Y-axis coordinate value of this node in a three-dimensional coordinate system is obtained. This obtained Y-axis coordinate value of the head node is directly determined as the target user's visual height. For example, if the detected Y-coordinate of the user's head node is 1.65 meters, then the target user's visual height is 1.65 meters.

[0038] Furthermore, the vertical orientation of the target user's head is detected, and the target user's visual orientation angle is determined based on the vertical orientation of the head. For example, a tilt angle sensor is used to obtain the tilt angle of the user's head relative to the horizontal plane. With horizontal forward as the 0-degree line of sight reference, tilting the head upwards is a positive angle, and tilting the head downwards is a negative angle. For example, if the user's head is tilted 30 degrees relative to the horizontal plane, then the target user's visual orientation angle is 30 degrees.

[0039] The target user's coordinate position, visual height, and visual orientation angle in the digital interaction area are used as user positioning information. For example, a user positioning information of (1.3, 1.5, 1.65, 30°) indicates that the user's torso is at (1.3, 1.5), the head height is 1.65 meters, and the visual orientation angle is 30 degrees.

[0040] By establishing a three-dimensional coordinate system for the digital interactive area and accurately detecting the target user's coordinate position, visual height, and visual orientation angle within this system, the core technological effect of providing high-precision, multi-dimensional user spatial state data for the entire interactive system is achieved. Obtaining the coordinate position determines the relative planar relationship between the user and the projection device; detecting the visual height determines the user's vertical viewing level, ensuring the content is neither too high nor too low; and identifying the visual orientation angle determines the angle between the user's line of sight and the projection surface, laying a reliable data foundation for subsequently generating truly personalized display parameters.

[0041] S20: Generate personalized display parameters for the target user based on the coordinate position, the visual height, and the visual orientation angle. The personalized display parameters include the projection center point, the projection size, and the projection angle.

[0042] After obtaining user location information, how to transform this spatial data into personalized display parameters that can guide content presentation is a pressing technical problem that needs to be solved. If the projection center point cannot be obtained based on the user's position and viewing angle, the core area of ​​the content may not coincide with the user's line of sight; if the projection size cannot be dynamically adjusted according to the viewing distance, the user may see an image that is disproportionate or lacks detail; if the projection angle cannot be compensated according to the visual orientation, visual deviations similar to image tilting or trapezoidal distortion will occur.

[0043] Step S20 in the method provided in this application embodiment includes:

[0044] Connect the coordinates of the target user with the position of the central projection device to determine the direction of the connecting line and the user's viewing distance;

[0045] A horizontal viewing point is obtained by extending a preset viewing distance from the target user's coordinate position along the connecting line towards the central projection device;

[0046] The vertical viewing point is determined based on the visual height, and the reference projection point is determined based on the horizontal viewing point and the vertical viewing point;

[0047] Based on the visual orientation angle, the reference projection point is corrected by arc to obtain the projection center point;

[0048] The projection size is obtained by looking up the size in the distance-size mapping table based on the user's viewing distance;

[0049] The projection angle is determined based on the visual orientation angle, wherein the projection angle and the visual orientation angle are complementary.

[0050] The projection center point, the projection size, and the projection angle are used as personalized display parameters for the target user.

[0051] In this embodiment of the application, personalized display parameters for the target user are generated based on the coordinate position, visual height, and visual orientation angle. The personalized display parameters include the projection center point, projection size, and projection angle.

[0052] Specifically, firstly, the coordinates of the target user are connected to the position of the central projection device to determine the direction of the connecting line and the user's viewing distance. For example, if the target user's coordinates are (1.3, 1.5) and the central projection device's position is (0, 0), then the vector (-1.3, -1.5) pointing from the user's position to the central projection device's position is obtained as the direction of the connecting line. The magnitude of this vector is then calculated as the user's viewing distance; for example, if the magnitude of (-1.3, -1.5) is 1.98, then the user's viewing distance is 1.98.

[0053] Furthermore, a preset viewing distance is extended from the target user's coordinate position along the connecting line towards the central projection device to obtain the horizontal viewing point. Specifically, the preset viewing distance is a pre-set distance that maximizes the user's viewing experience; for example, the preset viewing distance is set to 1.5 meters. Extending the predicted viewing distance from the target user's coordinate position along the connecting line towards the central projection device yields the horizontal viewing point. For example, if the connecting line direction is (-1.3, -1.5) and the preset viewing distance is 1.5 meters, then the horizontal viewing point is (0.32, 0.37).

[0054] Furthermore, a vertical viewing point is determined based on the visual height, and a reference projection point is determined based on both the horizontal and vertical viewing points. For example, the visual height is determined as the vertical viewing point; if the target user's visual height is 1.65, then 1.65 is determined as the vertical viewing point. The reference projection point is then determined based on the horizontal and vertical viewing points. For example, if the horizontal viewing point is (0.32, 0.37) and the vertical viewing point is 1.65, then the reference projection point is (0.32, 0.37, 1.65).

[0055] Furthermore, the reference projection point is corrected by an arc based on the visual orientation angle to obtain the projection center point. Specifically, with the central projection device as the center and the preset viewing distance as the radius, the reference projection point is adjusted vertically along an arc trajectory according to the visual orientation angle: when the visual orientation angle is positive (looking up), the reference projection point is adjusted upwards along the arc; when it is negative (looking down), it is adjusted downwards. The vertical offset can be calculated using the formula: Vertical offset = Preset viewing distance × sin(visual orientation angle). For example, if the visual orientation angle is 30 degrees and the preset viewing distance is 1.5 meters, then the vertical offset = 1.5 × sin(30°) = 0.75 meters. Adding this vertical offset to the Z-coordinate of the reference projection point yields the corrected Z-coordinate; that is, when the Z-coordinate of the reference projection point is 1.65, the corrected Z-coordinate = 1.65 + 0.75 = 2.4 meters. The corrected projection center point is (0.32, 0.37, 2.4). The projection center point after arc correction is more in line with the arc trajectory of the user's natural line of sight when looking up or down, which has the effect of improving the user's viewing experience.

[0056] Based on the user's viewing distance, the size is looked up in the distance-size mapping table to obtain the projection size. The distance-size mapping table is a pre-set mapping table that records the viewing distance and the corresponding optimal projection size. For example, if the user's viewing distance is 1.98, the size is found to be 4 meters × 3 meters in the distance-size mapping table.

[0057] The projection angle is determined based on the visual orientation angle, where the projection angle and the visual orientation angle are complementary. For example, the projection angle is calculated based on the rule that the projection angle and the visual orientation angle are complementary, i.e., their values ​​are equal but their directions are opposite. For instance, if the user's visual orientation angle is 30 degrees upward, then the projection angle is 30 degrees downward, or -30 degrees. The obtained projection angle ensures that the projection surface is approximately perpendicular to the user's line of sight, allowing the user to see a frontal effect without geometric distortion.

[0058] The projection center point, projection size, and projection angle are used as personalized display parameters for the target user. For example, the personalized display parameters for the target user can be a projection center point of (0.32, 0.37, 2.4), a projection size of 4 meters × 3 meters, and a projection angle of -30 degrees.

[0059] Through a series of algorithms, the system comprehensively processes coordinate position, visual height, and visual orientation angle to generate personalized display parameters, including the projection center point, projection size, and projection angle. This achieves the technical effect of transforming user spatial posture data into specific, executable display instructions. By determining the direction of the connecting lines, the user's viewing distance, and performing arc correction, the resulting projection center point ensures that the core visual area of ​​the content is accurately aligned with the user's line of sight. By mapping the projection size based on the viewing distance, the system guarantees that the displayed content is presented at the most suitable visual proportion for the current distance, regardless of the user's distance. By establishing a complementary relationship between the projection angle and the visual orientation angle, the system effectively compensates for image geometric distortion that may be caused by the user's viewing angle deviation, ensuring the visual uprightness of the displayed content.

[0060] S30: Based on the projection center point, the projection size and the projection angle, select the corresponding media content in the digital media file library for processing to obtain the initial projection content, which includes multiple digital media objects.

[0061] Traditional digital media systems often have fixed content library access and layout, making it impossible to dynamically adapt to real-time changes in parameters such as projection size and projection center point. This can lead to problems such as sparse or crowded arrangement, truncated or off-center key elements, or blurry content due to a mismatch between content resolution and projection size, even if the projection parameters have been optimized for the user.

[0062] Step S30 in the method provided in this application embodiment includes:

[0063] The preset grid layout is determined based on the projection size, and the quantity requirement of digital media objects is determined based on the preset grid layout;

[0064] Based on the quantity requirements, multiple digital media objects are randomly selected from the digital media file library, including three-dimensional media models and two-dimensional media images;

[0065] Obtain the first resolution data for each digital media object, and use it as the initial display data for multiple digital media objects;

[0066] Based on the preset grid layout and the initial display data of multiple digital media objects, the basic projection content is obtained;

[0067] The position and angle of the basic projection content are adjusted based on the projection center point and the projection angle to obtain the initial projection content.

[0068] In this embodiment, the corresponding media content is selected from the digital media file library based on the projection center point, projection size and projection angle to obtain the initial projection content, which includes multiple digital media objects.

[0069] Specifically, first, a preset grid layout is determined based on the projection size, and then the required quantity of digital media is determined based on this preset grid layout. For example, if the projection size is 4 meters × 3 meters, the preset grid layout (4×3, or 3 rows and 4 columns) is obtained by searching the projection size-grid layout mapping table. This mapping table pre-defines recommended grid layouts corresponding to different projection size ranges. Based on the preset grid layout, the required quantity of digital media is determined; for example, a 4×3 grid layout requires 4×3 = 12 pieces of digital media content. For example, the digital media content can be a three-dimensional art model or a two-dimensional image artwork.

[0070] Furthermore, based on quantity requirements, multiple digital media objects are randomly selected from the digital media file library. These digital media objects include 3D media models such as sculptures and object models in OBJ or FBX format, and 2D media images such as paintings and photographs in JPG or PNG format. Using a random number generator, 12 digital media objects are randomly selected from the digital media file library without repetition.

[0071] Furthermore, the first resolution data of each digital media object is obtained as the initial display data for multiple digital media objects. Each digital media object, upon being added to the database, pre-generates and stores display data for three resolutions: high-resolution data, medium-resolution data, and low-resolution data. The first resolution data can be the medium-resolution version. Twelve randomly selected digital media objects are traversed, and their pre-defined first resolution data is directly read from their associated data files. For example, for a 3D media model, its first resolution data might be a low-precision model containing 2500 polygons; for a planar media image, its first resolution data might be an image with a resolution of 800×600 pixels.

[0072] Furthermore, based on a preset grid layout and initial display data of multiple digital media objects, the basic projection content is obtained. Specifically, based on a defined preset grid layout (e.g., a 4×3 grid), multiple randomly selected digital media objects (e.g., 12 objects), and their corresponding initial display data (e.g., 5 low-resolution models and 7 800×600 resolution images), each digital media object is placed within a cell of the grid according to its first resolution data, forming a complete projection image, which serves as the basic projection content.

[0073] Furthermore, based on the projection center point and projection angle, the position and angle of the basic projection content are adjusted to obtain the initial projection content. For example, the basic projection content is translated to the projection center point (0.32, 0.37, 2.4) and adjusted according to the projection angle, such as tilting it downwards by 30 degrees, to obtain the initial projection content optimized and calibrated according to the target user's personalized display parameters.

[0074] By determining the grid layout and content quantity requirements based on the projection size, and adjusting the position and angle of the selected content based on the projection center point and projection angle, a technical effect is achieved that makes the media content itself and its initial presentation state highly adaptive to the personalized display environment. By dynamically selecting an appropriate number of digital media objects from the media library and initially arranging them according to an optimized grid, basic projection content is formed. Furthermore, by adjusting the projection center point and angle, it is ensured that the digital media content is accurately placed in the optimal display position calculated for the user, ensuring that the final initial projection content perfectly adapts to the user's viewing position and angle, laying a solid foundation for subsequent interactive operations.

[0075] S40: In response to the target user's gesture interaction, perform interactive processing based on the gesture interaction and the initial projection content to generate interactive response content.

[0076] Existing technologies generally suffer from a lack of diverse response methods at the interaction level, severely impacting the depth and smoothness of the user experience. For example, relying on physical controllers or simple predefined actions fails to accurately identify and understand users' natural and diverse gesture intentions, leading to frequent interaction delays, misidentifications, or functional limitations when users engage in in-depth interactions with content of interest.

[0077] Step S40 in the method provided in this application embodiment includes:

[0078] Detect the target user's gesture interaction actions, including swipe gestures, selection gestures, and zoom gestures;

[0079] When a swipe gesture is detected, the direction of the swipe gesture is identified, and multiple updated digital media objects are re-determined from the digital media file library based on the direction of the swipe gesture. The first resolution data of the multiple updated digital media objects is obtained, and interactive response content is generated.

[0080] When a selection gesture is detected, the digital media object pointed to by the selection gesture is identified, the target digital media object is determined, the second resolution data of the target digital media object is obtained, and interactive response content is generated.

[0081] The process includes identifying the digital media object pointed to by the selection gesture, determining the target digital media object, obtaining the second resolution data of the target digital media object, and generating interactive response content, including:

[0082] Detect the pointing position of the selection gesture in the projected content;

[0083] The corresponding grid cell is determined based on the pointing position, and the digital media object in the grid cell is identified. The identified digital media object is then identified as the target digital media object.

[0084] Obtain the second resolution data of the target digital media object from the digital media file library;

[0085] The target digital media object is processed based on the second resolution data, and the target digital media object is switched to a standalone display mode;

[0086] The target digital media object, displayed separately, serves as the interactive response content;

[0087] When a zoom-in gesture is detected, the local area pointed to by the zoom-in gesture in the target digital media object is identified, the target local area is determined, the third resolution data of the target local area is obtained, and interactive response content is generated.

[0088] Specifically, the process involves identifying the local area pointed to by the zoom-in gesture within the target digital media object, determining the target local area, acquiring the third resolution data of the target local area, and generating interactive response content, including:

[0089] Detect the pointing coordinates and gesture amplitude of the magnification gesture;

[0090] The center position of the corresponding local area in the target digital media object is determined according to the pointing coordinates, and the magnification of the local area is determined based on the gesture amplitude;

[0091] The target local area is determined based on the center position, the magnification, and the projection size;

[0092] Obtain the third resolution data of the target digital media object from the digital media file library;

[0093] The third resolution data of the target digital media object is obtained by extracting the third resolution data of the target local area based on the target local area;

[0094] The target local area is magnified based on the third resolution data of the target local area, and the target local area is switched to magnified display mode;

[0095] The magnified local area of ​​the target will be used as the interactive response content.

[0096] In this embodiment of the application, in response to the gesture interaction of the target user, interactive processing is performed based on the gesture interaction and the initial projection content to generate interactive response content.

[0097] Specifically, firstly, the system detects the target user's hand gestures, which include swiping gestures, selection gestures, and zooming gestures. For example, a gesture recognition sensor captures the user's hand movement trajectory and posture in real time, and a pre-defined gesture recognition algorithm, such as a skeletal tracking algorithm, is used to analyze and classify the gesture types: a swiping gesture is defined as continuous hand movement in the horizontal or vertical direction; a selection gesture is defined as a brief pointing motion of the hand; and a zooming gesture is defined as a hand separation or pinching motion.

[0098] Furthermore, when a swipe gesture is detected, the direction of the swipe gesture is identified. Based on the direction of the swipe gesture, multiple updated digital media objects are re-determined from the digital media file library, and the first resolution data of the multiple updated digital media objects is obtained to generate interactive response content. For example, if the target user's gesture is detected as a right swipe, multiple updated digital media objects are randomly determined from the digital media file library, such as 12 updated digital media objects re-determined based on the grid layout, and the first resolution data of the multiple updated digital media objects is obtained to generate interactive response content. If the user's gesture is a right swipe, the digital media objects are transformed into updated digital media objects from left to right.

[0099] When a selection gesture is detected, the digital media object pointed to by the selection gesture is identified, the target digital media object is determined, the second resolution data of the target digital media object is obtained, and interactive response content is generated.

[0100] Specifically, based on a gesture recognition sensor, the pointing position of the selection gesture within the projected content is detected. A coordinate system is established with the lower left corner of the projected content as the origin, the horizontal length as the X-axis, and the vertical width as the Y-axis. The pointing position is the coordinate point where the gesture points within the projected content.

[0101] Furthermore, based on the pointing position, the corresponding grid cell is determined, that is, the grid cell where the pointing position coordinate point is located is determined, and the digital media object in the grid cell is identified. The identified digital media object, such as a digital media image with a first resolution, is identified as the target digital media object.

[0102] Obtain the second resolution data of the target digital media object from the digital media file library. For example, if the first resolution of the target digital media image is 800×600, the second resolution data is 2400×1800.

[0103] Based on the second resolution data, the target digital media object is processed and switched to a separate display mode, that is, other projected content is canceled and only the target digital media object displayed with the second resolution data is retained.

[0104] The target digital media object is displayed separately as the interactive response content, responding to the user's selection gesture.

[0105] When a zoom-in gesture is detected, the local area pointed to by the zoom-in gesture in the target digital media object is identified, the target local area is determined, the third resolution data of the target local area is obtained, and interactive response content is generated.

[0106] Specifically, a gesture recognition sensor is used to detect the pointing coordinates and amplitude of the magnified gesture.

[0107] The center position of a corresponding local area is determined within the target digital media object based on the pointing coordinates, and the magnification factor of the local area is determined based on the gesture amplitude. Specifically, the detected pointing coordinates, such as (2.5, 1.2), are used as the center position of the local area. Further, through a preset mapping relationship, the gesture amplitude, such as magnifying by 0.25 meters with both hands, is converted into a magnification factor. For example, the magnification factor = minimum magnification factor + gesture amplitude × scaling factor. If the minimum magnification factor is set to 1 and the scaling factor is set to 2, then when magnifying by 0.25 meters with both hands, the magnification factor = 1 + 0.25 × 2 = 1.5 times.

[0108] Based on the center location, magnification, and projection size, the local area of ​​the target is determined. For example, if the center location is (2.5, 1.2), the magnification is 1.5 times, and the projection size is 4 meters × 3 meters, then the local area of ​​the target can be a 0.4 meter × 0.3 meter area centered at (2.5, 1.2), that is, the local area of ​​the target is a rectangular area with vertex coordinates of (2.3, 1.05), (2.7, 1.05), (2.7, 1.35), and (2.3, 1.35).

[0109] Retrieve the third resolution data of the target digital media object from the digital media file library. The third resolution is a higher resolution with higher clarity; for example, the third resolution data of the target digital media object is 4000×3000.

[0110] Based on the target local region, the third-resolution data of the target digital media object is cropped to obtain the third-resolution data of the target local region. Specifically, the target local region of the target digital media image at third resolution is cropped to obtain the third-resolution data of the target local region.

[0111] Based on the third-resolution data of the target local area, the target local area is magnified and displayed, and the target local area is switched to magnified display mode, for example, the entire projection content is changed to the third-resolution data of the target local area.

[0112] Use the magnified local area of ​​the target as the interactive response content.

[0113] By detecting and recognizing diverse gestural interactions of target users, such as swipe gestures, selection gestures, and zoom gestures, and processing these gestures in real time with the initial projected content to generate corresponding interactive responses, the system achieves a natural and precise interactive effect. When a swipe gesture is recognized, the system understands the user's intention to browse more content and updates the content set to maintain the continuity of the interaction. When a selection gesture is recognized, the system accurately locates the specific object the user is pointing to and switches it to a separate display mode, responding to the user's need for in-depth understanding. When a zoom gesture is recognized, the system further satisfies the user's need to explore details by magnifying a specified local area, fulfilling the user's desire for in-depth understanding. Through a resolution-on-demand loading mechanism, high-resolution data is only provided when the audience truly needs it, significantly reducing network transmission pressure and storage space requirements. This ensures that multiple users can use the device simultaneously even under limited hardware conditions, improving device efficiency.

[0114] Example 2, as Figure 2 As shown, based on the same inventive concept as the interactive processing method for digital media files provided in Embodiment 1, this embodiment of the invention also provides an interactive processing system for digital media files, including:

[0115] User location acquisition module 100 is used to detect user location information of a target user entering a digital interaction area. The user location information includes the target user's coordinate position, visual height, and visual orientation angle in the digital interaction area.

[0116] The display parameter generation module 200 is used to generate personalized display parameters for the target user based on the coordinate position, the visual height and the visual orientation angle. The personalized display parameters include the projection center point, the projection size and the projection angle.

[0117] The projection content acquisition module 300 is used to select corresponding media content from the digital media file library based on the projection center point, the projection size and the projection angle to process and obtain initial projection content, which includes multiple digital media objects.

[0118] The interaction response module 400 is used to respond to the gesture interaction action of the target user, perform interaction processing based on the gesture interaction action and the initial projection content, and generate interaction response content.

[0119] In one embodiment, the user location acquisition module 100 is further configured to:

[0120] A three-dimensional coordinate system for the digital interactive area is established with the central projection device of the digital interactive area as the center point, the preset response distance as the radius, and the preset vertical detection range as the height.

[0121] The position information of the target user in the three-dimensional coordinate system is detected to obtain the coordinate position of the target user in the digital interaction area;

[0122] Detect the head height position of the target user, and determine the visual height of the target user based on the head height position;

[0123] The vertical orientation of the target user's head is detected, and the visual orientation angle of the target user is determined based on the vertical orientation of the head;

[0124] The target user's coordinates, visual height, and visual orientation angle within the digital interaction area are used as the user's positioning information.

[0125] In one embodiment, the display parameter generation module 200 is further configured to:

[0126] Connect the coordinates of the target user with the position of the central projection device to determine the direction of the connecting line and the user's viewing distance;

[0127] A horizontal viewing point is obtained by extending a preset viewing distance from the target user's coordinate position along the connecting line towards the central projection device;

[0128] The vertical viewing point is determined based on the visual height, and the reference projection point is determined based on the horizontal viewing point and the vertical viewing point;

[0129] Based on the visual orientation angle, the reference projection point is corrected by arc to obtain the projection center point;

[0130] The projection size is obtained by looking up the size in the distance-size mapping table based on the user's viewing distance;

[0131] The projection angle is determined based on the visual orientation angle, wherein the projection angle and the visual orientation angle are complementary.

[0132] The projection center point, the projection size, and the projection angle are used as personalized display parameters for the target user.

[0133] In one embodiment, the projection content acquisition module 300 is further configured to:

[0134] The preset grid layout is determined based on the projection size, and the quantity requirement of digital media objects is determined based on the preset grid layout;

[0135] Based on the quantity requirements, multiple digital media objects are randomly selected from the digital media file library, including three-dimensional media models and two-dimensional media images;

[0136] Obtain the first resolution data for each digital media object, and use it as the initial display data for multiple digital media objects;

[0137] Based on the preset grid layout and the initial display data of multiple digital media objects, the basic projection content is obtained;

[0138] The position and angle of the basic projection content are adjusted based on the projection center point and the projection angle to obtain the initial projection content.

[0139] In one embodiment, the interactive response module 400 is further configured to:

[0140] Detect the target user's gesture interaction actions, including swipe gestures, selection gestures, and zoom gestures;

[0141] When a swipe gesture is detected, the direction of the swipe gesture is identified, and multiple updated digital media objects are re-determined from the digital media file library based on the direction of the swipe gesture. The first resolution data of the multiple updated digital media objects is obtained, and interactive response content is generated.

[0142] When a selection gesture is detected, the digital media object pointed to by the selection gesture is identified, the target digital media object is determined, the second resolution data of the target digital media object is obtained, and interactive response content is generated.

[0143] The process includes identifying the digital media object pointed to by the selection gesture, determining the target digital media object, obtaining the second resolution data of the target digital media object, and generating interactive response content, including:

[0144] Detect the pointing position of the selection gesture in the projected content;

[0145] The corresponding grid cell is determined based on the pointing position, and the digital media object in the grid cell is identified. The identified digital media object is then identified as the target digital media object.

[0146] Obtain the second resolution data of the target digital media object from the digital media file library;

[0147] The target digital media object is processed based on the second resolution data, and the target digital media object is switched to a standalone display mode;

[0148] The target digital media object, displayed separately, serves as the interactive response content;

[0149] When a zoom-in gesture is detected, the local area pointed to by the zoom-in gesture in the target digital media object is identified, the target local area is determined, the third resolution data of the target local area is obtained, and interactive response content is generated.

[0150] Specifically, the process involves identifying the local area pointed to by the zoom-in gesture within the target digital media object, determining the target local area, acquiring the third resolution data of the target local area, and generating interactive response content, including:

[0151] Detect the pointing coordinates and gesture amplitude of the magnification gesture;

[0152] The center position of the corresponding local area in the target digital media object is determined according to the pointing coordinates, and the magnification of the local area is determined based on the gesture amplitude;

[0153] The target local area is determined based on the center position, the magnification, and the projection size;

[0154] Obtain the third resolution data of the target digital media object from the digital media file library;

[0155] The third resolution data of the target digital media object is obtained by extracting the third resolution data of the target local area based on the target local area;

[0156] The target local area is magnified based on the third resolution data of the target local area, and the target local area is switched to magnified display mode;

[0157] The magnified local area of ​​the target will be used as the interactive response content.

[0158] In summary, the embodiments of this application have at least the following technical effects:

[0159] This application proposes an interactive processing method and system for digital media files. By detecting the target user's coordinate position, visual height, and visual orientation angle in real time within the digital interactive area, and dynamically generating personalized display parameters including the projection center point, projection size, and projection angle, the system intelligently selects and processes content from the media library based on these parameters to form an initial projection. Finally, it generates corresponding interactive response content in response to the user's natural gestures, significantly improving the personalization level of the digital media interactive system, the immersive experience of the user, and the natural fluency of the interaction. Specifically, this application establishes a three-dimensional coordinate system and accurately obtains the user's visual height and orientation, ensuring that the generated projection center point and projection angle are optimally aligned with the user's line of sight. This effectively eliminates visual distortion and content obstruction caused by improper viewing position and angle, allowing the user to obtain the best frontal viewing angle tailored to them. By dynamically adjusting the projection size according to the user's viewing distance, it ensures that the displayed content has appropriate visual proportions and clarity at different distances, enhancing viewing comfort. By combining personalized parameters with the selection and processing of media library content, it ensures that the initial projection content is optimized for the current user state in terms of layout and presentation, laying a good foundation for subsequent interactions. Furthermore, by introducing precise recognition and response to gesture interactions such as swiping, selecting, and zooming, users can deeply interact with the projection content in the most intuitive and natural way, performing operations such as switching content, focusing on specific objects, or exploring digital media details. Through an on-demand loading mechanism, high-resolution data is only provided when the user truly needs it, significantly reducing network transmission pressure and storage space requirements. Meanwhile, the progressive loading strategy with three resolution levels ensures that multiple users can use the device simultaneously under limited hardware conditions, improving device efficiency. Compared to traditional methods, the technical solution provided in this application significantly overcomes problems such as viewing angle deviation, content distortion, and stiff interaction caused by fixed projection modes. It achieves the technical effect of enabling digital media interaction systems to dynamically perceive user status, intelligently adapt display content, and accurately respond to natural interaction intentions, providing users with a highly personalized, immersive, and smooth digital media interaction experience.

[0160] It should be noted that the order of the embodiments described above is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, the above description focuses on specific embodiments of this specification. Additionally, the processes depicted in the accompanying drawings do not necessarily require a specific or sequential order to achieve the desired results. In some implementations, multitasking and parallel processing are possible or may be advantageous.

[0161] The above description is only a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

[0162] This specification and accompanying drawings are merely illustrative examples of this application and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from its scope. Therefore, if such modifications and modifications fall within the scope of this application and its equivalents, this application intends to include such modifications and modifications.

Claims

1. A method for interactive processing of digital media files, characterized in that, The method includes: The system detects the user location information of a target user entering a digital interaction area. The user location information includes the target user's coordinate position, visual height, and visual orientation angle in the digital interaction area. Personalized display parameters for the target user are generated based on the coordinate position, the visual height, and the visual orientation angle. The personalized display parameters include the projection center point, the projection size, and the projection angle. Based on the projection center point, the projection size, and the projection angle, corresponding media content is selected from the digital media file library and processed to obtain initial projection content. The initial projection content includes multiple digital media objects, including: The preset grid layout is determined based on the projection size, and the quantity requirement of digital media objects is determined based on the preset grid layout; Based on the quantity requirements, multiple digital media objects are randomly selected from the digital media file library, including three-dimensional media models and two-dimensional media images; Obtain the first resolution data for each digital media object, and use it as the initial display data for multiple digital media objects; Based on the preset grid layout and the initial display data of multiple digital media objects, the basic projection content is obtained; The position and angle of the basic projection content are adjusted based on the projection center point and the projection angle to obtain the initial projection content; In response to the target user's gesture interaction, interactive processing is performed based on the gesture interaction and the initial projected content to generate interactive response content.

2. The method according to claim 1, characterized in that, The system detects the user's location information when the target user enters the digital interaction area. This user location information includes the target user's coordinates, visual height, and visual orientation angle within the digital interaction area. A three-dimensional coordinate system for the digital interactive area is established with the central projection device of the digital interactive area as the center point, the preset response distance as the radius, and the preset vertical detection range as the height. The position information of the target user in the three-dimensional coordinate system is detected to obtain the coordinate position of the target user in the digital interaction area; Detect the head height position of the target user, and determine the visual height of the target user based on the head height position; The vertical orientation of the target user's head is detected, and the visual orientation angle of the target user is determined based on the vertical orientation of the head; The target user's coordinates, visual height, and visual orientation angle within the digital interaction area are used as the user's positioning information.

3. The method according to claim 2, characterized in that, Personalized display parameters for the target user are generated based on the coordinate position, the visual height, and the visual orientation angle. These personalized display parameters include the projection center point, projection size, and projection angle. Connect the coordinates of the target user with the position of the central projection device to determine the direction of the connecting line and the user's viewing distance; A horizontal viewing point is obtained by extending a preset viewing distance from the target user's coordinate position along the connecting line towards the central projection device; The vertical viewing point is determined based on the visual height, and the reference projection point is determined based on the horizontal viewing point and the vertical viewing point; Based on the visual orientation angle, the reference projection point is corrected by arc to obtain the projection center point; The projection size is obtained by looking up the size in the distance-size mapping table based on the user's viewing distance; The projection angle is determined based on the visual orientation angle, wherein the projection angle and the visual orientation angle are complementary. The projection center point, the projection size, and the projection angle are used as personalized display parameters for the target user.

4. The method according to claim 1, characterized in that, In response to the target user's gesture interaction, interactive processing is performed based on the gesture interaction and the initial projected content to generate interactive response content, including: Detect the target user's gesture interaction actions, including swipe gestures, selection gestures, and zoom gestures; When a swipe gesture is detected, the direction of the swipe gesture is identified, and multiple updated digital media objects are re-determined from the digital media file library based on the direction of the swipe gesture. The first resolution data of the multiple updated digital media objects is obtained, and interactive response content is generated. When a selection gesture is detected, the digital media object pointed to by the selection gesture is identified, the target digital media object is determined, the second resolution data of the target digital media object is obtained, and interactive response content is generated. When a zoom-in gesture is detected, the local area pointed to by the zoom-in gesture in the target digital media object is identified, the target local area is determined, the third resolution data of the target local area is obtained, and interactive response content is generated.

5. The method according to claim 4, characterized in that, Identify the digital media object pointed to by the selection gesture, determine the target digital media object, obtain the second resolution data of the target digital media object, and generate interactive response content, including: Detect the pointing position of the selection gesture in the projected content; The corresponding grid cell is determined based on the pointing position, and the digital media object in the grid cell is identified. The identified digital media object is then identified as the target digital media object. Obtain the second resolution data of the target digital media object from the digital media file library; The target digital media object is processed based on the second resolution data, and the target digital media object is switched to a standalone display mode; The target digital media object is displayed separately as the interactive response content.

6. The method according to claim 4, characterized in that, Identify the local area pointed to by the zoom-in gesture in the target digital media object, determine the target local area, obtain the third resolution data of the target local area, and generate interactive response content, including: Detect the pointing coordinates and gesture amplitude of the magnification gesture; The center position of the corresponding local area in the target digital media object is determined according to the pointing coordinates, and the magnification of the local area is determined based on the gesture amplitude; The target local area is determined based on the center position, the magnification, and the projection size; Obtain the third resolution data of the target digital media object from the digital media file library; The third resolution data of the target digital media object is obtained by extracting the third resolution data of the target local area based on the target local area; The target local area is magnified based on the third resolution data of the target local area, and the target local area is switched to magnified display mode; The magnified local area of ​​the target will be used as the interactive response content.

7. An interactive processing system for digital media files, characterized in that, The system for implementing the method according to any one of claims 1-6 comprises: The user location acquisition module is used to detect the user location information of the target user when entering the digital interaction area. The user location information includes the target user's coordinate position, visual height and visual orientation angle in the digital interaction area. The display parameter generation module is used to generate personalized display parameters for the target user based on the coordinate position, the visual height and the visual orientation angle. The personalized display parameters include the projection center point, the projection size and the projection angle. The projection content acquisition module is used to select corresponding media content from the digital media file library based on the projection center point, the projection size, and the projection angle, and process it to obtain initial projection content. The initial projection content includes multiple digital media objects, including: The preset grid layout is determined based on the projection size, and the quantity requirement of digital media objects is determined based on the preset grid layout; Based on the quantity requirements, multiple digital media objects are randomly selected from the digital media file library, including three-dimensional media models and two-dimensional media images; Obtain the first resolution data for each digital media object, and use it as the initial display data for multiple digital media objects; Based on the preset grid layout and the initial display data of multiple digital media objects, the basic projection content is obtained; The position and angle of the basic projection content are adjusted based on the projection center point and the projection angle to obtain the initial projection content; The interaction response module is used to respond to the gesture interaction actions of the target user, perform interactive processing based on the gesture interaction actions and the initial projection content, and generate interactive response content.

Images