Method, device, computer program, and computer program product for analyzing data sets of handling objects in audio and / or visual media contents
Patent Information
- Application Number
- EP2022714007
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-03-16
- Publication Date
- 2024-11-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Current methods lack an effective way to analyze and evaluate data sets of action objects in audio and/or visual media content, particularly in terms of specifying and measuring the quality of these objects based on their parameters and parameter values, which is crucial for determining their economic value and relevance.
A method that reads and verifies parameter values of action objects in media content, calculates results based on their presence, and prioritizes parameters using weighting factors to assess the quality and economic value of the data sets, allowing for comparison with product or service provider data sets.
Enables clear specification and measurement of action objects' quality and economic value, facilitating comparison and evaluation of media content's relevance to product or service providers, thus enhancing data set analysis and economic assessment.
Smart Images

Figure 1.1
Abstract
Description
[0001] Title: Method, device, computer program and computer program product for analyzing data sets of action objects in an audio and / or visual media content
[0002] The present invention relates to a method, a device, a computer program and a computer program product for analyzing and evaluating data sets of action objects in an audio and / or visual media content.
[0003] Metadata is known to be used as additional information to describe audio and / or visual media content and to specify technical and descriptive properties of an audio and / or visual media content. Examples of metadata include author, creation date, recording location, camera information, upload date, image resolution, refresh rate, aperture, focal length, artist name, music style, and sample rate.
[0004] The invention is based on the object of analyzing and evaluating the data set of action objects that appear in audio and / or visual media content. The action objects are visual and / or audible objects or elements that can be perceived by a viewer and / or listener in audio and / or visual media content and are not physical characteristics of the digital data of a video file or an audio file. Furthermore, the invention is based on the object of analyzing and evaluating the quality of the data set with respect to the action objects, depending on the significance of the parameters and parameter values, and making this measurable.
[0005] The present invention is described below according to the claims, listed embodiments and figures.
[0006] According to a first aspect of the present invention, a method is provided for analyzing a data set of parameters of action objects in an audio and / or visual media content, wherein the parameters of the data set describe the action objects in the audio and / or visual media content with corresponding parameter values, and wherein each action object has at least one associated parameter with at least one parameter value, and thus the method analyzes the parameters for existing parameter values in the data set. The method according to the first aspect comprises, in particular, the following steps:
[0007] - Reading the data set,
[0008] - Reading the existing parameter values,
[0009] - Verifying the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content,
[0010] - Calculating a result based on the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content.
[0011] Here, the data set comprises at least one action object, which is at least one product, one service, one athlete, one person, and / or a team. Furthermore, according to the invention, each action object can be specified with corresponding parameters, so that the corresponding action object is described and specified depending on the importance or number of existing parameter values. Thus, the data set comprises information about action objects occurring in the audio and / or visual media content, each of which can have parameter values for a more precise description. Depending on its type and nature, an action object can have various parameters, each of which can assume parameter values according to the parameter type or the parameter.
[0012] It should be noted that the action object is defined as an element from the audio and / or visual media content that is represented pictorially and / or acoustically and can be perceived by a viewer and / or listener. Thus, the action object can be a product, a service, an athlete, a player, or a team that is represented pictorially and / or acoustically in the audio and / or visual media content. The product can originate from a general or specific situation in daily life or professional life, and can therefore be, for example, a household object, such as a table, an armchair, a drinks bottle, a hanging lamp, a book, a shelf, a cupboard, or a piece of clothing. Accordingly, an acoustic action object can be an acoustically audible element that suggests a household product, such asthe spoken word "table" or an acoustic reproduction of a sound which suggests a table in the corresponding acoustically reproduced part of the plot, such as knocking sounds on a table. Thus, an object of action can be a product which can be manufactured and offered on the market and sold commercially. Furthermore, an object of action can be a service which is presented in the audio and / or visual media content or which establishes a connection with a service, such as the connection between a holiday scene from the plot of the audio and / or visual media content with a potential holiday trip as a travel product for the viewer and consequently with a travel service which is thus connected with the aforementioned scene or sounds, such asThe sound of the sea can be associated with the plot of the audio and / or visual media content, or it can be a real estate service that can be associated with, for example, a real estate object appearing in the audio and / or visual media content with a service in the field of real estate.
[0013] The method steps for analysis according to the invention, namely reading the data set, reading the existing parameter values, verifying the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content, and calculating a result based on the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content, enable an analysis of the data set with regard to existing or detected action objects in the data set and a review of the existing parameter values to determine how strongly an action object is specified in the data set. Furthermore, it can be checked whether and which parameters and / or parameter values are present, so that with increasing relevance of the parameters for an action object, the specification of the action object becomes clearer based on the corresponding parameter values.
[0014] According to a further aspect of the present invention, the parameter is a placeholder for color, size, manufacturer's information, material, purchase address, time information, ingredient, design name, reason for use, identification number, price, action description, location information, duration of visibility, statistical information, time of occurrence, duration of occurrence, number of occurrences, size of occurrence, user information, or action object specification, so that, using the aforementioned parameters as placeholders, the specification can be made depending on the action object with the corresponding tailored parameters. Depending on the parameter, appropriate parameter values can be used, such as for the color parameter, the parameter values: red, blue, gray, yellow, and / or black, etc., for parameter Size the parameter values: XS, S, M, L, XL, XXL, XXXL and / or a number, for parameter Material the parameter values: cotton, nylon, wool and / or polyester, for parameter Purchase address the parameter values: an address for online purchase.
[0015] According to a further aspect of the present invention, the method additionally comprises the step of calculating the result depending on a prioritization of at least one parameter. The parameters can be prioritized so that certain parameters have a higher ranking than the other parameters and are thus considered more important. Prioritization can preferably be implemented using a weighting factor. Prioritization is preferably performed depending on a specific product category and / or service category, so that the calculation is performed with a focus on one or more categories.
[0016] According to a further aspect of the present invention, the method additionally comprises the step of including at least one weighting factor for at least one of the parameters for calculating the result. Certain parameters can be assigned a factor to increase or decrease the weighting of the presence or absence of one or more parameters and / or the presence or absence of a specific combination of parameters.
[0017] According to a further aspect of the present invention, the method additionally comprises the step of calculating an overall result based on at least one existing parameter for the data set. A value can then be derived from the calculation as an overall result for the data set, which has at least one action object with at least one parameter with a corresponding parameter value. According to the invention, this enables an audio and / or visual media content to be assigned a specific value, which indicates the quality of the associated data set via the action objects and thus defines the economic value of the audio and / or visual media content.
[0018] According to a further aspect of the present invention, the method additionally comprises the step of standardizing the result or the overall result. Standardization has the advantage that a comparison can be made between different data sets and, in addition, it facilitates the addition of additional factors or mathematical quantities for further calculations.
[0019] According to a further aspect of the present invention, the method additionally comprises the step of additionally comparing at least one parameter of an action object from the data set with at least one product of a product provider and / or service provider in order to calculate a product-provider-specific evaluation factor. In this case, a comparison can advantageously be performed between an action object, which is specified by at least one corresponding parameter with at least one parameter value, and the data of a product provider and / or service provider, so that it is determined how the specified action object matches the products of a product provider or service provider, or how strong the degree of match is.Further according to the invention, the method additionally comprises the step of performing the comparison using a reference address, in particular a URL, EAN code, QR code, or barcode. Preferably, the comparison is performed by using a further data set containing data about a provider's products and / or services, so that the comparison is performed as a function of the further data set for the analysis of the data set of parameters of action objects in the audio and / or visual media content according to the invention. Consequently, according to the invention, a result is calculated which indicates the relevance of the action objects presented in the audio and / or visual media content for the provider's further data set with the corresponding products and / or services as a numerical value.
[0020] According to a further aspect of the present invention, a computer program product is proposed that can be loaded into the memory of an electronic computer and that has instructions that, when executed by the electronic computer, cause the electronic computer to perform the steps according to one of the methods described herein. The electronic computer can be a personal computer, a smartphone, a server, or a notebook.
[0021] According to a further aspect of the present invention, a device for analyzing a data set of parameters of action objects in an audio and / or visual media content is proposed. The device according to the invention has at least one input and one output for receiving and outputting data. Furthermore, the device has at least one memory unit and one processing unit. Furthermore, the device is designed, in particular for carrying out the aforementioned steps, in the form of a computer-implemented method, in particular as a computer-implemented method for processing and analyzing a data set of parameters of action objects in an audio and / or visual media content. Furthermore, the device is configured to process the parameters,wherein the parameters of the data set describe the action objects in the audio and / or visual media content with corresponding parameter values, and each action object has at least one associated parameter with at least one parameter value. The device is configured to analyze the parameters for existing parameter values in the data set, and the device has a readout unit for reading the data set and is configured to read out the existing parameter values. The device is further configured to verify, with a processing unit, the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content. The device is further configured to calculate a result based on the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content.
[0022] Furthermore, the device according to the invention is configured to process information about the action object, wherein the action object is at least one product, a service, a person, a place, an athlete, a real body, an animated body or a real-animated body.
[0023] Furthermore, the device is configured to process the parameter, wherein the parameter is a placeholder for color, size, manufacturer information, material, purchase address, time information, ingredient, design name, reason for use, identification number, price, action description, location information, duration of visibility, statistical information, time of appearance, duration of appearance, number of appearances, size of appearance, user information or action object specification.
[0024] Furthermore, the device is configured to use a prioritization specification and to calculate the result depending on the specified prioritization of at least one parameter. Furthermore, the device is configured to process at least one weighting factor for at least one of the parameters and to include the weighting factor in calculating the result.
[0025] Furthermore, the device is configured to calculate an overall result and to calculate the overall result based on at least one existing or non-existent parameter for the data set.
[0026] Furthermore, the device is designed to standardize the result or the overall result.
[0027] Furthermore, the device is configured to compare and perform a comparison of at least one parameter of an action object from the data set with at least one product of a product provider and / or service provider and is further configured to calculate a product provider-specific evaluation factor.
[0028] Furthermore, the device is designed to carry out the comparison by means of a reference address, in particular a URL, EAN code, QR code, barcode.
[0029] Furthermore, according to the invention, a computer program is proposed, wherein the computer program comprises instructions which, when the program is executed by a device, cause the device to operate according to one of the devices described here and to carry out the corresponding steps.
[0030] The invention is described in more detail below with reference to figures.
[0031] Figure 1 shows the relationship between action objects, a data set, parameters and parameter values according to the invention.
[0032] Figure 2 shows the comparison between two data sets with different quality based on an identical audiovisual media content according to the invention.
[0033] Figure 3 shows a method according to the invention for analyzing a data set of action objects in an audio and / or visual media content.
[0034] Figure 4 shows a further method according to the invention for analyzing a data set of action objects in an audio and / or visual media content.
[0035] Figure 5 shows a plurality of athletes or a sports team as action objects and statistical values as parameters and further use of this data according to the invention. Figure 1 shows a visual media content 1 with action objects 2, 3, 4 and 5, which are displayed at a specific time and can be visually perceived. Figure 1 also shows a data set 7 with the parameters for action objects 2, 3, 4 and 5 and the associated parameter values 8, 9, 10 and 11. Data set 7 contains parameter values 8 for action object 2 with the parameter values person, a1, b1 and c1, parameter values 9 for action object 3 with the parameter values rectangle, a2, b2 and c2, parameter values 10 for action object 4 with the parameter values triangle, a3, b3 and c3 and parameter values 11 for action object 5 with the parameter values circle, a4, b4 and c4.The double arrow 6 symbolizes the correspondence between the visual media content 1 and the associated data set 7, which are related to the visually represented action objects 2, 3, 4 and 5 in the visual media content 1.
[0036] Action objects 2, 3, 4, and 5 are played back as a video using a corresponding device as part of an action or scenario, and thus visualized for a viewer. Data set 7 specifies action objects 2, 3, 4, and 5 with parameter values 8, 9, 10, and 11, each of which can have different characteristic properties of action objects 2, 3, 4, and 5. Action object 2 can, for example, be a person who can be seen in video or visual media content 1, so that the aforementioned person can be specified with name, age, nationality, date of birth, height, type, eye color, hair color, etc. as possible parameter values. Action object 3, symbolized as a rectangle, can, for example, be a beverage container with name, color, manufacturer, brand, price, ingredients, flavor, usage situation, consumer age, etc. as possible parameter values.The action object 4, symbolized as a triangle, can, for example, be an item of clothing with name, color, manufacturer, brand, price, size, material, usage situation, etc. specified as possible parameter values. The action object 5, symbolized as a circle, can, for example, be a piece of furniture with name, color, manufacturer, brand, price, dimensions, material, usage situation, etc. specified as possible parameter values. According to the invention, the action objects 2, 3, 4 and 5 can each have one or more references to one or more action objects 2, 3, 4 and 5, so that one or more parameter values from the parameter values 8, 9, 10 and 11 have at least one parameter value which represents a relationship or a reference to another action object 2, 3, 4 and 5 or to several action objects 2, 3, 4 and 5.Thus, for example, the action object 4, which symbolizes a piece of clothing, can have in the parameter values 10 a parameter value which is directed to the action object 2 as a person and, for example, represents that the action object 4 is worn as a piece of clothing by the person as action object 2.
[0037] According to the invention and without further specific explanations, Figure 1 can also be related in an analogous manner to a pure audio media content, so that the action objects 2,
[0038] 3, 4 and 5 represent audible action objects that can be heard by a listener purely audio-based, which are then further specified based on the above descriptions for the visual media content 1 with the parameter values 8, 9, 10 and 11. Figure 2 shows a further example according to the invention, wherein a further data set 7b establishes a reference 6b to the action objects 2, 3 and 4 in the visual media content 1. However, the data set 7b differs by missing parameter values for the action object 5. In the data set 7b, the parameter value cl for action object 2, the parameter value c2 for action object 3 and the parameter value b3 for action object
[0039] 4. Furthermore, data set 7b has a different parameter value d3 than action object 4. The aforementioned differences between data set 7 and data set 7b illustrate possible discrepancies in data set quality and consequently lead to differences in further use of a data set.
[0040] Figure 3 shows a method according to the invention for analyzing data set 7 with reference to action objects 2, 3, 4, and 5. Figure 3 shows a readout 3A of parameters contained in data set 7 with parameter values 8, 9, 10, and 11. After readout 3A, a calculation 3B is performed, followed by output of the result 3C. Readout 3A, calculation 3B, and output of result 3C can be configured via settings 3D via input 3DA for readout 3A, input 3DB for the calculation, and input 3DC for the result 3C. Thus, for example, readout 3A can be restricted via 3DA to certain predefined parameters from parameter values 8, 9, 10, and 11 and / or can be configured according to a predefined priority.Furthermore, the calculation 3B can be carried out with settings 3D via 3DB according to a predefined specification, so that according to the invention the calculation 3B is calculated depending on a prioritization of at least one parameter (person, rectangle, triangle and / or circle) and / or that for the calculation 3B at least one weighting factor for at least one of the parameters for the calculation 3B of the result is included and / or that the calculation 3B is calculated based on at least one existing or non-existent parameter for the data set 7. After the calculation 3B, the subsequent output of the result 3C takes place, whereby with settings 3D via 3DC the output of the result 3C can be set according to a predefined specification, for example by subsequent standardization or conversion into a predetermined currency or payment currency.
[0041] Figure 4 shows a further method according to the invention for analyzing the data set 7 with reference to the action objects 2, 3, 4, and 5. The above description for Figure 3 applies here in the same way to Figure 4, wherein in Figure 4 a further instance is present as comparison 4D. The comparison 4D serves to carry out a comparison with at least one parameter of an action object from a further data set with at least one product of a product provider and / or service provider in order to calculate a product provider-specific evaluation factor. The further data set of the product provider and / or service provider comprises information about specific action objects and / or services that can be obtained or purchased by a consumer in the form of products or services from a specific provider.For this purpose, the additional data set contains a list of potential products and / or services of the provider, so that an analysis and evaluation of data set 7 can be carried out depending on the additional data set of the provider. By using the additional data set of the provider according to the invention, the reading 3A, the calculation 3B, and the output of the result 3C are carried out depending on the additional data set of the provider. In most cases, it can be assumed that not all products and / or services in data set 7 and the additional data set of the provider match each other.Consequently, the inventive method according to Figure 4, by using the provider's additional data set, delivers a result that provides a value for the relevant action objects 2, 3, 4, and 5 from the audio and / or visual media content with reference to the provider's products and / or services, thus delivering a specific value for the provider. As a concrete application example for Figure 4, visually or acoustically occurring products and / or services that appear in the audio and / or visual media content 1 can be compared with the provider's additional data set in order to verify, based on result 3C, the economic value of the audio and / or visual media content 1 for the provider.More specifically, it can be stated here that the method according to the invention according to Figure 4 with the above description calculates the economic value of action objects recorded in the data set 7 with a product and / or service range of the provider in order to be able to calculate and indicate the economic position value of the audio and / or visual media content 1 with the visualized or acoustically presented products and / or services as action objects 2, 3, 4 and 5 for the provider as result 3C.
[0042] Figure 5 shows, as audio and / or visual media content 51, a sporting event with a plurality of athletes 52, 53, 54, and 55 as action objects, wherein according to the invention a data set 57 with corresponding parameter values for athlete 1 with athlete 1, sl, s2, s3, for athlete 2 with athlete 2, sl, s2, s3, for athlete 3 with athlete 3, sl, s2, s3 and for athlete 4 with athlete 4, sl, s2, s3 is present and has a reference 56 to the audio and / or visual media content 51. Furthermore, as an alternative, the data set 57 can have further parameter values 512 and / or 513, which each relate to a group and / or subgroup of the action objects 52, 53, 54 and / or 55 and contain further parameter values such as d1, d2, d3, d4, d5 and d6. The parameter values 58, 59, 510, 511, 512, 513 are values related to the athletes 52, 53, 54, 55, which preferably represent a sporting performance of an individual athlete or a group orSpecify a subgroup of athletes and / or enable a calculation for an athletic performance and / or a specific athletic goal, such as in football a goal, attack, defense, corner kick, penalty kick, substitution, free kick, or the like. The parameter values 58, 59, 510, 511, 512, 513 are in particular athlete-specific data and / or statistically recorded or calculated values. According to the invention and with reference to Figure 3, the parameter values 58, 59, 510, 511, 512, 513 are read out and, based on a set specification, a calculation, in particular a statically based calculation, is carried out in order to calculate a forecast as a result for a specific time window, which in the case of a live event can lie in the future.
Claims
Claims:
1. A method for analyzing a dataset of parameters of action objects in audio and / or visual media content, wherein the parameters of the dataset describe the action objects in the audio and / or visual media content with corresponding parameter values, and each action object has at least one associated parameter with at least one parameter value, wherein the method analyzes the parameters for existing parameter values in the dataset and comprises the following steps: - Reading the data set, - Reading the existing parameter values, - Verifying the presence of parameter values of at least one action object in the audio and / or visual media content, - Calculating a result based on the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content.
2. The method of claim 1, wherein the object of the action is at least a product, a service, a person, a place or an athlete.
3. Method according to claims 1 and 2, wherein the parameter is a placeholder for color, size, manufacturer's information, material, reference address, time indication, ingredient, design name, occasion of use, identification number, price, description of action, location, duration of visibility, statistical information, time of appearance, duration of appearance, number of appearances, size of appearance, user information or object specification.
4. Method according to one of claims 1 to 3, wherein the method additionally comprises the step of calculating the result depending on a prioritization of at least one parameter.
5. Method according to any one of claims 1 to 4, wherein the method additionally comprises the step of including at least one evaluation factor for at least one of the parameters for calculating the result.
6. Method according to any one of claims 1 to 5, wherein the method additionally comprises the step of calculating an overall result based on at least one existing or non-existent parameter for the data set.
7. A method according to any one of claims 1 to 6, wherein the method additionally comprises the step of normalizing the result or the overall result.
8. Method according to one of claims 1 to 7, wherein the method additionally comprises the step of performing a comparison of at least one parameter of an object of action from the data set with at least one product of a product supplier and / or service supplier in order to calculate a product supplier-specific evaluation factor.
9. Method according to claim 8, wherein the method additionally comprises the step of performing the comparison by means of a reference address, in particular a URL, EAN code, QR code, barcode.
10. Device for analyzing a data set of parameters of action objects in audio and / or visual media content, wherein the parameters of the data set describe the action objects in the audio and / or visual media content with corresponding parameter values, and each action object has at least one associated parameter with at least one parameter value, wherein the device is configured to analyze the parameters for existing parameter values in the data set, wherein the device has a readout unit for reading the data set and reading out the existing parameter values, and wherein the device is further configured to verify, with a processing unit, the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content.wherein the device is further configured to calculate a result based on the presence of parameter values of the parameters of at least one action object in the audio and / or visual media content.
11. Device according to claim 10, wherein the device is configured to process information about the object of action, wherein the object of action is at least a product, a service, a person, a place, an athlete, a real body, an animated body or a real-animated body and / or the processing unit is configured to do so. to process the parameter, where the parameter is a placeholder for color, size, manufacturer's information, material, reference address, time specification, ingredient, design name, occasion of use, identification number, price, action description, location specification, visibility duration, statistical information, time of appearance, duration of appearance, number of appearances, size of appearance, user information or action object specification.
12. Device according to one of claims 10 to 11, wherein the device is further configured to use a prioritization specification and to calculate the result depending on the specified prioritization of at least one parameter and / or the device is further configured to process at least one weighting factor for at least one of the parameters and to include the weighting factor for the calculation of the result.
13. Device according to one of claims 10 to 12, wherein the device is further configured to calculate an overall result and is configured to calculate the overall result based on at least one existing or non-existent parameter for the data set and / or the device is further configured to normalize the result or the overall result and / or the device is further configured to perform a comparison of at least one parameter of an object of action from the data set with at least one product of a product supplier and / or service supplier and is configured to calculate a product supplier-specific evaluation factor and / or the device is further configured to perform the comparison by means of a reference address, in particular a URL, EAN code, QR code, barcode.
14. Computer program comprising instructions which, when the program is executed by a device, cause the device to operate according to any one of claims 10 to 13.
15. Computer program product which can be loaded into the memory of an electronic computer and which includes instructions which, when executed by the electronic computer, cause the electronic computer to perform the steps of the methods according to any one of the preceding claims 1 to 9.
