Method and server for facilitating provision of food information

The method enhances food information accessibility by using augmented image data to capture and display package markers, addressing the challenge of small print and multiple-sided inspection, enabling easy, readable, and user-specific food information display.

JP7733095B2Active Publication Date: 2025-09-02TETRA LAVAL HOLDINGS & FINANCE SA
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023500029
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-07-03
Filing Date
2021-06-30
Publication Date
2025-09-02
Estimated Expiration
2041-06-30

AI Technical Summary

Technical Problem

Existing food packaging systems make it difficult for consumers, especially those with poor eyesight, to access important product information such as ingredients and expiration dates, which are often printed in small fonts or require inspecting multiple sides of the package.

Method used

A method utilizing augmented image data by capturing a visual marker on the package with a user device camera, extracting marker data, obtaining linked artificial image data, and generating augmented image data to provide accessible and scalable food information on a screen, optionally including spatial calibration and user-specific data.

Benefits of technology

Enables easy access to food information without opening the package, allows large, readable text on small packages, and provides user-specific information relevant to the consumer's preferences or allergies, reducing the risk of adverse reactions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007733095000001
    Figure 0007733095000001
  • Figure 0007733095000002
    Figure 0007733095000002
  • Figure 0007733095000003
    Figure 0007733095000003
Patent Text Reader

Abstract

A method (300) for facilitating the provision of food information is provided. The method (300) includes providing (302) a food package (102), the food package (102) comprising a visual marker (104), capturing (304) authentication image data depicting the visual marker (104) with a camera (106) of a user device (108), extracting (308) marker data (112) from the authentication image data, obtaining (310) artificial image data (114) linked to the marker data (112) from an artificial image database (116), the artificial image data (114) depicting at least one food ingredient of a food held within the food package (102), determining (312) artificial image space reference points based on the visual marker (104), generating (314) augmented image data by combining the authentication image data, the artificial image data (114), and the artificial image space reference points, and providing (316) the augmented image data on a screen (110) of the user device (108).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to software technology in the food processing and packaging industry, and more particularly to a method and server for facilitating the provision of food information. [Background technology]

[0002] Currently, in the food processing industry, product information is provided as text printed on food packaging in accordance with the law. Such information may be important to consumers. For example, it may contain information about the product's contents, which is important to know regarding food preferences or allergies. It may also contain information about the expiration date, which is important regarding the product's condition.

[0003] However, this information is often difficult to access. It often requires inspecting multiple sides of a food package before the information can be identified. Additionally, it may be written in small fonts that can be difficult to read for people with poor eyesight, such as the elderly.

[0004] In view of the above, there is a need for improved ways of presenting food information to consumers so that they are fully aware of what food is being offered in the package. Summary of the Invention [Problem to be solved by the invention]

[0005] It is an object of the present invention to at least partially overcome one or more of the limitations identified in the prior art above, and in particular to provide a method that facilitates the provision of food information. [Means for solving the problem]

[0006] It is generally known that the use of augmented image data can facilitate the provision of food information. By adding artificial image data to the authentication image data, the food information can be made accessible to consumers who cannot read or otherwise comprehend the food information printed on the package, thereby reducing the risk of, for example, a consumer with a nut allergy consuming a food product containing nuts.

[0007] According to a first aspect, there is provided a method for facilitating the provision of food information, the method comprising: providing a food package, the food package comprising a visual marker; capturing authentication image data depicting the visual marker by a camera of a user device; extracting marker data from the authentication image data; obtaining artificial image data linked to the marker data from an artificial image database, the artificial image data depicting at least one food ingredient of a food held within the food package; determining an artificial image space reference point based on the visual marker; generating augmented image data by combining the authentication image data, the artificial image data, and the artificial image space reference point; and providing the augmented image data to a screen of the user device.

[0008] A visual marker should be understood as a distinguishable marker of a given size. It may be a simple shape or a complex image.

[0009] A food ingredient should be understood as an ingredient of a food product. By way of non-limiting example, a food ingredient may be water, sugar or salt. It may also be in a processed or unprocessed state, such as crushed or fresh tomatoes.

[0010] The artificial image data may also be text and / or a combination of text and image. For example, the artificial image data may consist of an image depicting three oranges, the number of oranges used to make the juice held in the package. Alternatively, the artificial image data may be the text "3 ORANGES," which may be presented next to the package in the augmented image data. Optionally, both the three oranges and the text may also be displayed next to the package in the augmented image data.

[0011] A food product may contain one food ingredient, such as milk, or multiple food ingredients, such as soda, which may contain the food ingredients carbonated water, sugar, flavoring, and food coloring.

[0012] The advantages of the proposed method are that it allows access to food information without having to identify where it is written on the package. Furthermore, it allows visualization of the product without opening the package. Also, while food information is limited by the space available for printing on food packaging, this method allows for large, easy-to-read text to be used on small-volume packages.

[0013] The method may further include extracting spatial measurement data from the authentication image data, the spatial measurement data being linked to measurements of the food package and / or measurements of the visual marker, performing spatial calibration of the artificial image data by comparing the spatial measurement data with spatial reference data linked to the food package and / or spatial reference data linked to the visual marker provided by a spatial reference database, and generating calibrated artificial image data, and the augmented image data being generated by combining the authentication image data, the calibrated artificial image data, and the artificial image spatial reference points.

[0014] In other words, spatial measurement data can be described as geometric measurements of an object that are determined from an image of the object, whereas spatial reference data can be described as geometric measurements that are determined by measuring the actual object.

[0015] An advantage of generating calibrated artificial data is that the augmented image data can be scaled to match the authentication image data.

[0016] The method may further include, in the step of providing a food package, providing an additional food package, the additional food package comprising an additional visual marker, the authentication image data depicting the visual marker and the additional visual marker, the marker data being based on the visual marker and the additional visual marker, the artificial image data depicting at least one food ingredient of the food held in the food package and at least one additional food ingredient of the additional food held in the additional food package, and the artificial image space reference point being based on the visual marker and the additional visual marker.

[0017] An advantage of providing the additional packaging is that the augmented image data can show the mixture of food products held in the food package.

[0018] The spatial measurement data may be linked to measurements of the food package, measurements of the additional food package, measurements of the visual marker and / or measurements of the additional visual marker, and the spatial reference data may be linked to the food package, the additional food package, the visual marker and / or the additional visual marker.

[0019] The advantage of this is that in the case of an additional food package, the augmented image data can be calibrated to both the food package and the additional food package.

[0020] The method may further include providing a physical container such as a bowl, wherein the authentication image data further describes the physical container, determining geometric data for the physical container in the authentication image data, adjusting the artificial image data based on the geometric data for the physical container to generate adjusted artificial image data, and generating augmented image data by combining the authentication image data, the adjusted artificial image data, and the artificial image space reference points.

[0021] The geometric data may be determined by comparing spatial reference data linked to the food packaging and / or spatial reference data linked to the visual marker with the physical container.

[0022] The visual marker may be provided on the side of the food package together with a two-dimensional code, such as a QR code. This has the advantage that the visual marker and the two-dimensional code can be captured in the same image.

[0023] The two-dimensional code may be configured to launch an application on the user device, which may be to open a web page in a web browser on the user device, which may be an advantage since no pre-installed application is required.

[0024] Additionally, the 2D code may be configured such that when scanned close to the camera, it instructs the user to move the camera back, thereby providing a wider field of view.

[0025] The two-dimensional code may include a unique identifier for the food package, which is advantageous in that augmented image data can provide food information associated with a particular package, such as expiration date data.

[0026] The visual marker may be included in the decoration of the food packaging. The decoration of the food packaging should be understood as the printed surface of the package on which consumer-oriented information, such as the product name, is provided. This is considered advantageous because it does not require printing additional markers on the food packaging. In other words, there is no need to change the printing process. Furthermore, by reducing non-consumer-oriented information, such as barcodes, more space on the package can be used for consumer-oriented information. Furthermore, "hiding" the visual marker in the decoration reduces the risk of counterfeiting and other types of fraud. Conversely, not specifying where and how the visual marker is located on the package makes it more difficult to copy or illicitly modify it.

[0027] The artificial image data may depict the food product in a first form, and the food product may be held in a food product package in a second form. A first volume of the food product in the first form may be different from a second volume of the food product in the second form. Representing the food product in different forms may be advantageous because it may, for example, allow a user to see how full a bowl will be after the food product has been processed, which may aid the user in bowl selection.

[0028] The augmented image data may be dependent on the geographic location of the user device, which can be advantageous as it can provide different augmented image data depending on where the food package is located.

[0029] The artificial image data may depend on a personal profile of the user. The personal profile may consist of user preference data for different food ingredients. This can be an advantage as it allows providing food information relevant to a specific user. For example, food information may be about food ingredients to which the user may have allergies. Another advantage would be that the user can choose the information they want to be presented with. For example, they may want to know what is in a food or where it comes from, or they may want to know its nutritional value or expiration date. Finding specific information can be difficult and time-consuming.

[0030] According to a second aspect, there is provided a server configured to facilitate providing food information, the server may include a transceiver, a control unit, and a memory.

[0031] The transceiver may be configured to receive the marker data and transmit the augmented image data to a screen of the user device.

[0032] The control unit may be configured to execute an acquisition function configured to acquire artificial image data linked to the marker data from an artificial image database, the artificial image data depicting at least one food ingredient of a food held in the food package, a determination function configured to determine an artificial image space reference point based on the visual marker, and a first generation function configured to generate augmented image data by combining the authentication image data, the artificial image data and the artificial image space reference point.

[0033] The control unit may further be configured to execute an extraction function configured to extract spatial measurement data from the authentication image data, the spatial measurement data being linked to measurements of the visual markers, and a second generation function configured to generate calibrated artificial image data by performing spatial calibration of the artificial image data by comparing the spatial measurement data with spatial reference data provided by the spatial reference database and linked to the visual markers.

[0034] The authentication image data may further depict a physical container. The control unit may be further configured to execute a second determining function configured to determine geometric data of the physical container in the authentication image data, a third generating function configured to generate adjusted artificial image data by adjusting the artificial image data based on the geometric data of the physical container, and a fourth generating function configured to generate augmented image data by combining the authentication image data, the adjusted artificial image data, and the artificial image space reference points.

[0035] In addition to the above attributes, further attributes may be added and combined with the above attributes or used separately from the above attributes.

[0036] Further objects, features, aspects and advantages of the present invention will be apparent from the following detailed description and drawings. The same features and advantages described with respect to one embodiment are applicable to other embodiments unless expressly stated otherwise.

[0037] Embodiments of the present invention will now be described, by way of example only, with reference to the accompanying schematic drawings, in which: [Brief explanation of the drawings]

[0038] [Figure 1] 1 is a schematic diagram illustrating a system that facilitates the provision of food information. [Figure 2A] FIG. 10 is a diagram showing an example of a scene using authentication image data. [Figure 2B] FIG. 10 is a diagram showing an example of a scene using extended image data. [Figure 2C] FIG. 10 is a diagram showing an example of a scene using extended image data. [Figure 3] 1 is a flowchart illustrating steps of a method for facilitating the provision of food information. [Figure 4A] 1 illustrates one way of providing a visual marker on a food package. [Figure 4B] 1 illustrates one way of providing a visual marker on a food package. [Figure 4C] 1 illustrates one way of providing a visual marker on a food package. [Figure 5] FIG. 1 illustrates a server configured to facilitate providing food information. DETAILED DESCRIPTION OF THE INVENTION

[0039] FIG. 1 is a schematic diagram illustrating an example of a system 100 that facilitates providing food information. A food package 102 is provided. The food package 102 can hold a food product. The food product can include one or more food ingredients. In this example, an additional food package 122 having an additional visual marker 124 is provided. There can also be multiple additional food packages. In the case of multiple food packages, two or more food packages can hold the same food product or different food products.

[0040] As illustrated in this example, a physical container 126 may be provided. Also, multiple physical containers may be provided. The physical container 126 may be a bowl, pot, glass, or any other physical container capable of holding food. The physical container 126 may be different from the food package 102.

[0041] The food package 102 may include a visual marker 104. It may also include a two-dimensional code 402, such as a QR code. The visual marker 104 and the two-dimensional code 402 are further described in Figures 4A-4C.

[0042] The system 100 may further include a user device 108. The user device may be a mobile device such as a smartphone, a tablet, or other electronic device, or may be smart glasses with a screen built into the lenses of the glasses.

[0043] The user equipment 108 may include a camera 106. The camera 106 may be provided as an external camera connected to the user equipment 108 by suitable means.

[0044] User equipment 108 may include a screen 110. Although screen 110 is shown as part of user equipment 108, it may also be provided as an external screen and connected to user equipment 108 by any suitable means.

[0045] The camera 106 of the user device 108 can be used to capture authentication image data. The authentication image data can depict one or more visual markers 104 provided on the food package 102. The authentication image data can also depict one or more food packages and / or one or more physical containers.

[0046] The marker data 112 can be extracted from the authentication image data by the user device 108. The marker data 112 can be used to retrieve the artificial image data 114 linked to the marker data 112 from the artificial image database 116. The artificial image database 116 can be provided locally on the user device 108 or externally to the user device 108. The artificial image data 114 can be an illustration of the food ingredients that make up the food held in the food package, i.e., an illustration of the contents of the food package 102, an illustration or video related to the food package 102, such as instructions on how to open the food package, or an illustration related to the producer, such as a company mascot or logotype.

[0047] An artificial image space reference point can be determined. It can be determined based on the position of the visual marker 104.

[0048] The augmented image data can be generated by combining the authentication image data, the artificial image data, and the artificial image space reference point. The augmented image data can be interpreted as an image showing both real objects, such as food packages or physical containers, and animated objects from the artificial image database. The artificial image space reference point can be used to align the authentication image data and the artificial image data. In a simpler version of the system 100, the step of determining the artificial image space reference point can be omitted. Instead, a predetermined reference point, such as the center of the screen, can be used to know where to place the artificial image data.

[0049] The augmented image data may be provided to a screen 110 of the user device 108 .

[0050] Optionally, a spatial reference database 120 may be provided. The spatial reference database 120 may provide spatial reference data 118 linked to the food package 102 and / or the visual marker 104. The spatial reference data may be the geometric dimensions of the food package or the visual marker. To know the type of package being depicted, this information may be linked to the visual marker or other code on the package. For example, by knowing what type of package it is, such as a Tetra Brik Aseptic 1000ml Slim package, the spatial reference data linked to the displayed package may be obtained. The advantage of using the package instead of a visual marker for spatial alignment is that the package is larger, which effectively allows different spatial reference points to be placed further apart, which may provide improved spatial alignment of the artificial image data and the authentication image data.

[0051] Spatial measurement data can be extracted from the authentication image data. The spatial measurement data can be linked to measurements of the food package 102 and / or measurements of the visual marker 104, as described above. By comparing the spatial measurement data with spatial reference data, calibrated artificial image data can be generated.

[0052] The augmented image data may be generated using the authentication image data, the calibrated artificial image data, and the artificial image space reference points. In this manner, the size of the artificial object may be calibrated to match the size of the food package 102 and / or the visual marker 104.

[0053] If the physical container 126 is provided in the authentication image data, then geometric data of the physical container 126 can be determined, for example, by comparing the physical container 126 to spatial reference data of the food package 102 and / or the visual marker 104.

[0054] 2A shows, by way of example, a scene based on authentication image data, in which a food package 102 with a visual marker 104 and a physical container 126 are visualized.

[0055] Figure 2B shows an example scene based on augmented image data. Food is shown in a first configuration 202, held in a food package 102, but held in a physical container 126. The same food can also be shown in a second configuration 204, shown in Figure 2C, but with a different volume, showing the same food package 102. The first and second configurations can be interpreted as processed and unprocessed forms of the food.

[0056] As an example, the food package 102 is a package of cream. In Figure 2B, the cream is visualized as unwhipped cream. In Figure 2C, the cream is visualized as whipped cream. In this case, the first form 202 of the product has a smaller volume than the second form 204.

[0057] As another example, food package 102 may be a package of orange juice. A first form may be a whole orange. A second form may be a form that has been processed into orange juice. In this case, the first form has a larger volume than the second form.

[0058] Although not shown in any of Figures 2A-2C, the augmented image data can depict food or food ingredients from multiple food packages within the same scene, which can be used to illustrate the mixing of two food products.

[0059] As another example, a food product can be described by its separately composed food ingredients.

[0060] FIG. 3 is a flow chart illustrating the steps of a method 300 for facilitating the provision of food information.

[0061] In a first step 302, a food package is provided, the food package comprising a visual marker.

[0062] In a second step 304, authentication image data depicting the visual marker is captured by a camera on the user device.

[0063] In a third step 308, the marker data is extracted from the authentication image data.

[0064] In a fourth step 310, artificial image data linked to the marker data can be obtained from an artificial image database, the artificial image data depicting at least one food ingredient of a food product held in the food product package.

[0065] Optionally, steps 3 and 4 can be skipped by checking 306 whether marker data has already been acquired. In this case, method 300 can be continuously repeated to acquire a real-time feed of augmented image data on the screen of the user device. In other words, step 3 may be performed only once. Additionally, step 4 may be performed only once.

[0066] In a fifth step 312, artificial image space reference points are determined based on the visual markers.

[0067] In a sixth step 314, augmented image data is generated by combining the authentication image data, the artificial image data and the artificial image space reference points.

[0068] In a seventh step 316, the augmented image data is provided to the screen of the user device.

[0069] Optionally, in an eighth step 318, spatial measurement data is extracted from the authentication image data, the spatial measurement data being linked to measurements of the food package and / or measurements of the visual marker.

[0070] Optionally, in a ninth step 320, spatial calibration of the artificial image data is performed by comparing the spatial measurement data with spatial reference data linked to the food package and / or spatial reference data linked to the visual marker provided by a spatial reference database to generate calibrated artificial image data.

[0071] Optionally, in a sixth step 314, augmented image data is generated by combining the authentication image data, the calibrated artificial image data and the artificial image space reference points.

[0072] Optionally, in the first step 302, an additional food package is provided (322), the additional food package providing an additional visual marker, the authentication image data depicting the visual marker and the additional visual marker, the marker data being based on the visual marker and the additional visual marker, the artificial image data depicting at least one food ingredient of the food held in the food package and at least one food ingredient of the additional food held in the additional food package, and the artificial image space reference point being based on the visual marker and the additional visual marker.

[0073] The spatial measurement data is linked to measurements of the food package, measurements of the additional food package, measurements of the visual marker and / or measurements of the additional visual marker. Further, the spatial reference data is linked to the food package, measurements of the additional food package, measurements of the visual marker and / or measurements of the additional visual marker.

[0074] Optionally, in a first step 302, a physical container is provided (324), and the authentication image data further describes the physical container. Optionally, in a tenth step, geometric data of the physical container in the authentication image data is determined. Optionally, in an eleventh step, adjusted artificial image data is generated by adjusting the artificial image data based on the geometric data for the physical container. Optionally, in a sixth step 314, augmented image data is generated by combining the authentication image data, the adjusted artificial image data, and the artificial image space reference points.

[0075] Optionally, in a tenth step, geometric data is determined by comparing spatial reference data linked to the food package and / or spatial reference data linked to the visual marker with the physical container.

[0076] 4A-4C show examples of how a visual marker 104 may be provided on a food package 102. The visual marker 104 may be provided together with a two-dimensional code 402, such as a QR code®, or may be provided separately.

[0077] 4A shows an example in which the visual marker 104 is located next to a two-dimensional code 402 on one side of the food package 102. The visual marker 104 can be located on either side of the food package 102.

[0078] FIG. 4B shows an example in which the visual marker 104 is provided within a two-dimensional code 402.

[0079] 4C shows an example in which the visual marker 104 is included in the decorative portion 404 of the food package 102. That is, the visual marker 104 is, for example, a packaging logo that is already printed on the food package 104.

[0080] 5 shows a schematic diagram of a server 500. The server 500 is configured to facilitate the provision of food information. The server 500 comprises a transceiver 502, a control unit 504, and a memory 508.

[0081] The transceiver 502 is configured to communicate with other devices, receive marker data, and transmit augmented image data to a screen of the user equipment.

[0082] The control unit 504 is configured to perform control of the functions and operations of the server 500. The control unit 504 includes a processor 506, such as a central processing unit (CPU), that is configured to execute program code stored in memory 508 in order to perform the functions and operations of the server 500.

[0083] The control unit 504 executes an acquisition function 510 configured to acquire artificial image data linked to the marker data from the artificial image database, the artificial image data depicting at least one food ingredient of a food product held within the food product package.

[0084] The control unit 504 executes a determination function 512 configured to determine an artificial image space reference point based on the visual marker.

[0085] The control unit 504 executes a first generation function 514 configured to generate augmented image data by combining the authentication image data, the artificial image data, and the artificial image space reference points.

[0086] Optionally, the control unit 504 executes an extraction function 516 configured to extract spatial measurement data from the authentication image data, the spatial measurement data being linked to measurements of the visual marker and / or package depicted in the authentication image data.

[0087] Optionally, the control unit 504 executes a second generation function 518 configured to perform spatial calibration of the artificial image data by comparing the spatial measurement data with spatial reference data linked to the visual markers and / or packages provided by a spatial reference database, and generate calibrated artificial image data.

[0088] Optionally, the control unit 504 executes a second determination function 520 configured to determine geometric data of the physical container in the authentication image data.

[0089] Optionally, the control unit 504 executes a third generating function 522 configured to generate adjusted artificial image data by adjusting the artificial image data based on geometric data for the physical container.

[0090] Optionally, the control unit 504 executes a fourth generation function 524 configured to generate augmented image data by combining the authentication image data, the adjusted artificial image data and the artificial image space reference points.

[0091] Optionally, the control unit 504 is configured to extract the marker data from the authentication image data by a second extraction function.

[0092] The server 500 may be located in a user device.

[0093] From the foregoing description, while various embodiments of the present invention have been described and illustrated, the present invention is not limited thereto and may be embodied in other ways within the scope of the subject matter defined in the following claims.

Claims

1. 1. A method (300) for facilitating the provision of food information, comprising: providing (302) a food package (102), said food package (102) comprising a visual marker (104); capturing (304) authentication image data depicting said visual marker (104) with a camera (106) of a user device (108); extracting (308) marker data (112) from the authentication image data; obtaining (310) artificial image data (114) linked to the marker data (112) from an artificial image database (116), the artificial image data (114) depicting at least one food ingredient of a food product held within the food package (102); determining (312) an artificial image space reference point based on said visual marker (104); generating (314) augmented image data by combining the authentication image data, the artificial image data (114) and the artificial image space reference points; providing (316) the augmented image data to a screen (110) of the user device (108); providing (324) a physical container (126), wherein the authentication image data further describes the physical container (126); determining geometric data of the physical container (126) in the authentication image data; adjusting the artificial image data (114) based on geometric data for the physical container (126) to generate adjusted artificial image data; generating the augmented image data by combining the authentication image data, the adjusted artificial image data, and the artificial image space reference points; method.

2. extracting (318) spatial measurement data from the authentication image data, the spatial measurement data being linked to measurements of the food package (102) and / or measurements of the visual marker (104); performing (320) a spatial calibration of the artificial image data (114) by comparing the spatial measurement data with spatial reference data (118) linked to the food package (102) and / or spatial reference data linked to the visual marker (104), as provided by a spatial reference database (120); and generating calibrated artificial image data; The method of claim 1 , wherein the augmented image data is generated by combining the authentication image data, the calibrated artificial image data, and the artificial image space reference points.

3. The step of providing (302) the food package (102) further includes providing (322) an additional food package (122), the additional food package (122) comprising an additional visual marker (124); the authentication image data depicting the visual marker (104) and the additional visual marker (124); the marker data (112) is based on the visual marker (104) and the additional visual marker (124); the artificial image data (114) depicting at least one food ingredient of a food product held in the food package (102) and at least one additional food ingredient of an additional food product held in the additional food package (122); The method of claim 1 or 2, wherein the artificial image space reference point is based on the visual marker (104) and the additional visual marker (124).

4. the spatial measurement data is linked to measurements of the food package (102), measurements of the additional food package (122), measurements of the visual marker (104), and / or measurements of the additional visual marker (124); 4. The method of claim 3, wherein the spatial reference data is linked to the food package (102), the additional food package (122), the visual marker (104) and / or the additional visual marker (124).

5. A method (300) for facilitating the provision of food information, comprising: providing (302) a food package (102), said food package (102) comprising a visual marker (104); capturing (304) authentication image data depicting said visual marker (104) with a camera (106) of a user device (108); extracting (308) marker data (112) from the authentication image data; obtaining (310) artificial image data (114) linked to the marker data (112) from an artificial image database (116), the artificial image data (114) depicting at least one food ingredient of a food product held within the food package (102); determining (312) an artificial image space reference point based on said visual marker (104); generating (314) augmented image data by combining the authentication image data, the artificial image data (114) and the artificial image space reference points; providing (316) the augmented image data to a screen (110) of the user device (108); the artificial image data (114) depicts the food product in a first configuration (202), the food product being held in the food product package in a second configuration (204), and a first volume of the food product in the first configuration (202) differing from a second volume of the food product in the second configuration (204); method.

6. 2. The method of claim 1, wherein the geometric data is determined by comparing spatial reference data linked to the food package (102) and / or linked to the visual marker (104) with the physical container (126).

7. 7. The method of claim 1, wherein the visual marker (104) is provided on a side of the food package (102) together with a two-dimensional code (402), the two-dimensional code (402) being configured to launch an application on the user device (108).

8. The method of claim 7, wherein the two-dimensional code (402) includes a unique identifier for the food package (102).

9. The method of any one of claims 1 to 8, wherein the visual marker (104) is included in a decoration (404) of the food package (102).

10. 2. The method of claim 1, wherein the artificial image data (114) depicts the food product in a first form (202), the food product held in the food product package in a second form (204), and a first volume of the food product in the first form (202) differs from a second volume of the food product in the second form (204).

11. The method of any one of claims 1 to 10, wherein the artificial image data (114) depends on the geographic location of the user equipment (108).

12. The method according to any one of the preceding claims, wherein said artificial image data (114) depends on a personal profile of a user, said personal profile comprising user setting data for different food ingredients.

13. A server (500) configured to facilitate the provision of food information, comprising: The server (500) comprises a transceiver (502), a control unit (504) and a memory (508); The transceiver (502) receiving marker data (112); Sending the augmented image data to a screen (108) of the user device; The control unit (504) an acquisition function (510) configured to acquire artificial image data (114) linked to the marker data (112) from an artificial image database (116), the artificial image data (114) depicting at least one food ingredient of a food product stored in a food package; a determining function (512) configured to determine an artificial image space reference point based on a visual marker (104) included in the food package; a first generation function (514) configured to generate augmented image data by combining authentication image data depicting the visual marker (104), the artificial image data (114), and the artificial image space reference points; The authentication image data further describes a physical container (126); The control unit (504) a second determination function (520) configured to determine geometric data of the physical container (126) in the authentication image data; a third generating function (522) configured to generate adjusted artificial image data by adjusting the artificial image data (114) based on geometric data for the physical container (126); and a fourth generating function (524) configured to generate the augmented image data by combining the authentication image data, the adjusted artificial image data, and the artificial image space reference points. server.

14. The control unit (504) an extraction function (516) configured to extract spatial measurement data from the authentication image data, the spatial measurement data being linked to measurements of the visual markers (104); and a third generating function (518) configured to perform spatial calibration of the artificial image data (114) by comparing the spatial measurement data with spatial reference data (118) linked to the visual markers (104) provided by a spatial reference database (120), and generate calibrated artificial image data. The server of claim 13.

15. A method (300) for facilitating the provision of food information, comprising: providing (302) a food package (102), said food package (102) comprising a visual marker (104); capturing (304) authentication image data depicting said visual marker (104) with a camera (106) of a user device (108); extracting (308) marker data (112) from the authentication image data; obtaining (310) artificial image data (114) linked to the marker data (112) from an artificial image database (116), the artificial image data (114) depicting at least one food ingredient of a food product held within the food package (102); determining (312) an artificial image space reference point based on said visual marker (104); generating (314) augmented image data by combining the authentication image data, the artificial image data (114) and the artificial image space reference points; providing (316) the augmented image data to a screen (110) of the user device (108); the artificial image data (114) is dependent on the geographic location of the user device (108); method.

Citation Information

Patent Citations

  • Food information providing system

    JP2019192091A

  • Information providing device, information processing device, information display system and program

    JP2021176046A

  • Incentivizing foodstuff consumption through the use of augmented reality features

    US20190012545A1

  • Virtually transparent packaging system

    US20200189795A1