Virtual rendering of digital materials

JP7909686B2Active Publication Date: 2026-08-21PPG INDUSTRIES OHIO INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2025505972
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-08-04
Filing Date
2023-07-20
Publication Date
2026-08-21
Estimated Expiration
2043-07-20

Smart Images

  • Figure 0007909686000002
    Figure 0007909686000002
  • Figure 0007909686000003
    Figure 0007909686000003
  • Figure 0007909686000004
    Figure 0007909686000004
Patent Text Reader

Abstract

A computer system renders a three-dimensional environment. The three-dimensional environment includes a target object. The computer system renders the target object with a first digital material applied to a visible surface of the target object. The first digital material includes a representation of a first physical coating and is associated with a known formula for creating the first physical coating. The computer system further displays a digital material adjustment interface to a user for adjusting one or more attributes of the first digital material. The computer system receives one or more adjustment attribute variables. The computer system identifies a second digital material and a second coating formula for the second digital material based on the one or more adjustment attribute variables. The computer system further renders the target object with the second digital material applied to the visible surface of the target object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to computer-implemented methods and systems that utilize technological improvements to assist in the display of desired materials.

Background Art

[0002] Modern economies and societies are increasingly utilizing digital means of communication in both personal and business functions. As digital commerce continues to grow, it has become more important to provide consumers with the digital tools necessary to adequately research and consider the products and services offered by companies. For example, when selling coatings (such as paints), it is useful for customers to be able to accurately view and experience the coating.

[0003] Given the wide range of different materials, including coating types and colors, it is often difficult for customers to identify the materials. For example, a customer may want to identify one or more paints for an automobile or a shed in the yard. Particularly when displaying colors digitally, it can be difficult to understand how the coating will appear when applied to the intended purpose.

[0004] Therefore, there are several deficiencies in the art that can be benefited from technological advancements. The subject matter disclosed herein is not limited to embodiments that solve any disadvantages or operate only in the environments described above. Rather, this background is provided only to explain one exemplary technical field in which some of the embodiments described herein may be implemented.

Summary of the Invention

[0005] A disclosed computer system for rendering digital materials in a three-dimensional environment comprises one or more processors and one or more computer-readable media storing executable instructions that, when executed by the one or more processors, constitute the computer system to perform various operations. The computer system renders a three-dimensional environment, which includes a target object. The computer system renders the target object using a first digital material applied to the visible surface of the target object. The first digital material includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating. Furthermore, the computer system displays to the user a digital material adjustment interface for adjusting one or more attributes of the first digital material. The computer system also receives one or more adjustment attribute variables from the digital material adjustment interface. Furthermore, the computer system identifies a second digital material and a second coating formulation of the second digital material based on one or more adjustment attribute variables. The second coating formulation is configured to physically create the second digital material. Furthermore, the computer system renders the target object using the second digital material applied to the visible surface of the target object.

[0006] A disclosed computer implementation method, executed by one or more processors, for rendering a digital material in a three-dimensional environment, renders the three-dimensional environment, which includes a target object. The computer implementation method renders the target object using a first digital material applied to the visible surface of the target object. The first digital material includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating. Furthermore, the computer implementation method displays to the user a digital material adjustment interface for adjusting one or more attributes of the first digital material. The computer implementation method also receives one or more adjustment attribute variables from the digital material adjustment interface. Furthermore, the computer implementation method identifies a second digital material and a second coating formulation of the second digital material based on one or more adjustment attribute variables. The second coating formulation is configured to physically create the second digital material. Furthermore, the computer implementation method renders the target object using the second digital material applied to the visible surface of the target object.

[0007] The computer-readable medium includes one or more physical computer-readable storage media that store computer-executable instructions for rendering a 3D environment, which, when executed by a processor, cause a computer system to perform a method for rendering a digital material in a 3D environment. The 3D environment includes a target object. The computer implementation method renders the target object using a first digital material applied to the visible surface of the target object. The first digital material includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating. Furthermore, the computer implementation method displays a digital material adjustment interface to the user for adjusting one or more attributes of the first digital material. The computer implementation method also receives one or more adjustment attribute variables from the digital material adjustment interface. Furthermore, the computer implementation method identifies a second digital material and a second coating formulation of the second digital material based on one or more adjustment attribute variables. The second coating formulation is configured to physically create the second digital material. Furthermore, the computer implementation method renders the target object using the second digital material applied to the visible surface of the target object.

[0008] Additional features and advantages of exemplary embodiments of this disclosure are described below, will be partially apparent from the description, or can be learned through the practice of such exemplary embodiments. Features and advantages of such embodiments may be realized and obtained by the fixtures and combinations specifically indicated in the appended claims. These and other features will be more fully apparent from the following description and the appended claims, or can be learned through the practice of exemplary embodiments as described below.

[0009] To illustrate how the above and other advantages and features of this disclosure can be obtained, a more specific description of the computer implementations, systems, and computer-readable media briefly described above will be made with reference to the specific embodiments shown in the accompanying drawings. Understanding that these drawings only illustrate typical embodiments of this disclosure and are therefore not intended to limit its scope, this disclosure will be described and interpreted more specifically and in detail with reference to the accompanying drawings described below. [Brief explanation of the drawing]

[0010] [Figure 1] This shows a computer system for rendering digital materials. [Figure 2] This shows a user interface for adjusting the rendering of digital materials. [Figure 3] This shows a user interface that displays the adjusted digital materials. [Figure 4] This shows a user interface for adjusting the environmental attributes of the rendering of digital materials. [Figure 5] This shows a user interface for selecting digital materials. [Figure 6] This flowchart shows how to render digital materials. [Modes for carrying out the invention]

[0011] Computer systems for dynamically and virtually rendering digital materials (also referred to herein as “physically based rendering”) provide end users with a technically improved system for displaying materials in three dimensions and adjusting digital materials in three-dimensional space. The resulting adjustments are then used to provide users with formulations for creating digital materials adjusted in the physical world. As used herein, “material” includes any physical medium that can be digitally displayed. For example, a material may include a coating applied to a digitally rendered surface. The coating may include paint, dye, ink, or other coating material that affects the visual appearance of the material. Furthermore, a material may include only coatings that are not applied to a particular digitally rendered surface. “Digital material” is a visually accurate rendering of a physical material.

[0012] The computer system provides an innovative and unique system for simultaneously displaying multiple physically based renderings. Furthermore, as used herein, “physically based rendering” or “digital material” refers to the rendering of a material that calculates the reflection of light from an opaque surface of the material using 1) a bidirectional reflectance distribution function (BRDF) or a simplified model of the BRDF, and / or 2) a bidirectional texture function (BTF). In some examples, the BRDF and / or BTF are obtained directly for the digital rendering of the material by performing BRDF and / or BTF measurements on the material in the physical world and then rendering a physically based rendering using those measurements.

[0013] BRDF includes:

number

[0014] In the formula, L is the radiance, or the power per unit solid angle in the direction of the ray per unit projected area perpendicular to the ray, E is the irradiance, or the power per unit surface area, and θ iω i The angle between the surface normal n and the vector n. The BTF is a 6D function where the variables are 2D position, field of view, and illumination direction. The BTF can be obtained by mechanically imaging the surface from multiple different angles under multiple light wavelengths.

[0015] BRDF and / or BTF measurements can be performed in the physical world using a goniometer. For example, BRDF and / or BTF measurements can be performed for a specific coating on multiple different materials. These different materials include, but are not limited to, different types of wood, plasterboard, metal, plastic, base coatings (e.g., primers), and various other materials commonly used for coatings in industrial, commercial, and residential applications. Each coating-material combination is associated with a unique physically based rendering. Therefore, when a physically based rendering is displayed to an end user, the end user can see a specific coating on multiple different materials.

[0016] The computer system allows the end user to view a rendering of digital materials on a target object in three-dimensional space. The rendering can be displayed on a computer screen, a mobile device screen, a head-mounted display in a virtual or mixed-reality environment, or any other means capable of displaying a three-dimensional environment. The user can then manipulate the physically based rendering in a way that alters its visual appearance. Accordingly, the computer system can generate one or more adjustment attribute variables used to identify formulations for creating a tuned physically based rendering in the physical world.

[0017] Figure 1 shows a computer system 100 for communication via virtual rendering of digital materials. As used herein, computer system 100 is used to refer to both a personal computer 100a, a head-mounted display device 100b, a mobile computing device, a server, or any other computing device or combination of computing devices. For example, at least a portion of the rendering engine 122 may be located on the user's device, while the digital materials database 128 may be stored and processed in a cloud server. The illustrated computer system 100 comprises one or more processors 140 and a computer storage medium 130. The computer storage medium 130 contains executable instructions that, when executed by one or more processors 140, configure the computer system 100 to start virtual digital materials software 120. The virtual digital materials software 120 comprises a rendering engine 122, an import / export interface 124, a coating match engine 126, and a physically based rendering database 128.

[0018] As used herein, “module” includes computer executable code and / or computer hardware that perform a particular function. Those skilled in the art will understand that distinctions between different modules are at least partially optional, otherwise modules may be combined and divided and still remain within the scope of this disclosure. Accordingly, the description of a component as a “module” is provided for clarity and descriptive purposes only and should not be construed as indicating that division between the functions of the computer executable code and / or computer hardware is necessary unless expressly stated otherwise. In this specification, the terms “component,” “agent,” “manager,” “service,” “engine,” and “virtual machine” may also be used similarly.

[0019] Furthermore, it will be understood that the various components and modules shown in FIG. 1 can be arranged and / or executed on a local processor and / or a remote processor. For example, some modules can be executed locally on a personal computing device (e.g., personal computer system 100a, mobile computing device, head-mounted display device 100b), while other modules can be arranged and / or executed on a remote server.

[0020] Computer system 100 is configured to render a three-dimensional environment that includes target objects. For example, FIG. 2 shows a user interface 200 for adjusting the rendering of digital materials. The illustrated user interface 200 includes an interface that can be shown on a personal computer or a mobile device. Further, or alternatively, the user interface 200 may be displayed as an immersive virtual reality or augmented reality environment.

[0021] User interface 200 includes a target object 210 in the form of a rendering of an automobile. The illustrated target object 210 includes an automobile, but in additional or alternative embodiments, any number of different types of target objects can be rendered, including, but not limited to, airplanes, boats, exterior of a house, interior of a house, industrial equipment, and any other object to which a coating can be applied.

[0022] In FIG. 2, the computer system 100 renders the target object 210 using a first digital material 220 applied to the visible surface of the target object 210 within the three-dimensional environment 240. The first digital material 220 includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating. For example, the first digital material 220 may include a red automotive paint having aluminum texture flakes associated within the coating. As described above, within the rendered three-dimensional environment, the rendering of the digital material can include a BRDF and / or BTF such that the rendered digital material is an accurate representation of the physical coating.

[0023] Further, the user interface 200 can display to the user a digital material adjustment interface 230 for adjusting one or more attributes of the first digital material 220. For example, the digital material adjustment interface 230 represents sliders for adjusting the brightness, saturation, flop, and roughness of the first digital material 220. In additional or alternative examples, the user may be able to adjust the color, texture, finish, substrate, and various other visual aspects of the digital material. When the digital material adjustment interface 230 is rendered within a virtual reality environment or a mixed reality environment, the digital material adjustment interface 230 can be displayed as an interface floating in the air near the target object.

[0024] The computer system 100 receives one or more adjustment attribute variables from the digital material adjustment interface 230. As used herein, “adjustment attribute variable” includes information describing changes made by the user to the first digital material using the digital material adjustment interface 230. For example, the adjustment attribute variable may include any number of changes to the appearance of the first digital material 220, such as saturation value, brightness value, color value, texture value, substrate type, or other properties. The adjustment of the digital material is applied to the first digital material 220, including adjustments to the BRDF or BTF data used for rendering the digital material. In some cases, the first digital material 220 on the target object 210 changes in real time as the user makes changes using the digital material adjustment interface 230.

[0025] Next, the computer system 100 can identify a second digital material 300 (shown in Figure 3) and a second coating formulation of the second digital material 300 based on one or more adjustment attribute variables and / or an adjusted BRDF file or adjusted BTF file. One or more digital materials stored in the digital material database 128 may be stored along with the formulations for creating each digital material in the physical world. Thus, the second coating formulation may be stored in the digital material database 128 in association with the closest match to the second digital material 300.

[0026] In one example, a coating matching engine 126 within the virtual digital material software 120 identifies the closest match to a second digital material 300 in the digital material database 128. The coating matching engine 126 may utilize the Kuberka-Munk algorithm to identify the best-matching digital material. In addition, or alternatively, the coating matching engine 126 may include a machine learning algorithm trained to match received color variables with colors stored in the digital material database 128. The machine learning algorithm may include a convolutional neural network (CNN) trained using labeled data entries in the digital material database 128.

[0027] Once the second digital material 300 is identified, the computer system 100 can render the target object 210 with the second digital material 300 applied to the visible surface of the target object 210, as shown in Figure 3. In some cases, the second digital material 300 identified in the digital material database 128 may include an exact match. In such cases, the user may already be seeing a correct depiction of the second digital material 300 based on the adjustments made to the first digital material 220. In contrast, in some cases, the closest match found in the digital material database 128 may not exactly match the adjustments made by the user to the first digital material 220. In such cases, the user may be shown a display prompt informing them that the target product needs to be re-rendered to display the best-matching color. If the user approves the re-rendering, the rendering engine 122 may render the target object 210 using the second digital material 300, which is the closest match in the digital material database 128. For example, Figure 3 shows a user interface 200 showing an adjusted digital material, here referred to as the second digital material 300.

[0028] In some examples, the user may select a first digital material 220 to be applied to a target object 210. For example, Figure 5 shows a user interface in which the computer system 100 displays to the user a command interface 500, indicated as a “digital material selector,” for applying the first digital material 220 to the target object 210. In the command interface 500, the user may select the target object 210 and then select a color from the types in visual representation of color or color text identification. In addition, or alternatively, the import / export interface 124 of the computer system 100 may receive an inspirational image from the user. As used herein, an “inspirational image” includes an image provided by the user to initiate a search for a digital material. For example, the image may include a photograph of a scene, room, or color that the user finds appealing and would like to use in identifying a digital material.

[0029] The computer system 100 can extract color information from the inspiration image. Extracting color information includes identifying the main color of the inspiration image, identifying colors that are contrasting or complementary to one or more colors in the inspiration image, or processing the inspiration image through a machine learning algorithm to identify digital materials. The coating matching engine 126 can then identify a first digital material 220 in the digital material database 128 by searching the digital material database 128 for the digital material that best matches the color information from the inspiration image. The search for the closest match can utilize the same process as described above.

[0030] Once the first digital material 220 is identified, the computer system 100 requests a digital file containing the first digital material 220 from the digital material database 128. The computer system 100 then receives the digital file representing the first digital material 220 via the command interface. Next, the rendering engine 122 renders the first digital material 220 onto the target object 210.

[0031] In addition to adjusting the characteristics of digital materials, users may also be able to adjust the environmental characteristics of the three-dimensional environment 240. For example, Figure 4 shows a user interface for adjusting the environmental attributes of the rendering of digital materials. The computer system 100 can display an environment adjustment interface 400 to the user for adjusting one or more environmental attributes of the three-dimensional environment 240. The shown environment adjustments include adjustments to lighting such as parallel light, diffuse light, sunlight, or twilight. By selecting one of these options, the user can adjust the lighting within the three-dimensional environment 240. Additional or alternative examples of environment adjustments may include the direction of light, the number of light sources, the background image, and various other environment variables.

[0032] The computer system 100 receives one or more environment adjustment variables from the environment adjustment interface 400. In response, the rendering engine 122 renders the target object using one or more environment adjustment variables applied to the 3D environment 240.

[0033] Figure 6 shows a flowchart of method 600 for rendering digital material. Method 600 includes operation 610 for rendering a 3D environment. Operation 610 includes rendering a three-dimensional environment, which includes a target object. For example, as illustrated and described with respect to Figure 2, the 3D environment 240 may be rendered on a computer screen or within a virtual reality headset. The 3D environment 240 further includes a target object 210, in this case a car.

[0034] Method 600 also includes an operation 620 for rendering a target object using a digital material. Operation 620 includes rendering the target object 210 using a first digital material 220 applied to the visible surface of the target object 210, the first digital material 220 including a representation of a first physical coating and associated with a known formulation for creating the first physical coating. For example, as illustrated and described with respect to Figures 1 and 2, the target object 210 is rendered using the first digital material 220, in this case automotive paint. The first digital material 220 is stored in a digital material database 128, which also stores formulations for creating coatings in the physical world.

[0035] Furthermore, method 600 includes an operation 630 that displays a digital material adjustment interface. Operation 630 includes displaying a digital material adjustment interface 230 to the user for adjusting one or more attributes of the first digital material 220. For example, as illustrated and described with respect to Figure 2, the digital material adjustment interface 230 provides the user with options for adjusting various color attributes of the first digital material 220.

[0036] Method 600 also includes an operation 640 for receiving adjustment attribute variables. Operation 640 includes receiving one or more adjustment attribute variables from the digital material adjustment interface 230. For example, as illustrated and described with respect to Figure 2, a user can make various adjustments using the digital material adjustment interface 230. These adjustments are transmitted to the computer system 100.

[0037] Furthermore, method 600 includes an operation 650 for identifying a second digital material. Operation 650 includes identifying a second digital material and a second coating formulation of the second digital material based on one or more adjustment attribute variables, the second coating formulation being configured to physically create the second digital material. For example, as illustrated and described with respect to Figure 1, the coating matching engine 126 receives adjustment attribute variables and uses that information to identify a matching coating in the digital material database 128. The identified coating includes the associated formulation stored with the digital material file in the digital material database 128.

[0038] Furthermore, method 600 includes operation 660 for rendering a target object using a second digital material. Operation 660 includes rendering the target object 210 using the second digital material 300 applied to the visible surface of the target object 210. For example, as illustrated and described with respect to Figure 3, the target object 210 is rendered using a new automotive coating (i.e., the second digital material 300) applied to the visible surface of a car.

[0039] Considering the above, it can be seen that the disclosed computer system is configured to render a realistic image of a coating applied to a target object. Furthermore, the disclosed embodiments provide the end user with means for displaying and adjusting the rendered digital material. Once adjusted, the computer system can provide the user with a formulation that can recreate the digital material in the physical world. Thus, this disclosure improves both the rendering of coatings and the user's ability to translate changes to digital renderings into rendering-faithful coatings in the physical world.

[0040] While the subject matter is described in language specific to structural features and / or methodological behavior, it should be understood that the subject matter as defined in the attached claims is not necessarily limited to the features or behaviors described above, or the order of the behaviors described above. Rather, the described features and behaviors are disclosed as exemplary forms for implementing the claims.

[0041] This disclosure may include or utilize a dedicated or general-purpose computer system, including computer hardware such as one or more processors and system memory, as described in more detail below. Embodiments within the scope of this disclosure also include physical media and other computer-readable media for transporting or storing computer-executable instructions and / or data structures. Such computer-readable media may be any available media accessible by a general-purpose or dedicated computer system. A computer-readable medium that stores computer-executable instructions and / or data structures is a computer storage medium. A computer-readable medium that transports computer-executable instructions and / or data structures is a transmission medium. Thus, embodiments of this disclosure may include, but are not limited to, examples, at least two distinctly different types of computer-readable media, namely computer storage media and transmission media.

[0042] Computer storage media are physical storage media for storing computer executable instructions and / or data structures. Physical storage media include computer hardware such as RAM, ROM, EEPROM, solid-state drives ("SSD"), flash memory, phase-change memory ("PCM"), optical disk storage, magnetic disk storage or other magnetic storage devices, or any other hardware storage device(s) that can be used to store program code in the form of computer executable instructions or data structures that can be accessed and executed by a general-purpose or dedicated computer system to implement the functions disclosed in this disclosure.

[0043] A transmission medium can be used to carry program code in the form of computer executable instructions or data structures and may include networks and / or data links accessible by a general-purpose or dedicated computer system. “Network” is defined as one or more data links that enable the transfer of electronic data between computer systems and / or modules and / or other electronic devices. If information is transferred to or provided to a computer system via a network or another communication connection (either wired, wireless, or a combination of wired and wireless), the computer system may consider that connection to be a transmission medium. The above combinations should also be included within the scope of computer-readable media.

[0044] Furthermore, upon reaching various computer system components, program code in the form of computer executable instructions or data structures can be automatically transferred from the transmission medium to the computer storage medium (or vice versa). For example, computer executable instructions or data structures received via a network or data link can be buffered in RAM within a network interface module (e.g., a "NIC") and ultimately transferred to the computer system's RAM and / or the computer system's less volatile computer storage medium. Therefore, it should be understood that computer storage medium can be included in computer system components that also (or primarily) utilize the transmission medium.

[0045] Computer executable instructions include, for example, instructions and data that, when executed by one or more processors, cause a general-purpose computer system, a dedicated computer system, or a dedicated processing device to perform a specific function or group of functions. Computer executable instructions may be, for example, binary instructions, instructions in an intermediate form such as assembly language, or source code.

[0046] Those skilled in the art will understand that this disclosure can be implemented in network computing environments with many types of computer system configurations, including personal computers, desktop computers, laptop computers, message processors, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile phones, PDAs, tablets, pagers, routers, switches, and the like. This disclosure can also be implemented in distributed system environments where both local and remote computer systems, linked over a network (either by wired data links, wireless data links, or a combination of wired and wireless data links), perform tasks. Thus, in a distributed system environment, the computer system may include multiple configured computer systems. In a distributed system environment, program modules may reside on both local and remote memory storage devices.

[0047] Those skilled in the art will also understand that this disclosure may be implemented in a cloud computing environment. The cloud computing environment may, but is not required, be distributed. If distributed, the cloud computing environment may be internationally distributed within an organization and / or its components may be owned across multiple organizations. In this description and the following claims, “cloud computing” is defined as a model that enables on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services). The definition of “cloud computing” is not limited to any of the many other benefits that can be obtained from such a model when properly deployed.

[0048] Cloud computing models can be comprised of a variety of characteristics, including on-demand self-service, extensive network access, resource pooling, rapid resilience, and measured service. Cloud computing models may also be offered in the form of various service models, such as Software as a Service ("SaaS"), Platform as a Service ("PaaS"), and Infrastructure as a Service ("IaaS"). Cloud computing models can also be deployed using different deployment models, such as private clouds, community clouds, public clouds, and hybrid clouds.

[0049] Some embodiments, such as cloud computing environments, may include a system comprising one or more hosts, each capable of running one or more virtual machines. While in operation, a virtual machine emulates an operational computing system that also supports an operating system and, optionally, one or more other applications. In some embodiments, each host includes a hypervisor that emulates the virtual resources of a virtual machine using physical resources abstracted from the virtual machine's view. The hypervisor also provides adequate isolation between virtual machines. Thus, from the perspective of any given virtual machine, the hypervisor gives the illusion that the virtual machine is interfaced with physical resources, even though the virtual machine is only interfaced with the appearance of physical resources (e.g., virtual resources). Examples of physical resources include processing power, memory, disk space, network bandwidth, media drives, and so on.

[0050] The present invention can be further described by the following embodiments.

[0051] In a first embodiment, a computer system is provided for rendering a digital material in a three-dimensional environment, comprising one or more processors, and one or more computer-readable media storing executable instructions preferably as defined in any one of embodiments 14 to 22, wherein the computer system is configured to perform the following actions when performed by the one or more processors: rendering a three-dimensional environment including a target object; rendering the target object using a first digital material applied to the visible surface of the target object, which includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating; displaying a digital material adjustment interface to a user for adjusting one or more attributes of the first digital material; receiving one or more adjustment attribute variables from the digital material adjustment interface; identifying a second digital material and a second coating formulation of the second digital material configured to physically create the second digital material based on one or more adjustment attribute variables; and rendering the target object using the second digital material applied to the visible surface of the target object.

[0052] Embodiment 2 relates to a computer system of Embodiment 1, wherein executable instructions for adjusting one or more attributes of a first digital material include executable instructions for configuring the computer system to adjust the color of the first digital material.

[0053] Embodiment 3 relates to a computer system in either Embodiment 1 or 2, wherein executable instructions for adjusting one or more attributes of a first digital material include executable instructions for configuring the computer system to adjust the texture of the first digital material.

[0054] Embodiment 4 relates to any one of Embodiments 1 to 3, wherein executable instructions for identifying a second digital material and a second coating formulation of the second digital material based on one or more adjustment attribute variables include executable instructions for configuring a computer system to identify the closest match to the second digital material in a digital material database, and the second coating formulation includes a coating formulation stored in the digital material database associated with the closest match to the second digital material.

[0055] Embodiment 5 relates to the computer system of Embodiment 4, wherein the closest match to the second digital material is identified using the Kuberka-Munk algorithm.

[0056] Embodiment 6 relates to a computer system of either Embodiment 4 or 5, wherein the closest match to a second digital material is identified using a machine learning algorithm.

[0057] Embodiment 7 relates to any one of Embodiments 1 to 6, wherein the executable instructions further include executable instructions to configure the computer system to display a command interface to a user for applying a first digital material to a target object, and to receive a user selection of the first digital material via the command interface.

[0058] Embodiment 8 relates to any one of Embodiments 1 to 7, wherein the executable instructions further include executable instructions for configuring the computer system to transmit a request for a first digital material to a digital material database and to receive a digital file containing the first digital material from the digital material database.

[0059] Embodiment 9 relates to any one of Embodiments 1 to 8, wherein the executable instructions further include an executable instruction for configuring the computer system to display an environment adjustment interface to a user for adjusting one or more environment attributes of a three-dimensional environment, receive one or more environment adjustment variables from the environment adjustment interface, and render a target object using the one or more environment adjustment variables applied to the three-dimensional environment.

[0060] Embodiment 10 relates to any one of Embodiments 1 to 9, wherein the executable instructions further include executable instructions for configuring the computer system to identify a first digital material in the digital material database by receiving an inspirational image from a user, extracting color information from the inspirational image, and searching the digital material database for the digital material that best matches the color information from the inspirational image.

[0061] Embodiment 11 relates to any one of the computer systems of Embodiments 1 to 10, wherein the first digital material is rendered by performing BRDF and / or BTF measurements on a material in the physical world, and then rendering a physically based rendering using those measurements.

[0062] Embodiment 12 relates to any one of embodiments 1 to 11, wherein the second digital material is identified based on the adjustment of BRDF or BTF data used for rendering the first digital material.

[0063] Embodiment 13 relates to a computer system of any one of Embodiments 1 to 12, wherein the target object includes an automobile, an airplane, a boat, the exterior of a house, the interior of a house, or a combination thereof.

[0064] A 14th aspect provides a computer implementation method performed by one or more processors for rendering a digital material in a three-dimensional environment, preferably as defined in any one of aspects 1 to 13, the method comprising: rendering a three-dimensional environment including a target object; rendering the target object using a first digital material applied to the visible surface of the target object, which includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating; displaying a digital material adjustment interface to a user for adjusting one or more attributes of the first digital material; receiving one or more adjustment attribute variables from the digital material adjustment interface; identifying a second digital material and a second coating formulation of the second digital material, which is configured to physically create the second digital material, based on one or more adjustment attribute variables; and rendering the target object using the second digital material applied to the visible surface of the target object.

[0065] Embodiment 15 relates to a computer system of Embodiment 14, wherein adjusting one or more attributes of the first digital material further includes adjusting the color of the first digital material.

[0066] Embodiment 16 relates to any one of Embodiments 14 or 15, wherein adjusting one or more attributes of the first digital material further includes adjusting the texture of the first digital material.

[0067] Embodiment 17 is any one of embodiments 14 to 16, wherein identifying a second digital material and a second coating formulation of the second digital material based on one or more adjustment attribute variables further comprises identifying the closest match to the second digital material in a digital material database, and the second coating formulation includes a coating formulation stored in the digital material database associated with the closest match to the second digital material.

[0068] Embodiment 18 relates to the method of Embodiment 17, wherein the closest match to the second digital material is identified using the Kuberka-Munk algorithm.

[0069] Embodiment 19 relates to one of Embodiments 17 or 18, wherein the closest match to the second digital material is identified using a machine learning algorithm.

[0070] Embodiment 20 relates to any one of embodiments 14 to 19, further comprising displaying a command interface to a user for applying a first digital material to a target object, and receiving a user selection of the first digital material via the command interface.

[0071] Embodiment 21 relates to any one of embodiments 14 to 20, further comprising transmitting a request for a first digital material to a digital material database and receiving a digital file containing the first digital material from the digital material database.

[0072] Embodiment 22 relates to any one of embodiments 14 to 21, further comprising displaying an environment adjustment interface to a user for adjusting one or more environment attributes of a three-dimensional environment, receiving one or more environment adjustment variables from the environment adjustment interface, and rendering a target object using one or more environment adjustment variables applied to the three-dimensional environment.

[0073] In the 23rd aspect, a computer-readable medium is provided, which includes one or more physical computer-readable storage media storing computer-executable instructions that, when executed by a processor, cause a computer system, preferably a system according to any one of aspects 1 to 13, to perform a method for rendering a digital material in a three-dimensional environment, wherein the method includes rendering a three-dimensional environment including a target object; rendering the target object using a first digital material applied to the visible surface of the target object, which includes a representation of a first physical coating and is associated with a known formulation for creating the first physical coating; displaying to a user a digital material adjustment interface for adjusting one or more attributes of the first digital material; receiving one or more adjustment attribute variables from the digital material adjustment interface; identifying a second digital material and a second coating formulation of the second digital material, which is configured to physically create the second digital material, based on one or more adjustment attribute variables; and rendering the target object using the second digital material applied to the visible surface of the target object.

[0074] This disclosure can be embodied in other specific forms without departing from its spirit or characteristics. It should be considered that the embodiments described are merely illustrative and not restrictive in all respects. Accordingly, the scope of this disclosure is indicated by the appended claims rather than by the foregoing description. All modifications within the meaning and scope of equivalence of the claims are to be incorporated therein.

Claims

1. A computer system for rendering digital materials in a three-dimensional environment, One or more processors, When executed by one or more processors, Obtaining Bidirectional Reflectance Distribution Function (BRDF) and / or Bidirectional Texture Function (BTF) data of a first physical coating on a target object in physical space, Rendering a three-dimensional environment including the target object in its rendered form, Rendering the target object using a first digital material applied to the visible surface of the target object, wherein the first digital material includes a representation of the first physical coating and is associated with a known formulation for creating the first physical coating, and the rendering of the first physical coating is performed based on first BRDF and / or BTF data physically measured from the first physical coating, Displaying a digital material adjustment interface to the user for adjusting one or more attributes of the first digital material described above, The digital material adjustment interface receives one or more adjustment attribute variables that are outside the range of the BRDF and / or BTF data of the first physical coating, Based on one or more adjustment attribute variables, identify a second digital material and a second coating formulation of the second digital material, the second coating formulation configured to physically create the second digital material based on second BRDF and / or BTF data obtained for the second coating formulation when applied to a physical object in physical space; A computer system comprising: one or more computer-readable media storing executable instructions that configure the computer system to render the target object using the second digital material applied to the visible surface of the target object, using the second BRDF and / or BTF data of the second coating formulation; and

2. The computer system according to claim 1, wherein the executable instructions for adjusting one or more attributes of the first digital material include executable instructions for configuring the computer system to adjust the color of the first digital material.

3. The computer system according to claim 1, wherein the executable instructions for adjusting one or more attributes of the first digital material include executable instructions for configuring the computer system to adjust the texture of the first digital material.

4. Based on the one or more adjustment attribute variables, the executable instruction for identifying the second digital material and the second coating formulation of the second digital material is: The computer system according to claim 1, comprising executable instructions for configuring the computer system to identify the closest match to the second digital material in a digital materials database, wherein the second coating formulation comprises a coating formulation stored in the digital materials database in association with the closest match to the second digital material.

5. The computer system according to claim 4, wherein the closest match to the second digital material is identified using the Kuberkar-Munk algorithm.

6. The computer system according to claim 4, wherein the closest match to the second digital material is identified using a machine learning algorithm.

7. The aforementioned executable instruction is, A command interface for applying the first digital material to the target object is displayed to the user. The computer system according to claim 1, further comprising executable instructions for configuring the computer system to receive a user selection of the first digital material via the command interface.

8. The aforementioned executable instruction is, The request for the first digital material is transmitted to the digital material database. The computer system according to claim 7, further comprising executable instructions for configuring the computer system to receive a digital file containing the first digital material from the digital material database.

9. The aforementioned executable instruction is, An environment adjustment interface for adjusting one or more environmental attributes of the three-dimensional environment is displayed to the user. The environment adjustment interface receives one or more environment adjustment variables, The computer system according to claim 1, further comprising executable instructions for configuring the computer system to render the target object using one or more environment adjustment variables applied to the three-dimensional environment.

10. The aforementioned executable instruction is, The user receives an inspirational image, Color information is extracted from the aforementioned inspiration image, The computer system according to claim 1, further comprising executable instructions for configuring the computer system to identify the first digital material in the digital material database by searching the digital material database for the digital material that best matches the color information from the inspiration image.

11. A computer implementation method for rendering digital materials in a three-dimensional environment, which is performed by one or more processors, To obtain BRDF and / or BTF data of the first physical coating on a target object in physical space, Rendering a three-dimensional environment including the target object in its rendered form, Rendering the target object using a first digital material applied to the visible surface of the target object, wherein the first digital material includes a representation of the first physical coating and is associated with a known formulation for creating the first physical coating, and the rendering of the first physical coating is performed based on first BRDF and / or BTF data physically measured from the first physical coating, Displaying a digital material adjustment interface to the user for adjusting one or more attributes of the first digital material described above, The digital material adjustment interface receives one or more adjustment attribute variables that are outside the range of the BRDF and / or BTF data of the first physical coating, Based on one or more adjustment attribute variables, identify a second digital material and a second coating formulation of the second digital material, the second coating formulation configured to physically create the second digital material based on second BRDF and / or BTF data obtained for the second coating formulation when applied to a physical object in physical space; A computer implementation method comprising rendering the target object using the second BRDF and / or BTF data of the second coating formulation, using the second digital material applied to the visible surface of the target object.

12. The computer implementation method according to claim 11, wherein adjusting the one or more attributes of the first digital material further includes adjusting the color of the first digital material.

13. The computer implementation method according to claim 11, wherein adjusting the one or more attributes of the first digital material further includes adjusting the texture of the first digital material.

14. Identifying the second digital material and the second coating formulation of the second digital material based on one or more adjustment attribute variables is: The computer implementation method according to claim 11, further comprising identifying the closest match to the second digital material in a digital materials database, wherein the second coating formulation includes a coating formulation stored in the digital materials database in association with the closest match to the second digital material.

15. The computer implementation method according to claim 14, wherein the closest match to the second digital material is identified using the Kuberker-Munk algorithm.

16. The computer implementation method according to claim 14, wherein the closest match to the second digital material is identified using a machine learning algorithm.

17. Displaying a command interface to the user for applying the first digital material to the target object, The computer implementation method according to claim 11, further comprising receiving a user selection of the first digital material via the command interface.

18. Transmitting the request for the first digital material to the digital material database, The computer implementation method according to claim 17, further comprising receiving a digital file containing the first digital material from the digital material database.

19. Displaying an environment adjustment interface to the user for adjusting one or more environmental attributes of the three-dimensional environment, The environment adjustment interface receives one or more environment adjustment variables, The computer implementation method according to claim 11, further comprising rendering the target object using one or more environment adjustment variables applied to the three-dimensional environment.

20. A computer-readable medium including one or more physical computer-readable storage media that store computer-executable instructions causing a computer system to perform a method for rendering digital materials in a three-dimensional environment when executed by a processor, wherein the method is To obtain BRDF and / or BTF data of the first physical coating on a target object in physical space, Rendering a three-dimensional environment including the target object in its rendered form, Rendering the target object using a first digital material applied to the visible surface of the target object, wherein the first digital material includes a representation of the first physical coating and is associated with a known formulation for creating the first physical coating, and the rendering of the first physical coating is performed based on first BRDF and / or BTF data physically measured from the first physical coating, Displaying a digital material adjustment interface to the user for adjusting one or more attributes of the first digital material described above, The digital material adjustment interface receives one or more adjustment attribute variables that are outside the range of the BRDF and / or BTF data of the first physical coating, Based on one or more adjustment attribute variables, identify a second digital material and a second coating formulation of the second digital material, the second coating formulation configured to physically create the second digital material based on second BRDF and / or BTF data obtained for the second coating formulation when applied to a physical object in physical space; A computer-readable medium comprising rendering the target object using the second BRDF and / or BTF data of the second coating formulation, using the second digital material applied to the visible surface of the target object.

Citation Information

Patent Citations

  • Color development process support device and support method based on deflection angle spectral reflectance of painted face

    JP2005071326A

  • Construction paint selection system and program

    JP2005258921A

  • Computer-implemented method for matching paint

    JP2007516677A

  • Color material blending information search system and color material blending information search method

    JP2019015539A

  • Toning simulation method, toning simulation device, and toning program

    WO2015108200A1