Object Collapse Tool

By using the object folding tool in a digital media environment, detecting the visual prompts of the expanded object to generate the shape of the 3D folded object, solving the problem that traditional systems cannot directly determine the 3D shape, and achieving the accurate placement of the figure and the accuracy and aesthetic effect of the design.

CN111125860BActive Publication Date: 2024-12-03ADOBE INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201910683778.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-07
Filing Date
2019-07-26
Publication Date
2024-12-03
Estimated Expiration
2039-07-26

AI Technical Summary

Technical Problem

Traditional systems cannot directly determine the shape of the 3D folded object from the 2D representation of the expanded object, resulting in users requiring extraordinary spatial imagination when designing packaging, making it difficult to accurately place graphics, limiting design aesthetics and increasing error rates.

Method used

Use the object folding tool in a digital media environment to detect visual prompts in the 2D representation of the expanded object, determine fold lines, cutting lines, etc., generate the shape of the 3D folded object, and provide the user interface to display 2D and 3D representations simultaneously, realizing graphics accurate placement and real-time visualization.

Benefits of technology

Reduces errors in user interaction and design, provides visualization of 3D folded objects, and improves design accuracy and aesthetics.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111125860B_ABST
    Figure CN111125860B_ABST
Patent Text Reader

Abstract

An object folding tool is utilized in a digital media environment. A two-dimensional (2D) representation of an unfolded object is obtained, and a visual cue indicating a fold for deforming the unfolded object into a folded object is detected. Based on the detected visual cue, a shape of the folded object is determined, and a three-dimensional (3D) representation of the folded object having the determined shape is generated. In one or more embodiments, the 2D representation of the unfolded object and the 3D representation of the folded object are simultaneously displayed on a display device.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Related Applications

[0002] This application claims priority under 35 U.S.C. §119(e) to U.S. Provisional Patent Application Serial No. 62 / 745,641, filed on October 15, 2018, entitled “Object Folding Tool,” the disclosure of which is incorporated herein by reference in its entirety. Background Art

[0003] Creating product packaging designs typically occurs in the 2D context of a package parting line, but these designs are intended to be viewed on a package that is manufactured in three dimensions (3D). For example, conventional systems enable designers to interact with a 2D representation of an unfolded object in order to place graphics for an assembled 3D folded object (e.g., a box, bag, or envelope). However, conventional systems cannot directly determine the 3D shape of a folded object directly from the 2D representation of the unfolded object and therefore cannot provide visualization of the 3D folded object. This forces users of conventional systems to visualize how graphics placed on the 2D representation of the unfolded object will appear on the 3D folded object. Doing so requires extraordinary spatial imagination, particularly for objects with complex shapes or when designing graphics that extend across multiple panels of a folded object. This disconnect between the 2D unfolded object and the 3D folded object makes it difficult to accurately place graphics on the object, limiting the user's ability to design aesthetically appealing objects and often leading to errors in the final folded object. Summary of the invention

[0004] To overcome these problems, an object folding tool is used in a digital media environment. A two-dimensional (2D) representation of an unfolded object is obtained, and a visual cue indicating a fold for deforming the unfolded object into a folded object is detected. Based on the detected visual cue, a shape of the folded object is determined, and a three-dimensional (3D) representation of the folded object having the determined shape is generated. In one or more implementations, the 2D representation of the unfolded object and the 3D representation of the folded object are simultaneously displayed on a display device.

[0005] This summary introduces a selection of concepts in a simplified form, which are further described in the following detailed description. Therefore, this summary is not intended to identify essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Detailed description is given with reference to the accompanying drawings.

[0007] Figure 1 is an illustration of an environment operable to employ example implementations described herein.

[0008] Figure 2 Depicted in it Figure 1 An example system for an object folding tool that generates a three-dimensional (3D) representation of a folded object from a two-dimensional (2D) representation of a corresponding unfolded object.

[0009] Figure 3 An example user interface is depicted via which a 2D representation of an expanded object and a 3D representation of a collapsed object are simultaneously displayed.

[0010] Figure 4 Another example user interface is depicted via which user input for visually modifying one of a 2D or 3D representation results in simultaneous visual modification of both representations.

[0011] Figure 5 Another example user interface is depicted via which a visual modification applied to a surface of a 3D folded object representation spans multiple non-adjacent panels of a 2D unfolded object representation.

[0012] Figure 6 Another example user interface is depicted via which a 3D representation of a partially folded object is displayed, and panels corresponding to a surface of the folded object and panels adjacent to the panels of the surface are displayed.

[0013] Figure 7 Another example user interface via which a 2D representation of an object in an expanded state and a 3D representation of an object in a first folded state are simultaneously displayed is depicted.

[0014] Figure 8 Another example user interface via which a 2D representation of an object in an expanded state and a 3D representation of the object in a second, folded state are simultaneously displayed is depicted.

[0015] Fig. 9 Another example user interface is depicted via which a 2D representation of an object in an expanded state and a 3D representation of the object in a third folded state are simultaneously displayed.

[0016] Fig.10 Another example user interface is depicted via which a 2D representation of an origami in an unfolded state and a 3D representation of the origami in a folded state are simultaneously displayed.

[0017] Fig.11 Depicted is a procedure in an example implementation in which a 3D representation of a folded object having a determined shape is generated from a 2D representation of a corresponding unfolded object.

[0018] Fig.12Depicted is a procedure in an example implementation in which a visual modification of a 2D representation of an object in an expanded state and a 3D representation of an object in a collapsed state are simultaneously displayed.

[0019] Fig.13 Depicted is a procedure in an example implementation in which a shape of a 3D representation of a folded object is determined from a 2D representation of a corresponding unfolded object.

[0020] Fig.14 An example system is shown that includes various components of an example device that can be implemented as described in reference Figure 1-13 Any type of computing device described and / or utilized to implement embodiments of the techniques described herein. DETAILED DESCRIPTION

[0021] Overview

[0022] Conventional systems enable designers to interact with a two-dimensional (2D) representation of an unfolded object (e.g., parting lines) in order to place graphics for an assembled three-dimensional (3D) folded object (e.g., a box, bag, or envelope). This disconnect between the 2D unfolded object representation and the 3D folded object makes it difficult to accurately place graphics onto the object, limits the user's ability to design an aesthetically appealing object, and often results in errors in the final folded object.

[0023] To overcome these problems, an object folding tool is utilized in a digital media environment. The object folding tool obtains a 2D representation of an unfolded object and detects visual cues indicating folds that transform the unfolded object into a 3D folded object. An example of a 2D representation of an unfolded object is a "parting line," although the 2D representation of an unfolded object may correspond to other unfolded objects, such as unfolded origami, without departing from the spirit or scope of the described technology.

[0024] Based on the style or type of visual cues, the object folding tool determines fold lines indicating where to fold the unfolded object so as to form the folded object. Additionally, based on the style or type of visual cues, the object folding tool may determine cut lines indicating where to cut the unfolded object, glue lines indicating where to glue portions of the unfolded object or secure portions of the unfolded object to each other, perforation lines, crease lines, etc.

[0025] Based on the detected visual cues and the identification of the visual cues as fold lines, cut lines, etc., the object folding tool determines the shape of the folded object. To do this, the object folding tool determines the area of ​​the 2D representation of the unfolded object based on the closure ("enclosure") of a set of fold lines and cut lines, and then designates each area as a panel or tab ("tab") of a shape to connect the panels to form a shape. As described herein, the panel corresponds to at least a portion of the surface of the folded object, and the tab corresponds to a portion that connects the panels to each other. Based on the identified fold lines and the designation of the areas as panels or tabs, the object folding tool determines the fold angle of each fold line detected from the visual cues. The object folding tool then determines the shape of the folded object by folding the unfolded object along the fold lines of the corresponding fold angles.

[0026] In many instances, different shapes can be generated based on different determined folding angles. As an example, consider that a box with a graphic applied to a bottom surface can be folded at a first angle so that the graphic is positioned on the bottom outer surface of the box, or folded at a second angle so that the graphic is positioned on the bottom inner surface of the box. In more complex object designs, the number of different shapes that may be formed due to different folding angles is even higher. Therefore, the object folding tool can iteratively determine different folding angles so as to generate multiple different candidate shapes of the folded object based on the object folded and unfolded at different folding angles, and then select one of the candidate shapes as the shape of the folded object. In some cases, the object folding tool automatically selects a shape from multiple candidate shapes based on one or more selection criteria, such as a closed volume of a candidate shape, an open edge of a candidate shape, etc. Alternatively, the object folding tool can display multiple candidate shapes for the user to select.

[0027] The object folding tool then generates a 3D representation of the folded object having the determined shape, and a mapping between the 2D representation of the unfolded object and the 3D representation of the folded object. To assist in the graphic design of the object, the object folding tool provides a user interface that simultaneously displays the 2D representation of the unfolded object and the 3D representation of the folded object. The mapping between the 2D and 3D representations enables the designer to place graphics on the 2D representation of the unfolded object or the 3D representation of the folded object, and see the visual changes reflected on each of the 2D and 3D representations in real time. In other words, a graphic placed on a portion of the 2D representation of the unfolded object will be displayed on that portion of the 2D representation of the unfolded object and the corresponding portion of the 3D representation, and vice versa.

[0028] In this manner, the object folding tool provides various advantages, including enabling the designer to accurately place graphics onto an object and view how those graphics will appear on the final 3D folded object. Doing so can reduce user interaction and frustration in the graphic design of the package. In addition, providing visualization of the 3D folded object eliminates uncertainty about the final design of the assembled object and reduces errors in the placement of the graphics of the final folded object.

[0029] In the following discussion, an example environment in which the techniques described herein may be employed is first described. Example implementation details and procedures are then described, which may be performed in the example environment as well as other environments. Therefore, the execution of the example procedures is not limited to the example environment, and the example environment is not limited to the execution of the example procedures.

[0030] Example Environment

[0031] Figure 1 is an illustration of a digital media environment 100 in an example implementation that is operable to employ the techniques described herein. The illustrated environment 100 includes a computing device 102, which can be configured in a variety of ways.

[0032] The computing device 102 may be configured, for example, as a desktop computer, a laptop computer, a mobile device (e.g., assuming a handheld configuration such as a tablet or mobile phone), etc. Thus, the computing device 102 may range from a full resource device with large amounts of memory and processor resources (e.g., a personal computer, a game console) to a low resource device with limited memory and / or processing resources (e.g., a mobile device). In addition, although a single computing device 102 is shown, the computing device 102 may represent a plurality of different devices, such as those utilized by an enterprise for use in, for example, Fig.14 Multiple servers that perform operations "on the cloud" as described in .

[0033] Computing device 102 is illustrated as including application 104. Application 104 represents functionality of computing device 102 for creating and modifying digital content, such as for creating and modifying digital photographs, creating and modifying raster graphics, creating and modifying vector graphics, applying created graphical elements (e.g., created digital photographs, raster graphics, and vector graphics) to digital representations of objects, etc. In the context of the described technology, for example, application 104 may be used to apply created graphical elements to digital parting lines and three-dimensional (3D) representations of folded objects (e.g., boxes, cartons, bags, envelopes, etc.) corresponding to such digital parting lines.

[0034] In conjunction with this functionality, consider a two-dimensional (2D) unfolded object representation 106 and a 3D folded object representation 108. One example of a 2D unfolded object representation 106 is a "parting line," although the 2D unfolded object representation 106 may correspond to other unfolded objects, such as unfolded origami, without departing from the spirit or scope of the described technology. The 3D folded object representation 108 corresponds to an object formed by folding the unfolded object represented by the 2D unfolded object representation 106.

[0035] In various scenarios, the unfolded object represented by the 2D unfolded object representation 106 can be transferred to the real world at least in part by printing the graphics applied to the representation on a piece of foldable material (e.g., paper, cardboard, metal, etc.) and cutting the material into the shape indicated by the representation. Other operations can also be performed as part of transferring the unfolded object to the real world, such as perforating the material, scoring the material, pressing creases into the material to be folded to form a corresponding folded object, etc. In any case, the real-world unfolded object can be folded (e.g., by a machine or a user) to form a corresponding real-world folded object, as represented by the 3D folded object representation 108.

[0036] As described above, real-time display of visual modifications while visually modifying the 2D unfolded object representation 106 simultaneously on the corresponding 3D folded object representation provides a number of advantages, including reducing user interaction involved in packaging graphic design. To achieve this simultaneous display, the application 104 utilizes an object folding tool 110. Generally speaking, the object folding tool 110 represents functionality for generating a 3D folded object representation 108 given a 2D unfolded object representation 106 as input.

[0037] To generate the 3D folded object representation 108, the object folding tool 110 initially detects visual cues of the 2D unfolded object representation 106. According to the described techniques, different visual cues indicate different aspects of deforming the unfolded object into a corresponding folded object, such as cut lines, fold lines, perforation lines, glue protrusions, etc. As an example, the visual cues indicating these different aspects can have different stroke and / or style attributes, such as different colors, different thicknesses, different dash types, etc. In the context of the illustrated environment 100, the 2D unfolded object representation 106 includes visual cues indicating fold lines (e.g., visual cues 112) and visual cues indicating cut lines (e.g., visual cues 114). Here, the visual cues indicating the fold lines are depicted as solid red lines, and the visual cues indicating the cut lines are depicted as solid black lines. However, in implementations, without departing from the spirit or scope of the described techniques, the 2D unfolded object representation 106 can include different visual cues indicating various aspects of deforming the unfolded object into a folded object.

[0038] Based on the detected visual cues, the object folding tool 110 determines the shape of the folded object, such as Figure 2 Determining the shape of a folded object based on visual cues is in contrast to some conventional techniques that utilize annotations included with a 2D unfolded object representation, where the annotations describe features of deformation aspects, such as fold angles, whether a line corresponds to a mountain fold or a valley fold, etc. Conventional applications are able to utilize these annotations, simply process them and generate a 3D representation based on the included annotations - these conventional applications do not determine the shape of the 3D folded object representation by detecting visual cues of the 2D unfolded object representation.

[0039] The object folding tool 110 generates the 3D folded object representation 108 to have the determined shape. Upon performing this operation, the object folding tool 110 may cause the 2D unfolded object representation 106 and the 3D folded object representation 108 to be displayed simultaneously, such as on a display device 116 of the computing device 102.

[0040] In one or more implementations, the 2D unfolded object representation 106 and the 3D folded object representation 108 are displayed simultaneously via a user interface 118 of the application 104. The user interface 118 represents functionality for receiving user input to apply a graphic to the 2D unfolded object representation 106 and the 3D folded object representation 108, such that when user input is received to apply a graphic to the 2D unfolded object representation 106, the object folding tool 110 also causes the user interface 118 to display that the graphic is simultaneously applied to a corresponding portion of the 3D folded object representation 108. Similarly, when user input is received to apply a graphic to the 3D folded object representation 108, the object folding tool 110 causes the user interface 118 to display that the graphic is simultaneously applied to a corresponding portion of the 2D unfolded object representation 106.

[0041] Additionally or alternatively, the object folding tool 110 can generate a file based on the determined shape of the folded object. The file can be used to transfer the object to the real world, such as by including instructions for instructing a machine (e.g., a printer, a cutter, a folder, etc.) how to form an unfolded object and / or a folded object from an original material (e.g., paper or cardboard). The file can also include or be used to generate human-understandable instructions for performing a portion of transferring the object to the real world, such as instructions for folding an already printed and cut object in an unfolded state to form a folded object. In one or more implementations, for example, the file can be used by the computing device 102 or by another computing device accessible via the network 120 to generate text instructions, picture-based instructions (where each picture depicts one or more folds in a sequence to form a folded object), video-based instructions (showing the order of folds to form a folded object), and the like.

[0042] Although shown as being implemented locally at the computing device 102, the functionality of the illustrated object folding tool 110 may also be implemented in whole or in part via functionality available over the network 120, such as as part of a web service or "in the cloud." It should also be understood that, although depicted at the computing device 102 in the illustrated example, the 2D unfolded object representation 106 and the 3D folded object representation 108 may be maintained remotely and / or transmitted over the network 120.

[0043]

[0026] Having considered an example environment, consider now a discussion of some example details for techniques for an object collapsing tool in a digital media environment in accordance with one or more implementations.

[0044] Object Collapse Tool

[0045] Figure 2 An example system 200 is depicted, wherein Figure 1 The object folding tool generates a three-dimensional (3D) representation of a folded object from a corresponding two-dimensional (2D) representation of an unfolded object. The illustrated example 200 includes Figure 1 The object folding tool 110 is provided.

[0046] The object folding tool 110 is depicted as receiving a 2D unfolded object representation 106, which is illustrated as being maintained in a storage device 202. The storage device 202 may correspond to a storage device local to the example system 200 or remote from the example system 200 and accessible via a communicative coupling, such as through a network 120. The 2D unfolded object representation 106 may be obtained in a variety of formats. For example, the 2D unfolded object representation 106 may be obtained as a file formatted in a portable document format (PDF), as a file including vector graphics of the 2D unfolded object representation 106, and so on. The 2D unfolded object representation 106 may be formatted in different ways without departing from the spirit or scope of the described technology.

[0047] According to the described technology, the object folding tool 110 processes the obtained 2D unfolded object representation 106 and generates a 3D folded object representation 108. The illustrated example 200 includes an annotation module 204 and an object folding module 206, which represent the functions of the object folding tool 110 for performing the processing and generation. Broadly speaking, the annotation module 204 represents the functions for detecting the visual cues of the 2D unfolded object representation 106 and generating annotation data 208. As described above, the visual cues of the 2D unfolded object representation 106 can indicate the positions of different deformation aspects through different strokes and styles. For example, a line formatted with a first combination of strokes and styles can indicate the position where the material will be cut to produce the object in the unfolded state, and a line formatted with a second combination of strokes and styles can indicate the position where the object is folded to form the folded object. The annotation module 204 is configured to detect differences in the properties of the deformation of these visual cues and the positions indicated by the visual cues.

[0048] The annotation data 208 generated by the annotation module 204 describes these aspects indicated by the detected visual cues. In the illustrated example 200, the annotation data 208 includes fold line data 210 and cut line data 212. The illustrated fold line data 210 describes the visual cues of the 2D unfolded object representation 106, which indicate fold lines-which may have a first stroke and style combination. Next, the cut line data 212 describes the visual cues of the 2D unfolded object representation 106, which indicate cut lines-which may have a second stroke and style combination different from the first combination. The ellipsis indicates that the annotation data 208 may include data describing other aspects of the deformation, such as perforation data and bonding data, without departing from the spirit or scope of the described technology. It should also be understood that in some scenarios, the generated annotation data 208 may not include the cut line data 212, such as associated with origami. In these scenarios, the generated annotation data 208 may simply identify an "edge" corresponding to the boundary of a piece of origami.

[0049] In one or more implementations, the annotation module 204 analyzes the 2D unfolded object representation 106 and generates annotation data 208 as a graphical representation including edges (e.g., cut and fold lines), vertices (e.g., intersections of edges), regions (e.g., closures based on a set of edges), and holes. The annotation module 204 analyzes the topology of the graph and the strokes and styles of the visual cues to apply assignments to the detected edges. For example, the annotation module 204 designates the detected lines as folds or cuts, and further designates the folds as mountain shapes or valley shapes.

[0050] The object folding module 206 represents the functionality of the object folding tool 110 for determining the shape of the 3D folded object representation 108 based on the generated annotation data 208. In other words, the object folding module 206 determines the shape based on aspects indicated by the visual cues. For example, the object folding module 206 initially identifies areas of the 2D unfolded object representation 106 that correspond to panels and protrusions of the folded object. In doing so, the object folding module 206 can define separate areas of the 2D unfolded object representation 106 based on closures within a set of fold lines and cut lines, for example, each area is surrounded by a combination of fold and / or cut lines. The object folding module 206 can then designate each of these determined areas as a panel that forms an exposed surface of a shape, or as a protrusion that can be folded or otherwise arranged to connect surfaces.

[0051] After identifying, fold lines, cut lines, panels, and protrusions, the object folding module 206 calculates a plurality of different candidate shapes, wherein the unfolded object is folded along the fold lines and the protrusions are attached to the panels, such as the protrusions are folded and glued to the panels. The object folding module 206 is configured to perform a correspondence analysis to determine the feasibility or infeasibility of various candidate shapes. For each candidate shape determined to be feasible, the object folding module 206 determines the folding angles for each fold line. These determined folding angles enable the unfolded object to be folded into a determined shape, thereby forming a folded object.

[0052] In one or more embodiments, the object folding module 206 further globally analyzes the 2D unfolded object representation 106 to identify geometric correspondences. These geometric correspondences include angle bisectors, which can form protrusions in a folded form, and also include edges of similar lengths. In addition to the global analysis for correspondences, the object folding module 206 locally analyzes each detected vertex of the 2D unfolded object representation 106 - where at least two detected cut or fold lines converge. Based on this local analysis, the object folding module 206 determines whether the vertex corresponds to a static fold, or in the case of vertices with at least some degrees of freedom, corresponds to the boundaries of the motion of those vertices. These determinations correspond to "vertex constraints" for each vertex.

[0053] Given these vertex constraints, the object folding module 206 utilizes an iterative process to determine a set of folding angles, wherein the set includes a determined folding angle for each determined edge - no fold or zero degrees in the case of a cut line, and a number of different angles in the case of a fold line. The determined set of folding angles is finite as long as each folding angle must satisfy the vertex constraints. In this iterative process, the object folding module 206 initially assigns folding angles to edges adjacent to vertices with zero degrees of freedom, as indicated by the vertex constraints. For edges that have only one configuration in which the unfolded object can be folded to produce a shape, the object folding module 206 updates the graphical representation by merging any vertices and edges that coincide in the 3D shape of the folded object - thus causing the shape to include one configuration. After merging these coincident vertices for a given iteration, the object folding module 206 analyzes the updated graphical representation by iterating over all vertices again, for example, to assign folding angles, detect edges that have only one possible configuration, and update the graphical representation.

[0054] In the scenario where the iterative process is performed to determine multiple valid final shapes of the folded object, the object folding module 206 stores each valid final shape in, for example, the storage device 202. In one or more implementations, the object folding module 206 causes a 3D representation of at least two of these valid final shapes to be displayed - in some cases all displayed - via a user interface that allows a user to select a shape from the displayed representations. Alternatively or additionally, the object folding module 206 ranks the valid final shapes according to some metrics, such as maximization of the closed volume of the shape, minimization of the open edges in 3D, a combination of these, and the like. Based on the ranking, the object folding module 206 can display the representations for selection with some indication of their ranking, such as presented in a ranking order or with a graphical element indicating the ranking. The object folding module 206 can also simply select the highest ranking shape from the multiple valid final shapes without presenting multiple shapes for selection. Then, the object folding module 206 can generate a 3D folded object representation 108 to have the selected shape. It should be understood that in some scenarios, the iterative process performed by the object folding module 206 may not determine multiple final valid shapes. Instead, the object folding module 206 may determine a single final valid shape by performing an iterative process. In this case, the object folding module 206 generates the 3D folded object representation 108 to have the determined shape.

[0055] In the illustrated example 200, the 3D folded object representation 108 is depicted as an input to a display module 214. The display module 214 represents functionality for displaying the 2D unfolded object representation 106 and the 3D folded object representation 108, for example, via a user interface of the application 104. In one or more implementations, the display module 214 generates a simultaneous display 216 that simultaneously displays the 2D unfolded object representation 106 and the 3D folded object representation 108. The simultaneous display 216 not only represents the simultaneous display of the 2D unfolded object representation 106 and the 3D folded object representation 108, but also represents that the visual modification of one of the representations via user input is performed simultaneously with the other representation in real time. As an example, if a user input is received to add a vector graphic to the 2D unfolded object representation 106 displayed via the simultaneous display 216, then in real time, when the vector graphic is displayed to be added to the 2D unfolded object representation 106, the vector graphic is also displayed as being added to the corresponding portion of the 3D folded object representation 108. In a similar manner, when user input is received to apply modifications associated with the 3D folded object representation 108 , the described system simultaneously applies visual modifications to the 2D unfolded object representation 106 .

[0056] To achieve this simultaneous display of visual modifications, the display module 214 utilizes a mapping between the panels of the 2D expanded object representation 106 and the 3D folded object representation 108. Given the shapes determined as described above, the object folding module 206 is able to generate a bidirectional mapping between the 2D expanded object representation 106 and the 3D folded object representation 108. The mapping (not shown) may be stored in the storage device 202. In the context of displaying the simultaneous display 216 via the user interface, consider the following Figure 3-10 discussion.

[0057] Figure 3 An example 300 of a user interface is depicted via which a 2D representation of an expanded object and a 3D representation of a collapsed object are simultaneously displayed.

[0058] The illustrated example 300 includes an object interaction interface 302 that can be displayed via a display device that is communicatively coupled to the computing device 102. In this example 300, the object interaction interface 302 is depicted as simultaneously displaying the 2D expanded object representation 106 and the 3D folded object representation 108. In other words, the object interaction interface 302 presents the simultaneous display 216. As described in more detail below, the object interaction interface 302 includes tools with respect to which user input can be received to visually modify the 2D expanded object representation 106 and the 3D folded object representation 108.

[0059] In one or more implementations, the object interaction interface 302 also includes tools with respect to which user input may be received to perform other operations, such as changing the view of the displayed representation (e.g., rotating the 3D folded object representation 108 to view a different surface or to view a surface at a different angle, selecting a different camera at a different location in the 3D space including the 3D folded object representation 108, etc.), to view the 3D representation of the object in a partially folded state, to view the progression of a folding operation of the object between an expanded state and a folded state (e.g., a progression may be displayed from the expanded state to the folded state - folding the object, a progression may be displayed from the folded state to the expanded state - unfolding the object, and less than a portion of the entire progression may be displayed), etc. These progressions may be viewed via snapshots (e.g., images) at different intervals of the progression (e.g., at each fold) or as a video showing the object being folded or unfolded.

[0060] The tool can also allow the user to choose to move one step at a time by folding or unfolding the progress. Consider the example that the folding object is a box. In this case, the object interaction interface 302 can include a tool via which the user can choose to unfold the 3D representation of the box by an unfolding step, such as rotating the panel corresponding to the top of the box back. The rotation back can expose the interior of the box and / or other panels of the box. In this way, when the top panel is rotated back, the user can view the design applied to the interior of the box and / or the exposed panel. In other words, these progress can be displayed, simulating the folding or unpacking experience. In this way, the object interaction interface 302 can implement the design of an object, such as packaging, to improve the unpacking experience.

[0061] In the illustrated example 300, the object interaction interface 302 also visually emphasizes the panels 304, 306, 308 of the 2D unfolded object representation 106, and the corresponding surface 310 of the 3D folded object representation 108 that is in "focus", which indicates that visual modification operations can be performed with respect to these focus panels and surfaces. In the illustrated example 300, the object interaction interface 302 indicates the focus panels 304, 306, 308 and the corresponding surface 310 by overlaying a blue hash graphic. Of course, without departing from the spirit or scope of the described technology, the object interaction interface 302 can indicate the focus panels and surfaces in other ways. In one or more implementations, the object interaction interface 302 may not display visual emphasis on the panels and surfaces that are in "focus". In any case, the object interaction interface 302 can indicate the focus panels and corresponding surfaces by utilizing a bidirectional mapping between the 2D unfolded object representation 106 and the 3D folded object representation 108.

[0062] Figure 4Another example 400 of a user interface is depicted via which user input for visually modifying one of a 2D or 3D representation results in simultaneous visual modification of both representations.

[0063] The illustrated example 400 also includes an object interaction interface 302. In this example 400, the object interaction interface 302 is depicted as including various graphics 402 that can be selected by the user to be applied to the 2D unfolded object representation 106 and the 3D folded object representation 108. In this particular example 400, the pin graphic is discussed with respect to a particular graphic 404 being applied to the representation. The object interaction interface 302 is capable of receiving user input to select a particular graphic 404 from the various graphics 402-of course, any one of the various graphics 402 can be selected by the user for application. The object interaction interface 302 is also capable of receiving relevant user input with respect to one of the 2D unfolded object representation 106 or the 3D folded object representation 108, wherein the user input specifies a position of the representation at which the graphic is applied. The illustrated example includes a cursor 406, which is depicted as dragging the particular graphic 404 (represented by an arrow 408) onto the surface 310 of the 3D folded object representation 108. In many scenarios, the cursor may not be displayed, such as in connection with touch-based interactions. In at least some scenarios, different types of "cursors" may be displayed, such as a point indicating a stylus tip or touch input. In any case, the drag input represented represents an input that specifies a location in one of the representations, in this case the 3D folded object representation 108. Notably, the object interaction interface 302 is depicted as visually modifying the 2D unfolded object representation 106 and the 3D folded object representation 108 simultaneously, such that the graphics, when applied to a particular location of the 3D folded object representation 108, are applied in real time to the corresponding location of the 2D unfolded object representation 106. In this case, the corresponding location of the 2D unfolded object representation 106 is the panels 304, 306, 308.

[0064] The illustrated example 400 also represents a scene in which the visual modification of the surface of the 3D folded object representation 108 corresponds to multiple panels of the 2D unfolded object representation 106. In addition, these panels are not adjacent, so that in the unfolded state-represented by the 2D unfolded object representation 106-only the portions of the visual modification exist on different panels. For example, consider the graphic portion 410. In the folded state, the graphic portion 410 appears to be substantially adjacent to the rest of the specific graphic 404 when applied to the surface 310. However, on the 2D unfolded object representation 106, the graphic portion 410 on the panel 308 is not adjacent to other portions of the specific graphic 404 (e.g., portions of the specific graphic 404 on the panels 304, 306). By allowing the user to provide input related to only one of the 2D unfolded object representation 106 or the 3D folded object representation 108, but automatically applying the visual modification to both representations, the described system reduces the user input involved in the design of the object (e.g., packaging). This is at least because the system does not require the user to provide input related to both representations to apply the visual modification.

[0065] Figure 5 Another example 500 of a user interface is depicted by which visual modifications applied to a surface of a 3D folded object representation span multiple non-adjacent panels of a 2D unfolded object representation.

[0066] The illustrated example 500 also includes the object interaction interface 302. In this example 500, the object interaction interface 302 is depicted as displaying the 3D folded object representation 108 with the graphic 502 on the top surface 504. The graphic 502 has been previously applied based on user input received via the object interaction interface 302. In any case, the object interaction interface 302 is depicted as displaying the graphic 502 on the 2D unfolded object representation 106. On the 2D unfolded object representation 106, the graphic 502 spans across multiple non-adjacent panels 506, 508, which correspond to the top surface 504.

[0067] Figure 6 Another example 600 of a user interface is depicted via which a 3D representation of a partially folded object is displayed and at which a panel corresponding to a surface of the folded object and panels adjacent to the panels of the surface are displayed.

[0068] The illustrated example 600 also includes an object interaction interface 302. In this example 600, the object interaction interface 302 is depicted as displaying a 2D auxiliary view 602 and a 3D partially collapsed object representation 604. The auxiliary view 602 includes a focus panel of the object and a panel adjacent to the focus panel. In other words, the auxiliary view 602 is a local flattened view of the 3D geometry of the object, on which graphic editing operations can be performed.

[0069] In this example 600, the focus panel corresponds to the top surface 504 of the object in the folded state. The auxiliary view 602 depicts the arrangement of the focus panel, as folded. The adjacent panels displayed can assist in the graphic design of the unfolded object. In contrast to the 2D unfolded object representation 106 depicted in the previous figures, the auxiliary view 602 does not correspond to what the object would look like flattened or what the material would look like when cut and printed to form the folded object.

[0070] To generate the auxiliary view 602, the object folding tool 110 deforms the 2D unfolded object representation 106 by rearranging the panels and protrusions of the 2D unfolded object representation 106 into an arrangement that approximates the view of the 3D folded object representation 108 (e.g., a view of the top of the 3D folded object representation 108). This arrangement closely matches the 3D geometry and position of the folded object surface. As shown, the object folding tool 110 also includes adjacent panels in this arrangement. In this example, the adjacent panels correspond to the sides of the 3D folded object representation 108. After applying the graphics to the panels via the auxiliary view 602, the object folding tool 110 determines the deformation of the graphics based on the bidirectional mapping-positioning the graphics on the 2D unfolded object representation 106. In this way, the graphics can be arranged on the 2D unfolded object representation 106 for production, for example, printing the graphics on a sheet of material.

[0071] The 3D partially folded object representation 604 represents a state between a fully expanded state of the object (eg, the 2D expanded object representation 106 ) and a fully folded state of the object (eg, the 3D folded object representation 108 ).

[0072] Figure 7 Another example 700 of a user interface is depicted via which a 2D representation of an object in an expanded state and a 3D representation of an object in a first folded state are simultaneously displayed.

[0073] The illustrated example 700 also includes an object interaction interface 302. In this example 700, the object interaction interface 302 is depicted as displaying a 2D unfolded representation 702 and a 3D folded representation 704 of a package. In this case, the package corresponds to a box for containing food (e.g., sushi), and the 3D folded representation 704 represents a first folded state (e.g., closed) of the object.

[0074] Figure 8 Another example 800 of a user interface is depicted via which a 2D representation of an object in an expanded state and a 3D representation of an object in a second, folded state are simultaneously displayed.

[0075] The illustrated example 800 also includes an object interaction interface 302. In this example 800, the object interaction interface 302 is depicted as displaying Figure 7 2D unfolded representation 702 and 3D folded representation 802 of a package are depicted in FIG. In this example 800 , 3D folded representation 802 represents a second folded state of the object, for example, partially opened.

[0076] Fig. 9 Another example 900 of a user interface is depicted via which a 2D representation of an object in an unfolded state and a 3D representation of the object in a third folded state are simultaneously displayed.

[0077] The illustrated example 800 also includes an object interaction interface 302. In this example 900, the object interaction interface 302 is depicted as displaying Figure 7 and Figure 8 2D unfolded representation 702 and 3D folded representation 902 of a package depicted in FIG. In this example 900, the 3D folded representation 902 represents a third folded state of the object, e.g., the package is partially opened more than Figure 8 These different states of displaying a folded object can be used in other scenarios, such as displaying a shopping bag in an open configuration (e.g., where products can be placed), and displaying the shopping bag in a closed configuration (e.g., when flattened for storage). In addition, these different displays can be output to create additional digital content, such as a design of a shopping bag with purchased items placed in the shopping bag. The ability of the system to generate representations of objects in various folded and unfolded configurations can be used in a variety of different scenarios without departing from the spirit or scope of the described technology.

[0078] Fig.10 Another example 1000 of a user interface is depicted via which a 2D representation of an origami in an unfolded state and a 3D representation of the origami in a folded state are simultaneously displayed.

[0079] The illustrated example 1000 also includes an object interaction interface 302. In this example 1000, the object interaction interface 302 is depicted as displaying a 2D unfolded representation 1002 and a 3D folded representation 1004 of an origami object. In this case, the origami object corresponds to a crane, and the 3D folded representation 1004 represents the fully folded state of the object, while the 2D unfolded representation 1002 simply represents the unfolded origami with the depicted design. The object interaction interface 302 also includes various graphics 1006 that are applied to portions of the 3D folded representation 1004 and corresponding portions of the 2D unfolded representation 1002. This difference in what the graphics look like between the 3D folded representation 1004 and the corresponding portions of the 2D unfolded representation 1002 clearly illustrates how the mapped visual modification of the mapping between the 2D unfolded object and the corresponding 3D folded object is nearly, if not completely, impossible for a person in a different scene.

[0080] Having discussed example details of the described technology for an object folding tool, consider now some example procedures to illustrate additional aspects of the technology.

[0081] Example Process

[0082] This section describes example processes of an object folding tool in one or more implementations. Aspects of the processes may be implemented in hardware, firmware, or software, or a combination thereof. The processes are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the order shown for performing the operations of the various blocks. In at least some implementations, the processes are performed by appropriately configured devices, such as Figure 1 The object folding tool 110 is provided.

[0083] Fig.11 An example process 1100 is depicted in which a three-dimensional (3D) representation of a folded object having a determined shape is generated from a two-dimensional (2D) representation of a corresponding unfolded object.

[0084] A visual cue of a 2D representation of an expanded object is detected by at least one computing device (block 1102). According to the principles discussed herein, the visual cue indicates a fold for transforming the expanded object into a folded object. As an example, the annotation module 204 detects the visual cues 112, 114 of the 2D expanded object representation 106.

[0085] The shape of the folded object is determined by at least one computing device based on the detected visual cues (block 1104 ). As an example, the object folding module 206 determines the shape of the folded object based on the visual cues detected at block 1102 .

[0086] A 3D representation of the folded object having the determined shape is generated by at least one computing device (block 1106 ). As an example, the object folding module 206 generates the 3D folded object representation 108 to have the shape determined at block 1104 .

[0087] Fig.12 An example process 1200 is depicted in which a visual modification of a 2D representation of an object in an expanded state and a 3D representation of an object in a collapsed state are simultaneously displayed.

[0088] A user interface including a 2D representation of an object in an expanded state and a 3D representation of an object in a collapsed state is displayed by at least one computing device (block 1202). As an example, the computing device displays an object interaction interface 302 including a simultaneous display 216 with a 2D expanded object representation 106 and a 3D collapsed object representation 108.

[0089] User input is received via a user interface to visually modify an object (block 1204). In accordance with the principles discussed herein, the user input is applied to a 2D representation of the object in an expanded state or a 3D representation of the object in a collapsed state. Figure 4 In the context of , for example, a drag input indicated by arrow 408 is received via the object interaction interface 302 to apply a particular graphic 404 to the 3D folded object representation 108 .

[0090] The visual modification of the object for the 2D representation of the object in the expanded state and the 3D representation of the object in the folded state is displayed simultaneously (block 1206). As an example, even if the user input for applying the specific graphic 404 is received in relation to the 3D folded object representation 108, the display module 214 causes the specific graphic 404 to be applied to both the 2D expanded object representation 106 and the 3D folded object representation 108 to be displayed simultaneously.

[0091] Fig.13 An example process 1300 is depicted in which the shape of a 3D representation of a folded object is determined from a corresponding 2D representation of an unfolded object.

[0092] A graphical representation is generated based on an analysis of detected visual cues of the 2D unfolded object representation (block 1302). According to the principles discussed herein, the graphical representation includes edges, vertices corresponding to intersections of the edges, regions each surrounded by a set of edges, and holes. As an example, the annotation module 204 generates the annotation data 208 as a graphical representation of the 2D unfolded object representation 106. In this example, the graphical representation of the annotation data 208 includes identified edges, vertices, regions, and holes. The annotation module 204 identifies these aspects based on an analysis of the visual cues of the 2D unfolded object representation 106, such as by identifying differences in strokes and style features of the visual cues.

[0093] The edges are designated as fold lines or cut lines based on the topology of the graph and the characteristics of the visual cues (block 1304). As an example, based on the characteristics of the topology of the graph and the visual cues generated at block 1302, the annotation module 204 designates the edges identified by the visual cue analysis at block 1302 as fold lines or cut lines. In one or more implementations, these designations may be represented by the fold line data 210 and the cut line data 212.

[0094] The geometric correspondences of the graphical representation are identified (block 1306). According to the principles discussed herein, the correspondences include angle bisectors and edges of similar length. In addition, the angle bisectors indicate areas of the 2D unfolded object representation that correspond to tabs for attaching areas corresponding to the panels together. As an example, the object folding module 206 identifies the geometric correspondences of the graphical representation generated at block 1302, including angle bisectors and edges of similar length.

[0095] Vertex constraints are determined for each vertex of the vertices based at least in part on the designation of the edges that intersect at the respective vertices and the identified correspondences (block 1308). As an example, the object folding module 206 determines vertex constraints for the vertices of the graphical representation and based on the designation of the folding lines or cutting lines at block 1304.

[0096] After performing these steps, an iterative process is then used to determine the shape of the object. The process includes the following steps to determine a set of folding angles for each edge of the graphic, and these steps are iteratively performed until a shape is generated. According to the determined vertex constraints, folding angles are assigned to edges close to vertices with zero degrees of freedom (block 1310). As an example, the object folding module 206 assigns folding angles to edges close to vertices of the graphic representation with zero degrees of freedom according to the vertex constraints determined at block 1308.

[0097] Edges are identified where there is only one configuration in which the unfolded object is foldable to produce a shape (block 1312). As an example, the object folding module 206 identifies edges where there is only one configuration in which the unfolded object is foldable to produce a shape using the fold angle assigned at block 1310.

[0098] When the unfolded object is folded at the identified edge according to a configuration, the graphical representation is updated by merging the vertices and edges that coincide in the 3D shape (block 1314). As an example, when the unfolded object is folded at the edge identified in block 1312, the object folding module 206 updates the graphical representation by merging the edges and vertices that coincide in 3D. Blocks 1310 to 1314 are repeated until fold angles are assigned to all edges. A shape is generated by folding the unfolded object according to the specified fold angles.

[0099] Having described example processes in terms of one or more implementations, consider now example systems and devices that can be used to implement the various techniques described herein.

[0100] Example Systems and Devices

[0101] Fig.14 An example system is shown generally at 1400, which includes an example computing device 1402, which represents one or more computing systems and / or devices that may implement the various techniques described herein. This is illustrated by the inclusion of object folding tool 110. Computing device 1402 may be, for example, a server of a service provider, a device associated with a client (e.g., a client device), a system on a chip, and / or any other suitable computing device or computing system.

[0102] The example computing device 1402 shown in the figure includes a processing system 1404, one or more computer-readable media 1406, and one or more I / O interfaces 1408 coupled to each other in a communicative manner. Although not shown, the computing device 1402 may further include a system bus or other data and command delivery system that couples various components to each other. The system bus may include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and / or a processor or local bus utilizing any of a variety of bus architectures. Various other examples are also contemplated, such as control and data lines.

[0103] The processing system 1404 represents the functionality of performing one or more operations using hardware. Thus, the processing system 1404 is illustrated as including hardware elements 1410 that may be configured as processors, functional blocks, and the like. This may include other logic devices implemented in hardware as application specific integrated circuits or formed using one or more semiconductors. The hardware elements 1410 are not limited by the materials from which they are formed or the processing mechanisms employed therein. For example, a processor may include semiconductors and / or transistors (e.g., electronic integrated circuits (ICs)). In such a context, processor executable instructions may be electronic executable instructions.

[0104] Computer-readable storage media 1406 is illustrated as including a memory / storage component 1412. Memory / storage component 1412 represents memory / storage capacity associated with one or more computer-readable media. Memory / storage component 1412 may include volatile media (such as random access memory (RAM)) and / or non-volatile media (such as read-only memory (ROM), flash memory, optical disks, magnetic disks, etc.). Memory / storage component 1412 may include fixed media (e.g., RAM, ROM, fixed hard drives, etc.) as well as removable media (e.g., flash memory, removable hard drives, optical disks, etc.). Computer-readable media 1406 may be configured in a variety of other ways as further described below.

[0105] Input / output interface 1408 exposes functionality for allowing a user to input commands and information to computing device 1402, and also allows information to be presented to the user and / or other components or devices using various input / output devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, a touch function (e.g., a capacitive or other sensor configured to detect physical touch), a camera (e.g., which may employ visible or invisible wavelengths such as infrared frequencies to identify motion as gestures that do not involve touch), and the like. Examples of output devices include a display device (e.g., a monitor or projector), a speaker, a printer, a network card, a tactile response device, and the like. Thus, computing device 1402 may be configured in various ways as further described below to support user interaction.

[0106] Various techniques are described herein in the general context of software, hardware elements, or program modules. Typically, such modules include routines, programs, objects, elements, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The terms "module," "function," and "component" as used herein generally refer to software, firmware, hardware, or a combination thereof. Features of the techniques described herein are platform-independent, meaning that the techniques can be implemented on a variety of commercial computing platforms with a variety of processors.

[0107] An implementation of the described modules and techniques may be stored on or transmitted via some form of computer-readable media. Computer-readable media include various media that can be accessed by computing device 1402. By way of example and not limitation, computer-readable media may include “computer-readable storage media” and “computer-readable signal media.”

[0108] "Computer-readable storage media" may refer to media and / or devices that enable persistent and / or non-transitory storage of information as compared to mere signal transmission, carrier waves, or signals themselves. Therefore, computer-readable storage media refers to non-signal bearing media. Computer-readable storage media include hardware such as volatile and non-volatile, removable and non-removable media, and / or storage devices implemented in methods or techniques suitable for storing information such as computer-readable instructions, data structures, program modules, logic elements / circuits, or other data. Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, hard disk, cassette, magnetic tape, disk storage or other magnetic storage device, or other storage device, tangible medium, or article of manufacture suitable for storing the desired information and accessible by a computer.

[0109] "Computer readable signal media" may refer to signal bearing media that is configured to send instructions to the hardware of the computing device 1402, such as via a network. Signal media may typically embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, data signal, or other transport mechanism. Signal media also include any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode the information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency, infrared, and other wireless media.

[0110] As previously described, hardware elements 1410 and computer-readable media 1406 represent modules, programmable device logic, and / or fixed device logic implemented in hardware that may be employed in some embodiments to implement at least some aspects of the techniques described herein, such as executing one or more instructions. Hardware may include components of an integrated circuit or system on a chip, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations of silicon or other hardware. In this context, hardware may operate as a processing device that performs program tasks defined by instructions and / or logic embodied in the hardware and hardware for storing instructions for execution, such as the previously described computer-readable storage medium.

[0111] The foregoing combination may also be used to implement the various techniques described herein. Thus, software, hardware, or executable modules may be implemented as one or more instructions and / or logic embodied on some form of computer-readable storage medium and / or by one or more hardware elements 1410. Computing device 1402 may be configured to implement specific instructions and / or functions corresponding to software and / or hardware modules. Thus, the implementation of a module that may be executed as software by computing device 1402 may be at least partially implemented in hardware, for example, by using a computer-readable storage medium and / or hardware element 1410 of processing system 1404. Instructions and / or functions may be executed / operated by one or more articles (e.g., one or more computing devices 1402 and / or processing system 1404) to implement the techniques, modules, and examples described herein.

[0112] The techniques described herein can be supported by various configurations of computing device 1402 and are not limited to the specific examples of the techniques described herein. The functionality can also be implemented in whole or in part by using a distributed system such as through a "cloud" 1414 via a platform 1416 as described below.

[0113] The cloud 1414 includes and / or represents a platform 1416 for resources 1418. The platform 1416 abstracts the underlying functionality of the hardware (e.g., servers) and software resources of the cloud 1414. The resources 1418 may include applications and / or data that may be used when executing computer processing on a server remote from the computing device 1402. The resources 1418 may also include services provided over the Internet and / or over a subscriber network (e.g., a cellular or Wi-Fi network).

[0114] The platform 1416 may abstract resources and functionality to connect the computing device 1402 with other computing devices. The platform 1416 may also be used to abstract resource scaling to provide corresponding scaling levels to the encountered needs of resources 1418 implemented via the platform 1416. Thus, in an interconnected device embodiment, the implementation of the functionality described herein may be distributed throughout the system 1400. For example, functionality may be implemented partially on the computing device 1402 and via the platform 1416 that abstracts the functionality of the cloud 1414.

[0115] in conclusion

[0116] Although the invention has been described in language specific to structural features and / or methodological acts, it should be understood that the invention defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed invention.

Claims

1. A computer-implemented method for applying graphics to a two-dimensional (2D) representation and a three-dimensional (3D) representation of an object in an application, the method comprising: receiving, by an object folding tool of a computer application, as input a 2D representation of an unfolded object, the input 2D representation of the unfolded object comprising formatted lines having a style; detecting, by the object folding tool, the formatted line on the input 2D representation of the unfolded object; determining, by the object folding tool, a deformed position for deforming the unfolded object into a folded object based on a position of the formatted line on the input 2D representation of the unfolded object; determining, by the object folding tool, a type of the deformation to be performed at the location based on the style of the formatted lines, wherein the type of the deformation includes a fold indicated by a different style of the formatted lines than another deformation; identifying, by the object folding tool, a plurality of folding lines based on the positions of the formatted lines and the different styles, on which the expanded object is foldable to form the folded object; generating, by an object folding tool, an annotation describing the location of the deformation and the type of deformation; The shape of the folded object is determined by an object folding tool by processing the annotation using an iterative technique that determines different fold angles at which the unfolded object is folded along a fold line of the plurality of fold lines, wherein: The different folding angles of the folding lines generate different candidate shapes for the folded object; Each different folding angle is determined based on the location of the deformation described by the annotation and the type of the deformation to be performed at the location; and The shape of the folded object is selected from among the different candidate shapes generated; and A 3D representation of the folded object having the determined shape is generated by the object folding tool. 2 . The method of claim 1 , further comprising simultaneously displaying the 2D representation of the expanded object and the 3D representation of the collapsed object on a display device.

3. The method of claim 1 , further comprising generating a file that can be used to cause at least one of the following: Printing the expanded object; cutting the unfolded object from a foldable material; or The expanded object is collapsed into the collapsed object.

4. The method according to claim 1, further comprising: receiving user input for applying a graphic to a portion of one of the 2D representation of the expanded object or the 3D representation of the folded object; displaying the graphic to the application of the portion; as well as The graphic is simultaneously displayed to a corresponding portion of the other of the 2D representation of the unfolded object or the 3D representation of the folded object. 5 . The method of claim 4 , further comprising determining a mapping between the 2D representation of the expanded object and the 3D representation of the collapsed object, the simultaneous display of a graphics application being based on the mapping. The method of claim 1 , further comprising generating instructions for collapsing the expanded object into the collapsed object.

7. The method of claim 1 , wherein determining the different folding angles comprises: identifying the plurality of fold lines and a plurality of cut lines of the input 2D representation of the unfolded object based on the positions of the formatted lines and the different styles of the formatted lines; detecting a vertex corresponding to an intersection of the plurality of fold lines and at least two of the plurality of cut lines; determining vertex constraints for the vertices; as well as Candidate fold angles are iteratively assigned to the plurality of fold lines and the plurality of cut lines that satisfy the vertex constraints. 8 . The method of claim 1 , wherein generating the 3D representation is based on folding the unfolded object along the plurality of fold lines at respective fold angles to form folds.

9. The method according to claim 1, further comprising: One of the different candidate shapes is selected as the shape of the folding object based on closed volumes of the different candidate shapes or open edges of the different candidate shapes.

10. The method according to claim 1, further comprising: displaying the different candidate shapes via a user interface; as well as A user input is received to select one of the different candidate shapes as the shape of the folding object.

11. The method according to claim 1, further comprising: determining an additional shape of the folded object; as well as The 3D representation of the folded object with the additional shape is displayed.

12. The method of claim 1, further comprising analyzing the pattern of the formatted lines to identify additional patterns indicative of a plurality of cut lines at which the expanded object is cut to form the folded object.

13. The method of claim 1, wherein determining the shape further comprises: determining an area of ​​the 2D representation of the unfolded object based on closure by a set of identified fold lines and cut lines; as well as Each of the regions is designated as a surface of the shape or a protrusion for connecting surfaces to form the shape.

14. The method of claim 1, wherein the pattern of the formatted lines includes at least one additional pattern corresponding to at least one of a glue line or a perforation line of the 2D representation of the unfolded object.

15. A computer-implemented method, the method comprising: receiving, by an object folding tool of a computer application, as input a 2D representation of an unfolded object, the input 2D representation of the unfolded object comprising formatted lines having a style; detecting, by the object folding tool, the formatted line on the input 2D representation of the unfolded object; determining, by the object folding tool, a position of a deformation for deforming the unfolded object into a folded object based on the position of the formatted line on the input 2D representation of the unfolded object; determining, by the object folding tool, a type of the deformation to be performed at the location based on the style of the formatted lines, wherein the type of the deformation includes a fold indicated by a different style of the formatted lines than another deformation; generating, by the object folding tool, annotation data based on the formatted lines, the annotation data being generated by identifying a plurality of folding lines for deforming the unfolded object into the folded object based on the positions and the different styles of the formatted lines; determining, by the object folding tool, different fold angles for fold lines among the plurality of fold lines, wherein the different fold angles for the fold lines produce different candidate shapes for the folded object; determining, by the object folding tool, a shape of the folded object by selecting a candidate shape from among the different candidate shapes; generating, by the object folding tool, a 3D representation of the folded object having the shape; outputting, by the object folding tool, a 3D representation of the folded object having the shape; as well as The 3D representation of the folded object is displayed via a user interface of the computer application. 16 . The computer-implemented method of claim 15 , further comprising displaying the 2D representation of the unfolded object concurrently with the 3D representation via the user interface.

17. The computer-implemented method of claim 15, wherein the input 2D representation of the unfolded object is a vector graphic.

18. A system for determining a shape of an object, the system comprising: Annotation module of the object folding tool for: detecting a visual cue of a 2D representation of an expanded object received as input by the object folding tool, the input 2D representation of the expanded object comprising a formatted line having a style; determining a position of a deformation for deforming the unfolded object into a folded object based on a position of the formatted line on the input 2D representation of the unfolded object; determining a type of the deformation to be performed at the location based on the pattern of the formatted lines, wherein the type of deformation includes a fold indicated by a different pattern of the formatted lines compared to other deformations; generating annotation data based on the formatted lines, the annotation data being generated by identifying a plurality of folding lines for deforming the unfolded object into the folded object based on the positions and the different styles of the formatted lines; The object folding module of the object folding tool is used to: determining different fold angles for fold lines among the plurality of fold lines, wherein the different fold angles for the fold lines produce different candidate shapes for the folded object; determining a shape of the folded object by selecting a candidate shape from among the different candidate shapes; as well as generating a 3D representation of the folded object having the shape; as well as A display module is used to simultaneously display the 2D representation of the unfolded object and the 3D representation of the folded object on a display device.

19. The system of claim 18, wherein the object folding module is further configured to iteratively determine the shape of the folded object based on motion boundaries of vertices indicated by the annotation data.

20. The system of claim 18, wherein the display module is further configured to display a 3D representation of a partially folded object, the partially folded object being a partial transformation of the unfolded object into the folded object.