Alignment for vacuum-based bonding tools

The fat content on the surface of the meat product is determined through the imaging system and the jointing tool is moved, which solves the problem of sealing the suction device caused by the uneven shape of the meat product, and achieves stable clamping and movement of the meat product.

CN116234447BActive Publication Date: 2024-11-12CRYOVAC INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202180065691.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-07-27
Filing Date
2021-07-09
Publication Date
2024-11-12
Estimated Expiration
2041-07-09

AI Technical Summary

Technical Problem

Existing bonding tools are difficult to effectively clamp and move meat products of uneven shapes, especially because the suction device is difficult to establish proper seals on meat products of different sizes and shapes, resulting in unstable and unreliable during movement. .

Method used

By capturing an image of the meat product surface using an imaging system, the computing device determines the target area based on the fat content at the target area on the meat product surface and causes the mobile system to move the engagement tool relative to the meat product, causing the suction device to engage the meat product surface on the meat product surface and and the vacuum is activated within the suction device to apply the necessary force.

Benefits of technology

Improve the clamping and movement reliability of the joint tool to objects with uneven shapes, ensure the stability and safety of meat products during transportation, and reduce physical damage to meat products.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116234447B_ABST
    Figure CN116234447B_ABST
Patent Text Reader

Abstract

A system includes a joining tool (100) having a suction device (224), a movement system (166) configured to move the joining tool (100), an imaging system (316) configured to capture an image of a surface of a meat product (202), and a computing device. The computing device is configured to: (i) determine a target area (2061) on the surface of the meat product (202) based on an estimated fat content in the meat product (202) at the target area (2061) from the image of the surface of the meat product (202); (ii) cause the movement system to move the joining tool (100) relative to the meat product (202) so that the suction device (224) engages the target area (2061); and (iii) activate a vacuum within the suction device (224) so ​​that the joining tool (100) applies a force on the target area on the surface of the meat product (202) at the suction device (224).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure is within the technical field of vacuum based joining tools. More specifically, the present disclosure relates to the alignment of meat products through the engagement of a suction device on a joining tool. Background Art

[0002] End-of-arm tooling is used for many functions of a robotic arm, including gripping and moving objects. For example, a suction device on a joining or clamping tool can be used to grip the surface of an object, move the object, and place the object in a new location. In many cases, the upper surface of an object is clamped in this manner, which requires the joining tool to apply a suction force on the upper surface of the object that is greater than the weight of the object. In order for such a joining tool to be effective, the joining tool needs to consistently and effectively engage the object so that the joining tool can be reliably and repeatedly used to lift and move objects.

[0003] Certain types of objects have a uniform shape, which makes it relatively easy for a joining tool to clamp the object. However, other objects are not uniform in shape. These objects are relatively difficult for a joining tool to reliably clamp. Examples of such non-uniform objects include food products, such as meat products. In particular, meat products have a variety of shapes and sizes, which creates difficulties in properly joining using a joining tool and establishing force on the meat products using a suction device. In particular, segmenting devices (such as suction cups) have difficulty establishing a proper seal on meat products of different sizes and shapes. It would be advantageous to find a method to improve the effectiveness and reliability of joining non-uniform objects so that a joining tool can be used to clamp and move such non-uniform objects. Summary of the invention

[0004] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0005] In a first embodiment, a system includes a bonding tool having a suction device, a mobile system configured to move the bonding tool, an imaging system configured to capture an image of a surface of a meat product, and a computing device communicatively coupled to the mobile system and the imaging system. The computing device is configured to (i) determine a target area on the surface of a meat product based on an estimated fat content in the meat product at the target area on the surface of the meat product based on the image of the surface of the meat product, (ii) cause the mobile system to move the bonding tool relative to the meat product so that the suction device engages the target area on the surface of the meat product, and (iii) activate a vacuum within the suction device so that the bonding tool applies a force on the target area on the surface of the meat product at the suction device.

[0006] In a second embodiment, the estimated fat content in the meat product at a target area on the surface of the meat product of the first embodiment is above a predetermined fat content level.

[0007] In a third embodiment, the predetermined fat content level of the second embodiment is an estimated average fat content of the surface of the meat product.

[0008] In a fourth embodiment, the estimated fat content in the meat product at the target area on the surface of the meat product of any of the previous embodiments is the highest estimated fat content on the surface of the meat product.

[0009] In a fifth embodiment, as part of determining a target area on a surface of a meat product, the computing device of any of the previous embodiments is configured to determine a target point in the target area on the surface of the meat product.

[0010] In a sixth embodiment, the meat product of any of the preceding embodiments comprises a piece of raw meat in a package. The package is at least partially transparent, and the surface of the meat product comprises a surface of the package.

[0011] In a seventh embodiment, the package of the sixth embodiment comprises at least one of a closed bag made of plastic film, a vacuum sealed bag made of plastic film, or a vacuum sealed package having a tray and a plastic film sealed across an opening of the tray.

[0012] In an eighth embodiment, the surface of the meat product of any of the preceding embodiments is an upper surface of the meat product.

[0013] In a ninth embodiment, the imaging system of any of the preceding embodiments is configured to capture images of a surface of a meat product while the meat product is on a transport system.

[0014] In a tenth embodiment, the movement system of any of the previous embodiments includes a robotic arm configured to move the bonding tool in three-dimensional space.

[0015] In an eleventh embodiment, the robotic arm of any of the preceding embodiments is further configured to rotate the engaging tool relative to the meat product to provide an angular alignment of the engaging tool relative to the meat product.

[0016] In a twelfth embodiment, the bonding tool of any of the preceding embodiments has a plurality of suction devices including the suction device and a second suction device.

[0017] In a thirteenth embodiment, the computing device of the twelfth embodiment is further configured to determine, from the image of the surface of the meat product, a second target area on the surface of the meat product based on an estimated fat content in the meat product at the target area on the surface of the meat product.

[0018] In the fourteenth embodiment, when the controller of the thirteenth embodiment causes the mobile system to move the engaging tool relative to the meat product so that the suction device engages a target area on the surface of the meat product, the controller is further configured to cause the mobile system to move the engaging tool relative to the meat product so that the second suction device engages the second target area on the surface of the meat product.

[0019] In a fifteenth embodiment, the controller of the fourteenth embodiment is further configured to cause the mobile system to rotate the engaging tool relative to the meat product before the suction device engages the target area and the second suction device engages the second target area to provide an angular alignment of the engaging tool relative to the meat product.

[0020] In a sixteenth embodiment, the estimated fat content in the meat product at the target area of ​​any of the previous embodiments is based on one or more of an estimate of the thickness of the fat content, a calculated surface area of ​​the fat content, or a profile of the fat content.

[0021] In a seventeenth embodiment, a method may be performed to control a system including a joining tool having a suction device and a movement system configured to move the joining tool. The method includes capturing an image of a surface of a meat product by an imaging system, and determining a target area on the surface of a meat product from the image of the surface of the meat product by a computing device based on an estimated fat content in the meat product at the target area on the surface of the meat product. The method further includes causing the movement system to move the joining tool relative to the meat product by the computing device so that the suction device engages the target area on the surface of the meat product, and activating a vacuum within the suction device by the computing device so that the joining tool applies a force on the target area on the surface of the meat product at the suction device.

[0022] In an eighteenth embodiment, the estimated fat content in the meat product at a target area on the surface of the meat product of the seventeenth embodiment is higher than a predetermined fat content level.

[0023] In a nineteenth embodiment, the meat product of any of the seventeenth to eighteenth embodiments comprises a piece of raw meat in a package, the package being at least partially transparent, and the surface of the meat product comprises the surface of the package.

[0024] In a twentieth embodiment, the surface of the meat product of any of the seventeenth to nineteenth embodiments is an upper surface of the meat product.

[0025] In a twenty-first embodiment, the imaging system of any of the seventeenth to twentieth embodiments is configured to capture an image of a surface of a meat product while the meat product is on a transport system. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The foregoing aspects and many of the attendant advantages of the disclosed subject matter will be more readily understood by reference to the following detailed description when taken in conjunction with the accompanying drawings, in which:

[0027] Figures 1A to 1D Depicted is an example embodiment of a method of engaging a tool for loading a product into a shipping container in accordance with embodiments disclosed herein;

[0028] Figures 2A to 2D depicts an embodiment of an image of a meat product according to embodiments disclosed herein;

[0029] Figure 2E and 2F Depicted is a diagram of an embodiment according to the present disclosure Figures 2A to 2D A top view of a meat product and a joining tool capable of clamping the meat product shown in an image of FIG.

[0030] Figure 3A and 3B depicts an embodiment of an image of a meat product according to embodiments disclosed herein;

[0031] Figure 3C and 3D Depicted is a diagram of an embodiment according to the present disclosure Figures 3A to 3B A top view of a meat product and a joining tool capable of clamping the meat product shown in an image of FIG.

[0032] Figure 4A and 4B depicts top and side views of an embodiment of a system for acquiring an image of a meat product and controlling a joining tool according to embodiments disclosed herein;

[0033] Figure 5A and 5B Depicted is a diagram of an embodiment according to the present disclosure Figure 4A and 4B A top view and a side view of a system for acquiring images of different types of meat products as shown in;

[0034] Fig. 6A and 6B Depicted is a diagram of an embodiment according to the present disclosure Figure 4A and 4B A top view and a side view of a system for acquiring images of different types of meat products as shown in;

[0035] Figure 7 Depicted is a diagram of an embodiment according to the present disclosure Figure 4A and 4B Schematic diagram of the system shown in;

[0036] Figure 8 Describes example embodiments of systems that can be used to implement some or all of the embodiments described herein; and

[0037] Fig. 9 Depicted is a block diagram of an embodiment of a computing device in accordance with embodiments described herein. DETAILED DESCRIPTION

[0038] As mentioned above, joining tools can be used to join, lift and move objects. Figures 1A to 1D An example of an embodiment of a method for loading an object into a bonding tool 100 in a transport container is depicted. In some embodiments, the bonding tool 100 has a vacuum manifold 110, which includes one or more suction devices (e.g., suction cups) on its lower surface. The vacuum manifold 110 is connected to a vacuum source (not shown) via a gas line 115. The vacuum source is configured to selectively draw vacuum from the vacuum manifold 110 and one or more suction devices. When one or more suction devices engage with the surface of the object and evacuate in the vacuum manifold 110, one or more suction devices apply force on the surface of the object. Examples of bonding tools (or clamping tools) and components thereof are discussed in detail in U.S. Provisional Patent Applications 62 / 972,229, 63 / 044,519, and 63 / 046,850, the contents of one of which are incorporated herein by reference in their entirety.

[0039] Figures 1A to 1D Also depicted is an environment 100 including a conveyor 162, a robot 166, and a transport container 170. In some embodiments, the conveyor 162 includes one or more of a conveyor belt, a set of rollers, a low friction surface, a ramp, or any other mechanism configured to move an object. In the depicted embodiment, the bonding tool 100 has been connected to the end of the robot 166. In some embodiments, the robot 166 can change the position, orientation, and / or operation of the bonding tool 100. For example, a computing device (e.g., a controller) can control the position of the robot 166 to position the bonding tool 100, the orientation of the bonding tool 100 relative to the end of the robot 166 to orient the bonding tool 100, and / or a vacuum source of a vacuum manifold 110 connected to the bonding tool 100 to control whether the bonding tool 100 clamps the object. In some embodiments, the transport container 170 is a carton, a crate, a pallet, a bag, or any other container that can transport an object. In the depicted embodiment, the transport container 170 is a box that is opened to receive an object.

[0040] The environment 100 also includes an object 160 1 , 160 2 , 160 3 , 160 4 , 160 5 , 160 6 , 160 7(collectively referred to as objects 160). Conveyor 162 is configured to move objects 160 in a downstream direction 164. In the depicted embodiment, the downstream direction 164 of the conveyor moves objects 160 generally toward a transport container 170. In the depicted embodiment, a robotic arm 166 is positioned near the downstream end of conveyor 162 so that robotic arm 166 can transfer objects 160 individually from conveyor 162 to transport container 170 using joining tool 100. In some embodiments, objects 160 are vacuum-packed products. For example, each object 160 can be a piece of vacuum-packed raw meat (e.g., beef, chicken, turkey, fish, etc.). In some embodiments, at least some of objects 160 have an upper surface that is a non-planar surface.

[0041] exist Figure 1A In the example depicted in FIG. 160 , the object 160 1 , 160 2 , 160 3 Located in a transport container 170, and the object 160 4 , 160 5 , 160 6 Located on conveyor 162. In the depicted embodiment, robotic arm 166 has moved object 160 1 , 160 2 , 160 3 From conveyor 162, objects 160 are transferred into transport containers 170. In the depicted embodiment, objects 160 1 , 160 2 has been placed in the shipping container to form a first layer of objects 160 in the shipping container 170, and the objects 160 1 and 160 2 With similar orientation. Object 160 3 The object 160 is also placed in the transport container 170 1 , 160 2 160 as part of a second layer of objects 160 in shipping container 170. In some embodiments, each layer of objects 160 has a different orientation than the layers of objects 160 adjacent to that layer (sometimes referred to as a "log cabin" arrangement). 3 is oriented to be with object 160 1 , 160 2 The orientation of the object 160 is different from that of the object 160. 1 and 160 2 ). In addition, Figure 1A In the example depicted in , the bonding tool 100 has been positioned and oriented by the robotic arm 166 in a manner that is not associated with any object 160. In some examples, Figure 1AThe position and orientation of bonding tool 100 in FIG. 1 may be any position and orientation of bonding tool 100 , or a default position and orientation of bonding tool 100 .

[0042] from Figure 1A The example shown in Figure 1B In the example shown in FIG. 1 , the conveyor 162 advances in a downstream direction 164. The advancement of the conveyor 162 causes the object 160 to 4 , 160 5 , 160 6 Moving in the downstream direction, and object 160 7 Part of the environment 100 Figure 1B The visible area from Figure 1A The example shown in Figure 1B In the example shown in FIG. 1 , the robot arm 166 moves the bonding tool 100 to the object 160 on the conveyor 162 4 The robot arm 166 also moves relative to the object 160. 4 Orienting bonding tool 100. In the depicted embodiment, the longest dimension of bonding tool 100 is substantially parallel to object 160. 4 Oriented by its longest dimension.

[0043] exist Figure 1B In the example shown in FIG. 1 , the robot arm 166 has been moved relative to the object 160 4 Position the bonding tool 100 so that the one or more suction devices on the underside of the bonding tool 100 have already bonded the object 160 4 The upper surface of Figure 1B In the example depicted in FIG. 1 , the vacuum source may be activated to draw a vacuum in the vacuum manifold 110. When one or more suction devices are provided by the subject 160 4 The surface of the object 160 is engaged and one or more suction devices are formed by the object 160 4 When engaged, the vacuum drawn in the vacuum manifold 110 causes the one or more suction devices to move toward the object 160. 4 In this way, the object 160 4 The object 160 is clamped by the bonding tool 100. 4 When clamped by the bonding tool 100, the robot arm 166 can move the object 160 4 from Figure 1B In some embodiments, a computing device (eg, a controller) can control the movement and orientation of the robotic arm 166 and the operation of the vacuum source.

[0044] from Figure 1B The example shown in Figure 1C In the example shown in FIG. 1 , when the bonding tool 100 is used to bond the object 1604 When clamping to another position, the robot arm 166 has moved the bonding tool 100. More specifically, the bonding tool 100 moves the object 160 4 from Figure 1B The conveyor 162 shown in FIG. 1 is moved to a position close to the object 160 in the transport container 170. 3 In order to make the bonding tool 100 Figure 1B and Figure 1C The example shown in FIG. 160 is a clamping object between 4 , the vacuum source continues to Figure 1B and Figure 1C In the example shown in FIG. 1 , a vacuum is applied in the vacuum manifold 110. Thus, even if the bonding tool 100 is not in the presence of the object 160, the bonding tool 100 may be used to bond the object 160 to the desired location. 4 Move the object 160 degrees on the area of ​​the bottom support 4 , the bonding tool 100 is also in the object 160 4 Apply on objects greater than 160 4 The force of weight makes the object 160 4 When moving object 160 4 Clamped by joining tool 100 .

[0045] In the depicted embodiment, when the robotic arm 166 moves the object 160 4 When moving from a position on conveyor 162 to a position in transport container 170, robot arm 166 moves between object 160 4 Changing objects while moving160 4 In the depicted embodiment, when the object 160 4 When located on conveyor 162, object 160 4 Basically perpendicular to the object 160 3 The robot arm 166 is oriented and moves toward the object 160 4 Changing objects while moving160 4 The orientation of the object is such that 160 4 When placed in the transport container 170, it is substantially parallel to the object 160. 3 In this way, the object 160 4 is oriented in a desired orientation for placement in shipping container 170. More specifically, object 160 4 is oriented so that the object 160 4 The second layer of objects 160 in shipping container 170 is completed.

[0046] exist Figure 1C In the example shown in FIG. , when object 160 4 Located in transport container 170 near object 160 3When the object 160 is in the position, the vacuum source can stop applying vacuum in the vacuum manifold 110 so that the object 160 4 When the vacuum source no longer applies vacuum in the vacuum manifold 110, the one or more suction devices no longer apply vacuum to the object 160. 4 Apply force so that the object 160 4 The object 160 is no longer clamped by the joining tool 100. 4 After no longer being clamped by the bonding tool 100, the robot arm 166 can be moved so that the bonding tool 100 is no longer clamped to the object 160. 4 In the depicted embodiment, from Figure 1C The example shown in Figure 1D In the example shown in FIG. 1 , the robot arm 166 is moved so that the bonding tool 100 is no longer in contact with the object 160 4 contact, and the bonding tool 100 has moved away from the object 160 4 Move. Figure 1D In the example shown in FIG. 1 , object 160 4 Retained in the shipping container 170, and the arbitrary or default position and orientation of the bonding tool 100 as Figure 1A as shown in .

[0047] Figures 1A to 1D The embodiment of the method shown in can be repeated multiple times to continue loading the transport container 170. For example, the conveyor 162 can continue to move the objects 160 in the downstream direction 164, and the robot 166 and the bonding tool 100 can be used to move the objects from the conveyor 162 individually to the transport container 170. The robot 166 and the bonding tool 100 can also control the position and orientation of the objects 160 in the transport container 170 to achieve a specific arrangement of the objects 160 in the transport container 170.

[0048] As described above, when a vacuum-based joining tool is used to clamp a non-uniform object, the non-uniformity of the object may make it difficult for the suction device on the vacuum-based joining tool to establish sufficient contact with the surface of the object. Poor contact with the suction device and the surface of the object prevents the joining tool from reliably joining these objects. In some embodiments, a meat product is an example of such a non-uniform object. The meat product may include raw or cooked meat pieces, such as beef, chicken, turkey, pork, fish, etc. In some embodiments, the meat product may be a raw meat piece without packaging. In some embodiments, the meat product may be a raw meat piece located in an at least partially transparent package. In one example, such packaging may include a closed bag made of a plastic film, and the meat piece may be located in the closed bag. In another example, such packaging may include a vacuum-sealed bag made of a plastic film, and the meat piece may be located in the vacuum-sealed bag. In another example, such packaging may include a vacuum-sealed package having a tray (e.g., a mostly opaque tray) and a plastic film (e.g., a mostly transparent film), the plastic film being sealed across the opening of the tray, and the meat piece may be located between the tray and the film. There are many other packaging examples in which a piece of meat may be placed. In many of the examples described herein, the interaction between the meat product and the suction device is described as being directly between the piece of meat and the suction device; however, it should be understood that such interaction may include a portion of the meat product's packaging (e.g., a film) between the piece of meat and the suction device.

[0049] One challenge in establishing proper contact between a meat product and a suction device is the various types of surfaces in a piece of meat. For example, a piece of meat may include various types of muscle tissue, different types of connective tissue (e.g., ligaments, tendons, silver skin, muscle fibers, etc.), bones, fatty tissue, etc. A suction device, such as a suction cup, interacts differently with each of the different types of surfaces of a meat product. Certain types of surfaces reduce the likelihood that the suction device will form a proper seal with the piece of meat. For example, if the suction device contacts a bone (or packaging material against a bone) having a particular shape, the bone may prevent the suction device from forming a proper seal. Other types of surfaces reduce the likelihood that the suction device will form a proper seal with the piece of meat. For example, if the suction device contacts adipose tissue (or packaging material against adipose tissue), the adipose tissue may make it more likely that the suction device will form a proper seal. In some cases, intermuscular fat (rather than intramuscular fat) may make it more likely that the suction device will form a proper seal. In some examples, intermuscular fat having a surface area at least as large as the surface area of ​​the suction device may make it more likely that the suction device will form a proper seal.

[0050] In some embodiments, the engaging device can be moved so that the suction device (e.g., a suction cup) engages a portion of the surface of the meat product that will facilitate forming a proper seal with the meat product. In some instances, a high percentage of fat content may be considered to be a portion of the surface of the meat product that is conducive to forming a proper seal. Thus, the engaging tool with respect to the meat product causes the suction device to engage a target area on the surface of the meat product, wherein the target area on the surface of the meat product is based on an estimated fat content in the meat product. Figures 2A to 2F Neutralization Figures 3A to 3D As described in the embodiment shown in , such a target area can be determined based on image data.

[0051] Figures 2A to 2D An embodiment of an image 200 of a meat product 202 is depicted. The image 200 also includes a background portion 204 surrounding the meat product 202. In some embodiments, the computing device is capable of processing the image 200 to determine a portion of the image 200 that includes the meat product 202 and a portion of the image 200 that includes the background portion 204. The image 200 shows one surface of the meat product 202. In some embodiments, the surface visible in the image 200, the visible surface of the meat product 202, is the surface of the meat product 202 that is intended to be engaged by the engagement device. In the depicted embodiment, the surface of the meat product 202 visible in the image 200 is the upper surface of the meat product 202. In some embodiments, the background portion 204 may display a surface on which the meat product 202 rests, such as a conveyor belt, a tabletop, etc.

[0052] exist Figure 2A In the embodiment shown in , the computing device detects the boundary between the meat product 202 and the background portion 204 (shown as a dotted line). The computing device can use any type of image processing to determine the boundary between the meat product 202 and the background portion 204. In some examples, the computing device can use a method based on color pixel counting, such as the method described in International Application No. PCT / US2019 / 036301 and U.S. Patent No. 10,667,530, the contents of which are incorporated herein by reference in their entirety. In some examples, the computing device can use machine learning methods, such as those described in International Application No. PCT / US2019 / 034488, the contents of which are incorporated herein by reference in their entirety. In other examples, the computing device can use any other method or technique of image processing to determine the boundary between the meat product 202 and the background portion 204.

[0053] exist Figure 2B In the example, the computing device identifies the region 206 of the meat product 202 1 ,206 2 ,206 3 and 206 4(collectively referred to as regions 206). In the depicted embodiment, regions 206 include four regions; however, in other embodiments, the computing device may identify any number of regions, such as any number of regions. In some embodiments, regions 206 are identified based on estimated similarities in tissue content (e.g., fat content) in the regions. In one example, one region may include a particularly high estimated fat content, another region may have a particularly low estimated fat content, and yet another region may have an estimated fat content between the other two regions. In another example, one or more regions may be estimated to have a fat content above a predetermined threshold, while one or more other regions may be estimated to have a fat content below a predetermined threshold. The computing device may use any type of image processing to determine regions 206, such as a method based on color pixel counting, a machine learning method, and the like.

[0054] exist Figure 2C In , the computing device has identified an estimated fat content for each region 206. Figure 2C In the particular example depicted, region 206 1 The fat content is estimated to be 90% in area 206 2 The fat content is estimated to be 85% in area 206 3 The fat content is estimated to be 70%, while area 206 4 The fat content of region 206 is estimated to be 65%. Obviously, in other embodiments, the estimated fat content in region 206 may be different from the depicted embodiment. In some embodiments, the estimated fat content is the estimated fat content on the surface of meat product 202 visible in image 200. In some embodiments, the computing device estimates the estimated fat content of each region 206 using any type of image processing (such as a method based on color pixel counting, a machine learning method, etc.).

[0055] In some embodiments, the computing device determines the target area based on the estimated fat content in area 206. In the depicted embodiment, the computing device may determine area 206 1 is the target area, because area 206 1 The target area may have the highest estimated fat content of any area 206. In other embodiments, the target area may be determined based on the estimated fat content in the area being above a predetermined fat content level. For example, the predetermined level of fat content may be the estimated average fat content of the surface of the meat product 202. In other embodiments, the target area may be determined based on the estimated fat content in the area in any other manner.

[0056] Figure 2D The computing device may optionally determine a target point 208 within the target area. In the depicted embodiment, the area 206 1is the target area, and the target point 208 is located in the area 206 1 Inside. Figure 2D As shown in , the target point can be defined by Cartesian coordinates, such as the two-dimensional coordinates (X 1 , Y 1 ) or three-dimensional coordinates (X 1 , Y 1 , Z 1 ). The target point may also be defined by any other type of coordinate system (e.g., polar coordinates, cylindrical coordinates, spherical coordinates, etc.) or any other way of defining a point in space. In some embodiments, the computing device may define the target point 208 anywhere within the target area, such as near the center of mass of the meat product 202, near the center of the target area, at least a certain distance from a boundary of the target area (e.g., a distance of a radius of a suction cup that will be used to engage the meat product 202), at least a certain distance from an outer edge of the meat product 202, etc. In some embodiments, the computing device may further determine the planarity of one or more target areas so that the suction device may be oriented substantially perpendicular to the target area when contacting the meat product 202. Orienting the suction device substantially perpendicular to the target area may increase the likelihood of establishing a proper seal between the suction device and the meat product 202.

[0057] Figure 2E A top view of a meat product 202 and a bonding tool 220 is depicted. The bonding tool 220 includes a vacuum manifold 222. The vacuum manifold 222 can be coupled to a vacuum source (not shown), such as a vacuum pump, which is capable of drawing a vacuum in the vacuum manifold 222. In the depicted embodiment, the bonding tool 220 also includes a suction device 224. 1 , 224 2 , 224 3 , 224 4 , 224 5 and 224 6 (collectively referred to as suction devices 224). In some embodiments, the suction devices 224 are suction cups or other structures capable of forming a seal against a surface. Each suction device 224 is fluidically connected in parallel with the vacuum manifold 222. In some embodiments, each suction device 224 includes a valve that is biased closed but will open when the suction device engages the surface of the object. In this way, the vacuum drawn in the vacuum manifold 222 will extend to each suction device 224 that engages with the object, and only to those suction devices 224 that engage with the object. In the depicted embodiment, there are six suction devices 224. In other embodiments, the bonding tool 220 may include any number of suction devices (i.e., one or more suction devices).

[0058] exist Figure 2EIn the embodiment shown in FIG. 1 , the engaging tool 220 is located away from the meat product 202. In particular, the target area 206 on the meat product 202 is shown. 1 , and there is no suction device 224 and target area 206 1 In some embodiments, the joining tool 220 is coupled to a moving system that is configured to move the joining tool 220 relative to the meat product 202. In some embodiments, the moving mechanism is a robotic arm (e.g., robotic arm 166) capable of moving the joining tool 220 in three-dimensional space. In some embodiments, the meat product 202 can be located on a transport system (e.g., a conveyor belt), and the joining tool 220 can be coupled to a track located above the transport system and aligned perpendicularly to the transport system, so that the moving mechanism can move the joining tool 220 vertically along the track and from the track to the transport system. In any case, the moving mechanism is capable of positioning and / or aligning the joining tool 220 with the meat product 202.

[0059] The movement mechanism can be communicatively coupled to a computing device configured to control the movement system to move the engaging tool. In some embodiments, the computing device (e.g., one or more computing devices) is configured to (i) based on the image 200 of the surface of the meat product 202, determine the target area 206 on the surface of the meat product 202. 1 The estimated fat content in the meat product 202 at the target area 206 on the surface of the meat product 202 is determined 1 , and (ii) causing the movement system to move the engagement tool 220 relative to the meat product 202 so that the at least one suction device 224 engages the target area 206 on the surface of the meat product 202 1 .like Figure 2F As shown in FIG. 2 , the engagement device 220 has been moved so that the suction device 224 4 Already engaged target area 206 1 In particular, in the depicted embodiment, the suction device 224 4 Align with and engage the target point 208. Once the suction device 224 4 Already engaged target area 206 1 , the computing device can start the vacuum in the suction device (for example, by starting the vacuum source connected to the vacuum manifold 222), so that the bonding tool 220 is in the suction device 224 1 The target area 206 is located on the surface of the meat product 202 1 At this time, the engaging tool 220 can move while clamping the meat product 202 to move the meat product 202.

[0060] When the joining tool 220 is moved so that one of the suction devices 224 engages the target area from the area 206, the computing device can determine the position and / or orientation of the joining tool 220 taking into account other factors. In one example, the computing device can position and / or orient the joining tool 220 to cover the center of mass of the meat product 202. Figure 2F In the embodiment shown in FIG. 2 , the bonding tool 220 is positioned so that the suction device 224 4 Aligned with and already engaged with target point 208, engagement tool 220 is also positioned and / or oriented to cover the estimated center of mass of meat product 202. Thus, although suction device 224 4 and target area 206 1 The engagement between the suction devices 224 and the meat product 202 is expected to be sufficient to clamp the meat product 202 as the meat product 202 moves, but any engagement of the other suction devices 224 with the meat product 202 will further improve the reliability of the clamping of the engagement tool 220 on the meat product. In another example, the computing device can cause the engagement tool 220 to be positioned and / or oriented to minimize the number of suction devices 224 that overhang or are located outside the edge of the meat product 202. Any suction devices 224 in these positions will not be available during the clamping of the meat product 202. The computing device can take any other factors into account when determining the position and / or orientation of the engagement tool 220 relative to the meat product 202.

[0061] exist Figures 2A to 2F In the embodiment shown in , one target area and one target point are determined on the meat product 202. In some embodiments, it may be advantageous to determine more than one target area and / or more than one target point. Figures 3A to 3D Embodiments are depicted in which more than one target area and more than one target point of more than one suction device 224 of the engagement tool 220 are determined to engage the meat product 202 .

[0062] Figure 3A A depiction of image 200 is shown, which is similar to Figure 2C A depiction of the image 200 shown in FIG. Figure 3A In , the computing device identifies an estimated fat content for each region 206. Figure 3A In the particular example depicted, region 206 1 The fat content is estimated to be 90% in area 206 2 The fat content is estimated to be 85% in area 206 3 The fat content is estimated to be 70%, while area 206 4 The fat content of region 206 is estimated to be 65%. In some embodiments, the computing device determines more than one target region based on the estimated fat content in region 206. In the depicted embodiment, the computing device may determine that region 206 1is the first target area, because area 206 1 has the highest estimated fat content of any region 206, and determines that region 206 2 is the second target area, because area 206 2 Region 206 has the second highest estimated fat content.

[0063] Figure 3B The computing device may optionally determine a target point within the target area. In the depicted embodiment, the area 206 1 is the first target area, and the first target point 210 1 Located in the first target area 206 1 and area 206 2 is the second target area, and the second target point 210 1 Located in the second target area 206 2 Inside. Figure 3B As shown in FIG. , the target points may be defined by Cartesian coordinates, such as the first target point 210 1 The two-dimensional coordinates (X 1 , Y 1 ) and the second target point 210 2 The two-dimensional coordinates (X 2 , Y 2 ). The target point may be defined in any other manner (e.g., three-dimensional coordinates) that defines a point in space. In some embodiments, the computing device may respectively 1 and the second target area 206 2 The first target point 210 is defined as any place within the meat product 202, such as near the center of the meat product 202, near the center of the acceptance target area, at least a certain distance from the boundary of the acceptance target area, at least a certain distance from the outer edge of the meat product 202, etc. 1 and the second target point 210 2 .

[0064] Figure 3C A top view of a meat product 202 and a joining tool 220 is depicted. Figure 3C In the embodiment shown in FIG. 1 , the engaging tool 220 is located away from the meat product 202. In particular, the first target area 206 on the meat product 202 is shown. 1 and the second target area 206 2 , and there is no suction device 224 and the first target area 206 1 and the second target area 206 2 In some embodiments, the joining tool 220 is coupled to a movement system that is configured to move the joining tool 220 relative to the meat product 202. Figure 3CAlso depicted is a first target point 210 1 and the second target point 210 2 In some embodiments, the computing device determines the first target point 210 1 and the second target point 210 2 , so that the distance 212 corresponds to the distance between the two suction devices 224.

[0065] In some embodiments, the computing device (eg, one or more computing devices) is configured to (i) based on the image 200 of the surface of the meat product 202, determine the first target area 206 on the surface of the meat product 202; 1 and the second target area 206 2 The estimated fat content in the meat product 202 at the meat product 202 determines the first target area 206 on the surface of the meat product 202 1 and the second target area 206 2 , and (ii) causing the movement system to move the engagement tool 220 relative to the meat product 202 so that at least one of the suction devices 224 engages the first target area 206 on the surface of the meat product 202 1 and the second target area 206 2 Each one of them.

[0066] like Figure 3D As shown in FIG. 2 , the engagement device 220 has been moved so that the suction device 224 4 The first target area 206 has been engaged 1 , and the suction device 224 3 The second target area 206 has been engaged 1 In particular, in the depicted embodiment, the suction device 224 4 With the first target point 210 1 Align and engage, and suction device 224 3 and the second target point 210 2 Align and engage. To achieve Figure 3D , a moving system (e.g., a robotic arm) rotates the joining tool 220 relative to the meat product 202 to provide an angular alignment of the joining tool 220 relative to the meat product 202. Once the suction device 224 4 and 224 3 Engage the first and second target areas 206 respectively 1 and 206 2 The computing device may activate the vacuum in the suction device (eg, by activating a vacuum source connected to the vacuum manifold 222), so that the bonding tool 220 is respectively in the suction device 224 4 and 224 3The first and second target areas 206 are located on the surface of the meat product 202 1 and 206 2 At this time, the engaging tool 220 can move while clamping the meat product 202 to move the meat product 202.

[0067] Figure 4A and 4B 3 is a top view and a side view of a system 300 for acquiring an image of a meat product and controlling a joining tool. The system 300 includes a transport system 302 configured to transport a meat product 304 along a transport direction 306. 1 ,304 2 and 304 3 (collectively referred to as meat products 304). In the depicted embodiment, the transport system 302 includes a conveyor belt 308 on which the meat products 304 are located. In the depicted embodiment, only a portion of the transport system 302 is depicted; additional meat products 304 may be located in the transport system 302. Figure 4A and 4B On the parts not depicted.

[0068] System 300 includes an imaging system 316 configured to obtain a captured image of meat product 304. In some embodiments, imaging system 316 is configured to capture images of meat product 304 while meat product 304 is being transported by transport system 302 along transport direction 306. In some embodiments, the images captured by imaging system 316 of meat product 304 include one or more still images, one or more videos, or any combination thereof.

[0069] In the depicted embodiment, the imaging system 316 includes an image capture system 318. The image capture system 318 includes a camera 320 configured to capture an image within a field of view 322. In some embodiments, the camera 320 includes one or more of a semiconductor charge-coupled device (CCD), an active pixel sensor in a complementary metal oxide semiconductor (CMOS) integrated circuit, an active pixel sensor in an N-type metal oxide semiconductor semiconductor (NMOS, Live MOS) integrated circuit, a three-dimensional (3D) sensor, a line scanner, or any other digital image sensor, or any combination thereof. In the depicted embodiment, the camera 320 is arranged so that the field of view 322 is directed toward a portion of the transportation system 302. Figure 4A and 4B In the example depicted in FIG. 1 , the meat product 304 2 On the conveyor belt 308 within the field of view 322 of the camera 320. 2 In this position, the camera 320 is configured to capture the meat product 304 2 One or more images of meat products 3042 One or more videos or meat products 304 2 A combination of images and videos.

[0070] In some embodiments, the image capture system 318 also includes one or more electromagnetic energy sources 324 configured to emit electromagnetic energy into the field of view 322 of the camera 320. In some embodiments, the one or more electromagnetic energy sources 324 are configured to emit electromagnetic energy in one or more of an X-ray wavelength range (i.e., electromagnetic energy with a wavelength between about 0.001 nm and about 30 nm), an ultraviolet wavelength range (i.e., electromagnetic energy with a wavelength between about 30 nm and about 400 nm), a visible wavelength range (i.e., electromagnetic energy with a wavelength between about 380 nm and about 760 nm), or an infrared wavelength range (electromagnetic energy with a wavelength between about 750 nm and about 3 mm). In some embodiments, the one or more wavelength ranges of electromagnetic energy emitted by the electromagnetic energy source 324 are determined based on desired characteristics of the image data acquired by the camera 320.

[0071] In the depicted embodiment, the imaging system 316 also includes a presence detector system 326. In the depicted embodiment, the presence detector system 326 is a photoelectric sensor (e.g., a photoelectric eye). More specifically, the illustrated embodiment of the presence detector system 326 is a through-beam photoelectric sensor that includes an emitter 328 and a detector 330. The emitter 328 is configured to transmit electromagnetic energy (e.g., infrared electromagnetic energy, visible electromagnetic energy, etc.) to the detector 330. The detector 330 is configured to detect the electromagnetic energy transmitted by the emitter 328. If the detector 330 fails to detect the electromagnetic energy, the detector 330 may generate a signal indicating that an object has passed between the emitter 328 and the detector 330. In other embodiments, the presence detector system 326 may be a through-beam photoelectric sensor that includes a transceiver in place of the detector 330 and a reflector in place of the emitter 328. The transceiver transmits electromagnetic energy to the reflector, and the reflector reflects the electromagnetic energy back to the transceiver. When the transceiver detects any interruption of the electromagnetic energy, the transceiver may generate a signal indicating that an object has passed between the transceiver and the reflector. In other embodiments, the presence detector system 326 may be a diffuse photoelectric sensor located on only one side of the transport system 302 and capable of detecting the presence of objects on the conveyor belt 308 .

[0072] In the depicted embodiment, the presence detector system 326 is communicatively coupled to the controller 332. When the presence detector system 326 detects the presence of an object on the transport system 302, the presence detector system 326 is configured to transmit a signal indicating the presence of the object to the controller 332. The controller 332 is communicatively coupled to the image capture system 318. The controller 332 is configured to cause the image capture system 318 to capture an image of one of the meat products 304. Figure 4A and 4B , the controller 332 is external to both the image capture system 318 and the presence detector system 326. In this case, the controller 332 may be a computing device that communicates with each of the image capture system 318 and the presence detector system 326. In other embodiments, the controller 332 may be integrated with the image capture system 318 or the presence detector system 326. In some embodiments, the controller 332 can control the timing of the image capture system 318 so that one of the meat products 304 is in the field of view 322 of the camera 320 when the image capture system 318 acquires image data.

[0073] In one example, as the transport system 302 continues to move the meat product 304 in the transport direction 306, the meat product 304 1 While moving between the emitter 328 and the detector 330, the presence detector system 326 will detect the meat product 304. 1 The presence of meat product 304 is detected by the detector 330, and the detector 330 sends an indication to the controller 332. 1 The presence of a signal. When meat products 304 1 As the meat product 304 continues to move in the transport direction 306, the controller 332 causes the image capture system 318 to capture the meat product 304. 1 In some embodiments, the controller 332 controls the timing of the image capture system 318 so that if the camera 320 captures the meat product 304 1 During at least a portion of the image data, the meat product 304 1 Within field of view 322.

[0074] In the depicted embodiment, the imaging system 316 is communicatively coupled to a computing device 334 via a network 336. In some embodiments, the computing device 334 may be a remote computing device. As used herein, the term "remote computing device" refers to a computing device that is sufficiently far away from a location that a user at the location cannot interact directly with the remote computer device. In other embodiments, the computing device 334 may be a local computing device. As used herein, the term "local computing device" refers to a computing device located at a location such that a user at the location can interact directly with the local computer device. The computing device 334 may be any type of computing device, such as a server, a desktop computer, a laptop computer, a cellular phone, a tablet computer, and the like.

[0075] In some embodiments, network 336 is a wired network, such as an Ethernet local area network (LAN), a coaxial cable data communication network, a fiber optic network, a direct wired serial communication connection (e.g., USB), or any other type of wired communication network. In some embodiments, network 336 is a wireless network, such as a WiFi network, a radio communication network, a cellular data communication network (e.g., 4G, LTE, etc.), a direct wireless communication connection (e.g., Bluetooth, NFC, etc.), or any other type of wireless communication network. In some embodiments, network 336 is a combination of wired and wireless networks. In some embodiments, network 336 can be a private network (e.g., a private LAN), a public network (e.g., the Internet), or a combination of private and / or public networks.

[0076] In some embodiments, imaging system 316 is configured to send images acquired from meat product 304 to computing device 334 via network 336. In the depicted embodiment, image capture system 318 is configured to send image data to computing device 334 via network 336. Computing device 334 is configured to determine, from the image of the surface of meat product 304, a target area on the surface of meat product 304 based on an estimated fat content in meat product 304 at the target area on the surface of meat product 304.

[0077] The computing device 334 is also communicatively coupled to a movement system 360. The movement system 360 is configured to move a joining tool 362. The joining tool 362 includes one or more suction devices (e.g., suction cups) configured to join the surface of the meat product 304. For example, the movement system 360 may be configured in the same manner as described above with respect to Figures 2A to 2F and Figures 3A to 3D The bonding tool 362 is moved in a manner similar to that described above. The computing device 334 is configured to cause the mobile system 360 to move, such as by sending control signals to the mobile system 360 instructing the mobile system 360 how to position and / or orient the bonding tool 362.

[0078] The computing device 334 is also communicatively coupled to a vacuum source 364. The vacuum source 364 is coupled to the bonding tool 362 (e.g., via a gas line) and is configured to draw a vacuum within the bonding tool 362 (e.g., draw a vacuum via a gas line). In some embodiments, the vacuum source 364 is a vacuum pump or any other device capable of drawing a vacuum. The computing device 334 is configured to initiate a vacuum within the bonding tool 362 by controlling the operation of the vacuum source 364, such as by sending a control signal to the vacuum source 364 indicating the operation of the vacuum source 364 (e.g., when the vacuum source 364 is operating, at what power level the vacuum source 364 is operating, etc.).

[0079] exist Figure 4A and 4BIn the embodiment shown in , meat product 304 is a cut of meat without external packaging. In this case, image capture system 318 can be configured to capture an image of the surface of the cut of meat, and engagement tool 362 can be configured to directly engage the surface of the cut of meat. In other embodiments, system 300 can be used with a meat product that includes a cut of meat in a package. An example of such a meat product is Figure 5A and 5B In Fig. 6A and 6B as shown in .

[0080] Figure 5A and Figure 5B Depicted are top and side views of a system 300 for use with a meat product that is a cut of meat in a packaging material. In particular, Figure 5A and 5B Depicted meat products 340 1 ,340 2 and 340 3 (collectively referred to as meat products 340). Each meat product 340 includes a piece of meat 342 and a vacuum sealed package 344 surrounding the piece of meat 342. Figure 4A and 4B 304 is located on the transport system 302. However, because the meat product 340 includes the vacuum sealed package 344, at least a portion of the vacuum sealed package 344 is at least partially transparent. In the depicted embodiment, a portion of the vacuum sealed package 344 adjacent to the upper surface of the meat piece 342 is at least partially transparent. This allows the image capture system 318 to capture an image of the upper surface of the meat piece 342 through the vacuum sealed package 344.

[0081] After the image capture system 318 captures an image of the upper surface of a piece of meat 342 and sends the image to the computing device 334, a target area on the surface of the meat product 340 is determined from the image of the surface of the meat product 340 based on an estimated fat content in the meat product 340 at the target area on the surface of the meat product 340. In this case, the computing device 334 determines the target area on the vacuum sealed package 344 based on the estimated fat content in the surface of the piece of meat 342 shown in the image. The computing device 334 can cause the movement system 360 to move the engagement tool 362 relative to the meat product 340 so that the suction device of the engagement tool 362 engages the target area on the surface of the vacuum sealed package 344 of the meat product 340.

[0082] Fig. 6A and Figure 6B Depicted in FIG. 1 are top and side views of a system 300 for use with a meat product that is a piece of meat in a packaging material. In particular, Fig. 6A and 6BDepicted meat products 350 1 , 350 2 and 350 3 (collectively referred to as meat products 350). Each meat product 350 includes a piece of meat 352 in a package that includes a tray 354 and a plastic film 356 sealed across the opening of the tray over the piece of meat 352. In some embodiments, the plastic film 356 is vacuum sealed to the piece of meat 352 and the tray 354. Figure 4A and 4B 354 is located on the transport system 302. However, because the meat product 350 includes the tray 354 and the film 356, at least a portion of the tray and / or the film 356 is at least partially transparent. In the depicted embodiment, the tray 354 is substantially opaque, and at least a portion of the film 356 is at least partially transparent. This allows the image capture system 318 to capture an image of the upper surface of the piece of meat 352 through the film 356.

[0083] After the image capture system 318 captures an image of the upper surface of a piece of meat 352 and sends the image to the computing device 334, a target area on the surface of the meat product 350 is determined from the image of the surface of the meat product 350 based on an estimated fat content in the meat product 350 at the target area on the surface of the meat product 350. In this case, the computing device 334 determines the target area on the film 356 based on the estimated fat content in the surface of the piece of meat 352 shown in the image. The computing device 334 can cause the movement system 360 to move the engagement tool 362 relative to the meat product 350 so that the suction device of the engagement tool 362 engages the target area on the surface of the film 356 of the meat product 350.

[0084] It is apparent that many other meat product variations can be used with the system 300. For example, the meat product can include any type of meat product, such as beef, chicken, turkey, pork, fish, etc. In another example, the meat product can have any type of packaging material around the piece of meat. In another example, each meat product can have multiple pieces of meat with packaging material around the multiple pieces of meat. In another example, the surface of the piece of meat in the captured image can be any surface of the meat product that will be engaged by the engaging tool. Any other variations of the meat product are possible and can be handled by the system described herein.

[0085] Figure 7Depicted is a schematic diagram of system 300. System 300 includes imaging system 316, computing device 334, moving system 360, joining tool 362, suction device 363, and vacuum source 364. Imaging system 316 is configured to capture images of meat products and provide the captured images to computing device 334. Imaging system 316 includes image capture system 318 configured to capture images (e.g., still images or videos) of meat products. Imaging system 316 also includes presence detector system 326 configured to detect the presence of individual meat products. For example, when the meat products are transported by a transport system, presence detector system 326 can detect the presence of individual meat products. Imaging system 316 also includes controller 332, which is configured to control the timing of image capture by image capture system 318 based on signals from presence detector system 326.

[0086] The computing device 334 includes a processing unit 370, such as a central processing unit (CPU). The processing unit is communicatively coupled to a communication bus 372. In the depicted embodiment, the computing device 334 also includes a memory 374, which is configured to store data under the direction of the processing unit 370. In the depicted embodiment, the computing device 334 also includes a user interface 376, which includes one or more devices that can receive input from a user into the computing device 334 and / or output output from the computing device 334. In the depicted embodiment, the computing device 334 also includes a communication interface 378 that can communicate with an external computing device and / or a network. In the depicted embodiment, the computing device 334 also includes a database 324 local to the computing device 334.

[0087] The computing device 334 further includes an image processing unit 380. The image processing unit 380 may be implemented as software, hardware, or some combination thereof executed by the processing unit 370. The image processing unit 380 may be capable of analyzing the image of the meat product in any manner discussed herein. In one example, the image processing unit 380 may be capable of determining the difference between the meat product and the background portion in the image. In another example, the image processing unit 380 may be capable of identifying regions of the meat product, such as regions identified based on estimated similarities of tissue content (e.g., fat content) in the regions. In another example, the image processing unit 380 may be capable of identifying the estimated fat content of each region. In another example, the image processing unit 380 may be capable of determining a target region based on the estimated fat content in the region. In another example, the image processing unit 380 may be capable of determining a target point within the target region.

[0088] The computing device 334 further includes a controller unit 382. The controller unit 382 can be implemented as software, hardware, or some combination thereof executed by the processing unit 370. The controller unit 382 can be capable of controlling the computing device, the moving system 360, the vacuum source 364, and / or any other component of the system 300 in any manner discussed herein. In one example, the controller unit 382 can be capable of generating a signal that causes the moving system 360 to move the joining tool 362 relative to the meat product so that the suction device 363 engages a target area on the surface of the meat product. In another example, the controller unit 382 can be capable of generating a signal that causes the vacuum source 364 to initiate a vacuum within the suction device 363 (e.g., by drawing a vacuum in the vacuum manifold of the joining tool 362) so that the joining tool 362 applies a force on the target area of ​​the surface of the meat product at the suction device 362. In another example, the controller unit 382 can be capable of generating signals that control the system 300, such as any other aspect of the transport system 302, the imaging system 316, etc.

[0089] In the depicted embodiment, each of the memory 374, the user interface 376, the communication interface 378, the image processing unit 380, and the controller unit 382 are communicatively coupled to the communication bus 372 such that the processing unit 370, the memory 374, the user interface 376, the communication interface 378, the image processing unit 380, and the image processing unit 382 can communicate with each other.

[0090] As described above, the imaging system 316 is configured to provide an image of the meat product to the computing device 334. The image from the imaging system 316 to the computing device 334 can be transmitted via one or more wired connections (e.g., a serial communication connection), a wireless connection (e.g., a WiFi connection), or a combination of wired and wireless connections. When the computing device 334 receives the image of the meat product from the imaging system 316, the processing unit 370 can cause the image to be stored in the memory 374. The processing unit 370 can then instruct the trained image processing unit to process the image. The processing unit 370 can then cause the controller unit 382 to control the movement system 360, the vacuum source 364, or any other component of the system 300 based on the processed image.

[0091] Figure 8 An example embodiment of a system 410 is depicted, which can be used to implement some or all of the embodiments described herein. In the depicted embodiment, the system 410 includes a computing device 420 1 ,420 2 ,420 3 and 420 4 (collectively referred to as computing device 420). In the depicted embodiment, computing device 420 1It is a tablet computer, computing device 420 2 is a mobile phone, computing device 420 3 is a desktop computer, and computing device 420 4 In other embodiments, computing device 420 includes one or more of a desktop computer, a mobile phone, a tablet, a megaphone, a notebook computer, a laptop computer, a distributed system, a game console (e.g., Xbox, PlayStation, Wii), a watch, a pair of glasses, a key fob, a radio frequency identification (RFID) tag, a headset, a scanner, a television, a dongle, a camera, a wristband, a wearable item, a kiosk, an input terminal, a server, a server network, a blade, a gateway, a switch, a processing device, a processing entity, a set-top box, a repeater, a router, a network access point, a base station, any other device configured to perform the functions, operations, and / or processes described herein, or any combination thereof.

[0092] Computing devices 420 are communicatively coupled to each other via one or more networks 430 and 432. Each of networks 430 and 432 may include one or more wired or wireless networks (e.g., 3G networks, the Internet, internal networks, private networks, secure networks). Computing devices 420 are capable of communicating with each other and / or with any other computing devices via one or more wired or wireless networks. Figure 8 The particular system 410 in FIG. 4 depicts computing devices 420 communicatively coupled via network 430 as including four computing devices, but any number of computing devices may be communicatively coupled via network 430 .

[0093] In the depicted embodiment, computing device 420 3 The peripheral device 440 is communicatively coupled to the computing device 420 via the network 432. In the depicted embodiment, the peripheral device 440 is a scanner, such as a barcode scanner, an optical scanner, a computer vision device, etc. In some embodiments, the network 432 is a wired network (e.g., a peripheral device 440 is connected to the computing device 420). 3 ), a wireless network (e.g., a Bluetooth connection or a WiFi connection), or a combination of wired and wireless networks (e.g., a Bluetooth connection between the peripheral device 440 and the cradle of the peripheral device 440 and a Bluetooth connection between the peripheral device 440 and the computing device 420). 3 In some embodiments, peripheral device 440 is itself a computing device (sometimes referred to as a "smart" device). In other embodiments, peripheral device 440 is not a computing device (sometimes referred to as a "dumb" device).

[0094] Fig. 9Depicted in is a block diagram of an embodiment of a computing device 500. Any computing device 420 and / or any other computing device described herein may include some or all of the components and features of computing device 500. In some embodiments, computing device 500 is a desktop computer, a mobile phone, a tablet, a megaphone, a notebook computer, a laptop computer, a distributed system, a game console (e.g., Xbox, PlayStation, Wii), a watch, a pair of glasses, a key fob, a radio frequency identification (RFID) tag, a headset, a scanner, a television, a dongle, a camera, a wristband, a wearable item, a kiosk, an input terminal, a server, a server network, a blade, a gateway, a switch, a processing device, a processing entity, a set-top box, a repeater, a router, a network access point, a base station, one or more of any other device configured to perform the functions, operations, and / or processes described herein, or any combination thereof. Such functions, operations, and / or processes may include, for example, sending, receiving, operating, processing, displaying, storing, determining, creating / generating, monitoring, evaluating, comparing, and / or similar terms as used herein. In one embodiment, these functions, operations and / or processes may be performed on data, content, information and / or similar terms as used herein.

[0095] In the depicted embodiment, computing device 500 includes processing element 505, memory 510, user interface 515, and communication interface 520. Processing element 505, memory 510, user interface 515, and communication interface 520 can communicate via communication bus 525 by reading data from and / or writing data to communication bus 525. Computing device 500 may include other components capable of communicating via communication bus 525. In other embodiments, the computing device does not include communication bus 525, and the components of computing device 500 can communicate with each other in some other manner.

[0096] Processing element 505 (also referred to as one or more processors, processing circuits and / or similar terms used herein) is capable of performing operations on certain external data sources. For example, the processing element can perform operations on data in memory 510, data received via user interface 515, and / or data received via communication interface 520. As will be understood, processing element 505 can be embodied in a variety of different ways. In some embodiments, processing element 505 includes one or more complex programmable logic devices (CPLDs), microprocessors, multi-core processors, co-processing entities, application specific instruction set processors (ASIPs), microcontrollers, controllers, integrated circuits, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), hardware accelerators, any other circuits or any combination thereof. The term circuit can refer to an entire hardware embodiment or a combination of hardware and computer program products. In some embodiments, processing element 505 is configured for a specific purpose, or is configured to execute instructions stored in a volatile or non-volatile medium or otherwise accessible by processing element 505. As such, whether configured by hardware or a computer program product, or a combination thereof, the processing element 505 may be capable of performing steps or operations when configured accordingly.

[0097] The memory 510 in the computing device 500 is configured to store data, computer executable instructions, and / or any other information. In some embodiments, the memory 510 includes volatile memory (also referred to as volatile storage, volatile media, volatile memory circuits, etc.), non-volatile memory (also referred to as non-volatile storage, non-volatile media, non-volatile memory circuits, etc.), or some combination thereof.

[0098] In some embodiments, the volatile memory includes random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), fast page mode dynamic random access memory (FPM DRAM), extended data output dynamic random access memory (EDO DRAM), synchronous dynamic random access memory (SDRAM), double data rate type synchronous dynamic random access memory (DDR SDRAM), double data rate type two synchronous dynamic random access memory (DDR2SDRAM), double data rate type three synchronous dynamic random access memory (DDR3 SDRAM), Rambus dynamic random access memory (RDRAM), two-transistor RAM (TTRAM), thyristor RAM (T-RAM), zero capacitor (Z-RAM), Rambus in-line memory module (RIMM), dual in-line memory module (DIMM), single in-line memory module (SIMM), video random access memory (VRAM), cache memory (including various levels), flash memory, any other memory that requires power to store information, or any combination thereof.

[0099] In some embodiments, the non-volatile memory includes a hard disk, a floppy disk, a floppy disk, a solid-state storage (SSS) (e.g., a solid-state drive (SSD)), a solid-state card (SSC), a solid-state module (SSM), an enterprise flash drive, a magnetic tape, any other non-transitory magnetic medium, a compact disk read-only memory (CD-ROM), or a hard disk. The present invention relates to a method of storing information in a manner that is suitable for use with a computer programmable logic device, a memory device, a memory card, a rewritable compact disk (CD-RW), a digital versatile disk (DVD), a Blu-ray disc (BD), any other non-transitory optical medium, a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory (e.g., serial, NAND, NOR, etc.), a multimedia memory card (MMC), a secure digital (SD) memory card, a memory stick, a conductive bridging random access memory (CBRAM), a phase change random access memory (PRAM), a ferroelectric random access memory (FeRAM), a non-volatile random access memory (NVRAM), a magnetoresistive random access memory (MRAM), a resistive random access memory (RRAM), a silicon oxide nitride silicon memory (SONOS), a floating junction gate random access memory (FJGRAM), a Millipede memory, a racetrack memory, any other memory that does not require power to store information, or any combination thereof.

[0100] In some embodiments, memory 510 is capable of storing one or more of a database, a database instance, a database management system, data, an application, a program, a program module, a script, a source code, an object code, a byte code, a compiled code, an interpreted code, a machine code, an executable instruction, or any other information. The terms database, database instance, database management system, and / or similar terms used herein may refer to a collection of records or data stored in a computer-readable storage medium using one or more database models, such as a hierarchical database model, a network model, a relational model, an entity-relationship model, an object model, a document model, a semantic model, a graph model, or any other model.

[0101] The user interface 515 of the computing device 500 communicates with one or more input or output devices capable of receiving input into the computing device 500 and / or outputting any output from the computing device 500. Examples of input devices include a keyboard, a mouse, a touch screen display, a touch sensitive pad, a motion input device, a mobile input device, an audio input, a pointing device input, a joystick input, a keyboard input, a peripheral device 440, a foot switch, etc. Examples of output devices include an audio output device, a video output device, a display device, a motion output device, a mobile output device, a printing device, etc. In some embodiments, the user interface 515 includes hardware configured to communicate with one or more input devices and / or output devices via a wired and / or wireless connection.

[0102] The communication interface 520 can communicate with various computing devices and / or networks. In some embodiments, the communication interface 520 can transmit data, content, and / or any other information that can be sent, received, manipulated, processed, displayed, stored, etc. Communication via the communication interface 520 can be performed using a wired data transmission protocol such as Fiber Distributed Data Interface (FDDI), Digital Subscriber Line (DSL), Ethernet, Asynchronous Transfer Mode (ATM), Frame Relay, Cable Data Service Interface Specification (DOCSIS), or any other wired transmission protocol. Similarly, wireless data transmission protocols such as General Packet Radio Service (GPRS), Universal Mobile Telecommunications System (UMTS), Code Division Multiple Access 2000 (CDMA2000), CDMA2000IX (lxRTT), Wideband Code Division Multiple Access (WCDMA), Global System for Mobile Communications (GSM), Enhanced Data Rates for GSM Evolution (EDGE), Time Division Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), Evolved Universal Terrestrial Radio Access Network (E-UTRAN), Evolution Data Optimized (EVDO), High Speed ​​Packet Access (HSPA), High Speed ​​Downlink Packet Access (HSDPA), IEEE 802.11 (WiFi), WiFi Direct, 802.16 (WiMAX), Ultra-Wideband (UWB), Infrared (IR) protocol, Near Field Communication (NFC) protocol, Wibree, Bluetooth protocol, wireless Universal Serial Bus (USB) protocol, or any other wireless protocol may be used for execution.

[0103] As will be appreciated by those skilled in the art, one or more components of computing device 500 may be located remotely from other components of computing device 500, such as in a distributed system. Furthermore, one or more of the components may be combined, and additional components that perform the functions described herein may be included in computing device 500. Thus, computing device 500 may be adapted to accommodate a variety of needs and environments. The depicted and described architecture and description are provided for exemplary purposes only and are not intended to be limiting of the various embodiments described herein.

[0104] The embodiments described herein may be implemented in various ways, including as a computer program product comprising an article of manufacture. A computer program product may include a non-transitory computer-readable storage medium storing an application, a program, a program module, a script, a source code, a program code, an object code, a byte code, a compiled code, an interpreted code, a machine code, an executable instruction, etc. (also referred to herein as an executable instruction, an instruction for execution, a computer program product, a program code, and / or similar terms used interchangeably herein). Such non-transitory computer-readable storage medium includes all computer-readable media (including volatile and non-volatile media).

[0105] It should be understood that various embodiments of the embodiments described herein may also be implemented as methods, apparatuses, systems, computing devices, etc. Therefore, the embodiments described herein may take the form of apparatuses, systems, computing devices, etc. that execute instructions stored on a computer-readable storage medium to perform certain steps or operations. Therefore, the embodiments described herein may be implemented entirely in hardware, entirely in a computer program product, or in an embodiment that includes a combination of a computer program product and hardware that performs certain steps or operations.

[0106] The embodiments described herein can be carried out with reference to block diagrams and flowchart illustrations. Therefore, it should be understood that each frame of the block diagram and flowchart can be implemented in the form of a computer program product, in a complete hardware embodiment, in a combination of hardware and computer program products, or in a device, system, computing device, etc. that executes instructions, operations, or steps. Such instructions, operations, or steps can be stored on a computer-readable storage medium for execution by a processing element in a computing device. For example, the retrieval, loading, and execution of the code can be performed sequentially so that an instruction is retrieved, loaded, and executed at one time. In some exemplary embodiments, retrieval, loading, and / or execution can be performed in parallel so that multiple instructions are retrieved, loaded, and / or executed together. Therefore, such an embodiment can produce a machine that performs a specific configuration of the steps or operations specified in the block diagram and flowchart illustration. Therefore, the block diagram and flowchart illustration support various combinations of embodiments for executing specified instructions, operations, or steps.

[0107] For purposes of this disclosure, terms such as "upper," "lower," "vertical," "horizontal," "inwardly," "outwardly," "interior," "exterior," "front," "rear," and the like should be interpreted as descriptive and not limiting the scope of the claimed subject matter. In addition, as used herein, "includes," "comprising," or "having," and variations thereof, are meant to encompass the items listed thereafter and their equivalents as well as additional items. Unless otherwise limited, the terms "connected," "coupled," and "mounted," and variations thereof, herein are used broadly and include direct and indirect connections, couplings, and mountings. Unless otherwise noted, the terms "substantially," "approximately," and the like are used to indicate within 5% of a target value.

[0108] The principles, representative embodiments and operating modes of the present disclosure have been described in the foregoing description. However, the various aspects of the present disclosure that are intended to be protected should not be interpreted as being limited to the disclosed specific embodiments. In addition, the embodiments described herein will be considered illustrative rather than restrictive. It should be understood that without departing from the spirit of the present disclosure, changes and changes can be made by other and adopted equivalent schemes. Therefore, it is clearly intended that all these changes, changes and equivalent schemes fall within the spirit and scope of the present disclosure as claimed.

Claims

1. A system for acquiring an image of a meat product and controlling a joining tool, comprising: A joining tool having a suction device; a movement system configured to move the bonding tool; an imaging system configured to capture an image of a surface of a meat product; as well as a computing device communicatively coupled to the mobile system and the imaging system, wherein the computing device is configured to: determining, from the image of the meat product surface, a target area on the meat product surface based on an estimated fat content in the meat product at the target area on the meat product surface, causing the movement system to move the engagement tool relative to the meat product so that the suction device engages the target area on the surface of the meat product, and activating a vacuum within the suction device so that the engaging tool applies a force on the target area of ​​the surface of the meat product at the suction device; wherein the meat product comprises a piece of raw meat in a package, wherein the package is at least partially transparent, and wherein the surface of the meat product comprises a surface of the package.

2. The system according to claim 1, wherein: The estimated fat content in the meat product at the target area on the surface of the meat product is above a predetermined level of fat content.

3. The system according to claim 2, wherein: The predetermined level of fat content is an estimated average fat content of the surface of the meat product.

4. The system according to claim 1, wherein: The estimated fat content in the meat product at the target area on the surface of the meat product is the highest estimated fat content on the surface of the meat product.

5. The system according to claim 1, wherein: As part of determining the target area on the surface of the meat product, the computing device is configured to determine a target point in the target area on the surface of the meat product.

6. The system according to claim 1, wherein: The package comprises at least one of: a closed bag made of a plastic film, a vacuum sealed bag made of a plastic film, or a vacuum sealed package having a tray and a plastic film sealed across an opening of the tray.

7. The system according to claim 1, wherein: The surface of the meat product is the upper surface of the meat product.

8. The system according to claim 1, wherein: The imaging system is configured to capture the image of the surface of the meat product while the meat product is on a transport system.

9. The system according to claim 1, wherein: The movement system includes a robotic arm configured to move the bonding tool in three-dimensional space.

10. The system according to claim 9, wherein: The robotic arm is further configured to rotate the engaging tool relative to the meat product to provide an angular alignment of the engaging tool relative to the meat product.

11. The system according to claim 1, wherein: The joining tool has a plurality of suction devices including the suction device and a second suction device.

12. The system according to claim 11, wherein: The computing device is further configured to determine, from the image of the meat product surface, a second target area on the surface of the meat product based on the estimated fat content in the meat product at the target area on the surface of the meat product.

13. The system according to claim 12, wherein: When the computing device causes the moving system to move the engaging tool relative to the meat product so that the suction device engages the target area on the surface of the meat product, the computing device is further configured to cause the moving system to move the engaging tool relative to the meat product so that the second suction device engages the second target area on the surface of the meat product.

14. The system according to claim 13, wherein: The computing device is further configured to cause the movement system to rotate the engagement tool relative to the meat product to provide angular alignment of the engagement tool relative to the meat product before the suction device engages the target area and the second suction device engages the second target area.

15. The system of claim 1, wherein: The estimated fat content in the meat product at the target area is based on one or more of an estimate of a thickness of the fat content, a calculated surface area of ​​the fat content, or a profile of the fat content.

16. The system according to any one of claims 1 to 15, wherein: The computing device is a controller.

17. A method of controlling a system comprising a bonding tool having a suction device and a movement system configured to move the bonding tool, the method comprising: capturing an image of the surface of the meat product by an imaging system; determining, by a computing device, a target area on the surface of the meat product from the image of the surface of the meat product based on an estimated fat content in the meat product at the target area on the surface of the meat product; causing a movement system, by the computing device, to move the engagement tool relative to the meat product so that the suction device engages the target area on the surface of the meat product; as well as activating, by the computing device, a vacuum within the suction device such that the engagement tool applies a force on the target area of ​​the surface of the meat product at the suction device; wherein the meat product comprises a piece of raw meat in a package, wherein the package is at least partially transparent, and wherein the surface of the meat product comprises a surface of the package.

18. The method according to claim 17, wherein: The estimated fat content in the meat product at the target area on the surface of the meat product is above a predetermined level of fat content.

19. The method according to claim 17, wherein: The surface of the meat product is the upper surface of the meat product.

20. The method according to claim 17, wherein: The imaging system is configured to capture the image of the surface of the meat product while the meat product is on a transport system.