Image processing apparatus, image processing program and image processing method
The image processing device automates the cutting of food elements with shape and color variations by specifying positions and calculating blade trajectories, addressing safety and labor challenges in manual handling.
Patent Information
- Application Number
- JP2024150719
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-10-13
AI Technical Summary
Existing devices struggle to efficiently cut out elements from foods with variations in shape and color, such as chicken thighs, due to the need for manual handling and low-temperature processing, which poses safety risks and labor challenges.
An image processing device that acquires images of the food, superimposes a predetermined figure to specify element positions, determines boundaries, and calculates blade trajectories for precise cutting based on these boundaries.
Enables safe and efficient cutting of food elements with variations by automating the process, reducing labor burdens and improving safety.
Smart Images

Figure 2024159977000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing device, an image processing program, and an image processing method. [Background technology]
[0002] Foods handled in factories and the like may contain unnecessary elements. For example, when the food is chicken thigh meat, the unnecessary elements are skin, fat, tendons, etc. The work of removing skin, fat, tendons, etc. from chicken thigh meat and shaping the chicken thigh meat is currently performed entirely by hand. However, this work is dangerous because it requires the use of blades. In addition, this work must be performed at low temperatures, which places a heavy burden on workers. Furthermore, in recent years, the problem of labor shortages has also become apparent. For example, a device disclosed in Non-Patent Document 1 is one device that has been developed to solve these problems. This device cuts food using a water jet. [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] "You Tube (registered trademark) JBT - Protein - Europe, Middle East and Africa DSI 800s-PL", [Retrieved June 24, 2020], Internet<URL:https: / / www.youtube.com / watch?v=kGfcRU7QpQw> Summary of the Invention [Problem to be solved by the invention]
[0004] However, the above-mentioned devices may not be able to suitably perform the task of cutting out elements that need to be cut out from food products that have variations in shape, color, etc., such as chicken thighs.
[0005] The present invention has been made in consideration of the above-mentioned circumstances, and aims to provide an image processing device, an image processing program, and an image processing method that can preferably assist in the task of preferably cutting out elements that need to be cut out from food that has variation. [Means for solving the problem]
[0006] One aspect of the present invention is an image processing device that includes an image acquisition unit that acquires an image depicting a subject including an element that needs to be cut out, a position identification unit that superimposes a predetermined figure different from the subject on the image and identifies the position of the element in the subject using the predetermined figure, a boundary identification unit that identifies the boundary between the element and a portion other than the element on the image by applying image processing to the image, and a trajectory determination unit that determines the trajectory of a blade when cutting the element from the subject based on the boundary.
[0007] In one aspect of the present invention, in the image processing device described above, a side of the predetermined figure circumscribes a region depicting a second element that is a portion of the subject other than the element.
[0008] One aspect of the present invention is the image processing device described above, wherein the predetermined graphic is a combination of a plurality of graphics that are identical to one another.
[0009] One aspect of the present invention is the above-mentioned image processing device, which acquires the image depicting the subject including at least two of the elements, and the position identification unit identifies the position of the element in the subject by utilizing the relative positional relationship between the at least two of the elements.
[0010] In one aspect of the present invention, in the image processing device described above, the trajectory determination unit sets the trajectory a predetermined distance away from the boundary.
[0011] One aspect of the present invention is an image processing program that causes a computer to implement an image acquisition function that acquires an image depicting a subject including an element that needs to be cut out; a position identification function that superimposes a predetermined figure different from the subject on the image and identifies the position of the element in the subject using the predetermined figure; a boundary identification function that identifies the boundary between the element and a portion other than the element on the image by applying image processing to the image; and a trajectory determination function that determines the trajectory of a blade when cutting the element out of the subject based on the boundary.
[0012] One aspect of the present invention is an image processing method that includes acquiring an image depicting a subject including an element that needs to be cut out using an image acquisition unit or image acquisition function, superimposing a predetermined figure different from the subject onto the image, identifying the position of the element in the subject using the predetermined figure, identifying the boundary between the element and a portion of the image other than the element using a boundary identification unit or boundary identification function by applying image processing to the image, and determining the trajectory of a blade when cutting the element out of the subject based on the boundary using a trajectory determination unit or trajectory determination function. Effect of the Invention
[0013] According to the present invention, it is possible to favorably assist the task of favorably cutting out elements that need to be cut out from food having variations. [Brief description of the drawings]
[0014] [Figure 1] FIG. 1 is a diagram illustrating an example of a hardware configuration of an image processing apparatus according to an embodiment. [Diagram 2] 1 is a diagram illustrating an example of an image processing device, an imaging device, lighting, and a food processing line according to an embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of the chicken thigh meat and its surroundings as viewed from above in FIG. 2. [Figure 4] FIG. 2 is a diagram illustrating an example of a software configuration of the image processing apparatus according to the embodiment. [Diagram 5]1 is a diagram showing an example of a boundary between a first skin, a second skin, a third skin or a muscle and red meat identified by an image processing device according to an embodiment. FIG. [Figure 6] 1 is a diagram showing an example of a first skin of a chicken thigh identified by the image processing device according to the embodiment; FIG. [Figure 7] FIG. 13 is a diagram illustrating an example of twelve rectangles superimposed on an image depicting a chicken thigh according to an embodiment. [Figure 8] 1A to 1C are diagrams showing an example of the boundary between the first skin and the red meat, the boundary between the second skin and the red meat, and the boundary between the muscle and the red meat identified by an image processing device according to an embodiment. [Figure 9] FIG. 13 is a diagram showing an example of a blade trajectory determined by an image processing device according to an embodiment when cutting a first skin from chicken thigh meat, a blade trajectory when cutting a second skin from chicken thigh meat, and a blade trajectory when cutting tendons from chicken thigh meat. [Figure 10] 5 is a flowchart illustrating an example of processing executed by the image processing apparatus according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] [Embodiment] An image processing device, an image processing program, and an image processing method according to an embodiment will be described with reference to Fig. 1 to Fig. 10. First, the hardware constituting the image processing device according to the embodiment and the hardware associated with the image processing device will be described with reference to Fig. 1 to Fig. 3.
[0016] Fig. 1 is a diagram showing an example of a hardware configuration of an image processing device according to an embodiment. As shown in Fig. 1, an image processing device 10 includes a processor 11, a main storage device 12, a communication interface 13, an auxiliary storage device 14, an input / output device 15, and a bus 16.
[0017] The processor 11 is, for example, a CPU (Central Processing Unit), and reads and executes an image processing program to realize the functions shown in Fig. 4. The processor 11 may also read and execute a program other than the image processing program to realize a function required to realize each function of the image processing device 10.
[0018] The main storage device 12 is, for example, a RAM (Random Access Memory), and stores in advance an image processing program and other programs that are read and executed by the processor 11.
[0019] The communication interface 13 is an interface circuit for communicating with the photographing device 154, the control device 200, and other devices via a network. For example, the photographing device 154 and the control device 200 shown in Fig. 1 and Fig. 2 are connected to the communication interface 13. The network referred to here is, for example, a wide area network (WAN), a local area network (LAN), the internet, or an intranet.
[0020] The auxiliary storage device 14 is, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or a read only memory (ROM).
[0021] The input / output device 15 is, for example, an input / output port. For example, the mouse 151, keyboard 152, and display 153 shown in FIG. 1 are connected to the input / output device 15. FIG. 2 is a diagram showing an example of an image processing device, a photographing device, lighting, and a food processing line according to an embodiment. FIG. 3 is a diagram showing an example of chicken thigh meat and its surroundings as viewed from above shown in FIG. 2. Furthermore, lighting 155, lighting 156, lighting 157, and lighting 158 are connected to the control device 200, and the control device 200 controls these four lightings.
[0022] The mouse 151 and the keyboard 152 are used, for example, to input data required to operate the image processing device 10 .
[0023] The display 153 is, for example, a liquid crystal display, and displays, for example, a graphical user interface (GUI) of the image processing device 10.
[0024] The photographing device 154 is a camera that photographs a subject in color. The subject is, for example, chicken thigh meat M shown in FIG. 2. The chicken thigh meat M is transported by a belt conveyor 201 constituting the food processing line 20, and is successively detected by a photoelectric sensor 202, a photoelectric sensor 203, and a photoelectric sensor 204. The belt conveyor 201, the photoelectric sensor 202, the photoelectric sensor 203, and the photoelectric sensor 204 are controlled by a control device 200. The photographing device 154 is installed in a position where it can photograph the chicken thigh meat M from above when the chicken thigh meat M is transported between the photoelectric sensor 203 and the photoelectric sensor 204 by the belt conveyor 201, as shown in FIG. 2, for example.
[0025] The lighting 155, the lighting 156, the lighting 157, and the lighting 158 are devices that irradiate a subject with light such as white light, and include, for example, LEDs (light emitting diodes). The lighting 155 is installed above the belt conveyor 201 as shown in FIG. 2, and irradiates light onto the chicken thigh meat M from the upstream side of the belt conveyor 201 relative to the photographing device 154. The lighting 156 is installed above the belt conveyor 201 as shown in FIG. 2, and irradiates light onto the chicken thigh meat M from the downstream side of the belt conveyor 201 relative to the photographing device 154. The lighting 157 and the lighting 158 are installed on the side of the track along which the chicken thigh meat M is transported by the belt conveyor 201 as shown in FIG. 3, and irradiate light from the side onto the chicken thigh meat M that has been transported by the belt conveyor 201 to a position where it can be photographed by the photographing device 154.
[0026] The bus 16 connects the processor 11, the main memory device 12, the communication interface 13, the auxiliary memory device 14, and the input / output device 15 so that they can transmit and receive data to and from one another.
[0027] Next, the processing executed by the image processing device according to the embodiment will be described with reference to Fig. 4 to Fig. 9. Fig. 4 is a diagram showing an example of the software configuration of the image processing device according to the embodiment. As shown in Fig. 4, the image processing device 10 includes an image acquisition unit 101, a boundary identification unit 102, a position identification unit 103, and a trajectory determination unit 104.
[0028] The image acquisition unit 101 acquires an image depicting a subject including an element that needs to be cut out. For example, the image acquisition unit 101 acquires an image depicting a subject including at least two elements. The image is, for example, a color image captured by the image capture device 154 and depicting chicken thigh meat M. In addition, for example, when the subject is chicken thigh meat M, the elements are a sinew, a first skin, a second skin, and a third skin.
[0029] The tendons are white, string-like objects that are found attached to the meat near the tip of the leg when an incision is made along the bone from the tip of the leg to the thigh and the meat is opened.
[0030] The first skin is the skin located first when the chicken thigh meat M is meat from the left leg of the chicken and the circumference of the chicken thigh meat M seen from the side where the bone was attached is traced clockwise from the tendon. Alternatively, the first skin is the skin located third when the chicken thigh meat M is meat from the right leg of the chicken and the circumference of the chicken thigh meat M seen from the side where the bone was attached is traced clockwise from the tendon. In other words, the relative position of the first skin to the tendon is uniquely determined whether the chicken thigh meat M is meat from the left leg of the chicken or the right leg of the chicken. Also, the first skin is the skin of the chicken's buttocks.
[0031] The second skin is the skin located second when the chicken thigh meat M is meat from the left leg of the chicken and the circumference of the chicken thigh meat M seen from the side where the bone was attached is traced clockwise from the tendon. Alternatively, the second skin is the skin located second when the chicken thigh meat M is meat from the right leg of the chicken and the circumference of the chicken thigh meat M seen from the side where the bone was attached is traced clockwise from the tendon. In other words, the position of the second skin relative to the tendon is uniquely determined whether the chicken thigh meat M is meat from the left leg of the chicken or the right leg of the chicken. Also, the second skin is the skin of the chicken's back.
[0032] The third skin is the skin located third when the chicken thigh meat M is meat from the left leg of the chicken and the circumference of the chicken thigh meat M seen from the side where the bone was attached is traced clockwise from the tendon. Alternatively, the third skin is the skin located first when the chicken thigh meat M is meat from the right leg of the chicken and the circumference of the chicken thigh meat M seen from the side where the bone was attached is traced clockwise from the tendon. In other words, the position of the third skin relative to the tendon is uniquely determined whether the chicken thigh meat M is meat from the left leg of the chicken or the right leg of the chicken. The third skin is also the skin of the chicken's buttocks or back.
[0033] The boundary identifying unit 102 calculates the difference between the pixel value of each pixel of an image obtained by extracting only the red component from the color image acquired by the image acquiring unit 101 and the pixel value of each pixel of an image obtained by extracting only the green component from the color image, and generates a difference image in which the pixel values of each pixel are the differences.The boundary identifying unit 102 then performs a binarization process on the image to separate areas depicting the muscles, first skin, second skin, or third skin from areas depicting other red meat, and identifies the boundaries between the two.
[0034] FIG. 5 is a diagram showing an example of a boundary between the first skin, the second skin, the third skin, or the tendon and the lean meat identified by the image processing device according to the embodiment. The chicken thigh meat M shown in FIG. 5 is meat from the left leg of a chicken. The boundary identification unit 102 generates, for example, the difference image shown in FIG. 5, and performs a binarization process on the difference image to identify the boundary shown by the dashed line in FIG. 5. The area inside the dashed line shown in FIG. 5 is an area in which the lean meat of the chicken thigh meat M is depicted. On the other hand, the area outside the dashed line shown in FIG. 5 is an area in which the tendon, the first skin, the second skin, or the third skin of the chicken thigh meat M is depicted.
[0035] The position identifying unit 103 identifies the position of the element that needs to be cut out based on the image acquired by the image acquiring unit 101. For example, the position identifying unit 103 identifies the area having the largest area outside the boundary identified by the boundary identifying unit 102 and shown by the dashed line in Fig. 5 as the area depicting the first skin.
[0036] Fig. 6 is a diagram showing an example of a first skin of a chicken thigh meat identified by an image processing device according to an embodiment. Chicken thigh meat M shown in Fig. 6 is meat from the left leg of a chicken. The area inside the dashed line shown in Fig. 6 is an area in which the muscle, first skin, second skin or third skin of the chicken thigh meat M is depicted. The position identifying unit 103 identifies, for example, the area with the largest area among the areas inside the dashed line shown in Fig. 6 as the area depicting the first skin.
[0037] FIG. 6 is a diagram showing an example of a first skin of a chicken thigh meat identified by an image processing device according to an embodiment. The chicken thigh meat M shown in FIG. 6 is meat from the left leg of a chicken. The region inside the dashed line shown in FIG. 6 is a region in which the muscle, the first skin, the second skin, or the third skin of the chicken thigh meat M is depicted. The length of the long side of each of the two rectangles shown in FIG. 6 is equal to the width in the direction parallel to the long side of the region depicting the red meat of the chicken thigh meat M. In addition, as shown in FIG. 6, these two rectangles share one of their long sides. For example, the position identification unit 103 compares the area of the region in which any of these three skins is depicted for the two rectangles shown in FIG. 6. Then, the position identification unit 103 determines that the first skin is depicted inside the rectangle in which the area of the region in which any of these three skins is depicted is larger.
[0038] Next, the position identifying unit 103 superimposes a predetermined figure on the image and identifies the positions of the elements in the subject using the predetermined figure. The position identifying unit 103 also uses the relative positional relationship between the tendon, the first skin, the second skin, and the third skin to identify the positions of these four elements in the chicken thigh meat M. For example, the position identifying unit 103 superimposes a plurality of rectangles on the color image acquired by the image acquiring unit 101 and identifies the positions of the tendon, the first skin, the second skin, and the third skin in the chicken thigh meat M using the plurality of rectangles.
[0039] FIG. 7 is a diagram showing an example of twelve rectangles superimposed on an image depicting a chicken thigh according to an embodiment. The chicken thigh M shown in FIG. 7 is meat from the left leg of a chicken. FIG. 7 shows a rectangle P1, a rectangle P2, a rectangle P3, a rectangle P4, a rectangle P5, a rectangle P6, a rectangle P7, a rectangle P8, a rectangle P9, a rectangle P10, a rectangle P11, and a rectangle P12. The long sides of these twelve rectangles are all inclined at 40 degrees with respect to the top and bottom sides of the image shown in FIG. 7 and the top and bottom sides of the plate-like member on which the chicken thigh M is placed. In addition, the rectangles P4, P5, P8, and P9 are combined to circumscribe the area depicting the red meat of the chicken thigh M identified using the difference image shown in FIG. 5.
[0040] When the position specifying unit 103 determines that the chicken thigh meat M is meat from the left leg of the chicken as shown in FIG. 7 and that the first skin is depicted inside the lower rectangle of the two rectangles shown in FIG. 6, the position specifying unit 103 specifies the part of the chicken thigh meat M where the rectangle P3 is superimposed as the area where the first skin is depicted. Next, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the left leg of the chicken as shown in FIG. 7 and that the first skin is depicted inside the lower rectangle of the two rectangles shown in FIG. 6, the position specifying unit 103 specifies the part of the chicken thigh meat M where the rectangle P1 or the rectangle P2 is superimposed as the area where the second skin is depicted. Next, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the left leg of the chicken as shown in FIG. 7 and that the first skin is depicted inside the lower rectangle of the two rectangles shown in FIG. 6, the position specifying unit 103 specifies the part of the chicken thigh meat M where the rectangle P9 is superimposed as the area where the third skin is depicted. Then, when the position identification unit 103 determines that the chicken thigh meat M is meat from the chicken's left leg as shown in Figure 7 and that the first skin is depicted inside the lower rectangle of the two rectangles shown in Figure 6, it identifies the part of the chicken thigh meat M where the rectangle P8 is superimposed as the area where the muscles are depicted.
[0041] In addition, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the left leg of the chicken and that the first skin is depicted inside the upper rectangle of the two rectangles shown in FIG. 6, it specifies the part of the chicken thigh meat M where the rectangle P10 is superimposed as the area where the first skin is depicted. Next, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the left leg of the chicken and that the first skin is depicted inside the upper rectangle of the two rectangles shown in FIG. 6, it specifies the part of the chicken thigh meat M where the rectangle P11 or the rectangle P12 is superimposed as the area where the second skin is depicted. Next, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the left leg of the chicken and that the first skin is depicted inside the upper rectangle of the two rectangles shown in FIG. 6, it specifies the part of the chicken thigh meat M where the rectangle P4 is superimposed as the area where the third skin is depicted. Then, when the chicken thigh meat M is meat from the right leg of a chicken, the position identifying unit 103 identifies the portion of the chicken thigh meat M on which the rectangle P5 is superimposed as the region in which a muscle is depicted.
[0042] In addition, when the position identification unit 103 determines that the chicken thigh meat M is meat from the chicken's right leg and that the first skin is depicted inside the lower rectangle of the two rectangles shown in Figure 6, it identifies the part of the chicken thigh meat M where the rectangle P7 is superimposed as the area where the first skin is depicted. Next, when the position identifying unit 103 determines that the chicken thigh meat M is meat from the right leg of the chicken and that the first skin is depicted inside the lower rectangle of the two rectangles shown in FIG. 6, it identifies the part of the chicken thigh meat M where the rectangle P11 or the rectangle P12 is superimposed as the area where the second skin is depicted. Next, when the position identifying unit 103 determines that the chicken thigh meat M is meat from the right leg of the chicken and that the first skin is depicted inside the lower rectangle of the two rectangles shown in FIG. 6, it identifies the part of the chicken thigh meat M where the rectangle P5 is superimposed as the area where the third skin is depicted. Then, when the position identifying unit 103 determines that the chicken thigh meat M is meat from the right leg of the chicken and that the first skin is depicted inside the lower rectangle of the two rectangles shown in FIG. 6, it identifies the part of the chicken thigh meat M where the rectangle P4 is superimposed as the area where the muscle is depicted.
[0043] In addition, when the position identification unit 103 determines that the chicken thigh meat M is meat from the chicken's right leg and that the first skin is depicted inside the upper rectangle of the two rectangles shown in Figure 6, it identifies the part of the chicken thigh meat M where the rectangle P6 is superimposed as the area where the first skin is depicted. Next, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the right leg of the chicken and that the first skin is depicted inside the upper rectangle of the two rectangles shown in FIG. 6, it specifies the part of the chicken thigh meat M where the rectangle P1 or the rectangle P2 is superimposed as the area where the second skin is depicted. Next, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the right leg of the chicken and that the first skin is depicted inside the upper rectangle of the two rectangles shown in FIG. 6, it specifies the part of the chicken thigh meat M where the rectangle P8 is superimposed as the area where the third skin is depicted. Then, when the position specifying unit 103 determines that the chicken thigh meat M is meat from the right leg of the chicken and that the first skin is depicted inside the upper rectangle of the two rectangles shown in FIG. 6, it specifies the part of the chicken thigh meat M where the rectangle P9 is superimposed as the area where the muscle is depicted.
[0044] The boundary identifying unit 102 identifies the boundary between the element and the non-element portion on the image by performing image processing on the image. For example, the boundary identifying unit 102 determines a closed curve circumscribing a region depicting the lean meat of the chicken thigh meat M in the color image acquired by the image acquiring unit 101, and identifies a portion of the closed curve passing through a region depicting the tendon, the first skin, the second skin, or the third skin in the color image as a boundary between the tendon, the first skin, the second skin, or the third skin, and the lean meat of the chicken thigh meat M.
[0045] 8 is a diagram showing an example of the boundary between the first skin and the lean meat, the boundary between the second skin and the lean meat, and the boundary between the tendon and the lean meat, which are identified by the image processing device according to the embodiment. The chicken thigh meat M shown in FIG. 8 is meat from the right leg of a chicken. The boundary identifying unit 102 determines a closed curve C that circumscribes the area depicting the lean meat of the chicken thigh meat M shown in FIG. 8. Then, the boundary identifying unit 102 identifies a line L91 of the closed curve C as the boundary between the first skin and the lean meat of the chicken thigh meat M. Furthermore, the boundary identifying unit 102 identifies a line L92 of the closed curve C as the boundary between the second skin and the lean meat of the chicken thigh meat M. Furthermore, the boundary identifying unit 102 identifies a line L94 of the closed curve C as the boundary between the muscle and the lean meat of the chicken thigh meat M.
[0046] The trajectory determination unit 104 determines the trajectory of the blade when cutting out the element from the subject based on the boundary. For example, the trajectory determination unit 104 determines a line segment passing through the boundary identified by the boundary identification unit 102 as the trajectory of the blade.
[0047] Fig. 9 is a diagram showing an example of a blade trajectory when cutting the first skin from the chicken thigh meat, a blade trajectory when cutting the second skin from the chicken thigh meat, and a blade trajectory when cutting the tendon from the chicken thigh meat, determined by the image processing device according to the embodiment. Fig. 9 shows a line segment L101 connecting points P11 and P12, a line segment L102 connecting points P21 and P22, and a line segment L104 connecting points P41 and P42. The horizontal direction of the image shown in Fig. 9 is the X direction. The vertical direction of the image shown in Fig. 9 is the Y direction.
[0048] Point P11 represents the starting point of the blade when cutting the first skin from the chicken thigh meat M. The X coordinate of point P11 is "242.4" as shown in the upper part of the image shown in FIG. 9. The Y coordinate of point P11 is "0" as shown in the upper part of the image shown in FIG. 9. Point P12 represents the ending point of the blade when cutting the first skin from the chicken thigh meat M. The X coordinate of point P12 is "10" as shown in the upper part of the image shown in FIG. 9. The Y coordinate of point P12 is "-239.8" as shown in the upper part of the image shown in FIG. 9. Line segment L101 represents the trajectory of the blade when cutting the first skin from the chicken thigh meat M. Note that "T:-0.969" shown under the coordinate of point P11 shown in the upper part of the image shown in FIG. 9 represents the speed of the blade when cutting the first skin from the chicken thigh meat M. Moreover, "θ:-44.09" shown below the coordinates of point P12 shown at the top of the image shown in FIG. 9 represents the inclination of line segment L101.
[0049] Point P21 represents the starting point of the blade when cutting the second skin from the chicken thigh meat M. The X coordinate of point P21 is "65.2" as shown in the upper part of the image shown in FIG. 9. The Y coordinate of point P21 is "0" as shown in the upper part of the image shown in FIG. 9. Point P22 represents the ending point of the blade when cutting the second skin from the chicken thigh meat M. The X coordinate of point P22 is "292.3" as shown in the upper part of the image shown in FIG. 9. The Y coordinate of point P22 is "-151.8" as shown in the upper part of the image shown in FIG. 9. Line segment L102 represents the trajectory of the blade when cutting the second skin from the chicken thigh meat M. Note that "T: 1.404" shown below the coordinate of point P21 shown in the upper part of the image shown in FIG. 9 represents the speed of the blade when cutting the second skin from the chicken thigh meat M. Moreover, "θ:34.54" shown below the coordinates of point P22 shown at the top of the image shown in FIG. 9 represents the inclination of line segment L102.
[0050] Point P41 represents the starting point of the blade when cutting the tendon from the chicken thigh meat M. The X coordinate of point P41 is "70.8" as shown at the top of the image shown in FIG. 9. The Y coordinate of point P41 is "0" as shown at the top of the image shown in FIG. 9. Point P42 represents the ending point of the blade when cutting the tendon from the chicken thigh meat M. The X coordinate of point P42 is "90.1" as shown at the top of the image shown in FIG. 9. The Y coordinate of point P42 is "-370.9" as shown at the top of the image shown in FIG. 9. Line segment L102 represents the trajectory of the blade when cutting the tendon from the chicken thigh meat M. Note that "T: 0.036" shown below the coordinate of point P41 shown at the top of the image shown in FIG. 9 represents the speed of the blade when cutting the tendon from the chicken thigh meat M. Moreover, "θ:2.06" shown below the coordinates of point P42 shown at the top of the image shown in FIG. 9 represents the inclination of line segment L102.
[0051] The trajectory determination unit 104 determines the trajectory of the blade when cutting the first skin from the chicken thigh meat M to be line segment L101 shown in Fig. 9 based on the line L91 shown in Fig. 8. Moreover, the trajectory determination unit 104 determines the trajectory of the blade when cutting the second skin from the chicken thigh meat M to be line segment L102 shown in Fig. 9 based on the line L92 shown in Fig. 8. Moreover, the trajectory determination unit 104 determines the trajectory of the blade when cutting the tendon from the chicken thigh meat M to be line segment L104 shown in Fig. 9 based on the line L94 shown in Fig. 8.
[0052] The trajectory determination unit 104 may set the trajectory at a predetermined distance from the above-mentioned boundary. For example, the trajectory determination unit 104 may set the trajectory of the blade to a line obtained by moving the above-mentioned boundary by a predetermined distance in a direction perpendicular to the boundary. Examples of such trajectories include a line segment obtained by translating the line segment L101, the line segment L102, or the line segment L104 shown in FIG. 9 by a predetermined distance. In this case, a translation in a direction away from the red meat of the chicken thigh meat M may be a translation in a positive direction, and a translation in a direction toward the red meat of the chicken thigh meat M may be a translation in a negative direction. Note that, even if the above-mentioned boundary is a broken line, a curve, or the like, the trajectory determination unit 104 may set the broken line, curve, or the like obtained by translating the boundary by a predetermined distance as the trajectory of the blade.
[0053] Next, an example of processing executed by the image processing device according to the embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of processing executed by the image processing device according to the embodiment.
[0054] In step S1, the image acquisition unit 101 acquires an image depicting a subject including an element that needs to be cropped.
[0055] In step S2, the boundary identifying unit 102 performs image processing on the image to identify the boundary between an element that needs to be cut out on the image and the portion other than the element.
[0056] In step S3, the position specifying unit 103 superimposes a predetermined figure on the image, and specifies the position of the element in the subject using the predetermined figure.
[0057] In step S4, the boundary identifying unit 102 identifies the boundary between each element and a portion other than these elements, based on the position of each element identified in step S3.
[0058] In step S5, the trajectory determination unit 104 determines the trajectory of the blade when cutting the element from the subject, based on the boundary identified in step S4.
[0059] The image processing device, image processing program, and image processing method according to the embodiment have been described above. The image processing device 10 includes an image acquisition unit 101, a boundary identification unit 102, and a trajectory determination unit 104. The image acquisition unit 101 acquires an image depicting a subject including an element that needs to be cut out. The boundary identification unit 102 identifies the boundary between the element and a portion other than the element on the image by performing image processing on the image. The trajectory determination unit 104 determines the trajectory of a blade when cutting the element from the subject based on the boundary. This allows the image processing device 10 to favorably support the task of favorably cutting out elements that need to be cut out from food having variations.
[0060] The image processing device 10 further includes a position specifying unit 103 that superimposes a predetermined figure on the image and specifies the position of an element in the subject by using the predetermined figure. This allows the image processing device 10 to specify the element that needs to be cut out and to suitably determine the trajectory of a blade when cutting the element out of the subject.
[0061] Furthermore, the image processing device 10 acquires an image depicting a subject including at least two elements, and identifies the positions of the elements in the subject by using the relative positional relationship between the at least two elements. As a result, even if the subject includes multiple elements that need to be cut out, the image processing device 10 can appropriately identify the position of each element and appropriately determine the trajectory of the blade when cutting the elements out of the subject.
[0062] In the above-mentioned embodiment, the image processing device 10 shown in FIG. 1 is realized by the processor 11 that reads and executes an image processing program, but the present invention is not limited to this. At least a part of the image processing device 10 shown in FIG. 1 may be realized by hardware including a circuitry such as a large-scale integration (LSI), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a graphics processing unit (GPU). Alternatively, at least a part of the image processing device 10 shown in FIG. 1 may be realized by a combination of software and hardware. Moreover, these pieces of hardware may be integrated into one, or may be divided into multiple pieces.
[0063] In addition, in the above-described embodiment, an example was given in which the subject is chicken thigh meat M and the elements that need to be cut out are the tendons, the first skin, the second skin, and the third skin, but this is not limited to this.
[0064] The embodiments of the present invention have been described above in detail with reference to the drawings. However, the specific configurations of the embodiments of the present invention are not limited to the above-mentioned embodiments, and at least one of various combinations, modifications, substitutions, and design changes may be added to the above-mentioned embodiments without departing from the scope of the present invention.
[0065] The effects of the present invention described in the above-mentioned embodiments are merely examples, and the present invention may have other effects that a person skilled in the art may recognize from the description of the above-mentioned embodiments in addition to the effects described above. [Explanation of symbols]
[0066] 10: image processing device, 11: processor, 12: main memory device, 13: communication interface 14 ... auxiliary storage device, 15 ... input / output device, 16 ... bus, 101 ... image acquisition unit, 10 2... boundary identification unit, 103... position identification unit, 104... orbit determination unit, 151... mouse, 152... Keyboard, 153...display, 154...photographic equipment, 155, 156, 157, 15 8...Lighting, 20...Food processing line, 200...Control device, 201...Belt conveyor, 202 ,203,204...Photoelectric sensor, M...Chicken thigh
Claims
1. an image acquisition unit for acquiring an image depicting a subject including an element that needs to be cropped; a position specifying unit that superimposes a predetermined figure different from the subject on the image and specifies a position of the element in the subject by using the predetermined figure; a boundary specifying unit that specifies a boundary between the element and a portion other than the element on the image by performing image processing on the image; a trajectory determination unit that determines a trajectory of a blade when cutting the element from the subject based on the boundary; An image processing device comprising:
2. A side of the predetermined figure circumscribes a region depicting a second element, which is a portion of the subject other than the element. The image processing device according to claim 1 .
3. The predetermined figure is a combination of a plurality of figures that are identical to one another. The image processing device according to claim 1 .
4. the image acquisition unit acquires the image depicting the subject including at least two of the elements; the position specifying unit specifies the positions of the elements in the subject by utilizing a relative positional relationship between at least two of the elements; The image processing device according to claim 1 .
5. The orbit determination unit sets the orbit a predetermined distance away from the boundary.
5. The image processing device according to claim 1.
6. an image acquisition function for acquiring an image depicting a subject including an element that needs to be cropped; a position specifying function of superimposing a predetermined figure different from the subject on the image and specifying a position of the element in the subject by using the predetermined figure; a boundary specifying function for specifying a boundary between the element and a portion other than the element on the image by performing image processing on the image; a trajectory determination function that determines a trajectory of a blade when cutting the element from the object based on the boundary; An image processing program that enables a computer to achieve this.
7. Acquire an image depicting a subject including an element to be cut out by an image acquisition unit or an image acquisition function; superimposing a predetermined figure different from the object on the image, and identifying a position of the element in the object using the predetermined figure; By performing image processing on the image, a boundary between the element and a portion other than the element on the image is identified by a boundary identification unit or a boundary identification function; determining a trajectory of a blade when cutting the element from the subject based on the boundary by a trajectory determination unit or a trajectory determination function; Image processing methods.
Citation Information
Patent Citations
Method and device for detecting bony part of bone-in meat
JP2014007982A
X-ray inspection device
JP2021081332A
Method and apparatus for slaughtering and processing animals
US6623348B1
