Aquatic product sorting system and ship

Abstract

The present invention provides an aquatic product sorting system 1 (201) including a camera 6, a display 14, and a control device 12 (212). The camera 6 captures an image of aquatic products X. The display 14 displays a sorting screen S (S2). The control device 12(212) may generate the sorting screen S (S2) on which the aquatic products X are sorted on the basis of image data D (D2) captured with the camera 6 and may display the sorting screen S (S2) on the display 14.

Description

Seafood sorting system and vessel

[0001] The present disclosure relates to a seafood sorting system and a vessel including the seafood sorting system.

[0002] Seafood caught and landed using various fishing methods varies in species, sex, size, and other characteristics. Seafood is brought to seafood processing plants and fish markets in a mixed state. Processing plants are sometimes located on land, but also on ships (fishing boats). To distribute and sell seafood brought in this state to markets, a sorting process is required to separate the seafood into types appropriate for the distribution method. Traditionally, this sorting process has been carried out manually at processing plants and fish markets. This sorting process is subject to geographical restrictions, such as the location being near the fishing port where the catch was landed, as well as restrictions on the experience and proficiency of the sorters, making it difficult to secure personnel to carry out the process.

[0003] For this reason, in recent years, a seafood sorting system that automatically performs such a sorting process has been developed (see, for example, Patent Document 1). In the seafood sorting system of Patent Document 1, the type of seafood is automatically determined from image data acquired by a camera, and the seafood is sorted based on this determination result.

[0004] Patent No. 2981891

[0005] However, seafood brought to processing plants and fish markets comes in a wide variety of species and sizes. It is desirable to complete the sorting process of these seafood quickly to prevent the freshness of the landed seafood from decreasing. The seafood sorting system of Patent Document 1 limits the species of seafood to be sorted, and then determines the shape and size from image data to sort the seafood. Such a seafood sorting system, which makes determinations solely from image data, requires massive data processing when the number of species of seafood to be sorted increases, making it difficult to achieve both accurate sorting and reduced data processing time. As a result, there is a problem in that it is difficult to sort seafood accurately in a short amount of time.

[0006] An object of the present disclosure is to provide a seafood sorting system that can sort seafood accurately in a short period of time.

[0007] (1) A seafood sorting system according to the present disclosure includes a camera, a display, and a control device. The camera captures images of seafood. The display displays a sorting screen. The control device is capable of communicating with both the camera and the display, generates a sorting screen for sorting seafood based on the images captured by the camera, and displays the sorting screen on the display.

[0008] (2) The seafood sorting system may further include a conveying device. The conveying device may transport the seafood. The control device may determine a first seafood product that can be sorted by the control device and a second seafood product that cannot be sorted by the control device. The sorting screen may include information on at least the second seafood product.

[0009] (3) The seafood sorting system may further include a weighing scale and an input device. The weighing scale may measure the weight of the seafood transported by the transport device. The input device may receive input of at least second seafood sorting information. The control device may be capable of communicating with the weighing scale and the input device. The control device may include a memory unit and a processing unit. The memory unit may store combined information of shape information of the seafood, a type corresponding to the shape information, and a weight. The processing unit may estimate the type of seafood included in the video based on video captured by the camera and the weight measured by the weighing scale, and generate a sorting screen. The first seafood may be a seafood whose type can be estimated by the processing unit. The second seafood may be another seafood other than the first seafood. The sorting screen may include image information obtained by combining a video and a first sorting unit corresponding to the first seafood and a second sorting unit corresponding to the second seafood included in the video with the video.

[0010] (4) The combined information may include at least one of the season in which the marine product was landed, the sea area, and the water depth.

[0011] (5) The processing unit may determine that the type can be estimated if the shape of the seafood included in the video matches the shape information of the seafood included in the combination information stored in the memory unit at a rate equal to or greater than a predetermined value.

[0012] (6) The first sorting unit may include a first seafood product and candidates for combination information corresponding to the first seafood product selected based on the combination information stored in the storage unit. The second sorting unit may include a second seafood product and candidates for combination information corresponding to a plurality of second seafood products estimated based on the combinations stored in the storage unit.

[0013] (7) The processing unit may determine a predetermined evaluation corresponding to the input of the combination information based on the combination information input via the input device.

[0014] (8) The processing unit may evaluate the input to the second sorting unit more favorably than the input to the first sorting unit.

[0015] (9) The camera may capture images of the seafood from multiple directions.

[0016] According to this seafood sorting system, the control device can generate a sorting screen for sorting seafood based on images captured by the camera. This allows the control device to generate the sorting screen without having to perform extensive image processing and calculations for seafood sorting. As a result, the seafood sorting system can sort seafood accurately in a short amount of time.

[0017] According to the present disclosure, a seafood sorting system can be provided that can sort seafood accurately in a short amount of time.

[0018] Fig. 5 is a schematic diagram showing a seafood sorting system according to an embodiment of the present disclosure. Fig. 6 is a flowchart showing a processing procedure by a control device according to the present disclosure. Fig. 7 is a schematic diagram showing an example of a sorting screen according to a first embodiment of the present disclosure. Fig. 8 is a schematic diagram showing an enlarged view of a portion of Fig. 3. Fig. 9 is a schematic diagram showing an example of a sorting screen according to a second embodiment of the present disclosure. Fig. 10 is a schematic diagram showing an enlarged view of a portion of Fig. 5. Fig. 11 is a schematic diagram of a ship equipped with a seafood sorting system according to a third embodiment of the present disclosure.

[0019] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0020] 1 , a seafood sorting system according to a first embodiment of the present disclosure includes a conveying device 2, a separating device 4, a camera 6, a first weighing scale (an example of a weighing scale) 8, a second weighing scale 10, a control device 12, a display 14, an input device 16, and a sorting area 18. In this embodiment, the seafood sorting system 1 is a seafood sorting system that sorts a plurality of seafood X that is a mixture of various kinds of fish and shellfish that have been caught. When such seafood X is carried into a sorting area, it is carried into the conveying device 2 in a state where it is mixed with fish species Y (an example of a type), and a sorting operation is performed. During the sorting operation, the seafood sorting system 1 sorts the plurality of seafood X into predetermined fish species Y.

[0021] The conveying device 2 includes an actuator 21 and a belt 22. In this embodiment, the conveying device 2 is a belt conveyor that conveys the seafood X placed on the belt 22 at a predetermined speed. The actuator 21 is electrically connected to and driven by the control device 12. The belt 22 is driven by the actuator 21 and moves the seafood X placed on the belt 22 from the upstream U to the downstream B. Note that the conveying device 2 is not limited to a belt conveyor, and may be, for example, a slide that descends from the upstream U to the downstream B and conveys the seafood X by gravity, or other conveyors such as a roller type or a chain type.

[0022] The separation device 4 has an actuator and a separator (not shown). The separation device 4 further has a separation path 43. The actuator and the separator are provided on the belt 22 of the conveying device 2. The actuator is electrically connected to the control device 12 and drives the separator. Each separator is a plate-shaped member with an actuator provided at one end. The separator is driven by the actuator and rotates on the belt 22. The separator changes the conveying path of the seafood X between the downstream of the belt 22 and the separation path 43. The separation path 43 is provided by branching off from the middle of the belt 22. The separation path 43 conveys the seafood X, whose conveying path has been changed by the separator, to the sorting area 18, which will be described later. In this embodiment, the separation device 4 has three actuators, three separators, and a first separation path 431 to a third separation path 433. That is, the conveying device 2 and the separating device 4 sort and convey the marine products X on the belt 22 to four routes consisting of the downstream B of the belt 22 and the three separating paths 43 .

[0023] The camera 6 captures images of the seafood X transported by the transport device 2. In this embodiment, the camera 6 is attached to an arm (not shown) on the belt 22 of the transport device 2, and its position can be changed by an actuator (not shown). The camera 6 may also be attached to the ceiling, beams, or the like of the work area where the sorting work is performed. Furthermore, in this embodiment, the camera 6 captures images of the seafood X included in an imaging area W provided on the belt 22 of the transport device 2 from multiple directions. The camera 6 is electrically connected to the control device 12. The camera 6 repeatedly captures images of the imaging area W from different angles at predetermined intervals, and acquires image data D (an example of a video) of the imaging area W as multiple still images. The camera 6 may also continuously capture images of the imaging area W while changing its position, and acquire the image data D of the imaging area W as a video. The camera 6 transmits the captured image data D to the control device 12.

[0024] The first weighing scale 8 measures a first weight W1 (an example of a weight) of the seafood X transported by the transporting device 2. In this embodiment, the first weighing scale 8 is disposed below the belt 22 of the transporting device 2 and is electrically connected to the control device 12. The first weighing scale 8 measures the first weight W1 of the seafood X on the belt 22 downstream of the imaging area W and transmits the first weight W1 to the control device 12.

[0025] The second weighing scale 10 measures a second weight W2 of the seafood X sorted into the plurality of sorting areas 18 described below. In the present embodiment, the second weighing scales 10 are arranged below the plurality of sorting areas 18 and electrically connected to the control device 12. The second weighing scales 101 to 103 are arranged below the first sorting area 181, the second sorting area 182, and the third sorting area 183, respectively, and measure the second weight W2 of the seafood X sorted into each sorting area 18. The second weighing scale 10 transmits the second weight W2 to the control device 12. The number of second weighing scales 10 may be changed as appropriate depending on the number of the plurality of sorting areas 18.

[0026] The control device 12 is provided to control the seafood sorting system 1. The control device 12 is electrically connected to and capable of communicating with the conveying device 2, the separating device 4, the camera 6, the first weighing scale 8, the second weighing scale 10, a display 14 (described later), and the input device 16. The control device 12 has a storage unit 12a and a processing unit 12b. The control device 12 is actually configured by a microcomputer having the storage unit 12a including a hard disk drive (HDD) and a random access memory (RAM), the processing unit 12b including a central processing unit (CPU) and a graphics processing unit (GPU), and an input / output buffer, etc. The storage unit 12a stores combination data Z (an example of a combination). The processing unit 12b estimates the seafood X contained in the image data D and the fish species (an example of a species) Y corresponding to the seafood X based on the image data D captured by the camera 6 and the first weight W1 measured by the first weighing scale 8, and generates a selection screen S described below.

[0027] The display 14 displays the sorting screen S. In this embodiment, the display 14 is a portable touch-input communication terminal M that is integrated with an input device 16 (described later). The communication terminal M is communicatively connected to the control device 12 via a line such as the Internet or a virtual private network (VPN) via a wired or wireless connection. The communication terminal M is placed in a different room or building away from the work area where the sorting work is performed. This allows the operator H to perform the sorting work by operating the communication terminal M without traveling to the work area. As a result, the seafood sorting system 1 allows the operator H to perform the sorting work without being restricted by the location of the work area where the sorting work of the seafood X is performed.

[0028] The input device 16 receives input of combination data (information) Z, which will be described later. In this embodiment, the input device 16 is a touch-type input interface that is integrated with the display 14 of the communication terminal M. The operator H inputs the combination data Z to the input device 16 by directly operating the display 14 of the communication terminal M. The input device 16 is actually configured by a microcomputer, such as a smartphone, tablet computer, or desktop terminal, that has a storage unit 12a including a hard disk drive (HDD) and a random access memory (RAM), a processing unit including a central processing unit (CPU) and a graphics processing unit (GPU), an input / output buffer, etc.

[0029] The display 14 and the input device 16 may be separate input devices. The operator H may operate the input device 16 at hand while viewing the selection screen S displayed on the display 14.

[0030] The multiple sorting areas 18 are provided downstream B of the conveying device 2, and the marine products X are sorted according to the fish species Y. In this embodiment, the multiple sorting areas 18 are configured from a first sorting area 181 corresponding to the fish species Y1, a second sorting area 182 corresponding to the fish species Y2, and a third sorting area 183 corresponding to the fish species Y3. The number of the multiple sorting areas 18 may be changed appropriately depending on the number of fish species Y to be sorted.

[0031] Next, the control procedure performed by the control device 12 will be described with reference to the flowchart of Fig. 2, Fig. 3 and Fig. 4. When a start button (not shown) is pressed, the control device 12 drives the conveying device 2 and starts the control procedure.

[0032] The control device 12 acquires image data D captured by the camera 6 (step S1). The control device 12 acquires the first weight W1 measured by the first weighing scale 8 (step S2).

[0033] The processing unit 12b of the control device 12 generates a seafood region x based on the acquired image data D and the first weight W1 (step S3). The seafood region x is a region obtained by dividing the image data D into regions for each seafood X included in the image data D.

[0034] When the image data D contains one seafood X, the image data D is partitioned into one seafood region x and a background region xs excluding the seafood region x. As shown in Fig. 3(a) , in this embodiment, the image data D contains five seafood X1 to X5, and the processing unit 12b partitions the image data D into five seafood regions x1 to x5 partitioned by solid lines and a background region xs excluding these seafood regions x. In other words, one seafood region x contains one seafood X.

[0035] In this embodiment, the camera 6 captures images of the seafood X included in the imaging area W from various angles. This allows the image data D to include the seafood X captured at different angles. As a result, the processing unit 12b of the control device 12 can generate the seafood region x with high accuracy.

[0036] The processing unit 12b of the control device 12 refers to the combination data Z stored in the memory unit 12a and calculates the matching rate α between the seafood X included in the existing combination data Z stored in the memory unit 12a and the seafood X included in the seafood area x (step S4).

[0037] The combination data Z is information that combines the seafood X, the fish species Y of the seafood X, shape information y1, which is information about the shape of the seafood X, the season and time when the seafood X was landed (an example of a season) y2, sea area location information y3 (an example of a sea area), and water depth y4. The shape information y1 is information about the shape characteristics, color, and the like, corresponding to the fish species Y of the seafood X. The combination data Z is sufficient as long as it includes at least the seafood X, the fish species Y of the seafood X, and the shape information y1, and the season and time y2, sea area location information y3, and water depth y4 can be selected or omitted.

[0038] The matching rate α is calculated as an index for determining whether the control device 12 can estimate the fish species Y of the seafood X. If the matching rate α is equal to or greater than a predetermined value, the processing unit 12b determines that the fish species Y of the seafood X can be estimated. On the other hand, if the matching rate α is smaller than the predetermined value, the processing unit 12b determines that the fish species Y of the seafood X cannot be estimated.

[0039] In the present embodiment, the processing unit 12b of the control device 12 calculates the difference β for each of the seafood regions x1 to x5 included in FIG. 3( a). The difference β is a value indicating the degree of difference between the image of the seafood X included in the seafood region x and the image of the seafood X included in the combination data Z stored in the memory unit 12a. More specifically, the processing unit 12b extracts, as the difference β, a point where the shape differs between the image of the seafood X included in the seafood region x and the image of the seafood X included in the combination data Z stored in the memory unit 12a. The processing unit 12b determines that the greater the difference β, the lower the matching rate α. Furthermore, the processing unit 12b determines that the smaller the difference β, the higher the matching rate α. In other words, the processing unit 12b calculates the difference β as an index of whether the shape of the image of the seafood X included in the seafood region x matches that of the image of the seafood X included in the combination data Z stored in the memory unit 12a.

[0040] The processing unit 12b compares the images of the seafood X1 to X5 included in the seafood regions x1 to x5 with the shape information y1 of the seafood X included in all the combination data Z stored in the storage unit 12a, and calculates the difference between them. Furthermore, the processing unit 12b calculates the lowest difference value among each combination of the seafood region x for which the difference was calculated and the seafood X included in the combination data Z as the difference β. When the images of the seafood region x and the seafood X completely match, i.e., are the same image, the difference β is 0. The difference β is calculated as a value between 0 and 1. In this embodiment, predetermined image processing is performed on the images of the seafood region x and the seafood X, feature points of each image are extracted, and the degree to which the feature points match is calculated as the difference β. This type of processing may be performed by a variety of methods using known image processing techniques.

[0041] The processing unit 12b calculates the match rate α based on the difference β. In this embodiment, the processing unit 12b calculates the match rate α as a percentage between 0% and 100% based on the value of the difference β. When calculating the match rate α, the processing unit 12b may take into consideration at least one of the season and time y2, the sea area location information y3, and the water depth y4 included in the combination data Z. This allows the match rate α to be calculated accurately for the seafood X included in the seafood region x.

[0042] The processing unit 12b of the control device 12 determines whether the matching rate α of the image included in the seafood area x is equal to or less than a predetermined value A (step S5). The predetermined value R is set as a numerical value that allows the image of seafood X included in the seafood area x to be identified as the same fish species Y, even taking into account size and individual differences, when compared with the image of seafood X included in the existing combination data Z stored in the storage unit 12a. The matching rate α can be set arbitrarily, and the higher the matching rate α is set, the higher the accuracy of the sorting work.

[0043] If it is determined that the matching rate α is equal to or less than the predetermined value A (Yes in step S5), the processing unit 12b of the control device 12 classifies the seafood region x as a first seafood c1 (step S6). Subsequently, the processing unit 12b generates a first sorting unit C1 for the seafood X classified as the first seafood c1 (step S7).

[0044] In this embodiment, as shown in Fig. 3(b), the marine products X1 to X4 are classified as a first marine product c1. The boundaries of the marine product regions x1 to x4 of these marine products X1 to X4 are indicated by thick solid lines, and these marine products are distinguished from a second marine product c2, which will be described later. Furthermore, first sorting sections C11 to C14 are generated corresponding to the marine product regions x1 to x4, respectively.

[0045] Figure 4(a) is an enlarged schematic diagram of a portion of the first sorting section C11, one of the four first sorting sections C11 to C14 shown in Figure 3(b), which corresponds to the seafood X1 and the seafood region x1.

[0046] 3(b) and 4(a), the first sorting unit C1 includes a seafood region x divided into a first seafood region c1 and a fish species candidate s (an example of a candidate). The fish species candidate s is an option of combination data Z of a fish species Y corresponding to a seafood X included in the seafood region x, selected based on the combination data Z stored in the memory unit 12a of the control device 12. In this embodiment, the fish species candidate s included in the first sorting unit C1 is the combination data Z that includes an image of a seafood X with the smallest difference value from the seafood region x, among the existing combination data Z stored in the memory unit 12a. The first sorting unit C1 includes a seafood region x whose boundary is indicated by a thick solid line, fish species candidates s arranged near the seafood region x, and a change button E1 for selecting a change to the second sorting unit C2.

[0047] The seafood region x included in the first sorting unit C1 may be displayed as an image that distinguishes it from the seafood region x classified as the second seafood c2 and the background region xs excluding the seafood region x. The seafood region x in the first sorting unit C1 may be displayed as an image, such as a thick solid line indicating the boundary, a solid diagonal line pattern, or a semi-transparent solid pattern. Furthermore, if the processing unit 12b can determine the fish species, it is not necessary for the processing unit 12b to display the first sorting unit C1.

[0048] If it is determined that the matching rate α is greater than the predetermined value A (No in step S5), the processing unit 12b of the control device 12 classifies the seafood region x as a second seafood c2 (step S8). Subsequently, the processing unit 12b generates a second sorting unit C2 for the seafood region x classified as the second seafood c2 (step S9).

[0049] FIG. 4B is an enlarged schematic view of a part of the second sorting unit C2 shown in FIG. 3B.

[0050] As shown in FIGS. 3( b) and 4( b), the second sorting unit C2 includes a seafood region x classified as a second seafood c2 and a plurality of fish species candidates s. The fish species candidates s are options for combination data Z of a fish species Y corresponding to the seafood X included in the seafood region x, selected based on the combination data Z stored in the memory unit 12a of the control device 12. The plurality of fish species candidates s are a plurality of combination data Z extracted based on the differences between the seafood region x and the existing combination data Z stored in the memory unit 12a. The processing unit 12b extracts a predetermined number of combination data Z with smallest differences between the seafood region x and the image of the seafood X included in the combination data Z, in ascending order of smallest difference value, and sets these as the plurality of fish species candidates s. Any number of the plurality of fish species candidates s can be set.

[0051] In this embodiment, as the multiple fish species candidates s, three of the seafood X included in the existing combination data Z stored in the memory unit 12a that have small differences from the image of the seafood X5 included in the seafood area x5 are extracted from the seafood X included in the existing combination data Z stored in the memory unit 12a, and these are set as the multiple fish species candidates s1 to s3.

[0052] As described above, when calculating the difference between the seafood X included in the seafood region x and the seafood X included in the existing combination data Z, at least one of the information on the season and time y2, the sea area location information y3, and the water depth y4 included in the combination data Z is used. This allows the first sorting unit C1 and the second sorting unit C2 to include fish species candidates s that take into account information such as the season and sea area in which the seafood X was landed.

[0053] The second sorting unit C2 includes a seafood area x whose boundary is indicated by a thick dashed line, and a selection button E2 that displays multiple fish species candidates s arranged near the seafood area x. The multiple fish species candidates s and the selection button E2 are displayed in an ordered state based on the difference value between the seafood area x and the image of the seafood X included in the combination data Z. In this embodiment, the three fish species candidates s1 to s3 are displayed in descending order of the smallest difference value. This allows the operator H to instantly identify the most appropriate option from the multiple fish species candidates s as the combination data Z with the fish species Y corresponding to the seafood X included in the seafood area x. This allows the operator H to quickly input the combination data Z of the seafood X and the fish species Y, regardless of his or her experience or level of proficiency in the sorting work. As a result, the seafood sorting system 1 can accurately sort the seafood X by fish species Y in a short period of time.

[0054] The seafood region x included in the second sorting unit C2 may be displayed as an image that distinguishes it from the seafood region x classified as the first seafood c1 and the background region xs excluding the seafood region x. The seafood region x of the second sorting unit C2 may be displayed as an image that is not only a thick dashed line indicating the boundary, but also a solid fill with a diagonal line pattern or a semi-transparent solid fill.

[0055] The processing unit 12b of the control device 12 generates a selection screen S (step S10). As shown in Fig. 3B, the selection screen S is screen data obtained by overlapping and synthesizing the image display of the first selection section C1 generated in step S6 and the image display of the second selection section C2 generated in step S8 on the image data D.

[0056] The control device 12 transmits the selection screen S to the communication terminal M (step S11). The control device 12 displays the selection screen S on the display 14 of the communication terminal M (step S12). Here, the operator H operates the first sorting unit C1 and the second sorting unit C2 while viewing the selection screen S displayed on the display 14, and inputs combination data Z of the seafood X and the fish species Y corresponding to the seafood X.

[0057] The operator H operates any one of the first sorting units C1 or the second sorting unit C2 while viewing the sorting screen S displayed on the communication terminal M. The control device 12 determines whether the first sorting unit C1 is being operated by the operator H (step S13). If the control device 12 determines that the first sorting unit C1 is being operated (step S13: Yes), the control device 12 proceeds to step S14. On the other hand, if the first sorting unit C1 is not being operated (step S13: No), the control device 12 proceeds to step S15.

[0058] The operator H compares the seafood area x included in the first sorting unit C1 currently being operated with the fish species candidate s, and if the fish species candidate s is not appropriate for the seafood X included in the seafood area x and the corresponding fish species Y, the operator operates the change button E1. The control device 12 determines whether the change button E1 included in the first sorting unit C1 has been operated (step S14). If it is determined that the change button E1 has been operated (step S14: Yes), the control device 12 returns control to step S7, classifies the seafood area x as a second seafood c2 (step S8), and generates the second sorting unit C2 (step S9). On the other hand, if not (step S14: No), the control proceeds to step S17.

[0059] The control device 12 determines whether the second sorting unit C2 is being operated by the operator H (step S15). If the control device 12 determines that the second sorting unit C2 is being operated (step S15: Yes), the control proceeds to step S16. On the other hand, if the control device 12 determines that the second sorting unit C2 is not being operated (step S15: No), the control returns to before step S13.

[0060] The operator H compares the seafood area x included in the second sorting unit C2 currently being operated with a plurality of fish species candidates s, selects the most appropriate fish species Y corresponding to the seafood X included in the seafood area x, and inputs it via the selection button E2. The control device 12 determines whether the selection button E2 included in the second sorting unit C2 has been operated (step S16). If it is determined that the selection button E2 has been operated (step S16: Yes), the control device 12 proceeds to step S17. On the other hand, if it has not been operated (step S16: No), the control returns to before step S15.

[0061] The control device 12 acquires the seafood region x included in the first sorting unit C1 or the second sorting unit C2 currently in operation as the seafood X (step S17). That is, when the change button E1 included in the first sorting unit C1 is not operated and when the select button E2 included in the second sorting unit C2 is operated, the control device 12 acquires the seafood X.

[0062] Next, the control device 12 acquires the fish species candidate s included in the currently operating first sorting unit C1 or second sorting unit C2 as the fish species Y (step S18). Furthermore, the processing unit 12b of the control device 12 combines the marine product X acquired in step S17 with the fish species Y acquired in step S18 to generate combination data Z (step S19). The storage unit 12a of the control device 12 stores the combination data Z (step S20).

[0063] The processing unit 12b of the control device 12 generates evaluation data r corresponding to the combination data Z generated in step S19 (step S21). In operating the first sorting unit C1, the operator H determines whether the combination of the seafood region x and the fish species candidate s included in the first sorting unit C1 is appropriate. On the other hand, in operating the second sorting unit C2, the operator H selects the most appropriate fish species candidate s from among the multiple fish species candidates s for the seafood region x included in the second sorting unit C2. Therefore, operating the second sorting unit C2 places a greater workload on the operator H than operating the first sorting unit C1. The processing unit 12b gives a higher evaluation priority to the input to the second sorting unit C2 than to the input to the first sorting unit C1. This allows the processing unit 12b to give a higher evaluation priority to the input to the second sorting unit C2, which places a greater workload on the operator H. In this embodiment, the processing unit 12b of the control device 12 selects one of the predetermined evaluation levels to generate the evaluation data r.

[0064] The processing unit 12b may generate the evaluation data r based on the time required from when the selection screen S is displayed on the display 14 of the communication terminal M in step S12 until the combination data Z is generated in step S19. If the time required to generate the combination data Z is short, that is, if the operator H completes inputting the seafood product X and the fish species Y in a short time, the processing unit 12b may select a high evaluation level to generate the evaluation data r. In this way, the processing unit 12b may select an evaluation level depending on the time required to generate the combination data Z, and generate the evaluation data r.

[0065] Furthermore, the processing unit 12b of the control device 12 may generate the evaluation data r based on the difference between the combination data Z previously stored in the storage unit 12a of the control device 12 and the combination data Z generated in step S19. Specifically, when the processing unit 12b of the control device 12 compares the combination data Z of the fish species Y of the seafood X input by the operator H to the communication terminal M with the combination data Z previously stored in the storage unit 12a and determines that the data is similar within a predetermined range, that is, when the processing unit 12b determines that the fish species Y of the seafood X has been appropriately selected and input, the processing unit 12b may select a high evaluation level and generate the evaluation data r. In this way, the processing unit 12b may select an evaluation level depending on the accuracy of the combination data Z generated in step S19 and generate the evaluation data r.

[0066] Furthermore, the evaluation data r may be changed depending on various conditions, such as the time period when the seafood X and the fish species Y of the seafood X are input via the communication terminal M, and identification information of the operator H previously stored in the storage unit 12a of the control device 12. Specifically, the processing unit 12b may select a high evaluation level to generate the evaluation data r when an input is made to the communication terminal M during a preset time period or working time. Furthermore, the processing unit 12b may select an evaluation level depending on the proficiency of the operator H to generate the evaluation data r.

[0067] The storage unit 12a of the control device 12 stores the evaluation data r generated in step S21 in association with the combination data Z generated in step S19 (step S22). This allows the evaluation data r associated with the combination data Z to be accumulated in the storage unit 12a. As a result, the seafood sorting system 1 can improve the speed and accuracy of sorting operations based on the combination data Z and evaluation data r stored in the storage unit 12a.

[0068] The processing unit 12b of the control device 12 changes the seafood region x corresponding to the seafood X acquired in step S17 to the selected region xu (step S23). This prevents duplicate or repeated input of the fish species Y for the same seafood X via the display 14 of the communication terminal M. As a result, the seafood sorting system 1 can improve the speed at which the sorting work is carried out.

[0069] The processing unit 12b of the control device 12 determines whether the selection screen S includes a seafood area x (step S24). If the processing unit 12b determines that the selection screen S does not include the seafood area x (step S24: Yes), it determines a reward R based on the evaluation r stored in the storage unit 12a (step S25). On the other hand, if the processing unit 12b determines that the selection screen S does not include the seafood area x (step S24: No), the processing unit 12b of the control device 12 returns the process to before step S13. In this embodiment, the processing unit 12b calculates and determines the reward R as a monetary reward to be awarded to the operator H who inputs the seafood X and the fish species Y via the communication terminal M. The reward R may also be redeemable points or various other rewards awarded to the operator H. The reward R is determined based on the evaluation data r generated in step S21 and the number of times the operator H inputs the seafood X and the fish species Y into the communication terminal M. Specifically, the higher the evaluation level of the evaluation data r and the greater the number of inputs, the greater the reward R awarded to the operator H. Therefore, an appropriate remuneration R can be given to the operator H depending on the accuracy of the combination data Z of the seafood X and the fish species Y input into the communication terminal M and the number of times of input. This increases the motivation of the operator H to perform input work into the communication terminal M. As a result, it is possible to widely secure human resources to engage in the work of sorting the seafood X.

[0070] The processing unit 12b of the control device 12 controls the actuator of the separation device 4 to move the seafood X to one of the plurality of sorting areas 18 (step S26). In this embodiment, the processing unit 12b of the control device 12 generates operation control for the separation device 4 to move the seafood X to the sorting area 18 corresponding to the fish species Y, based on the image data D and the combination data Z generated in step S18, and moves the seafood X to the predetermined sorting area 18.

[0071] The control device 12 acquires the second weight W2 measured by the second weighing scale 10 (step S27). The processing unit 12b of the control device 12 updates the value of the first weight W1 included in the combination data Z based on the acquired second weight W2, and returns the process to before step S1 (step S28). This allows the control device 12 to update the combination data Z stored in the memory unit 12a based on the sorting work actually performed. This allows the accuracy of the sorting work for the seafood X to be improved.

[0072] The control device 12 may further perform learning to correct and update the existing combination data Z stored in the storage unit 12a based on the combination data Z generated in step S20. In this embodiment, the control device 12 compares the combination data Z generated in step S20 with the existing combination data Z stored in the storage unit 12a, and may add information about the shape information y1, the season and time y2, the sea area position information y3, and the water depth y4 to the combination data Z having the same fish species Y.

[0073] Second Embodiment Next, a second embodiment of the present disclosure will be described with reference to Figures 5 and 6. Note that in the description of the second embodiment, only the differences from the first embodiment will be described.

[0074] The seafood sorting system 201 according to the second embodiment of the present disclosure sorts farmed seafood X of the same fish species according to quality (an example of type) Y2. The quality Y2 is set to one of three levels: excellent Y21, good Y22, and fair Y23, depending on the size, weight, body color, shape, etc. of the seafood X.

[0075] 5A, the image data D2 includes seafood X21 to X23 of the same fish species. The processing unit 212b of the control device 212 divides the image data D2 into three seafood regions x21 to x23, which are divided by solid lines, and a background region xs.

[0076] Furthermore, the processing unit 212b calculates a matching rate α2 for each of the seafood regions x21 to x23. In this embodiment, the matching rate α2 is calculated as an index for determining whether the control device 212 can estimate the quality Y2 of the seafood X.

[0077] 5(b), the processing unit 212b of the control device 212 classifies the seafood X21 to X23 into a first seafood c21 and a second seafood c22 based on the value of the matching rate α2. In this embodiment, the first seafood c21 is a seafood whose quality Y2 can be estimated based on the value of the matching rate α2, and the boundary of the seafood region x2 is indicated by a thick solid line. Furthermore, the second seafood c22 is a seafood whose quality Y2 is difficult to estimate as excellent Y21, good Y22, or fair Y23, and the boundary of the seafood region x2 is indicated by a thick dashed line.

[0078] 5(b) and 6(a), the processing unit 212b generates a first sorting unit C21 for the seafood regions x21 and x22 classified as the first seafood product c21. In this embodiment, the processing unit 212b generates two first sorting units C211 and C212 corresponding to the seafood region x21 and the seafood region x22. The first sorting unit C21 includes the seafood region x classified as the first seafood product c21 and a quality candidate s2 (an example of a candidate). The quality candidate s2 is one of excellent Y21, good Y22, and fair Y23 of the quality Y2 estimated based on the value of the matching rate α2.

[0079] 5(b) and 6(b), the processing unit 212b generates a second sorting section C22 for the seafood region x23 classified as the second seafood c22. The second sorting section C22 includes the seafood region x23 classified as the second seafood c22 and a plurality of quality candidates s2. The plurality of quality candidates s2 are excellent Y21, good Y22, and fair Y23 of quality Y2, selected and sorted based on the value of the matching rate α2.

[0080] The processing unit 212b of the control device 212 generates a selection screen S2. In this embodiment, the selection screen S2 is screen data obtained by overlapping and synthesizing image displays of the seafood areas x21 to x23, the first sorting section C21, and the second sorting section C22 on the image data D2.

[0081] This allows the operator H to instantly identify the option from among the multiple quality candidates s2 that is most suitable as the combination data Z with the quality Y2 corresponding to the seafood X included in the seafood area x2.

[0082] Third Embodiment Next, a third embodiment of the present disclosure will be described with reference to Fig. 7. Note that in the description of the third embodiment, only the differences from the first embodiment will be described.

[0083] As shown in FIG. 7 , a vessel 301 includes a seafood sorting system 302 and a freezer 304. The seafood sorting system 302 is the same as the seafood sorting system 1 according to the first embodiment. The seafood sorting system 302 may also be the same as the seafood sorting system 201 according to the second embodiment. Such a vessel is required to sort seafood hauled up by, for example, a trawl net 306 and store the fish in a freezer by species. Therefore, a vessel equipped with the seafood sorting system 302 according to the present disclosure can easily perform such sorting. As a result, the number of crew members on the vessel can be reduced, enabling more efficient fishing.

[0084] Other Embodiments Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit and scope of the invention.

[0085] (a) In the above embodiment, the seafood sorting systems 1, 201 are described as examples that sort seafood X by fish species Y or quality Y2 of seafood X, but the present disclosure is not limited to this. The seafood sorting systems 1, 201 may sort seafood by sex, size, etc., in addition to fish species and quality.

[0086] (b) In the above embodiment, camera 6 is configured from a single camera, but the present disclosure is not limited to this. That is, camera 6 may capture images by controlling multiple cameras installed at different positions or angles, and image data D may be image data that integrates images captured by multiple cameras.

[0087] (c) In the above embodiment, the processing unit 12b of the control device 12 selects one of the predetermined evaluation stages as the evaluation data r and generates it, but the present disclosure is not limited to this. The evaluation data r can be in various forms for determining the reward R, such as a numerical value or a variable.

[0088] 1, 201,: Seafood sorting system 2: Conveyor device 4: Separator 6: Camera 8: First weighing scale 10: Second weighing scale 12, 212: Control device 12a, 212a: Memory unit 12b, 212b: Processing unit 14: Display 16: Input device S (S2): Sorting screen Ship: 301

Claims

1. A camera for imaging aquatic products, A display for displaying a sorting screen, A control device capable of communicating with the camera and the display respectively, generating the sorting screen for sorting the aquatic products based on the video imaged by the camera, and displaying the sorting screen on the display, A conveying device for conveying the aquatic products, The camera images the aquatic products conveyed by the conveying device, The control device includes a storage unit storing the combination information of the shape information of the aquatic products and the types corresponding to the shape information, A processing unit for estimating the types of the aquatic products included in the video and generating the sorting screen, And has, The combination information includes at least one of the season, sea area, and water depth when the aquatic products are landed, The processing unit acquires at least one of the season, sea area, and water depth included in the combination information stored in the storage unit and the shape information of the aquatic products, calculates the coincidence rate between at least one of the season, sea area, and water depth of the aquatic products included in the video and the shape of the aquatic products, and when the coincidence rate is equal to or higher than a predetermined value, determines that the type can be estimated, An aquatic product sorting system comprising.

2. When the control device determines that the type can be estimated by the processing unit, it determines that the aquatic product included in the video is the first type of aquatic product that can be sorted, When the processing unit determines that the type cannot be estimated, it determines that the aquatic product included in the video is the second type of aquatic product that cannot be sorted, The sorting screen is image information obtained by synthesizing the video, a first sorting part corresponding to the first aquatic product among the aquatic products included in the video, and a second sorting part corresponding to the second aquatic product onto the video, The aquatic product sorting system according to Claim 1.

3. The first sorting part includes the first aquatic product and candidates for the first aquatic product selected based on the combination information stored in the storage unit, The second sorting part includes the second aquatic product and a plurality of candidates for the second aquatic product estimated based on the combination information stored in the storage unit, The aquatic product sorting system according to Claim 2.

4. The processing unit generates selection buttons for displaying a plurality of candidates for the second aquatic product, and arranges the selection buttons based on the coincidence rate between the aquatic product included in the video and the image of the aquatic product included in the combination information. The aquatic product sorting system according to claim 3.

5. Based on the combination information input via the input device, the processing unit determines a predetermined evaluation corresponding to the input of the combination information, and evaluates the input to the second sorting unit more favorably than the input to the first sorting unit. Based on the evaluation, determine a reward. The aquatic product sorting system according to any one of claims 2 to 4.

6. A weighing scale for measuring the weight of the aquatic product conveyed by the conveying device; An input device into which at least the sorting information of the second aquatic product is input; further comprising; The control device is capable of communicating with the weighing scale and the input device; Based on the video captured by the camera and the weight measured by the weighing scale, the processing unit estimates the type of the aquatic product included in the video. The aquatic product sorting system according to any one of claims 1 to 5.

7. A ship equipped with the aquatic product sorting system according to claims 1 to 6.