Commodity display method, commodity-related work support method, and commodity distribution method

Abstract

To provide a commodity display method, a commodity-related work support method, and a commodity distribution method which realizes efficient and highly productive agriculture through cooperation between professional agricultural persons or between the professional agricultural persons and persons working closely to them, and which are directed to smooth distribution of agricultural commodities to consumers.SOLUTION: A commodity display method according to the present invention has a step of extracting a commodity image from a video obtained by capturing a commodity production environment, a step of changing a part or the whole of a background image of the commodity to a video other than the environment image, and a step of overlappingly displaying sensor information indicating characteristics of the commodity. A commodity related work support method has a step of generating a commodity related work request video, a step of replacing the video with the background image to produce work request content, and a step of calculating a work amount to carry out a work contract processing. A commodity distribution method has a step of extracting a video part specifying a place and attributes of an owner from the product environment image, and a step of producing content with replacing the video part with a commodity promotion video or a purchase intention enhancement video to perform auction.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a product labeling method, a product-related work support method, and a product distribution method that realize efficient and highly productive agriculture through collaboration between agricultural workers or between those directly engaged in agriculture and those around them, and that smoothly distribute agricultural products to consumers. Background and Prior Art

[0002] Currently, Japan is facing a variety of major problems surrounding food and the environment. One of these is the country's food self-sufficiency rate. Until the 1960s, the self-sufficiency rate on a calorie basis was over 60%, but today it has fallen to around 30%. The reasons for this include a decrease in the area of ​​farmland, a decrease in the number of people working in agriculture due to a declining birthrate and aging population, and a decrease in domestic production due to losing out in price competition with other countries. If things continue as they are, a halt to food imports in the future will be a threat to our survival. Therefore, it is desirable to improve the situation as soon as possible.

[0003] One of the reasons for farmers leaving farming is the management of farms. Compared to food exporting countries in the world, Japanese farmers have a smaller farmland area per household, making it difficult to introduce large machinery. Therefore, it is difficult to make a living from the labor required. In the case of paddy field farming, although the data is from 2006, more than 70% of farmers have less than one hectare, and the average age is in the late 60s. Farming income is around several tens of thousands to several hundred thousand yen per year. In reality, farmers are somehow managing to keep their total income at an average level by adding part-time jobs and pensions. In this way, if farming income is low, it is no longer an attractive occupation, and it is natural that successors will not be cultivated and farmers will leave farming. In 2015, the amount of abandoned farmland reached more than 420,000 hectares. If this situation is left unchecked, environmental changes will occur and it could have a serious impact on land conservation.

[0004] To make agriculture an attractive occupation, there is a strong desire to improve productivity and profitability. For this, it is important to efficiently produce agricultural products with added value, not just produce but process them into high-value products, and improve distribution to consumers. Such production and processing requires labor and expert know-how. Distribution requires providing products that accurately meet consumer needs. A common challenge to all of these is cooperation among those involved in agriculture.

[0005] Conventional inventions related to agricultural support information systems include the following. JP 2001-350818 A discloses an information system that enables people involved in agriculture and fisheries to provide and view their own information on the Internet, a method for constructing said database, and a terminal device that makes necessary information available at the actual work site. The aim is to link various services by manipulating the information entered by producers and the information evaluated by consumers.

[0006] In addition, JP 2017-182731 discloses an invention that aims to consolidate information provided by the government and information provided by farmers, etc., through farms and other intermediaries, and use the information for managing cultivated crops and creating agricultural plans.

[0007] However, collaboration often poses difficult problems. For example, in production and processing, small and medium-sized farmers often seek support due to a lack of manpower and know-how, but they often do not know how to express the necessary work or where to ask for help. There are ways to seek support via the Internet, but arrangements cannot be made unless the content and amount of work are specifically and clearly disclosed. In terms of distribution, there is a direct-from-producer business using the Internet, but there are many cases where problems arise due to insufficient communication between producers and consumers. Those who receive support or consultation will want to know as specifically as possible about the problems the farmers are facing, but those making the request will want to limit the information they receive to only that which is directly related to the support, in order to ensure safety and to avoid disruption to their business.

[0008] Therefore, in order to develop cooperative agriculture, an information system that can facilitate smooth communication between the party requesting the work and the party undertaking the work, and between the party supplying the work and the party consuming the work, is desirable. However, there have been few inventions of information systems aimed at improving communication in this type of cooperative agriculture. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Patent Publication No. 2001-350818 [Patent Document 2] Patent Publication No. 2017-182731 [Non-patent literature]

[0010] [Non-Patent Document 1] "Understanding agriculture will help you understand the workings of society," by Shinichi Shogenji, Ie no Hikari Kyokai Publishing, April 1, 2018, pp. 14-205 Summary of the Invention [Problem to be solved by the invention]

[0011] A major challenge is to design an information system that promotes communication in order to safely and efficiently realize collaborative agriculture. In order to safely carry out collaborative agriculture, it is desirable to delete information that is not necessary for collaboration, but if too much is deleted, the information provided becomes boring and the collaborating business operator loses interest. That will be pointless. An important challenge is to create and display attractive product-related content that emphasizes information necessary for collaboration while deleting unnecessary information. The object of the present invention is to provide a display method for accurately conveying the content when requesting work support from other agricultural stakeholders due to labor shortages, or when consulting with experts on methods for efficiently producing value-added agricultural products or methods for processing agricultural products into other food ingredients, and a method for arranging and implementing work support. In addition, a product display method and distribution method are provided that make consumers interested in the product and easily generate purchasing motivation.

[0012] [Means for solving the problem]

[0013] In order to achieve the above-mentioned object, the present invention provides, as a first feature, a product display method (3) comprising: a means for managing an image (B-1) or sensor information (A-1) acquired from an environment (1) in which a product is produced; a means (B-3) for extracting a product image (B-2) from the image; a means (C-1) for changing a part or all of the background image of the product to an image other than the environmental image; and a means (D-1) for superimposing and displaying sensor information (A-2, A-3) showing the characteristics of the product on an image consisting of the product image and the changed background image.

[0014] In the above configuration, the product environment (1) can be expanded to a marine environment in addition to a farm. The means for overlaying and displaying can be achieved by using mixed reality technology or image synthesis technology.

[0015] In the above configuration, the product image extraction means (B-3) may extract product images related to the value of the product at the time of product trading. For example, images of fruits, food ingredients, and products such as mandarin oranges, apples, pears, grapes, strawberries, and bamboo shoots. A 3D reconstructed image may be produced (B-4) using images of the product taken from multiple angles, and the image may be produced as product-related content that can be viewed in a virtual reality environment.

[0016] In the above configuration, the extraction process can be made more efficient by providing an image mark on the product or the subject that produces the product (tree or vine). A two-dimensional barcode can be used as the mark. The two-dimensional barcode can be recognized from within the image, and the surrounding area can be defined as the product and extracted. It is also possible to provide a position sensor linked to the camera image around the product. If a position detection sensor is provided in the camera, the product can be recognized and extracted using the position of the sensor in the image as a clue.

[0017] In the above configuration, information related to the value of the product, such as the size, weight, shape, color, sugar content, hardness, sweetness, and odor components of the product, can be extracted (A-3) from the product sensor information (A-2) to be used when trading the product, and the information can be included in the product-related content (D-1) using electronic watermarking technology (A-5). The confidentiality of the electronic watermarking information can be set in stages. In other words, since the information related to the value (A-3) may be disclosed depending on the product trading stage (E-4) or the product-related content production support stage (H-1), passwords can be set in stages. For example, in an auction-style product trading (E-4), it is possible to set restrictions on sensor information until a bid is made, and to control the amount of sensor information to be disclosed depending on the bid. After a bid is made, non-public information such as the name of the product producer can be disclosed. Also, in the product-related content support (H-1), it is possible to set restrictions on sensor information to be disclosed until a supporter is decided, and to control the amount of sensor information to be disclosed depending on the support work. In addition, in member-based product trading, the value information can be disclosed only to the member.

[0018] In the above configuration, the product sensor information (A-2) includes aroma sensor information, which detects the aroma components of the product, extracts aroma synthesis parameters (A-4) to resemble the sensation of smelling in the product environment, and can be included in the product-related content production (D-1). By downloading the content from the Internet and extracting the synthesis parameters, the aroma can be smelled using a dedicated aroma generating device.

[0019] In order to achieve the above-mentioned object, the present invention provides, as a second feature, in addition to the first feature, a product-related work support method (4) which uses a product display method (3) to extract or generate (G-2) a product-related work request video from the product video (B-2) and the background video (B-5, B-6) and replace the video with part or all of the background video to create product-related content (D-1), and which includes a means (H-1) for calculating the amount of the related work from the product-related work request video (G-2) and product environmental sensor information (A-1) and performing work undertaking processing.

[0020] With the support method configured as above, when a request for produce-related work is received from the owner of the produce environment (1), the request for the produce-related work is displayed as a video (G-2, D-1), and the amount of work related to the work is calculated from the video and sensor information and shown to the owner (H-1), which facilitates communication between the work requester and the work contractor, and is effective in improving work efficiency and reducing work costs.

[0021] The produce-related work includes support for work related to produce growth, such as weeding (mowing grass) and spraying fertilizer and pesticides (H-2). It also includes support for work such as plowing paddy fields, planting rice, harvesting rice ears, polishing rice, and producing and harvesting fruits. It can be linked with a personnel dispatching means (H-3) for the work. Furthermore, the produce-related work includes analysis and diagnosis of the produce condition (H-4), estimation of the produce price (H-5), etc. It also includes contract and remuneration processing (H-6) when carrying out the support work.

[0022] Regarding the calculation of the amount of work in this configuration, if information on similar past work is stored as a database, the calculation can be made more efficient and the accuracy improved by referring to this information.

[0023] Regarding the contracting and remuneration process when carrying out the support work in this configuration, when the product-related work is carried out, a change occurs in the product environment image (B-1, B-2, B-3, or B-6). Also, a change occurs in the product environment sensor information (A-1 or A-2). This change is analyzed in the extraction or generation process (G-2) of the product-related work request image, and after the background image rewriting process (C-1), it is visualized by the product-related content production means (D-1) and delivered to the client, so that the remuneration claim from the work contractor is satisfactory to the client. This has the effect of making the work contract proceed smoothly.

[0024] The product growth state analysis in the product-related work is information processing that utilizes mathematical knowledge such as statistics, agricultural science, physics, biology, and chemistry to make the information (A-1 or A-2) obtained from the product environment sensor useful for product growth. In addition, by combining video and the sensor information, a more advanced product growth state can be analyzed. Specifically, the growth progress, growth crisis, weed amount, need for weeding, need for pesticides and fertilizers, need for pest control, disease diagnosis, sugar content, taste, hardness, aroma, etc. can be analyzed or estimated as product state parameters. Here, the effects of pesticides and fertilizers can be clarified by subjecting the product sensor information in the environment with and without the work support to multivariate analysis such as discriminant analysis, principal component analysis, and factor analysis.

[0025] The analysis can also be requested to unspecified product experts via the Internet. In this case, information related to the product growing region and the right holder can be concealed from the product background video, and the request content can be clarified using the product-related work request extraction video (G-2) and product environment sensor information (A-1, A-2, A-3, etc.), so that related work can be carried out safely and efficiently.

[0026] Taking the weeding (grass cutting) (H-2) task as an example, the produce-related work request image (G-2) is an image in which the weed area is extracted from the produce environment image (B-1) to allow the amount of weeding work to be visually understood. This can be realized by differential processing of time-series images, focusing on the produce background image (B-5). That is, in the case of an orange orchard, for example, weeds generally grow faster than the oranges that are the product, so by performing differential processing of the product background image daily and integrating this, the weed area can be identified. The amount of weeds in that area can be calculated by comparing it with the time when no weeds grow. If weeding is the product-related work, then overlaying the weed image as the image related to the product background corresponds to the background image replacement process (C-1). The industry-related content (D-1) obtained by carrying out this process can be sent directly to a company that provides support for product-related work, or it can be made available on the Internet (I) to select a company with good support services.

[0027] In this way, when the information is made public, the right holder of the produce environment (such as a farmer with labor shortages) often wants to ask a contractor to remove the weeds, but wants to keep the location of the farm and the information about the produce secret until the contractor is actually decided. If the location of the farm and the video of the produce are made public on the Internet (I), the general public will have the opportunity to view them (F-2). In this case, there is also concern about damage caused by agricultural produce thieves. In order to ensure the safety of the farm, it is desirable to disclose only the information necessary for the work. Therefore, in the example of weeding, the relationship between the weeds and the produce is expressed by the video, and the video that leads to the identification of the farm related to the background of the product can be replaced with another video. The other video can be selected from the mood-boosting video database (G-1) that will make people interested in mandarin oranges and motivate them to buy them. The mood-boosting video can be replaced with, for example, a video of an all-you-can-eat farm that makes people want to eat mandarin oranges. However, it goes without saying that care should be taken not to cause misunderstandings by replacing it.

[0028] In order to achieve the above-mentioned object, the present invention provides, as a third feature, a produce-related work support method (4), which is characterized in that, in addition to the second feature, an avatar of the agricultural product is used in a means (G-2) for extracting or generating a produce-related work request image.

[0029] In producing the produce-related content, a process (C-1) can be performed to replace the background image (B-6) with an image of an agricultural product avatar (an anthropomorphized agricultural product) making a produce-related work request (G-2). In the case of an agricultural product being a mandarin orange, a character called "Mikan-kun" can be used as an avatar to appeal for work assistance. For example, "I've been having a lot of bugs lately and it's a problem. What should I do?" This has the effect of making it easier for the farm right holder (farmer) to respond to the appeal and request pest control as a produce-related work. It also has the effect of making it easier for agricultural experts watching the produce-related content to give advice. The agricultural product avatar can also widely solicit issues and solutions for improving the cultivation of the agricultural product via the Internet based on analytical information on the cultivation state of the agricultural product.

[0030] As described above, in the produce-related work support method of the present invention, the information necessary to enable the person requesting the produce-related work to understand the work content is visualized (G-2) and replaced as a produce background image (C-1), or an image that leads to the identification of the produce environment is replaced with another mood-boosting image (G-1), thereby producing and publishing produce-related content (D-1), so that the produce-related work support can be realized safely and efficiently, which is effective in improving work quality and reducing work costs.

[0031] In order to achieve the above-mentioned object, as a fourth feature, in addition to the first feature, the present invention provides a product distribution method (5) which publishes product-related content (D-1, D-2) produced using a product display method (3) which extracts (B-6) background video identifying the location of the industrial environment or the attributes of the rights holder of the product environment from a product environmental video (B-1) and replaces the video area with a promotional video advertising the product region or a video encouraging purchasing desire (G-1), and carries out transactions of the product with consumers.

[0032] In the above configuration, the purchase motivation boosting video (G-1) can include videos that show the food processing method using the product, cooking method, nutritional value of eating, the history of the product that came to be eaten as a product, etc. It can also include videos that increase added value such as the cultivation method showing that the product is pesticide-free or reduced-pesticide, the shipping method showing that the product is fresh, and the presentation of taste and smell information (A-4).

[0033] In the above-mentioned configuration, the video (G-1) for increasing motivation to buy can use an avatar of the agricultural product (an anthropomorphized agricultural product). If the agricultural product is a mandarin orange, a character called "Mikan-kun" can be used as the avatar to appeal to the consumer to buy. "It has been bathed in plenty of summer sunlight and is delicious. Please try it!" and so on. This has the effect of making consumers respond to the appeal and increasing their motivation to buy.

[0034] In order to achieve the above-mentioned object, as a fifth feature, the present invention provides a product distribution method (5), which is characterized in that, in addition to the first feature, the product is traded (F-1) using an auction site (E-4) having a means (E-1) for collecting product-related content (D-1, D-2) produced using a product display method (3) having a process (C-1) of extracting (B-6) background image identifying the location of the industrial environment or the attributes of the rights holder of the product environment from an environmental image (B-1) of the product and replacing it with another background image.

[0035] In order to achieve the above-mentioned object, the present invention provides, as a sixth feature, a product distribution method (5), characterized in that, in addition to the fourth feature, the content collected by the industry-related content collection means (E-1) is integrated by an auction content production means (E-2) using virtual reality technology or mixed reality technology, in which images (E-3) from a regional development video database or a mood-boosting video database are used as background images. BEST MODE FOR CARRYING OUT THEINVENTION

[0036] The embodiments of the present invention will now be described in detail. Example 1

[0037] FIG. 1 illustrates a product display method, a product-related work support method, and a product distribution method according to an embodiment of the present invention. In the figure, I is the Internet, and 1 is the product environment to be monitored. Specifically, it is farmland, agricultural greenhouses, etc. K1 is the right holder of the product environment, that is, an information processing device of an agricultural worker. A-1 is sensor information output from a product environment sensor installed in 1, such as temperature, humidity, moisture, wind speed, soil condition, biological reaction, and the type and amount of pests. A-2 is sensor information related to the product, which is part of the sensor information, such as the type, size, color, shape, weight, smell, and position of the product. B-1 is an image of the environment in which the product is grown, B-2 is an image related to the product in the image, and B-5 is a background image of the product obtained by removing B-2 from B-1. B-3 is an image in which a part of the product that has value when trading the product is extracted. For example, it is an image of a product such as an orange, an apple, grapes, or a banana. B-4 is a 3D image reconstructed using images from multiple directions of B-3. B-6 is an image related to the background of the product extracted from B-1.

[0038] G-2 is a video to explain the work content when requesting produce-related work from agricultural partners or those receiving assistance, and is extracted or generated by image processing and analysis of B-1, B-2, and B-5. For example, if a request is for weeding, it is a video edited to show the type and amount of weeds around the produce, if a request is for produce condition analysis, produce value estimation, or fertilizer spreading, it is a video edited to show the fruit density, sunlight conditions, fruit tree condition, branch shape, etc., and if a request is for watch work to prevent produce thieves, it is a video edited to show whether a transport vehicle such as a truck has entered the vicinity of the produce.

[0039] G-1 is a video that can be used as an advertisement for a product, and that lifts the spirits when viewed. For example, if the product is Shizuoka tea, it is a video promoting the region, such as Mt. Fuji or the Shimizu Port Festival. If the product is bamboo shoots, it is a video of the bamboo shoots' growth process, cooking methods using bamboo shoots, and the history of bamboo shoot dishes. If the product is grapes, it is a video of the wine-making process using the product, the benefits of wine, etc. C-1 is an image processing means that removes B-6 and replaces G-1 or G-2.

[0040] A-3 is sensor information that extracts valuable parts of the product based on the information from A-2 when trading the product, such as the size, shape, color, weight, hardness, sugar content, chemical components, and odor components of the product. A-4 is a processing means that extracts parameters for fragrance synthesis to express the state of the product based on the information from A-3. The same fragrance perception can be obtained by preparing a basic fragrance and blending and presenting it, even if the analyzed components are not released as they are. The synthesis parameters are information for the blending.

[0041] D-1 is a means of producing content related to products, and has the function of integrating sensor information. It can be expressed using video, audio, sound, text, characters, avatars, scents, etc. It can integrate information about the product, B-3 and B-4, with information about the background. In this case, part or all of the background can be replaced with G-1 and G-2.

[0042] A-5 is a means for carrying out digital watermark processing, and is a means for controlling the confidentiality of the information on A-3, the information on 1, or the information on K1. The digital watermark information can be superimposed on the content produced by D-1. Since the confidentiality can be released with an electronic key, the information on A-3, 1, or K1 can be made viewable as necessary.

[0043] 3 shows a configuration for providing the product display method of the present invention for producing D-1. D-2 is a product-related content production means of a different right holder from K1, which is produced in the same manner as 1. F-1 and F-2 are the product-related content viewing means.

[0044] 4 shows a configuration for providing a method for supporting produce-related work of the present invention using 3. H-1 is a produce-related work support means. Various supports are possible by viewing D-1. H-2 is a means for carrying out weeding and fertilizer / pesticide spraying. By viewing G-2, the scope of work can be clearly recognized, making it easy to prepare work in advance and to easily purchase equipment. In addition, the cost of work can be accurately grasped, making it possible to set reasonable remuneration. H-3 is a means for dispatching personnel. H-4 is a means for analyzing the produce condition, and H-5 is a means for estimating the produce value. Since the work content is clarified in G-2 and A-3 of 3, there is an effect that the work proceeds efficiently. H-6 is a means for performing work contracting and remuneration processing for the produce-related work. Since it is easy to reach an agreement using D-1, the work proceeds safely and efficiently.

[0045] 5 shows a configuration for providing the product distribution method of the present invention using 3. E-3 is a database of regional promotion videos for advertising the region where the product is produced, or a database of videos for increasing the excitement of the viewer in advertising the product. It can be configured as a virtual reality environment or a mixed reality environment. In the environment, a person who wants to distribute the product can appear as an avatar.

[0046] E-1 is a means for collecting product-related content D-1, D-2, etc. on the Internet. E-2 is a means for using an image selected from E-3 as a background image for an auction venue, and displaying the product-related content collected by E-1 against that background. E-4 is a website for auctioning products using E-2. An auction environment designed to promote distribution for each product is provided here. At the target product auction venue on the site, the avatar can auction his or her own product using his or her own product-related content created by D-1 and D-2. The product-related content viewing means of F-1 has an auction participation means, and can participate in the auction for the product.

[0047] FIG. 2 is an example of a background image of the auction used in the product distribution method of the present invention. In the figure, P1 is the home page of the product auction website. Since it is assumed that mountain village products are being handled, mountain animals are used as avatars. P6 is the organizer (manager) avatar (owl), P4 is the producer's avatar (snake) who is offering mandarin oranges as a product, and P7 is the avatar of a participant in the auction. , P2 is the mandarin orange for sale. P3 is a stereoscopic display using mixed reality technology. The mandarin oranges and mandarin orange trees in the frame are 3D reconstructed images of actual camera images, and are the most important images in the transaction. The seller's intention is indicated as a comment: "This is an auction of all the mandarin oranges growing on the tree."

[0048] For security reasons, qualifications for participation in the auction can be set, and personal information can be protected by an electronic key as necessary.

[0049] In this way, the product producer or his / her representative can participate in the venue as an avatar and can promote and explain the product. In the explanation, the product display method of the present invention is used, so that product information that is valuable to consumers is fully disclosed, but there is no need to disclose environmental information (such as the location) in which the product is produced, the location of the producer, or attributes such as facial images, voice, and personality. In addition, the purchaser also participates as an avatar, so attributes can be kept secret. Therefore, the product can be distributed safely. In this distribution method, since there are rarely multiple intermediaries, the producer has the advantage of being able to omit the middleman margin. In addition, the consumer has the advantage of being able to obtain the desired product directly from the producer while carefully checking the information on the product without disclosing his / her own personal information. As described above, there are advantages to be gained by both the producer and the consumer.

[0050] FIG. 3 illustrates another embodiment of the present invention, which describes a product display method and a product-related work support method. 10 is a product environment in which a vast farmland is divided. m1 and m2 are mountains that are part of the background of the product environment and indicate the characteristics of the region. The location of 10 is indicated by looking at the mountains. f11 to f33 are product environments that are divided into compartments. s11 to s33 are product environment sensors or product sensors installed near the products in the compartments. The product environment sensors provide soil detection information, temperature, humidity information, microbial information, pest information, and the like, and the product sensor information indicating the product state can be obtained by processing the information. In addition, information related to the value of the product during product trading, such as the size, color, quantity, weight, shape, aroma components, and taste components of the product, can be extracted, which is not shown in the figure.

[0051] r1 is a visible camera, and r2 is a near-infrared camera, which photographs 10 or f11 to f33. Each of the above sections may be photographed separately. The shape and color of the photographed object can be detected from r1, and the temperature distribution of the object can be detected from r2. By integrating and processing the sensor information of r1 and r2, the temperature change of the object can be detected with high accuracy. It can also be combined with the sensor information of s11 to s33. Therefore, if the photographed object is a product, the ripeness and taste such as sweetness can be estimated from the size, shape, color, weight, temperature, and aroma components of the product.

[0052] d1 to d3 are drones for monitoring the produce environment. The drones are equipped with cameras and sensors, and the acquired images and sensor information can be integrated and processed with the sensor information of r1, r2, s11 to s33. For example, if three drones are flown, the position of each drone is measured by GPS, so the produce environment can be photographed simultaneously from different positions. If image information can be obtained from three or more locations, a three-dimensional stereoscopic image of the produce environment can be reconstructed in real time. In addition, even if only one drone is used, it can be reconstructed, although not in real time, by devising a flight route. This information is useful for informing a third party of the work environment when the produce-related work described later is requested.

[0053] gh1 and gh2 are environmentally-controlled product growing houses. s51 and s52 are product environment sensors or product sensors, and the method of use is the same as in the case of s11 to s33.

[0054] H-1 is a produce-related work support means, which indicates an information processing device of a person who provides intermediary services for work support related to produce production. This means has a user interface (H-7) that coordinates cooperation between producers and those who support the production work. The interface is provided with a function for accepting agricultural consultations. H-1 also has a means (AB) for managing the sensor information, a means (B-3) for extracting and processing produce images from the acquired images, a means (B-6) for extracting and processing background images of the products, a means for recognizing more advanced objects using a sensor information integration processing technology, a means (G-2) for extracting or generating images of agricultural produce-related work requests, a processing means (C-1) for replacing the background images with mood-boosting images (G-1) or produce-related work request images (G-2), and a produce-related content production means (D-1).

[0055] The characteristics of the product display method of the present invention will be described. V3 is a crisis management processing means. In an environment such as that shown in FIG. 3, when requesting support for product-related work, it is necessary to specifically disclose the related work because the product environment is vast. For example, in the case of weeding, if it is not possible to clearly indicate which area of ​​which section to request, how much to weed, and how to dispose of the weeded grass, it is not possible to request a third party to do the work. On the other hand, since cameras are scattered over a vast site, various backgrounds are captured. When using a drone, a wide range can be easily captured. In that case, if a forest or a river is recognized, the location of the product environment is likely to be identified. If a producer requests a specific contractor to do the work, there is no problem if the location of the product environment is identified, but if the producer requests a third party to widely support the work, for example, as a volunteer, it is often not desirable to disclose the location until the support is confirmed and a contract is concluded.

[0056] If video information unrelated to the work is made available on the Internet, it could invite theft of produce. V3 is a processing method to determine the possibility of such a crisis occurring. It can be achieved by combining sensor integration technology, image recognition technology, and AI learning technology to check whether personal information such as the producer's name or information that can identify the location of the produce environment is present in the video.

[0057] Moreover, the process of replacing the background image (C-1) is also effective for purposes other than the above-mentioned work requests. For example, the same thing can be said when consulting with experts on problems in agricultural work to receive know-how and advice. In other words, cooperation cannot be obtained unless the problem is disclosed accurately and in an easy-to-understand manner, but it is not desirable to disclose more information about the crop environment than necessary. If information about a plot other than the owner's own plot is captured in the image, it will cause inconvenience to the owner of that plot. Images of other people's plots must be deleted.

[0058] In this way, in order to smoothly carry out collaborative agriculture with the cooperation of various people, it is extremely important to provide information by distinguishing between information necessary for collaboration and information that is not necessary. In the present invention, it is assumed that a third party is requested to perform work or provide advice within the framework of collaborative agriculture. Therefore, as described above, the product image and the background image are distinguished, and if there is any image in the background image that is not suitable for disclosure, it is deleted, and the deleted part is replaced with an image that specifically shows the work content or the requested know-how, or with an uplifting image so that the image is interesting to the viewer, and the product-related content is produced and can be disclosed to a third party. This is a characteristic of the present invention.

[0059] The replacement image can be a virtual reality (VR) or mixed reality image. When a crisis is recognized based on the judgment of V3, the background image can be replaced with the VR environment image. VR-DB is a database in which a virtual reality environment is prepared. V2 is an environment created using the technology. V1 is an avatar of a product, and can be made to appear in V2. For example, in a potato field, the potato avatar can lift the mood of the viewer of the content by saying, "It's almost time to harvest. They're getting delicious."

[0060] H-2, H-3, H-4, H-5, and H-6 are the same as in Figure 1.

[0061] K1 is the same as in FIG. 1. A production environment (farm) may be located in one corner of 10. K2 is an information processing device of a person who owns land at a remote location in 10. net is a communication network, for example, the Internet. There are many city dwellers who want to farm in the countryside on their days off. Even if they have such a desire, it has been difficult in the past because it requires agricultural know-how and regular farm work. However, according to the present invention, it is easy to cooperate with local farmers and local labor agencies, so there is an effect that it is highly likely to be realized.

[0062] Specifically, a company having H-1 can provide the following intermediary service. The company manages sensor information and video information of the farm of an urban resident having K2, and informs the urban resident of the state of the farm using the product display method of the present invention. Here, information such as the increase in weeds and the need for fertilizer is also notified. The urban resident can request the company to arrange for the weeding and fertilizer. The company may carry out the work using H-2 as its own business, but can also ask a third party for knowledge and know-how from a more multifaceted perspective. In this case, since the display method of the present invention is used, the specific content of the work can be inquired while suppressing interference and ensuring safety. 11 is information regarding agricultural product content (D-1) and service information sent from H-1. 12 is information from K2 requesting services such as intermediation of weeding. 13 is the flow of sending the results of the agricultural support service as agricultural product-related content. 14 is the processing of remuneration for the intermediary work.

[0063] K3 is an information processing device owned by a food processing and sales company that owns land in 10. In the same way, a company that owns H-1 can be asked to create product-related content, which can then be distributed on the auction site in Figure 1. When creating the product-related content, the background video can be replaced with a video of the company's processed food. This has the effect of advertising both the product and the processed food.

[0064] M1 is an information processing device of a person who has knowledge and know-how related to agriculture. It is connected to the net. The city resident who does farming at 10 on holidays can send an advice request to M1 via H-1 using the display method of the present invention, as shown in 15. 16 is advice information, which is sent from M1 to the producer via H1. 17 is a reward processing means that is provided if the advice is successful. Whether the advice is successful or not can be determined by creating the agricultural product-related content after the advice is given and comparing it with the agricultural product-related content showing the state of the farm before the advice was given. Both the city resident and the advice provider can confirm through the content. In this way, collaborative farming can be performed while keeping personal information secret from each other. Lav is a laboratory in the agricultural department of a university, and M2 is an information processing device in the laboratory. Even more advanced collaboration is possible.

[0065] M1-H-4 is the agricultural produce growth status analysis means owned by M1, M1-H-5 is the agricultural produce price estimation means owned by M1, and M1-H-7 is the means for monitoring agricultural thieves by continuously and automatically analyzing agricultural produce-related content sent from H1. If there is a monitoring request from H1, the holder of M1 can use the agricultural produce-related content to find the trucks owned by the thief and notify the producer via H1.

[0066] In this way, a contract-like business is established between a producer who owns farmland and a person who performs agricultural support intermediation services using an information processing system, and an open collaborative business is established between the producer and a person with agricultural knowledge. Open means that collaboration is possible without disclosing personal information to each other. Furthermore, if a relationship of trust is deepened between the producer and the person with agricultural knowledge by implementing the method of the present invention, it will be possible for them to disclose personal information to each other and collaborate. When mutual benefits begin to flow, it becomes a business model that generates positive feedback aimed at optimizing agricultural results.

[0067] FIG. 4 explains the background replacement process (C-1) in the product display method of the present invention. In the figure, Img01 to Img04 are time-series images obtained from a visible camera installed in the product environment. In Img01, 21 is the house of the owner of the product environment, 22 is a nearby mountain with a distinctive feature, 23 is a river with a distinctive feature, 24, 25, and 26 are trees that produce products such as oranges, and j1, j2, and j3 are sensors installed near the trees. The sensors can measure chemical substances and moisture content in the soil, and can also transmit location information to the camera. The process in the figure is performed for the purpose of grasping the amount of weeds growing around the orange tree, creating product-related content, and requesting work. This is the case when the owner does not have frequent access to the environment.

[0068] Img01 shows a state where no weeds have grown. Over time, grass begins to grow, as shown in Img02. Grass generally grows faster than mandarin oranges, so by performing differential processing between Img01 and Img02, the weeds can be extracted, as shown in Img11. Numeral 28 is the extracted weed. Similarly, by performing differential processing between Img02 and Img03, weed 29 can be extracted, as shown in Img12. By adding the differential images obtained in this way and performing superimposition processing, it is possible to extract an area 30 where weeds are growing densely, as shown in Img13.

[0069] Img04 is the latest image. The densely weeded area in that image is also 30, so by performing differential processing for that area between Img01 and Img04, the latest weed condition can be extracted as shown in Img14, 31. Now consider the case where the weeding work is outsourced to a third party through open bidding. To do this, detailed information about the weeds is required. This includes the area of ​​the weeds, the type of grass, how the grass is growing, and the amount of grass. With detailed information about the grass, the person doing the work can take the optimal action. This allows them to select the herbicide and lawnmower to use.

[0070] On the other hand, until the weeding work is requested and a contract is made, the requesting party does not know who will view the video, so they want to conceal unnecessary parts. Therefore, it is possible to emphasize the work request part by putting a box around it, and to replace the background that leads to the identification of the location with an uplifting video. Img14 is produce-related content created in this way. Here, G-1 is the produce-related work request video to be replaced, and G-2 is a database of uplifting videos. Img14 uses a safe uplifting video or a video of regional development as a background, and shows the amount of weeding, type of grass, and area, and also displays the requested details of tangerine pruning and fertilizer. [Industrial Applicability]

[0071] As shown in Figures 1 and 3, this invention allows agricultural workers to communicate with each other, and with agricultural experts in the area, to work together to carry out agricultural work. This can be used for farm management and agricultural consulting businesses. It can also be used for direct delivery of agricultural products and auction businesses. It can also be used for marine products in addition to agricultural products. [Brief description of the drawings]

[0072] [Figure 1] In the embodiments of the present invention, a product display method, a product-related work support method, and a product distribution method are described. [Diagram 2] In the embodiment of the product distribution method of the present invention, an example of a homepage of a Web site used for product auction transactions is explained. [Diagram 3] In another embodiment of the present invention, a method for displaying products and assisting in product-related tasks is described. [Figure 4] In the product display method of the present invention, a background replacement process is explained. [Explanation of symbols]

[0073] 1. Product environment 3. Product labeling method 4. Product-related work support method 5. Product distribution methods 10. How vast farmland is divided by product environment 11. Product-related content and service information 12. Information for requesting services such as weed removal services 13. Sending agricultural product-related content as a result of agricultural support services 14. Processing of fees for the relevant intermediary services 16. Advice 17. Reward system provided if the advice is successful 21. The home of the owner who owns the product environment 22. Distinctive mountains nearby 23. Distinctive Rivers 24, 25, 26: Trees that produce oranges and other products AB: Means for managing sensor information A-1 Product environment sensor information A-2 Product sensor information A-3: Information on the value of the product obtained from the product sensor at the time of product trading A-4: Parameter extraction process for fragrance synthesis A-5: Digital watermark processing B-1...Product Environment Video B-2...Product footage B-3 Extraction of product images related to the value of the product when trading the product B-4...3D reconstructed image B-5...Product background video B-6: Means for extracting and processing background images of products C-1 Background image replacement process D-1: Product-related content production method (sensor information integration processing) D-2: Product-related content production method (sensor information integration processing) E-1: A means of collecting product-related content on the Internet E-2: A method for creating auction content that combines product-related content and background E-3: A database of videos promoting local communities, or a database of videos that create excitement in viewers E-4: Auction sites, auction-style product trading F-1: Means of browsing industry-related content, means of participating in auctions F-2: Means of viewing industry-related content G-1...Mood-boosting video database G-2: Product-related work request video (obtained by extraction and generation processing) H-1 Product-related work support means H-2: Supporting means for work related to crop growth (weeding, fertilizer and pesticide spraying means) H-3: Temporary staffing means H-4 Product status analysis and diagnosis H-5...Product Price Estimation H-6: Means of contracting and processing remuneration for work related to the product H-7: A user interface that coordinates collaboration between producers and those who support the production work Internet Img01~Img04: Time series images obtained from a visible light camera installed in the production environment K1: Information processing device of the right holder of product environment 1 K2: Information processing equipment for remote farmers, owning 10 acres of land K3: Information processing device for food processing and sales companies Lav...Agriculture Laboratory M1: Information processing device for agricultural experts with agricultural knowledge and know-how M2: Information processing device in the agricultural laboratory M1-H-4: Means for analyzing agricultural product growth status owned by M1 M1-H-5··M1's agricultural price estimation method M1-H-7 ··Method of automatically analyzing agricultural product-related content and monitoring agricultural thieves P1: Product auction website home page P2: Orange exhibit P3: 3D display using mixed reality technology P4: Avatar of a producer offering mandarin oranges as produce (snake) P6: Host (Manager) avatar (owl) P7: Avatars of people participating in the auction V1...Product Avatar V2...Mixture Realty Equipment that Generates Agricultural Environments V3... Crisis management processing means VR: Virtual Reality VR-DB: A database with a virtual reality environment d1, d2, d3...Product environment monitoring drone f11~f33 Compartmentalized product environment gh1, gh2: A well-maintained cultivation house j1, j2, j3: Sensors installed near trees m1, m2: Mountains that are part of the product environment and characterize the region net: a communication network, e.g. the Internet r1: Visible camera r2: Near infrared camera s51, s52: Product environment sensor or product sensor s11 to s33: Product environment sensors installed near the products in the relevant section

Claims

1. A product display method (3) comprising: a means for managing an image (B-1) or sensor information (A-1) acquired from an environment (1) in which a product is produced; a means (B-3) for extracting a product image (B-2) from the image; a means (C-1) for changing a part or all of a background image of the product to an image other than the environmental image; and a means (D-1) for superimposing sensor information (A-2, A-3) indicating characteristics of the product on an image consisting of the product image and the changed background image.

2. In claim 1, a product-related work support method (4) is used to extract or generate (G-2) a product-related work request video from the product video (B-2) and the background video (B-5, B-6), and to create product-related content (D-1) by replacing the video with part or all of the background video, and a means (H-1) is provided to calculate the amount of the related work from the product-related work request video (G-2) and product environment sensor information (A-1) and perform work undertaking processing.

3. A produce-related work support method (4) according to claim 2, characterized in that an avatar of the agricultural product is used in the means (G-2) for extracting or generating a produce-related work request image.

4. In claim 1, a product distribution method (5) is provided which publishes product-related content (D-1, D-2) produced using a product display method (3) that extracts (B-6) background image identifying the location of the industrial environment or the attributes of the right holder of the product environment from an environmental image (B-1) of the product, and replaces the image area with a promotional image advertising the product region or an image encouraging purchase desire (G-1), and then trades the product with consumers.

5. In claim 1, a product distribution method (5) is characterized in that the product is traded (F-1) using an auction site (E-4) having a means (E-1) for collecting product-related content (D-1, D-2) produced using a product display method (3) having a process (C-1) of extracting (B-6) background image identifying the location of the industrial environment or the attributes of the right holder of the product environment from an environmental image (B-1) of the product and replacing it with another background image.

6. The product distribution method (5) according to claim 4, characterized in that the contents collected by the industry-related content collection means (E-1) are integrated by an auction content production means (E-2) using virtual reality technology or mixed reality technology, using images (E-3) from a regional development video database or a mood-boosting video database as background images.

Images