System, device, and method for providing therapeutic farming activity service by using metaverse and digital twin

Abstract

A system, a device, and a method for providing a therapeutic farming activity service by using a metaverse and a digital twin are disclosed. According to one embodiment of the present application, the method for providing a therapeutic farming activity service by using a metaverse and a digital twin may comprise the steps of: constructing a digital twin including a virtual activity space virtually simulated to correspond to an offline activity space on the basis of object information and space information the offline activity space; generating a virtual object performing an online therapeutic farming activity in a metaverse space based on the digital twin on the basis of user information of a user; obtaining activity performance information for the online therapeutic farming activity performed in the virtual activity space on the basis of the virtual object; and transmitting the activity performance information to the offline activity space side.

Description

A system, device, and method for providing healing agriculture activities using metaverse and digital twins.

[0001] This paper relates to a system, device, and method for providing healing agriculture activity services utilizing metaverse and digital twins.

[0002]

[0003] As industry and technology advance, people in industrialized cities embrace diverse lifestyles and conduct their daily lives. This has accelerated the migration of people of all ages to large cities, and residential patterns have also evolved to better suit urban living. As people become accustomed to urban living, services related to remote farming and horticulture are on the rise.

[0004] Furthermore, the development of online gatherings and online activity platforms utilizing virtual reality is driving the rise of garden cultivation, rather than weekend farms where large groups of people gather to cultivate crops. Furthermore, there is demand for garden management systems that link user cultivation activities in online virtual reality using the metaverse with automated gardening equipment. This system then applies cultivation activity data from user terminals to the automated equipment, enabling crop cultivation. This allows users to cultivate crops online without having to physically engage in cultivation activities at weekend farms.

[0005] In addition, digital therapeutics are software medical devices that provide evidence-based therapeutic interventions to patients to prevent, manage, and treat medical disorders or diseases. Among digital healthcare technologies, they are expected to play a key role in future healthcare services that enable disease prevention, management, and treatment, rather than simply health management.

[0006] Furthermore, the digital therapeutics market is expected to grow with the rise in patients with mental illness, chronic diseases, and rehabilitation. Digital therapeutics are a type of software that uses a series of digital stimuli, such as images and sounds, to alter a patient's behavior or lifestyle, and then collect and analyze the resulting data. Therefore, recommendations should be tailored to the characteristics of the digital therapeutic and the user's needs.

[0007] The technology underlying this application is disclosed in Korean Patent Publication No. 10-2023-0033064.

[0008] The present invention aims to solve the problems of the prior art described above and to provide a system, device, and method for providing a healing agriculture activity service utilizing a metaverse and digital twin that provides customized healing agriculture activity-related content.

[0009] However, the technical tasks to be achieved by the embodiments of the present invention are not limited to the technical tasks described above, and other technical tasks may exist.

[0010] As a technical means for achieving the above-described technical task, a method for providing a healing agriculture activity service using a metaverse and a digital twin according to one embodiment of the present invention may include a step of constructing a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space based on spatial information and object information of the offline activity space, a step of creating a virtual object for performing an online healing agriculture activity in a metaverse space based on the digital twin based on user information of a user, a step of acquiring activity performance information for the online healing agriculture activity performed in the virtual activity space based on the virtual object, and a step of transmitting the activity performance information to the offline activity space.

[0011] In addition, the method for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include, after the transmitting step, a step of controlling a robot provided in the offline activity space so that an offline action according to the activity performance information is performed in the offline activity space.

[0012] In addition, a method for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include a step of collecting status information linked to the offline activity space and a step of reflecting the status information in the virtual activity space.

[0013] In addition, a method for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include a step of providing guide information on recommended healing agriculture activities based on the status information to the user terminal of the user.

[0014] Additionally, the user information may include content participation purpose information including at least one of the user's disease information and health improvement goal information.

[0015] In addition, the step of obtaining the activity performance information may obtain the user's performance information for the offline healing agriculture activity recommended based on the content participation purpose information as the activity performance information.

[0016] In addition, the step of obtaining the activity performance information may include a step of controlling an auxiliary robot to assist the user in performing the offline healing agriculture activity, taking into account the type of the offline healing agriculture activity.

[0017] Additionally, the status information may include information about changes in the object information according to application of the offline action.

[0018] In addition, a method for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include a step of generating feedback information evaluating the health promotion effect of the user based on the activity performance information and providing the feedback information to the user terminal of the user.

[0019] Meanwhile, a device for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include a space construction unit that constructs a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space based on spatial information and object information of the offline activity space, an object generation unit that generates a virtual object for performing an online healing agriculture activity in a metaverse space based on the digital twin based on user information of a user, and a content management unit that obtains activity performance information for the online healing agriculture activity performed in the virtual activity space based on the virtual object and transmits the activity performance information to the offline activity space.

[0020] In addition, the device for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include an offline management unit that controls a robot provided in the offline activity space so that offline actions based on the activity performance information are performed in the offline activity space.

[0021] Additionally, the offline management unit can collect status information linked to the offline activity space.

[0022] Additionally, the content management unit can reflect the status information in the virtual activity space.

[0023] Additionally, the content management unit can provide guide information on recommended healing agriculture activities based on the status information to the user terminal of the user.

[0024] In addition, the content management unit can obtain the user's performance information for the offline healing agriculture activity recommended based on the content participation purpose information as the activity performance information.

[0025] In addition, the content management unit can control an auxiliary robot to assist the user in performing the offline healing agriculture activity, taking into account the type of the offline healing agriculture activity.

[0026] Meanwhile, a system for providing a healing agriculture activity service utilizing a metaverse and a digital twin according to one embodiment of the present invention may include a main server that builds a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space based on spatial information and object information of the offline activity space, creates a virtual object based on user information of a user, obtains activity performance information for an online healing agriculture activity performed in the virtual activity space based on the virtual object, and transmits the activity performance information to the offline activity space, and a user terminal that outputs content for performing the online healing agriculture activity using the virtual object in the metaverse space based on the digital twin.

[0027] The above-described problem-solving methods are merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, additional embodiments may be included in the drawings and detailed description of the invention.

[0028] According to the aforementioned means of solving the problem of the present invention, a system, device, and method for providing a healing agriculture activity service utilizing a metaverse and digital twin that provide customized healing agriculture activity-related content can be provided.

[0029] According to the aforementioned means of solving the problem of this invention, a customized digital therapeutic agent can be provided that can recommend and guide specific therapeutic agricultural activities for the purpose of improving the user's physical ability, rehabilitation, etc.

[0030] However, the effects that can be obtained from this center are not limited to the effects described above, and other effects may exist.

[0031] Figure 1 is a schematic diagram of a healing agriculture activity service provision system according to one embodiment of the present invention.

[0032] Figure 2 is a conceptual diagram for explaining content provided through a healing agriculture activity service provision system according to one embodiment of the present invention.

[0033] Figure 3 is a conceptual diagram for explaining an artificial intelligence-based user analysis model utilized in a healing agriculture activity service provision system according to one embodiment of the present invention.

[0034] Figure 4 is a diagram illustrating an example of a user interface for providing content for performing online healing agriculture activities based on the metaverse and digital twin.

[0035] Figure 5 is a conceptual diagram illustrating an offline activity space equipped with a robot.

[0036] Figure 6 is a schematic diagram of a device for providing a healing agriculture activity service utilizing a metaverse and digital twin according to one embodiment of the present invention.

[0037] Figure 7 is a flowchart illustrating a method for providing a healing agriculture activity service using a metaverse and digital twin according to one embodiment of the present invention.

[0038] Figure 8 is a detailed flowchart of a process for linking an offline activity space and a virtual activity space according to one embodiment of the present invention.

[0039] Figure 9 is a detailed flowchart of a healing agriculture activity recommendation process according to one embodiment of the present invention.

[0040] Below, with reference to the attached drawings, embodiments of the present invention are described in detail to facilitate easy implementation by those skilled in the art. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, irrelevant parts have been omitted for clarity, and similar reference numerals have been used throughout the specification to indicate similar elements.

[0041] Throughout this specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" or "indirectly connected" with another element in between.

[0042] Throughout this specification, when it is said that a member is located “on,” “above,” “upper,” “lower,” “lower” or “lower” another member, this includes not only cases where the member is in contact with the other member, but also cases where another member exists between the two members.

[0043] Throughout this specification, whenever a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise specifically stated.

[0044] This paper relates to a system, device, and method for providing healing agriculture activity services utilizing metaverse and digital twins.

[0045] Figure 1 is a schematic diagram of a healing agriculture activity service provision system according to one embodiment of the present invention.

[0046] Referring to FIG. 1, a healing agriculture activity service providing system (10) according to one embodiment of the present invention may include a healing agriculture activity service providing device (100) utilizing a metaverse and digital twin according to one embodiment of the present invention (hereinafter referred to as 'service providing device (100)'), a user terminal (200), a wearable device (210), an auxiliary robot (220), a farm terminal (300), and a database (400).

[0047] The service providing device (100), the user terminal (200), the wearable device (210), the assistive robot (220), the farm terminal (300), and the database (400) can communicate with each other through a network (20). The network (20) refers to a connection structure that enables information exchange between each node, such as terminals and servers, and examples of such a network (20) include, but are not limited to, a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a 5G network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a wifi network, a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a DMB (Digital Multimedia Broadcasting) network, etc.

[0048] In addition, the content providing device (100) according to one embodiment of the present invention may be implemented in a form that is mounted (installed) on at least one of a wearable device (210) and a user terminal (200).

[0049] The wearable device (210) may be, for example, a smart watch, a smart band, etc. that is worn on the user's wrist to collect the user's biometric information, but is not limited thereto. As another example, the wearable device (210) may broadly refer to a device that can be worn in various locations, such as a head-worn device, a strap-type device, a clothing-type device, or a foot-worn device (shoe-won / foot pods), to obtain the user's characteristic information. In addition, by way of example, the wearable device (210) may be a Fitbit, a Jawbone Up, a Nike+ FuelBand, an Apple Watch, a Samsung Gear, etc. In addition, the wearable device (210) and the user terminal (200) may be mutually linked based on a single account information for the same user. Additionally, depending on the implementation example of the present invention, the wearable device (210) may be understood to be included in a user terminal (200) in a wide range.

[0050] The user terminal (200) may be any type of wireless communication device, such as, for example, a smartphone, a smart pad, a tablet PC, a PCS (Personal Communication System), a GSM (Global System for Mobile communication), a PDC (Personal Digital Cellular), a PHS (Personal Handyphone System), a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication)-2000, a CDMA (Code Division Multiple Access)-2000, a W-CDMA (W-Code Division Multiple Access), or a Wibro (Wireless Broadband Internet) terminal.

[0051] Figure 2 is a conceptual diagram for explaining content provided through a healing agriculture activity service provision system according to one embodiment of the present invention.

[0052] Referring to FIG. 2, the service providing device (100) can determine the type of participation in the user's healing agriculture activity content based on the user's user information. For example, the service providing device (100) can classify the content participation type into at least one type among the 'disease risk reduction type (disease risk group category classification)' corresponding to the user's existing disease, treatment purpose for expected disease, disease prevention purpose, etc., the 'health goal achievement type (personal health goal classification)' corresponding to the purpose of improving the user's constitution, lifestyle habits, and mental health, and the 'professional education type' corresponding to the purpose of obtaining educational information linked to smart farm operation.

[0053] In this regard, the service providing device (100) can obtain user information including at least one of the user's biometric data, lifestyle pattern data, and preference data.

[0054] For example, the service providing device (100) may receive the user's biometric data measured using a wearable device (210) or a user terminal (200) from the wearable device (210) or the user terminal (200), or may receive the user's biometric data input through the wearable device (210) or the user terminal (200) from the wearable device (210) or the user terminal (200).

[0055] More specifically, referring to FIG. 2, biometric data may broadly include the user's blood pressure information, breathing information, blood sugar information, blood flow information, pulse information, body mass index (BMI) information, information linked to DNA, RNA, protein, blood, etc., metabolite information, intestinal microflora information, etc.

[0056] In addition, the service providing device (100) provides a questionnaire interface or a survey interface for authorizing user input linked to lifestyle data (life pattern data) through a wearable device (210) or a user terminal (200), and can obtain lifestyle data linked to the user's eating habits, sleep, physical activity, mental health, etc. by using data input through the wearable device (210) or the user terminal (200).

[0057] In addition, referring to FIG. 2, the service providing device (100) provides a survey interface for authorizing user input linked to preference data (preference data) through a wearable device (210) or a user terminal (200), and can obtain preference data linked to user preference information, product (product) purchase history information, etc. by using data input through the wearable device (210) or the user terminal (200).

[0058] Additionally, the service providing device (100) can determine the user's content participation type by using the user's personalized data collected from various aspects as described above.

[0059] Specifically, if the service providing device (100) has a disease that the user is currently suffering from or a disease that is expected to have a probability of developing higher than a preset threshold level if the user continues to maintain the current lifestyle pattern, based on the user's biometric data and lifestyle pattern data, the service providing device (100) can determine the content participation type for the user as a disease risk reduction type (disease risk group category typification) corresponding to the purpose of treatment or prevention for the disease.

[0060] Referring to Fig. 2 as an example, the disease risk reduction types can be specifically subdivided into disease types such as hyperlipidemia risk group, hypertension risk group, diabetes risk group, and mental illness.

[0061] In addition, the service providing device (100) may determine the type of content participation for the user as a health goal achievement type (type by individual health goal) corresponding to the purpose of improving the constitution or lifestyle habits, if the user does not show a health condition that has deteriorated to the extent that the user has a disease or is expected to develop a disease, but is determined to be suitable for participating in content of healing agriculture activities to establish detailed health goals such as weight control, obesity relief, improvement of weak constitution, application of vegan lifestyle pattern, improvement of chewing disorder, improvement of digestive disorder, etc. in light of at least one of the user's biometric data, lifestyle pattern data, and preference data.

[0062] In addition, the service providing device (100) outputs an interface for receiving user information associated with at least one of a learning level and content participation purpose related to the operation of a user's offline activity space (e.g., a smart farm, etc.) through a wearable device (210) or a user terminal (200), and obtains user information about the user's occupation (job group), age, education level, etc. through the output interface, and determines the content participation type as a specialized education type based on the obtained user information.

[0063] As another example, the service providing device (100) may receive input regarding the user's content participation purpose according to pre-classified categories, such as simple experience purpose, expert training (education) participation purpose, etc., and determine the content participation type as a professional training type based on this. Meanwhile, the more closely the user's content participation purpose aligns with the expert training (education) participation purpose, the more sophisticated the user's participation purpose is compared to the simple experience purpose.

[0064] Meanwhile, according to one embodiment of the present invention, the service providing device (100) may generate statistical data on user information including biometric data, lifestyle pattern data, preference data, personal information data (e.g., age, gender, residential area, occupation / job group, education level, etc.) collected for users classified as disease risk reduction types based on content participation types classified for multiple users, by dividing them by individual disease types. For example, the service providing device (100) may generate statistical data on biometric information, lifestyle patterns, preferences, personal information, etc. for multiple users evaluated as hyperlipidemia risk group, statistical data on biometric information, lifestyle patterns, preferences, personal information, etc. for multiple users evaluated as hypertension risk group, and statistical data on biometric information, lifestyle patterns, preferences, personal information, etc. for multiple users evaluated as mental illness risk group.

[0065] In this regard, when the user's personalized content participation type corresponds to a disease risk reduction type, the service providing device (100) not only provides customized healing agriculture activity content corresponding thereto, but also processes / generates statistical data on disease risks evaluated for multiple users, thereby enabling the data to be used in decision-making regarding the development direction of healing agriculture activity content (e.g., development of additional content specialized for a specific disease type, etc.).

[0066] Likewise, the service providing device (100) can generate statistical data on user information including biometric data, lifestyle pattern data, preference data, personal information data, etc. for users whose personalized content participation type is classified as a health goal achievement type, by dividing the data by individual health goal type.

[0067] Figure 3 is a conceptual diagram for explaining an artificial intelligence-based user analysis model utilized in a healing agriculture activity service provision system according to one embodiment of the present invention.

[0068] Referring to FIG. 3, the service providing device (100) can estimate a disease risk reduction type or a health goal achievement type among content participation types by using an artificial intelligence-based user analysis model that is pre-built using user information collected for a plurality of users and learning data including disease information and constitution information of each of the plurality of users, and is trained to output at least one of the disease information and constitution information of the user when the user information collected for the user is input.

[0069] For example, referring to FIG. 3, an artificial intelligence-based user analysis model possessed by a service providing device (100) may be constructed using pre-secured physical strength measurement data as learning data to derive output data evaluating the user's physical abilities, such as muscular strength, muscular endurance, cardiopulmonary endurance, and flexibility, by taking user information including age, gender, weight, BMI, body fat percentage, etc. as input data, and the service providing device (100) may set a detailed health goal suitable for the user by considering the evaluation result of the user's physical ability output through the artificial intelligence-based analysis model, and may determine the user's content participation type as a health goal achievement type accordingly.

[0070] However, it is not limited to this, and the aforementioned artificial intelligence-based user analysis model may be constructed to estimate the user's existing or expected disease corresponding to the disease risk reduction type by providing output data such as the risk (probability) of developing a specific disease as well as the evaluation result of the user's physical ability. In addition, the present invention may apply various artificial intelligence learning algorithms that are already known in the past or can be developed in the future, such as machine learning algorithms, deep learning algorithms, artificial neural networks, and supervised / unsupervised learning algorithms.

[0071] In addition, the service providing device (100) can provide virtual space-based healing agriculture activity content that can be participated in by using a virtual object corresponding to the user based on the user information and the content participation type determined for the user.

[0072] According to one embodiment of the present invention, the service providing device (100) may provide (output) through the user terminal (200) healing agricultural activity content including at least one of 'digital therapeutic content' in which the user is recommended to participate based on user information, 'farming experience content' for cultivating or raising virtual objects in a virtual space, and 'commerce content' including recommendation information on products that the user can purchase based on user information.

[0073] Specifically, the service providing device (100) can provide digital treatment content to a user whose content participation type corresponds to a disease risk reduction type.

[0074] According to one embodiment of the present invention, the digital therapeutic content may be determined in various ways, taking into account the type of the disease or disease expected to develop, to include behavioral elements that can alleviate, treat, prevent, or improve the symptoms of the user's disease or reduce the likelihood of developing the disease, such as horticultural therapy, plant-mediated therapy, ecological therapy, animal-mediated therapy, and exercise therapy.

[0075] Additionally, depending on the implementation example of the present invention, the digital treatment content may be content that can be experienced through a virtual space, such as the farming experience content described below.

[0076] Figure 4 is a diagram illustrating an example of a user interface for providing content for performing online healing agriculture activities based on the metaverse and digital twin.

[0077] Referring to FIG. 4, the service providing device (100) can provide farming experience content to users whose content participation type corresponds to a health goal achievement type or a professional education type.

[0078] For example, referring to FIG. 4, the service providing device (100) can create a virtual space in which farming experience content is performed using virtual space implementation technologies such as Metaverse, Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR), and can provide farming experience content in which virtual objects (e.g., avatars, characters, etc.) created to correspond to users move and perform farming actions in the created virtual space.

[0079] In addition, according to one embodiment of the present invention, the service providing device (100) can apply the difficulty level and content participation time of the farming experience content provided to the user according to the content participation type.

[0080] In this regard, according to one embodiment of the present invention, the service providing device (100) can determine the number of objects (e.g., livestock, crops, horticultural plants, etc.) that can be cultivated or raised through farming experience content by considering the learning level evaluated for the user or the type of content participation.

[0081] In addition, according to one embodiment of the present invention, the service providing device (100) can determine the growth rate of a virtual object corresponding to a target object in a virtual space constructed for providing farming experience content by taking into consideration the user's learning level or content participation type.

[0082] For example, the content may be determined so that the higher the user's learning level is evaluated (e.g., evaluated as an advanced level), the more objects the user can cultivate / raise on the farming experience content provided to the user. In this regard, the service providing device (100) may re-provide query information to re-evaluate the user's learning level at predetermined intervals (e.g., a preset growth cycle required for the object to grow, etc.), and may control the number of objects the user can cultivate / raise on the farming experience content to increase / decrease at a point in time after the evaluation by reflecting the changed learning level of the user newly evaluated based on the query information.

[0083] In addition, as an example, the more sophisticated the purpose of the user's content participation becomes (in other words, the more it matches the purpose of participating in expert training (education), the more the growth speed of the object cultivated / raised through the farming experience content is determined to be similar to the growth speed of the actual livestock or plants (crops) in the offline environment corresponding to the object, and the more the type of the user's content participation does not match the educational purpose linked to smart farm operation, such as the disease risk reduction type or the health goal achievement type, the growth speed of the virtual object cultivated / raised through the farming experience content can be determined to grow at a faster speed than the growth speed of the actual livestock or plants (crops) in the offline environment corresponding to the virtual object (in other words, the growth cycle of the object can be determined to be shorter).

[0084] In this way, the healing agriculture activity service provision system (10) disclosed by this center can determine in detail the content of the farming experience content that comprehensively considers the user's learning level and content participation type.

[0085] In addition, according to one embodiment of the present invention, if the achievement level of the farming experience content is above a preset threshold level, the service providing device (100) can provide commerce content including information on recommended products associated with virtual objects grown or raised through the farming experience content.

[0086] For example, recommended products associated with virtual entities may broadly include products or services related to actual livestock or plants (crops) corresponding to the virtual entities cultivated or raised through farming experience content. For example, if the farming experience content is about running a farm using virtual dairy cows, the recommended products may be dairy products such as milk and cheese. Conversely, if the farming experience content is about cultivating specific crops, the recommended products may be meal kits, health functional foods, beverages, etc. based on recipes using the crops. Another example is if the farming experience content is about raising pets, the recommended products may be pet food, snacks, etc. that the pets can consume.

[0087] Specifically, if there is pre-secured sales information on recommended products (in other words, recommended products associated with virtual objects, etc.) determined for a user, the service providing device (100) can provide content that enables a virtual object to purchase recommended products as commerce content by using a virtual market.

[0088] Hereinafter, a detailed embodiment related to metaverse and digital twin-based content that links offline healing agriculture activities and online healing agriculture activities using a service providing device (100), assists users in performing healing agriculture activities, and reflects the results of users performing healing agriculture activities in an offline activity space (1000) will be described in detail.

[0089] The service providing device (100) can build a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space (1000) based on the spatial information and object information of the offline activity space (1000). The "digital twin" in the present invention can include everything from a basic digital twin technology that replicates and converts the real world into a digital world and performs optimization therein, to a highest level of digital twin technology that interconnects individually optimized single digital twins to effectively link the complex real world and the virtual world, and organically links digital twins to autonomously recognize, decide, and act on real-world phenomena, and further, to make optimal decisions on their own through artificial intelligence (AI) and an autonomous system.

[0090] For example, in the description of the embodiment of the present invention, the offline activity space (1000) may refer to an offline farm (smart farm) where crop cultivation, livestock raising, etc. are performed, but is not limited thereto, and may be set to target various types of spaces where users can actually perform healing farming activities offline according to the implementation example of the present invention.

[0091] In this regard, the spatial information of the offline activity space (1000) may refer to information reflecting the scale, area, terrain, size, location, structure, shape, etc. of the actual offline space, and based on this spatial information, a virtual activity space corresponding to the offline activity space (1000) may be constructed based on a digital twin and a metaverse. In addition, the object information of the offline activity space (1000) may refer to objects, things, creatures, etc. that are targets for interaction with virtual objects (e.g., avatars, characters, etc.) corresponding to users within the virtual activity space when constructing a virtual activity space based on a digital twin and a metaverse, such as crops grown in an actual smart farm, etc., or livestock raised in a livestock shed space.

[0092] In addition, the service providing device (100) can create a virtual object that performs online healing farming activities in a metaverse space based on the constructed digital twin based on the user's user information.

[0093] Additionally, the service providing device (100) can obtain activity performance information regarding online healing farming activities performed in a virtual activity space based on the generated virtual object. For example, the activity performance information may include the user's virtual object-based access information for the virtual activity space, movement paths, and information related to the healing farming activities performed by the user using the virtual object.

[0094] For example, if the content of the healing agriculture activity performed by the user is content about growing crops, the activity performance information for the online healing agriculture activity may include, but is not limited to, action categories such as digging the ground, planting crops, watering, and pulling a cart, which are unit actions related to the crops corresponding to the target object. For reference, the types of healing agriculture activities in which the user can participate may broadly include various types such as crop growing activities, gardening activities, livestock raising activities, agricultural machinery use, and forestry management activities, and accordingly, the service providing device (100) may determine unit actions that the user is expected (predicted) to perform differently for each activity in response to the activity type of the healing agriculture activity content provided to the user.

[0095] In addition, according to one embodiment of the present invention, the service providing device (100) can obtain user performance information for recommended offline healing agriculture activities based on the user's content participation purpose information as activity performance information.

[0096] In addition, according to one embodiment of the present invention, the service providing device (100) can control an auxiliary robot (220) to assist the user in performing offline healing farming activities by considering the type of offline healing farming activities performed by the user.

[0097] For example, an assistive robot (220) is a module or device that provides driving force to assist the movement of the user's body (lower limbs, upper limbs, injured area of ​​the user, etc.) while the user wears or attaches the robot to achieve rehabilitation purposes, improve physical abilities, etc., and a robot control method for assisting the user's body movement using the assistive robot (220) may be determined according to the type of unit movement included in the offline therapeutic farming activity performed by the user.

[0098] Meanwhile, the service providing device (100) can obtain content participation purpose information including at least one of the user's disease information and health improvement goal information, and generate and provide recommendation information for offline healing agriculture activities based on the obtained content participation purpose information.

[0099] In addition, the service providing device (100) can reflect the status information of the offline activity space (1000) collected in the offline activity space (1000) in the metaverse-based virtual activity space.

[0100] In this regard, Fig. 5 is a conceptual diagram illustrating an offline activity space equipped with a robot.

[0101] Referring to FIG. 5, the offline activity space (1000) may be equipped with a sensor module (310) for measuring status information such as temperature, humidity, brightness, gas concentration, vibration, noise, etc. of the offline activity space (1000).

[0102] Additionally, the service providing device (100) can collect status information linked to an offline activity space (1000). For example, the service providing device (100) can obtain status information including information on changes in object information (e.g., growth status of crops, etc.) in an offline activity space (1000) according to offline actions applied in response to online healing agriculture activities performed by a user.

[0103] In addition, referring to FIG. 5, an offline activity space (1000) may be equipped with a robot (320) for performing offline activities (e.g., in the case of a smart farm type, planting, watering, sowing, spraying pesticides, supplying nutrients, etc. for cultivated crops) performed according to the type of the offline activity space (1000).

[0104] In addition, the service providing device (100) can control a robot (320) provided in the offline activity space (1000) so that offline actions based on activity performance information for online healing agriculture activities performed in the virtual activity space are actually performed in the offline activity space (1000).

[0105] Specifically, the service providing device (100) may operate to control (determine) the operation of the robot (320) and the action (action) performed by the robot (320) on the object by using the activity performance information acquired so that the action corresponding to the healing agriculture activity performed by the user in the offline activity space (1000) is actually applied based on the activity performance information for the offline healing agriculture activity performed by the user in a space separate from the offline activity space (1000) or the online healing agriculture activity performed in the virtual activity space.

[0106] In this regard, the service providing device (100) uses the mapping result between the virtual space and the offline activity space (1000) using the established digital twin to identify an object (e.g., a target crop, etc.) for which the user has performed an online healing agricultural activity within the offline activity space (1000), which is an actual offline space, and controls the behavior of the robot (320) so that the robot (320) moves to the location of the identified actual object, and controls the operation of the robot (320) so that the robot (320) performs a predetermined interaction (offline action) according to the online healing agricultural activity for the object.

[0107] In addition, according to one embodiment of the present invention, the offline activity space (1000) may be equipped with a camera module (not shown) for acquiring an object image with an object (e.g., crops grown in a smart farm) as a shooting target, and as activity performance information for a healing agricultural activity performed by a user by the service providing device (100) is transmitted to the offline activity space (1000), an object image captured while an offline action according to the activity performance information is performed on an object as a target in the offline activity space (1000) through a robot (320) is transmitted from the camera module (not shown) to the service providing device (100), and the service providing device (100) may transmit the transmitted object image to the user terminal (200) for output.

[0108] Accordingly, by using the healing agriculture activity service provision system (10) disclosed by this center, the user can actually confirm the offline activity performed in the actual offline activity space (1000) corresponding to the offline healing agriculture activity or online healing agriculture activity performed by the user, thereby directly seeing the result of the healing agriculture activity performed by the user being reflected, thereby increasing the user's interest in participating in the healing agriculture activity, and thereby inducing the user's continuous and active participation in the healing agriculture activity.

[0109] In addition, the service providing device (100) can provide guide information on recommended healing agriculture activities based on status information of an offline activity space (1000) to a user terminal (200).

[0110] For example, if it is determined that status information such as temperature, humidity, brightness, gas concentration, vibration, noise, etc. measured in an offline activity space (1000) does not meet a preset standard, and an offline action that must be performed via a robot (320) in the offline activity space (1000) to meet the standard is determined, the service providing device (100) may output guide information to guide the user to perform an offline healing agriculture activity or an online healing agriculture activity corresponding to the offline action in an actual offline space or a virtual activity space, through a user terminal (200), thereby guiding the user who has confirmed the guide information to perform an offline healing agriculture activity or an online healing agriculture activity corresponding to the specific offline action required in the offline activity space (1000), thereby linking the offline healing agriculture activity and the online healing agriculture activity.

[0111] Furthermore, according to one embodiment of the present invention, the service providing device (100) may generate feedback information evaluating the user's health promotion effect based on the collected activity performance information and provide the feedback information to the user terminal (200). In other words, the service providing device (100) may generate feedback information quantitatively evaluating the rehabilitation effect, physical ability improvement effect, mental health promotion effect, etc. based on the user's participation in the healing agriculture activity content, the user's participation history in the healing agriculture activity, the level of the healing agriculture activity performance, etc., and provide the feedback information to the user.

[0112] Figure 6 is a schematic diagram of a device for providing a healing agriculture activity service utilizing a metaverse and digital twin according to one embodiment of the present invention.

[0113] Referring to FIG. 6, the service providing device (100) may include a space construction unit (110), an object creation unit (120), a content management unit (130), and an offline management unit (140).

[0114] The space construction unit (110) can construct a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space (1000) based on the spatial information and object information of the offline activity space (1000).

[0115] The object creation unit (120) can create a virtual object that performs online healing farming activities in a metaverse space based on the constructed digital twin based on the user's user information.

[0116] The content management unit (130) can obtain activity performance information for online healing agriculture activities performed in a virtual activity space based on the created virtual object.

[0117] For example, the content management unit (130) can obtain the user's performance information for recommended offline healing agriculture activities as activity performance information based on the user's content participation purpose information.

[0118] In addition, according to one embodiment of the present invention, the content management unit (130) can control an auxiliary robot (220) to assist the user in performing offline healing farming activities by considering the type of offline healing farming activities performed by the user.

[0119] In addition, the content management unit (130) can obtain content participation purpose information including at least one of the user's disease information and health improvement goal information, and generate and provide recommendation information for offline healing agriculture activities based on the obtained content participation purpose information.

[0120] Additionally, the content management unit (130) can reflect the status information of the offline activity space (1000) collected in the offline activity space (1000) in the virtual activity space based on the metaverse.

[0121] Additionally, the content management unit (130) can provide guide information on recommended healing agriculture activities based on status information of the offline activity space (1000) to the user terminal (200).

[0122] The offline management unit (140) can control the robot (320) provided in the offline activity space (1000) so that offline actions based on activity performance information for online healing agriculture activities performed in the virtual activity space are actually performed in the offline activity space (1000).

[0123] Additionally, the offline management unit (140) can collect status information associated with the offline activity space (1000). For example, the offline management unit (140) can obtain status information including information on changes in object information in the offline activity space (1000) according to offline actions applied in response to online healing farming activities performed by the user.

[0124] Below, we will briefly review the operating flow of the present invention based on the detailed description above.

[0125] Figure 7 is a flowchart illustrating a method for providing a healing agriculture activity service using a metaverse and digital twin according to one embodiment of the present invention.

[0126] The method for providing a healing agriculture activity service utilizing the metaverse and digital twins illustrated in FIG. 7 can be performed by the service providing device (100) described above. Therefore, even if omitted below, the description of the service providing device (100) can be equally applied to the description of the method for providing a healing agriculture activity service utilizing the metaverse and digital twins.

[0127] Referring to FIG. 7, in step S11, the space construction unit (110) can construct a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space (1000) based on the spatial information and object information of the offline activity space (1000).

[0128] Next, in step S12, the object creation unit (120) can create a virtual object that performs online healing agriculture activities in the metaverse space based on the constructed digital twin based on the user information.

[0129] Next, in step S13, the content management unit (130) can obtain activity performance information for online healing agriculture activities performed in a virtual activity space based on the generated virtual object.

[0130] For example, in step S13, the content management unit (130) can obtain the user's performance information for recommended offline healing agriculture activities as activity performance information based on the user's content participation purpose information.

[0131] In addition, according to one embodiment of the present invention, in step S13, the content management unit (130) can control an auxiliary robot (220) to assist the user in performing offline healing farming activities by considering the type of offline healing farming activities performed by the user.

[0132] Next, in step S14, the offline management unit (140) can transmit activity performance information to the offline activity space (1000).

[0133] In the above description, steps S11 to S14 may be further divided into additional steps or combined into fewer steps, depending on the implementation example of the present invention. Furthermore, some steps may be omitted as needed, and the order of the steps may be changed.

[0134] Figure 8 is a detailed flowchart of a process for linking an offline activity space and a virtual activity space according to one embodiment of the present invention.

[0135] The process of linking the offline activity space and virtual activity space illustrated in FIG. 8 can be performed by the service providing device (100) described above. Therefore, even if omitted below, the description of the service providing device (100) can be equally applied to the description of FIG. 8.

[0136] Referring to FIG. 8, in step S15, the offline management unit (140) can control the robot (320) provided in the offline activity space (1000) so that offline actions according to activity performance information are actually performed in the offline activity space (1000).

[0137] Next, in step S16, the offline management unit (140) can collect status information linked to the offline activity space (1000).

[0138] For example, in step S16, the offline management unit (140) can obtain status information including information on changes in object information in the offline activity space (1000) according to offline actions applied in response to online healing farming activities performed by the user.

[0139] Next, in step S17, the content management unit (130) can reflect the status information of the collected offline activity space (1000) in the metaverse-based virtual activity space.

[0140] Next, in step S18, the content management unit (130) can provide guide information on recommended healing agriculture activities based on status information of the offline activity space (1000) to the user terminal (200).

[0141] In the above description, steps S15 to S18 may be further divided into additional steps or combined into fewer steps, depending on the implementation example of the present invention. Furthermore, some steps may be omitted as needed, and the order of the steps may be changed.

[0142] Figure 9 is a detailed flowchart of a healing agriculture activity recommendation process according to one embodiment of the present invention.

[0143] The healing agriculture activity recommendation process illustrated in FIG. 9 can be performed by the service providing device (100) described above. Therefore, even if omitted below, the description of the service providing device (100) can be equally applied to the description of FIG. 9.

[0144] Referring to FIG. 9, in step S21, the content management unit (130) can obtain content participation purpose information including at least one of the user's disease information and health improvement goal information.

[0145] Next, in step S22, the content management unit (130) can generate recommendation information for offline healing agriculture activities based on the acquired content participation purpose information.

[0146] Next, in step S23, the content management unit (130) can provide the generated recommendation information to the user terminal (200).

[0147] In the above description, steps S21 to S23 may be further divided into additional steps or combined into fewer steps, depending on the implementation example of the present invention. Furthermore, some steps may be omitted as needed, and the order of the steps may be changed.

[0148] A method for providing a healing agriculture activity service utilizing a metaverse and digital twin according to one embodiment of the present invention may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the medium may be those specifically designed and configured for the present invention or may be known and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The above hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

[0149] In addition, the method of providing healing agriculture activity services utilizing the aforementioned metaverse and digital twin can also be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

[0150] The above description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0151] The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

[0152] [Explanation of symbols]

[0153] 10: Healing Agriculture Activity Service Provision System

[0154] 100: A device that provides healing agriculture activities using the metaverse and digital twins.

[0155] 110: Space Construction Department

[0156] 120: Object creation section

[0157] 130: Content Management Department

[0158] 140: Offline Management Department

[0159] 200: User terminal

[0160] 210: Wearable Devices

[0161] 220: Assistive robot

[0162] 300: Farm Terminal

[0163] 310: Sensor module

[0164] 320: Robot

[0165] 1000: Offline activity space

Claims

1. In the method of providing healing agriculture activity services utilizing metaverse and digital twin, A step of building a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space based on spatial information and object information of the offline activity space; A step of creating a virtual object performing online healing agriculture activities in a metaverse space based on the above digital twin based on the user's user information; A step of obtaining activity performance information for the online healing agriculture activity performed in the virtual activity space based on the virtual object; and A step of transmitting the above activity performance information to the offline activity space side; A method of providing services, including:

2. In paragraph 1, After the above transmitting step, A step of controlling a robot provided in the offline activity space so that offline actions based on the above activity performance information are performed in the offline activity space; A method of providing services that further includes:

3. In paragraph 2, A step of collecting status information linked to the above offline activity space; and A step of reflecting the above status information in the virtual activity space, A method of providing services that further includes:

4. In paragraph 3, A step of providing guide information on recommended healing agriculture activities based on the above status information to the user terminal of the user; A method of providing services that further includes:

5. In paragraph 1, The above user information is: Includes content participation purpose information including at least one of the user's disease information and health improvement goal information, The step of obtaining the above activity performance information is: A service provision method, wherein the user's performance information for the offline healing agriculture activity recommended based on the content participation purpose information is obtained as the activity performance information.

6. In paragraph 5, The step of obtaining the above activity performance information is: A step of controlling an auxiliary robot to assist the user in performing the offline healing agriculture activity, taking into account the type of the offline healing agriculture activity; A method of providing services, including:

7. In paragraph 3, The above status information is, A service providing method including information on changes in the object information according to application of the above offline action.

8. In paragraph 1, A step of generating feedback information evaluating the health promotion effect of the user based on the activity performance information and providing the feedback information to the user terminal of the user; A method of providing services that further includes:

9. In the device providing healing agriculture activity services utilizing metaverse and digital twins, A space construction unit that constructs a digital twin including a virtual activity space virtually simulated to correspond to the offline activity space based on spatial information and object information of the offline activity space; An object generation unit that generates a virtual object performing online healing agriculture activities in a metaverse space based on the above digital twin based on the user's user information; and A content management unit that obtains activity performance information for the online healing agriculture activity performed in the virtual activity space based on the virtual object and transmits the activity performance information to the offline activity space. A service providing device including:

10. In paragraph 9, An offline management unit that controls a robot provided in the offline activity space so that offline actions based on the above activity performance information are performed in the offline activity space; A service providing device that further includes:

11. In paragraph 10, The above offline management department, Collect status information linked to the above offline activity space, The above content management department, A service providing device that reflects the above status information in the above virtual activity space.

12. In paragraph 11, The above content management department, A service providing device that provides guide information on recommended healing agriculture activities based on the above status information to the user terminal of the user.

13. In paragraph 9, The above user information is: Includes content participation purpose information including at least one of the user's disease information and health improvement goal information, The above content management department, A service providing device that obtains the user's performance information for offline healing agriculture activities recommended based on the content participation purpose information as the activity performance information.

14. In paragraph 13, The above content management department, A service providing device that controls an auxiliary robot to assist the user in performing the offline healing agricultural activity, taking into account the type of the offline healing agricultural activity.

15. In the system for providing healing agriculture activities using metaverse and digital twins, A main server that builds a digital twin including a virtual activity space that is virtually simulated to correspond to the offline activity space based on spatial information and object information of the offline activity space, creates a virtual object based on the user information of the user, obtains activity performance information for online healing agriculture activities performed in the virtual activity space based on the virtual object, and transmits the activity performance information to the offline activity space; and A user terminal that outputs content for performing the online healing agriculture activity using the virtual object in the metaverse space based on the digital twin; A system including.

Images