Virtual funeral system, method, and program

Abstract

[Problem] To realize interactive participation in a virtual funeral in real time, to improve emotional connectivity, and to enable sharing of a realistic sense of presence and live attendance.　[Solution] The present invention comprises: a virtual space management unit that manages and controls a virtual space including a virtual funeral hall that is set on the coordinates of the virtual space; a real space management unit that acquires, on the coordinates of a real space including the three-dimensional outline of a funeral hall installed in the real space, a geographical element within the real space; a capture unit that acquires the current position and behavior of a real user in the real space; a virtual space data generation unit that, on the basis of the current position and behavior of the real user acquired by the capture unit, generates virtual space data in which a synchronous avatar and a related object appear in the virtual space; and a distribution unit that distributes the virtual space data in a viewable manner through a communication network. The virtual space data generation unit causes a remote avatar of a net user to appear in the virtual space in accordance with a remote operation performed by the net user.

Description

Virtual funeral system, method and program

[0001] The present invention relates to a virtual funeral system, method, and program in which internet users participate in a virtual funeral held in a virtual space as remotely controlled virtual remote avatars, and real users participate as virtual synchronized avatars through real-world facilities.

[0002] In recent years, with the advancement of digitalization, waves of change are also reaching the traditional way of funerals. Traditional funerals have taken the form of gathering in a physical location to remember the deceased, but there are many cases where it is difficult for all parties involved to gather due to geographical constraints or unexpected circumstances. Against this background, a new concept of virtual funerals using the Internet has been proposed, as disclosed in Patent Document 1, for example.

[0003] The virtual funeral disclosed in Patent Document 1 has the advantage that even participants in remote locations can participate in the funeral via the Internet, allowing people who have difficulty attending in person or who are in different time zones to participate in the act of remembering the deceased. Furthermore, the memory of the deceased can be perpetuated in a digital form, allowing bereaved family and friends to visit the funeral home online at any time and share memories.

[0004] On the other hand, in recent years, for fans who have a strong emotional connection to anime characters, fictional characters, or deceased celebrities, the death of a beloved character brings with it the same sadness and sense of loss as the death of a real person, and this has led to a demand for virtual funerals within fan communities.

[0005] JP 2013-102637 A

[0006] However, the technology described in the aforementioned Patent Document 1 suffers from a lack of a sense of realism or liveliness. That is, funerals in physical, real-world spaces have a unique atmosphere that provides empathy and comfort, and this is difficult to fully reproduce in a virtual space. Particularly in funerals involving anime characters or fictional figures, emotional involvement with unrealistic beings is more complex, and simply imitating the traditional funeral process in a virtual space may not be enough to meet these needs.

[0007] Specifically, in the virtual funeral disclosed in the aforementioned Patent Document 1, users do not participate in the virtual funeral in real time, so there is no opportunity for interaction with other participants. Furthermore, online operations alone result in low emotional connectivity, failing to engage participants' emotions and deepening emotional connections. In particular, fictional virtual funerals require a mechanism for participants to interact with each other to increase empathy within the community. However, simply viewing photos and videos on a website is not enough; interactive participants must be able to form emotional connections with each other.

[0008] Therefore, the present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide a virtual funeral system, method, and program that enables real-time interactive participation in virtual funerals, improves emotional connectivity, allows participants to share a sense of realism and liveliness that is close to reality, and deepens the emotional bonds between participants, even at funerals for fictional characters, creating an experience of empathy and sharing.

[0009] In order to solve the above problems, the present invention provides a virtual funeral system that allows internet users to participate in a virtual funeral held in a virtual space as a virtual remote avatar remotely controlled via a content server on a communication network, and allows real users to participate as virtual synchronized avatars through facilities in the real world, and comprises: a virtual space management unit that manages and controls a virtual space including a virtual funeral hall set on the coordinates of the virtual space; a real space management unit that acquires geographical elements in the real space including the three-dimensional outline of the funeral hall set in the real space on the coordinates of the real space; a capture unit that acquires the real user's current position and movement in the real space; a virtual space data generation unit that generates virtual space data that causes the synchronized avatar and related objects to appear in the virtual space based on the real user's current position and movement acquired by the capture unit; and a distribution unit that distributes the virtual space data so that it can be viewed via a communication network, and is characterized in that the virtual space data generation unit causes the internet user's remote avatar to appear in the virtual space in response to the internet user's remote control.

[0010] In the above invention, it is preferable that the system further comprises a virtual reality display unit that displays the virtual space data according to a viewpoint of the remote avatar that appears in the virtual space. Also, in the above invention, it is preferable that the related object includes 3D data that is digitized from an actual floral tribute or offering provided by the real user, the actual object is displayed with an identification code that identifies it, and the identification code is linked to presented information about the real user who provided the actual object, the capture unit recognizes the identification code of the actual object, and the virtual space data generation unit displays the presented information linked to the recognized identification code so that it can be viewed in response to a selection operation by the internet user.

[0011] Furthermore, in the above invention, it is preferable that the virtual space data generation unit further comprises a presentation information access unit that reads the identification code displayed on the real object and accesses the presentation information linked to the identification code. Also, in the above invention, it is preferable that, when generating the virtual space data, the virtual space data generation unit makes the deceased of the virtual funeral appear in the virtual space as a virtual deceased avatar, and the deceased avatar is a life simulation model generated by a generative AI that has been machine-learned based on data related to the deceased.

[0012] In the above invention, it is preferable that the virtual space data generation unit, when generating the virtual space data, acquires generation control input information entered by the real user or the internet user, and causes a synchronized avatar or a remote avatar with appearance and clothing recommended by the generation system AI based on the generation control input information to appear in the virtual space in a selectable manner. In the above invention, it is preferable that the system further comprises a virtual value issuing unit that issues points or digital content having exchange value with real currency as virtual value information, and that the virtual value issuing unit has a function of calculating the value of a predetermined percentage of the transferred quantity when the virtual value information is exchanged, and processing the calculated value of the virtual value information as a donation.

[0013] The above-described system and method according to the present invention can be realized by executing a program of the present invention written in a predetermined language on a computer. That is, by installing the program of the present invention in an IC chip or memory device of a portable terminal device, smartphone, wearable terminal, mobile PC or other information processing terminal, or a general-purpose computer such as a personal computer or server computer and executing it on the CPU, a system having the above-described functions can be constructed and the method according to the present invention can be implemented.

[0014] Furthermore, the program of the present invention can be distributed, for example, via a communication line, or transferred as a package application that runs on a stand-alone computer by recording it on a computer-readable recording medium. Specifically, this recording medium can be recorded on a variety of recording media, including magnetic recording media such as flexible disks and cassette tapes, optical disks such as CD-ROMs and DVD-ROMs, and RAM cards. Furthermore, a computer-readable recording medium on which this program is recorded makes it possible to easily implement the above-described system and method using a general-purpose computer or a dedicated computer, and also makes it easy to store, transport, and install the program.

[0015] As described above, the present invention enables real-time interactive participation in virtual funerals, improves emotional connectivity, and allows participants to share a sense of realism and liveliness that is close to reality.Even at funerals for fictional characters, it is possible to deepen the emotional bonds between participants and create an experience of empathy and sharing.

[0016] This virtual funeral system provides a new format in which internet users can participate remotely using virtual avatars, while real users can participate using synchronized avatars from real facilities. The virtual space management unit manages the virtual funeral hall, and the real space management unit obtains information about the real funeral hall, enabling the connection between reality and virtuality, providing participants with a highly immersive experience.

[0017] The capture unit captures the movements of real users, and the virtual space data generation unit reflects this in the virtual world. Furthermore, flowers and offerings provided by real users can be digitized and shared in the virtual space. This will enable many people to participate in memorials and mourn the deceased, regardless of physical distance, and is expected to revolutionize the way memorials are held.

[0018] In this invention, a life simulation model is created using machine learning-based generative AI based on data from the deceased's life (video, audio, written records, etc.), and then appears in a virtual funeral. This deceased avatar is not simply a static digital image; it is a dynamic model capable of reproducing the deceased's speech and behavioral patterns, allowing for a certain degree of interaction with virtual funeral attendees (e.g., audio playback of messages from the deceased, recreating their movements, etc.). For example, by recreating the deceased's words and facial expressions, funeral attendees can feel a deeper connection with the deceased, enabling a more immersive memorial experience. Furthermore, this technology can be applied to virtual funerals not only for real deceased individuals, but also for historical figures and fictional characters.

[0019] Furthermore, according to the present invention, the virtual space data generation unit acquires user input information, and the generative AI recommends the optimal avatar (appearance and clothing), allowing the user to select the appearance of a synchronized avatar or remote avatar from the AI's suggestions. This allows for a virtual space experience optimized for each individual user. By having the AI ​​suggest the optimal avatar, the personalization of the virtual funeral is improved, allowing the user to select appropriate clothing, just as if attending a real funeral, thereby increasing the realism of the virtual space ceremony. Furthermore, the costumes and accessories generated by this AI can be sold and purchased, potentially opening up new business opportunities.

[0020] Furthermore, according to the present invention, a virtual value issuing unit is provided to issue and manage points and digital content that have exchange value for real currency, and when virtual value information is exchanged between users, a certain percentage of the value is treated as a donation. For example, when purchasing flowers or offerings or making donations in the virtual space, a portion of the payment amount is automatically donated. This allows transactions in the virtual space to contribute to donations and charitable activities in the real world. By combining this with NFT and blockchain technology, the flow of donations can be made visible and fraud can be prevented. Furthermore, beyond the scope of virtual funerals, the purchase and exchange of digital items can form an economic sphere, enabling integration with virtual currencies.

[0021] 1 is a conceptual diagram showing the overall configuration of a virtual funeral system according to an embodiment. [Correction based on Rule 91 31.03.2025] An explanatory diagram showing a virtual funeral screen (smartphone) according to an embodiment. An explanatory diagram showing a virtual funeral screen (mounted display) according to an embodiment. A block diagram showing the internal configuration of a content server for a virtual funeral according to an embodiment. A block diagram showing the internal configuration of a smartphone according to an embodiment. An oblique view showing the appearance of a flower offering stand according to an embodiment. A block diagram showing the internal configuration of a capture system according to an embodiment. A block diagram showing functional modules constructed in a CPU of a capture system according to an embodiment. A sequence diagram showing the overall operation of a virtual funeral system according to an embodiment. A flow diagram showing the procedure for flower offering information presentation processing in a virtual funeral according to an embodiment. A flow diagram showing the procedure for token transfer in an energy trading system according to an embodiment. An explanatory diagram illustrating the relationship between public keys and private keys in an energy trading system according to an embodiment. An explanatory diagram regarding a blockchain in a virtual funeral system according to an embodiment. An explanatory diagram regarding a blockchain in a virtual funeral system according to an embodiment. An explanatory diagram regarding a blockchain in a virtual funeral system according to an embodiment. An explanatory diagram regarding a blockchain in a virtual funeral system according to an embodiment. An explanatory diagram illustrating the overall operation of a generative AI in a virtual funeral system according to an embodiment. An explanatory diagram illustrating a partial excerpt of the operation of a generative AI in a virtual funeral system according to an embodiment.

[0022] The following describes in detail the embodiments of the virtual funeral system, virtual funeral method, and virtual funeral program according to the present invention, with reference to the accompanying drawings. Note that the embodiments shown below are examples of devices that embody the technical concept of the present invention, and the technical concept of the present invention does not specify the materials, shapes, structures, arrangements, etc. of each component part as described below. The technical concept of the present invention can be modified in various ways within the scope of the claims.

[0023] (Overview of Virtual Funeral System) An overview of a virtual funeral according to this embodiment will be described. FIG. 1 shows the overall configuration of the virtual funeral system according to this embodiment, and FIGS. 2 and 3 show streaming screens for the virtual funeral according to this embodiment. In this embodiment, as shown in FIG. 1, this virtual funeral system allows an internet user U1 to participate in a virtual space 4 held in a virtual space as a virtual remote avatar RA1 remotely controlled via a content server 3 on the Internet 2, and a real user U2 to participate as a virtual synchronized avatar SA2 using augmented reality technology that is superimposed on the scenery of a real-world facility via a capture system 5 installed in the real world, such as a temple 5a.

[0024] More specifically, this embodiment of the virtual funeral system offers a new way of participating in a funeral both in a virtual space, such as the one shown in Figures 2 and 3, and in a real space, such as a real funeral hall, such as a temple 5a. Centered around a funeral hall set up in the virtual space 4, real users U2 can participate as remote avatars RA1 using augmented reality delivered from a content server 3 via their smartphones 1a or mount displays MD1. This overcomes the constraints of geographical distance and creates an environment in which people around the world can mourn the deceased. Furthermore, real users U2 in real-world facilities, such as a temple 5a, can participate in the virtual funeral via synchronized avatars SA2.

[0025] This virtual funeral system allows for a more realistic memorial experience by bringing physical presence and movement into the virtual funeral. The capture system 5 acquires the movements and current location of the real user U2, and based on this data, the virtual space data generator 36c generates a synchronized avatar and related objects in the virtual space 4. This allows the movements of the real user U2 to be reflected in the virtual space 4.

[0026] Furthermore, actual objects such as flowers and offerings provided by real user U2 can be digitized and placed as 3D data objects in virtual space 4. These actual objects are labeled with identification codes, which are linked to information about the real user who provided them. The capture system 5 recognizes these identification codes, and the virtual space data generation unit 36c displays the information linked to these identification codes so that it can be viewed in response to selection operations by the internet user.

[0027] The system according to this embodiment provides a unique way for all users participating in the virtual funeral to feel connected to the deceased. Participating in a funeral in a virtual space allows people in remote locations to remember and mourn the deceased together without feeling the constraints of physical distance.

[0028] Temple 5a is a real-world facility where real user U2 will pay his respects. A local server device 50 installed at this facility has the ability to directly link with the virtual funeral. A capture system 5 captures the movements of real user U2 and converts them into the movements of a synchronized avatar SA2 in a virtual space (virtual funeral parlor) 4, ensuring that the movements in the actual facility are reflected in virtual space 4. This technology converts the actions of real user U2 into movements in virtual space 4, creating an experience that enhances empathy and a sense of solidarity between users in remote locations through augmented reality that blends virtual and real spaces.

[0029] In this embodiment, the funeral experience in virtual space 4 is integrated with the real space, providing an environment in which users from all over the world can participate. The virtual funeral hall in virtual space 4 is accessed via content server 3, and real user U2 participates as remote avatar RA1 via the Internet 2. Real user U2 in a temple 5a in the real world participates in the virtual funeral hall as synchronized avatar SA2 and is linked to the progress of the funeral. The content server 3 not only distributes the virtual funeral hall, but also performs synchronization processing with the actual funeral held at temple 5a. As a result, the sights, sounds, and progress of the actual funeral are synchronized in real time with the experience in virtual space, allowing participants to participate in the funeral from remote locations with the feeling that they are actually there.

[0030] 1, the virtual funeral system according to this embodiment is generally composed of a smartphone 1a or 1b, which is a mobile terminal device used by a user U1 or U2, a content server 3 installed on the Internet 2, and a capture system 5 installed in a real-world facility such as a temple 5a to capture the current location and movements of a real user U2 in real space. In this embodiment, the smartphones 1a and 1b will be described as an example of a mobile terminal device.

[0031] In this embodiment, the content server 3 is a server that performs virtual funeral process processing. It can be realized by a single server device or a group of multiple server devices, with multiple functional modules virtually constructed on the CPU, and each functional module executes processing in cooperation with other functional modules. In addition, this content server 3 can send and receive data via the Internet 2 using its communication function, and can present web pages via browser software using its web server function.

[0032] The smartphone 1a or 1b is a portable information processing terminal device that uses wireless communication. It communicates wirelessly with relay points such as a wireless base station 22 and an access point 23, enabling mobile communication services such as phone calls and data communications. The smartphone 1a is equipped with a function for displaying a stereoscopic image with left-right parallax, as shown in FIG. 2, to display a virtual space in three dimensions. Wearing the smartphone 1a on a head mount allows it to function similarly to a head-mounted display, enabling a stereoscopic view of the virtual space. Examples of communication methods for this mobile phone include 3G (3rd Generation), LTE (Long Term Evolution), 4G, and 5G. The smartphone 1 also includes various functions, such as a digital camera, application software execution, and location information acquisition using a global positioning system (GPS), and may also be used as a mobile computer such as a tablet PC.

[0033] The location information acquisition function provided in the smartphone 1a or 1b is a function for acquiring and recording location information indicating the location of the smartphone itself. Examples of this location information acquisition function include, as shown in FIG. 1, a method of detecting the location of the smartphone itself using signals from satellites, such as GPS, and a method of detecting the location using the radio wave strength from a mobile phone wireless base station 22 or a Wi-Fi communication access point 23.

[0034] The smartphone 1 is equipped with a liquid crystal display as a display unit that displays information, as well as operation devices such as operation buttons for the user to perform input operations, and the operation devices include a touch panel that is superimposed on the liquid crystal display and serves as an input unit that acquires operation signals by touch operations such as specifying coordinate positions on the liquid crystal display. The head-mounted display MD1 is wirelessly connected to the smartphone 1a and the capture system 5, and displays a three-dimensional video with left-right parallax as shown in Figure 3 superimposed on an object in the real world, thereby creating a virtual reality.

[0035] Furthermore, in this embodiment, as shown in Figure 1, an AI content generation service is available via the content server 3. As shown in the figure, in this system, content is generated by accessing various generation AIs 6 provided by the generation AI service via the content server 3. The generated AI-generated content is managed and operated by the content server 3.

[0036] Here, AI-generated content refers to content generated using generative artificial intelligence (AI), specifically content such as audio, images, video, and text that is automatically generated based on data learned by AI. Examples include videos of real people, people who existed in the past, and fictional characters making sounds and moving. Additionally, a guarantee system 9 is provided on the Internet 2 that provides a blockchain interface service that guarantees the management of AI-generated content, digital content, virtual currency, etc. Once this guarantee system 9 is installed, it can be connected to a distributed ledger system such as a blockchain through this blockchain interface service.

[0037] (Configuration of each device) Next, we will explain each device that makes up the above-mentioned virtual funeral system. Figure 4 shows the internal configuration of the content server 3 according to this embodiment, and Figure 5 shows the internal configuration of a smartphone. Note that the term "module" used in this explanation refers to a functional unit that is composed of hardware such as a device or equipment, software with the corresponding function, or a combination of these, and that performs a specific operation.

[0038] (1) Content Server First, we will explain the internal configuration of the content server 3. The content server 3 is a server device located on the Internet 2, and is capable of transmitting and receiving data to and from each of the smartphones 1 a and 1 b and the local server device 50 via the Internet 2.

[0039] The content server 3 comprises a communication interface 31 for data communication via the Internet 2, an authentication unit 33 for authenticating the authority of users and user terminals, a location information management unit 32 for collecting and managing location information of each user terminal, a virtual funeral progress unit 36 ​​for processing the virtual funeral as a whole and for each user, a distribution unit 34 for distributing virtual funeral data to each user, and various database groups 35a to 35d.

[0040] The databases include a real-space database 35a, which serves as a real-world map storage unit that stores real-world map information including geographic information and facilities (buildings and locations) in the real world; a virtual funeral database 35b, which stores virtual map information, information related to the virtual funeral process for the entire virtual funeral, and information related to the virtual funeral process for each user; a user database 35c, which stores information related to users; and a presentation information database 35d, which stores information related to presentation information. Each of these databases may be a single database, or may be divided into multiple databases and configured as a relational database in which the data is linked to each other by establishing relationships between them.

[0041] The real space database 35a is a storage device that stores real map information including geographic information in the real world, and stores natural geographical elements such as mountains, valleys, and rivers, man-made objects such as facilities, buildings, roads, and railways, place names, addresses, traffic regulations, etc. Note that the real space database 35a may be owned and operated by the service provider that operates the content server 3, or it may be a map database operated by another map service provider.

[0042] The information stored in the virtual funeral database 35b includes virtual world map information, characteristics of characters and objects, information related to event processing, graphic information, etc. as virtual funeral data, as well as mapping data for associating this virtual funeral data with geographical elements, buildings, roads, railways, etc. contained in the real map.

[0043] Specifically, the virtual funeral database 35b stores user profiles detailing the relationship between attendees and the deceased, digitized objects such as flowers and notes sent as memorials, multimedia content from the memorial service, etc. The virtual funeral database 35b also stores specific records of the virtual funeral, participant interactions, interactive session data, and feedback and comments on the service.

[0044] Additionally, the virtual funeral database 35b stores multimedia tributes such as videos, images, and audio clips shared by attendees as part of the memorial service, as well as service records such as the date and time of the virtual funeral event, ceremony logs, and participant interaction records, interactive session data such as user interactions, message exchanges, gestures, and movement records within the virtual space, and feedback data such as user opinions and comments regarding the service and user engagement and behavior patterns during the service.

[0045] The information stored in the user database 35c includes an identifier (user ID, terminal ID) that identifies the user or the mobile terminal device used by the user, and authentication information linked to a password, etc., as well as personal information about the user linked to the user ID and the model of the terminal device. The user database 35c also stores authentication history (access history) for each user or each user terminal, information about the virtual funeral for each user (current location such as latitude and longitude, service record during the virtual funeral, usage history, etc.) through its relationship with the virtual funeral database 35b, and information such as engagement data and feedback data within the virtual funeral.

[0046] The information stored in the presentation information database 35d includes the donor's identity information (donor's name, relationship to the deceased, contact information), gift details (type of flowers or offering, intention, date and event of the gift), digitized gifts (3D models and photos of the flowers or offering), messages and condolences (condolence messages for the deceased and animated cards), as well as "gift stories" such as the background surrounding the gift and episodes with the deceased, functions that allow the donor and other users to interact, and interactive elements such as gift-related activities.

[0047] The authentication unit 33 is a module that establishes a communication session with each smartphone 1 (1a, 1b, etc.) via the communication interface 513 and performs authentication processing for each established communication session. This authentication processing involves obtaining authentication information from the smartphone 1 (1a, 1b, etc.) of the accessing user, referencing the user database 35c to identify the user, etc., and authenticating their authority. The authentication results (user ID, authentication time, session ID, etc.) by the authentication unit 33 are sent to the virtual funeral proceeding unit 36 ​​and stored in the user database 35c as authentication history.

[0048] The location information management unit 32 is a module that acquires location information that is acquired on the user terminal device side and sent to the content server 3. The location information management unit 32 links the identifiers (user ID, terminal ID, etc.) of the user and user terminal device identified by the authentication process by the authentication unit 33 with the location information and stores it as usage history in the user database 35c.

[0049] The virtual funeral proceeding unit 36 ​​is a module on the content server 3 that manages and operates each event and ceremony of the virtual funeral. It distributes instructions and information for carrying out the funeral proceedings in the virtual space in cooperation with other communication terminals. In particular, the virtual funeral proceeding unit 36 ​​of this embodiment adjusts the proceedings according to the actions of participants and realizes the functionality to respond to real-time reactions and changes, allowing all participants, including those in remote locations, to share a unified mourning experience. The virtual funeral provided by the virtual funeral proceeding unit 36 ​​causes characters, items, and other objects corresponding to each user to appear in the virtual world, triggers various event processing, and progresses the virtual funeral. It executes a virtual funeral program containing certain rules, logic, and algorithms, triggering event processing such as level-up, AR execution, and movie playback depending on the relative positions (e.g., proximity or contact) of characters and objects.

[0050] In this embodiment, the virtual funeral proceeding unit 36 ​​cooperates with the virtual funeral condolence call processing unit 141 on the smartphone 1, with part of the virtual funeral proceeding processing being performed on the content server 3, and part of the graphic processing and event processing being performed by the virtual funeral condolence call processing unit 141 on the smartphone 1. For example, when a condolence call by real user U2 is scanned at temple 5a on the content server 3, the latest event occurrence status is transmitted to the smartphone 1, and the actual event processing and the associated graphic processing are calculated on the smartphone 1 based on the latest event occurrence conditions received from the content server 3. In this embodiment, the virtual funeral proceeding unit 36 ​​includes a virtual space management unit 36a, a real space management unit 36b, a virtual space data generation unit 36c, and an inter-user collaboration unit 36d.

[0051] The virtual space management unit 36a is a module that creates, maintains, and manages the virtual environment for conducting a virtual funeral. This virtual space management unit comprehensively manages the setting of events and ceremonies within the virtual space, the placement of participant avatars, and interactive elements, providing all the background and scenarios necessary for the virtual funeral to proceed. In particular, it functions as an interface that allows participants to move freely within the virtual space as avatars and communicate with each other. The virtual space management unit 36a also controls the generation of advanced graphics and sound effects using the virtual funeral proceeding unit 36 ​​to enhance the realism and immersion of the virtual funeral.

[0052] The real-space management unit 36b acquires the addresses, latitude, longitude, and shapes of topographical elements, buildings, roads, railways, etc. contained in the real-space map information stored in the real-space database 35a, and references the mapping data stored in the virtual funeral database 35b to form the foundation necessary for positioning and object placement in the virtual space. In particular, through cooperation with a capture system 5 installed in a specific facility such as a temple 5a, the movement and behavior of real user U2 are captured in real time and reproduced as a synchronized avatar SA2 in the virtual space 4. This synchronizes the progress of the funeral in the real world with the progress of the virtual funeral, achieving a sense of immersion and unity as if participants were actually at the actual funeral, even though they are physically separated.

[0053] The real-space management unit 36b can also reflect the user's actions in real space in the virtual space based on the user's current location, acquired by the location information management unit 32 through the location information acquisition unit 144 on the smartphone 1 (1a or 1b). Specifically, the real-space management unit 36b controls the synchronized avatar SA2's movements in the virtual space based on the user's current location and movements on the real-space map or user operations. For example, the real-space management unit 36b captures the user's movements in a real-world setting, such as a temple, through the smartphone's location information acquisition unit 144 and converts them into movements of the synchronized avatar SA2 in the virtual space. For example, if the user offers incense at a real-world location, the real-space management unit captures the movement information in real time, and instructs the synchronized avatar to reproduce the same incense-offering movements in the virtual space. This allows participants in the virtual funeral space to share the actual ceremony taking place at the real-world location in real time.

[0054] The user-to-user linking unit 36d is a module that enables users to communicate with each other. Through this user-to-user linking unit 36d, users attending the virtual funeral can share information and exchange messages of support. The system can also provide chat functions, voice messages, and even video calling functions for the direct exchange of emotional support and words of comfort. By setting protocols for how users behave and interact with each other in the virtual space, and by providing a way to show respect for the deceased and a forum for participants to share memories of the deceased and express their condolences through dialogue between avatars, the system is expected to deepen the virtual funeral experience while strengthening the bonds of the community.

[0055] The distribution unit 34 is a module that distributes virtual funeral data, including display map information, event occurrence conditions, event details, etc., generated by the virtual funeral proceeding unit 36, to each user via the communication interface 31 based on the user's current location. In this embodiment, the virtual space management unit 36a has a content management unit 361, a virtual value issuing unit 362, and a guarantee system linkage unit 363.

[0056] The content management unit 361 is a module that manages digital content within the virtual space (such as the deceased person's avatar, user avatar, offerings, backgrounds, video, and audio data), manages the appearance, movement, and audio data of the deceased person's avatar, and allows users to access them. The virtual value issuing unit 362 is a module that issues and manages points and digital content that have exchange value with real currency as virtual value information. For example, digital transactions such as condolence money and condolence gift return gifts are recorded as NFTs. The virtual value issuing unit 362 also has the function of processing a certain percentage of donations made by users within the virtual space as actual donations.

[0057] The guarantee system cooperation unit 363 is a module that cooperates with the guarantee system to manage records of transactions (condolence money, donations, NFTs, avatar customization, etc.) conducted in virtual space. Specifically, the guarantee system cooperation unit 363 stores transaction history on a blockchain or the like to prevent tampering, and also cooperates with the blockchain to guarantee the validity of the data generated by the deceased's avatar and data during the deceased's lifetime.

[0058] On the other hand, the virtual space data generation unit 36 ​​c has a machine learning control unit 367 , an assurance system collaboration unit 365 , a generation control input information acquisition unit 366 , the machine learning control unit 367 , and a generation process execution unit 368 .

[0059] The machine learning control unit 367 is a module that generates a deceased person's avatar using AI that has learned from video, audio, and text data from the deceased's life. In this embodiment, the machine learning control unit 367 constructs an AI-based life simulation model and creates a virtual avatar that can reproduce the deceased's speech and behavior during life. Furthermore, by using generative AI to set specific scenarios during the virtual funeral, it is possible to make it appear as if the deceased is speaking.

[0060] The assurance system linkage unit 365 is a module that manages the reliability of the data generated by the deceased person's avatar and the AI-generated learning data in cooperation with the assurance system. Specifically, it records the transaction history of condolence money, offerings, digital items, etc. traded in the virtual space on the blockchain.

[0061] The generation control input information acquisition unit 366 is a module that acquires prompts and data (images, videos, audio, personal information, etc.) input by the user when generating content using AI. Based on the acquired input information (generation control input information), each generation AI generates an avatar and content (clothes, accessories, etc.). This allows the AI ​​to optimize the user's desired appearance and clothing and apply them to the avatar in the virtual space in real time. For example, by inputting the user's preferences, video of their appearance, career history, etc. as control generation input information, the generation AI can recommend the optimal avatar appearance and clothing based on the user's selections and past data, or instantly apply the clothing and accessories selected by the real user to the avatar in the virtual space.

[0062] The generation process execution unit 368 executes a process in which the AI ​​automatically generates avatars, digital content, and elements of the virtual environment based on the information collected by the generation control input information acquisition unit 366. Specifically, the AI ​​immediately reflects the generation control input information of the avatar entered or selected by the user and makes adjustments in real time. For example, if the user enters "Japanese clothing is good," the AI ​​recommends an appropriate Japanese clothing design and immediately applies it.

[0063] (2) Smartphone 1 Next, the internal configuration of the smartphone 1 (1a and 1b) will be described. As shown in FIG. 5A, the smartphone 1 includes a communication interface 11, an input interface 12, an output interface 13, an application execution unit 14, and a memory 15.

[0064] The communication interface 11 is a communication interface for performing data communication, and has the function of performing contactless communication such as wireless communication, and contact (wired) communication using a cable, adapter means, etc. The communication interface 11 also includes short-range communication such as Wi-Fi and Bluetooth.

[0065] The input interface 12 includes devices for inputting user operations, such as a mouse, keyboard, operation buttons, and touch panel 12a, as well as a camera 12b, which is an imaging means built into the smartphone 1. The output interface 13 includes devices for outputting video and audio, such as a display and speaker. In particular, the output interface 13 includes a display 13a, such as a liquid crystal display, which is superimposed on the touch panel 12a, which is the input interface.

[0066] The memory 15 is a storage device that stores the OS (Operating System), firmware, various application programs, and other data. In addition to a user ID that identifies the user, the memory 15 also stores virtual funeral application data downloaded from the content server 3, as well as virtual funeral data for the virtual funeral process executed by the application execution unit 14. In particular, in this embodiment, the memory 15 stores virtual funeral data (such as graphics of the virtual funeral parlor) such as event occurrence conditions acquired from the content server 3.

[0067] The application execution unit 14 is a module that executes applications such as a general OS, a virtual funeral application, browser software, etc., and is usually realized by a CPU, etc. In this application execution unit 14, the virtual funeral program according to the present invention is executed, and thereby a virtual funeral condolence question processing unit 141, a synchronization processing unit 142, an AR processing unit 143, a display data generation unit 146, an output control unit 145, and a position information acquisition unit 144 are virtually constructed.

[0068] The virtual funeral condolence call processing unit 141 is a module that moves each avatar and other objects corresponding to each user in the virtual world and generates various event processes to carry out condolence calls at the virtual funeral using the same rules, logic, and algorithms as the virtual funeral program executed on the content server 3. The virtual funeral condolence call processing unit 141 synchronizes with the virtual funeral proceeding unit 36 ​​on the content server 3 side via the synchronization processing unit 142, and generates event processes such as displaying AR images to the real user U2 and playing movies according to the positional relationships (approach, contact, etc.) of avatars, other characters, and objects.

[0069] In this embodiment, the synchronization processing unit 142 cooperates with the virtual funeral condolence question processing unit 141 on the content server 3 side, with part of the virtual funeral progress processing being performed on the content server 3 side, and part of the graphic processing and event processing being performed by the virtual funeral condolence question processing unit 141 on the smartphone 1 side. For example, the conditions for an event occurrence are generated on the content server 3 side, and the conditions are transmitted to the smartphone 1 side, with the actual occurrence of the event processing and the graphic processing required for that being performed on the smartphone 1 side.

[0070] The synchronization processing unit 142 is a module that synchronizes the virtual funeral progress processing on the smartphone 1 with the virtual funeral progress processing on the content server 3. Specifically, the content server 3 accumulates and updates event processing information related to the user, including other users, and transmits the latest event occurrence conditions for the virtual funeral to the smartphone 1. The synchronization processing unit 142 receives these occurrence conditions, and the virtual funeral condolence question processing unit 141 on the smartphone 1 executes the actual event processing and the corresponding graphic processing based on the occurrence conditions received from the content server 3. The results of the event processing executed by the virtual funeral condolence question processing unit 141 on the smartphone 1 are notified to the virtual funeral condolence question processing unit 141 on the content server 3 via the synchronization processing unit 142 and are reflected in the subsequent virtual funeral progress processing. Examples of event processing that synchronizes the synchronization processing unit 142 and the content server 3 include the following:・Processing attendees' entry ・Identity authentication and profile synchronization ・User location setting and movement synchronization ・Processing actions such as leaving condolence messages and flowers ・Streaming of ceremony audio and video ・Synchronization of real-time ceremony actions such as incense burning ・Processing communication and chat functions between attendees ・Funeral progress schedule management ・Playing tribute videos and slideshows for the deceased ・Processing exit from the virtual space after the ceremony has ended

[0071] The AR processing unit 143 is a module that creates augmented reality by overlaying images and information from a virtual space onto images of the actual site when a real user U2 visits a funeral at a site such as a temple 5a. The real user can connect a VR headset to their smartphone and experience the ceremony being held at the actual temple 5a through images that are integrated with the virtual space. This allows participants to feel as if they are physically present at the site, while also enjoying the additional information and visual effects unique to the virtual space.

[0072] Meanwhile, internet users can also enjoy a similar VR experience from the comfort of their own homes. They connect a VR headset to their smartphones and can "attend" a virtual funeral through footage streamed from the content server 3. This process allows users in remote locations to get a feel for the atmosphere of the funeral taking place on-site and express their condolences at the appropriate time.

[0073] In this way, the AR processing unit 143 plays an important role in promoting deeper empathy and participation by eliminating the boundary between the real and the virtual world, providing a new way for real users and online users to pay their respects from their respective perspectives, share the same space and time, and remember the deceased.

[0074] Specifically, the AR processing unit 143 generates augmented reality display data (AR data) that displays virtual objects such as virtual buildings superimposed on real-world images captured by multiple cameras 52 installed at the venue, for example, as shown in Fig. 8, in accordance with the virtual funeral progress and virtual map coordinates generated by the virtual funeral condolence call processing unit 141. The augmented reality display data (AR data) generated by the AR processing unit 143 is input to the display data generation unit 146, where it is incorporated into a predetermined GUI (Graphical User Interface), and displayed on the display of the VR headset together with other UIs.

[0075] On the other hand, when an internet user participates in a virtual funeral using a VR headset, the AR processing unit 143 generates AR data that overlays virtual objects such as virtual buildings on an image of the real world based on the instructions and virtual map coordinates of the virtual funeral condolence call processing unit 141. This data is incorporated into the GUI by the display data generation unit 146 and displayed on the user's VR headset, allowing the user to experience the funeral in a space where reality and virtuality are combined.

[0076] In addition, the AR processing unit 143 monitors the event processing generated by the virtual funeral condolence question processing unit 141 and the current location of the device acquired by the location information acquisition unit 144, and if the current location is within a predetermined range (latitude, longitude, address) of an object that triggers the occurrence of an event, such as an event venue, and the event processing generated by the virtual funeral condolence question processing unit 141 is a predetermined AR executable event, it executes a notification process of the occurrence of the AR executable event.

[0077] The display data generation unit 146 is a module that generates display data to be displayed on the display 13a, and generates and displays a virtual funeral screen and its surrounding GUI (Graphical User Interface) as shown in Figure 2. This display data is data that is generated by combining graphic data, as well as image data, text data, video data, audio data, and other data.

[0078] In particular, the display data generation unit 146 according to this embodiment generates graphics of real-world map information indicating the user's current location based on the user's current location acquired by the location information acquisition unit 144, and generates display data representing a virtual synchronized avatar SA2 or the like corresponding to the user's current location on the display map information based on the current location. The display data generated by the display data generation unit 146 is displayed in the VR headset. The display data generation unit 146 also receives augmented reality display data (AR data) generated by the AR processing unit 143, and has the function of incorporating the input augmented reality display data (AR data) into a predetermined GUI and displaying it together with other UIs.

[0079] The output control unit 145 is a module that controls the output of the display data (graphics and video) generated by the display data generation unit, and the display 13a displays the display data and outputs sound through the output interface 13 according to the control of the output control unit 145. In addition, in this embodiment, the output control unit 145 has a function of changing the display or display operation of the real display data and the virtual display data according to the progress of the virtual funeral performed by the virtual funeral condolence question processing unit 141.

[0080] The output control unit 145 changes the display of the real display data and the virtual display data by switching the display of the real display data and the virtual display data in response to the coordinate position specified by the operation signal acquired by the touch panel 12a or the movement of this coordinate position. For example, by tapping or swiping the touch panel 12a with a finger, the camera viewpoint can be moved or the image can be enlarged or reduced. Then, by performing a predetermined gesture operation on the touch panel 12a, the real display data and the virtual display data can be displayed by superimposing both, a selected one, or a portion of one of the display data on the other.

[0081] (3) Capture System The capture system 5 is controlled by a local server device 50, which is installed in a real facility such as a temple 5a. The local server device 50 detects and photographs the three-dimensional shape of the interior and exterior of the building, as well as people and other moving objects present there, using cameras 52 and other devices installed at the venue, and transmits the captured information to the content server 3. The system also obtains virtual reality information from the content server 3, creates an augmented reality space within the captured space, and distributes it.

[0082] The on-site server device 50 can be implemented as a server device, and in this embodiment, can be realized by a single server device or a group of multiple server devices, with multiple functional modules virtually constructed on a CPU, and each functional module cooperates to execute processing. The on-site server device 50 can also send and receive data via the Internet 2 using its communication function, and can present web pages as an interface via browser software using its web server function.

[0083] The cameras 52 are used to capture surface information of the three-dimensional object, and many of them are installed in various locations within the temple 5a so that they can overlook the capture system 5. The function of these cameras 52 can be realized by optical sensors such as digital cameras. In particular, in this embodiment, image information of the three-dimensional object viewed from 12 directions is captured as digital data, and audio, etc. is also recorded as necessary.

[0084] 7, the on-site server device 50 in this embodiment has a storage 514, a CPU 511 that performs arithmetic processing, a memory 512 that temporarily stores information, a communication I / F 513 that communicates with the outside via the Internet 2, an output I / F 515, and an input I / F 516. In this embodiment, the storage 514, CPU 511, memory 512, communication I / F 513, etc. are connected via the CPU 511, and are capable of transferring data between them.

[0085] The storage 514 is a device that stores data on a recording medium and reads out the stored data in response to requests from each device, and can be configured, for example, with a hard disk drive (HDD), a solid state drive (SSD), a memory card, etc.

[0086] The CPU 511 is a device that performs various arithmetic operations required to control each unit, and by executing various programs, various modules are virtually constructed on the CPU 511. In this embodiment, by executing a virtual funeral program on the CPU 511, the general-purpose smartphone 1 functions as a scanner system terminal for the virtual funeral system.

[0087] The communication I / F 513 communicates via a communication network, and may be a known device. By connecting an external or internal telephone line to the communication I / F 513, wired communication is possible, and by connecting a mobile phone or the like, wireless communication is also possible. Of course, the Internet 2 is not limited to telephone lines, and similar functions can also be realized using a LAN or the like.

[0088] The storage 514 is a device that stores data on a recording medium and reads out the stored data in response to requests from each device, and can be configured, for example, with a hard disk drive (HDD), a solid state drive (SSD), a memory card, etc.

[0089] The output interface 515 is a module that sends video signals and audio signals to output video and audio from output devices such as a display and a speaker, and can output video and audio related to application software executed by the CPU 511. The input interface 516 is a module that receives operation signals and detection signals from operation devices such as the mouse 506a and keyboard 506b, and the multiple cameras 52 described above, and the received operation signals are transmitted to the CPU 511, allowing operations to be performed on the OS and each application.

[0090] An OS (Operating System) provided for the server device by the OS is started and executed on the CPU 511, and the basic functions of the server device are controlled by this OS. The OS also enables various applications to be executed, and by executing these applications, various functional modules are virtually constructed on the CPU.

[0091] The on-site server device 50 of this embodiment has a capture information acquisition unit 501, an object information generation unit 502, a texture processing unit 503, and a model processing unit 504 as modules related to capture.

[0092] The capture information acquisition unit 501 is a module that acquires surface information of a three-dimensional object photographed by the camera 52 and operation information from various sensors, and also acquires photographing information of a three-dimensional object photographed from multiple directions by the camera 52 and calibration information of the camera 52. This capture information acquisition unit 501 can acquire surface information of multiple three-dimensional objects, and can also photograph multiple three-dimensional objects simultaneously or sequentially with one camera, and can photograph each three-dimensional object using multiple cameras.

[0093] The capture information acquisition unit 501 is equipped with a sensor control function that controls the operation of the camera and various other sensors, and this sensor control function performs control processing for the camera 52 to capture surface information of a three-dimensional object, as well as synchronization processing and adjustment processing for the sensors.

[0094] The object information generation unit 502 generates shape information of an avatar object in virtual space based on the captured information, which includes the acquired surface information and motion information of the three-dimensional object. This module has the function of generating shape information of the avatar object parts for each of multiple three-dimensional objects, and executes the process of identifying a character region image corresponding to the three-dimensional object and generating a polygon mesh based on that image.

[0095] The object information generation unit 502 also performs object vertex combining processing to simplify the polygon mesh for a character object, and texture vertex combining processing to associate each face of the polygon mesh for texture. To achieve this function, the object information generation unit 502 executes evaluation value calculation, combining processing, and face information processing. Note that the polygon meshes that are the targets of the object vertex combining processing and texture vertex combining processing are not limited to polygon meshes generated from surface information, and may also be polygon meshes designed by a designer.

[0096] The texture processing unit 503 is a module that assigns texture coordinates to the vertices of a given polygon mesh, and in this embodiment, the texture processing unit 503 places each face of the polygon mesh in a texture space for each set of associated faces, and assigns texture coordinates to the vertices of the polygon mesh. If the polygon mesh to be processed here is a polygon mesh generated from surface information, the texture processing unit 503 generates a texture by assigning a color distribution corresponding to each set of faces arranged in the texture space to texture coordinates based on the surface information (image capture information) of the three-dimensional object.

[0097] In particular, in this embodiment, the texture processing unit 503 reduces the resolution of the generated texture to generate a blurring image of the original texture, and performs alpha blending based on the original texture image and the blurring image to blur portions other than those corresponding to the sets of faces of the original texture. Note that the functions of the texture processing unit 503 may be realized by, for example, a CPU alone, or part of them may be realized by a GPU.

[0098] The model processing unit 504 performs a process of associating the generated shape information (polygon mesh) with model information. In particular, when generating shape information for each part of a character object based on surface information of multiple three-dimensional objects, the model processing unit 504 performs a process of associating the shape information of each part with model information. The model processing unit 504 may also select model information from multiple pieces of prepared model information based on the shape information, and associate the selected model information with the shape information.

[0099] Specifically, in this embodiment, multiple types of skeleton model information are prepared, one skeleton model information is selected according to the shape information of each generated part object, and each part object is associated with the corresponding bone of the selected skeleton model information. In particular, in this embodiment, the vertex information of each part object is associated with the corresponding bone data.

[0100] The local server device 50 also includes a data control unit 505, a parameter setting unit 506, an object space control unit 507, a virtual camera control unit 508, a drawing processing unit 509, and an audio processing unit 510 as modules of the augmented reality generation system.

[0101] The data control unit 505 is a module that compares each piece of data forming an object and performs corrections based on the comparison results. The data comparison function of the data control unit 505 compares shape information with a predetermined bounding volume. In particular, when generating shape information for each part of a character object based on the surface information of multiple three-dimensional objects, the shape information for at least one of the parts is compared with the predetermined bounding volume. Specifically, in this embodiment, the ratio of the maximum values ​​in three mutually perpendicular axial directions between the generated shape information and the predetermined bounding volume is compared to evaluate whether the shapes of the two are similar. Then, based on the comparison results, the model processing unit 504 selects model information associated with the bounding volume whose shape is most similar.

[0102] Meanwhile, the correction function of the data control unit 505 corrects the shape information based on a predetermined bounding volume. Specifically, in this embodiment, the shape information of each generated part object is corrected according to the bounding volume corresponding to each part. More specifically, the shape information is enlarged or reduced so that each part object fits appropriately within its corresponding bounding volume. At this time, the size of the shape information in three mutually orthogonal axis directions may be enlarged or reduced at different ratios. The model processing unit 504 then performs processing to associate the corrected shape information with model information.

[0103] The parameter setting unit 506 sets character parameters for a character object based on at least one of shape information and model information for an object to be placed in virtual space. In this embodiment, various parameters can be set as character parameters, such as the character's offensive ability, defensive ability, and movement ability. The character parameters are set based on shape information for the generated character as a whole and shape information for each part. In particular, when shape information for each part of a character object is generated based on surface information for multiple three-dimensional objects, the parameter setting unit 506 may set part parameters for each part of the character object.

[0104] The parameter setting unit 506 also sets basic parameters for the character object and updates the basic parameters set for the character object based on the game results. In this embodiment, the basic parameters for the character object can be set as parameters such as experience points that change depending on the number of games played and game results, and are not affected by shape information or model information. Then, parameters that are set based on, for example, shape information or model information may be changed based on the basic parameters.

[0105] The object space control unit 507 performs processing to place and set in object space various objects (objects configured with primitive surfaces such as polygons, free-form surfaces, or subdivision surfaces) representing display objects such as character objects generated in this embodiment, pre-stored character objects, buildings, trees, pillars, walls, and maps (terrain). That is, the object space control unit 507 determines the position and rotation angle (synonymous with orientation and direction) of an object (model object) in the world coordinate system, and places the object at that position (X, Y, Z) with that rotation angle (rotation angle around the X, Y, and Z axes).

[0106] The object space control unit 507 also executes movement / motion processing that calculates the movement / motion (movement / motion simulation) of moving objects (avatars, characters, tools used by characters, etc.). That is, this movement / motion processing performs processing to move moving objects within the object space or control the movement (motion, animation) of moving objects based on operation data input by the user, set parameters and attributes or programs (movement / motion algorithms), various data (motion data), etc.

[0107] Specifically, the object space control unit 507 of this embodiment performs simulation processing to sequentially obtain object movement information (position, rotation angle, speed, or acceleration) and operation information (position or rotation angle of each part object) for each frame (e.g., 1 / 60 seconds). Here, a frame is a unit of time for performing object movement / operation processing (simulation processing) and image generation processing. In this embodiment, the frame rate may be fixed for each frame, or may be variable depending on the processing load.

[0108] The virtual camera control unit 508 performs control processing of the virtual camera (viewpoint) to generate an image seen from a given (arbitrary) viewpoint in the object space. Specifically, it performs processing to control the position (X, Y, Z) or rotation angle (rotation angle around the X, Y, Z axes) of the virtual camera (processing to control the viewpoint position or line of sight).

[0109] For example, when using a virtual camera to photograph an object (e.g., a character, a ball, or a car) from behind, the position or rotation angle (orientation of the virtual camera) of the virtual camera is controlled so that the virtual camera follows changes in the position or rotation of the object. In this case, the virtual camera can be controlled based on information such as the position, rotation angle, or speed of the object obtained by the movement / motion processing unit 112. Alternatively, the virtual camera may be controlled to rotate at a predetermined rotation angle or move along a predetermined movement path. In this case, the virtual camera is controlled based on virtual camera data for specifying the position (movement path) or rotation angle of the virtual camera. Note that when there are multiple virtual cameras (viewpoints), the above control process is performed for each virtual camera.

[0110] The rendering processor 509 performs rendering processing based on the results of various processes (game processing) performed by the CPU 511, thereby generating an image and outputting it to the mount display MD1, etc. When generating a so-called three-dimensional game image, the rendering processor 509 of this embodiment first receives object data (model data) including vertex data for each vertex of the object (model) (such as vertex position coordinates, texture coordinates, color data, normal vectors, or α values), and then performs vertex processing based on the vertex data included in the input object data. Note that when performing vertex processing, vertex generation processing (tessellation, surface division, polygon division) for subdividing polygons may be performed as necessary.

[0111] Vertex processing involves geometry processing such as vertex movement, coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping, perspective transformation, and lighting processing, and based on the results of these processing, the vertex data assigned to the vertices that make up the object is changed (updated, adjusted). Rasterization (scan conversion) is then performed based on the vertex data after vertex processing, and polygon (primitive) faces are associated with pixels. Following rasterization, pixel processing (fragment processing) is performed to draw the pixels that make up the image (fragments that make up the display screen).

[0112] Pixel processing involves various processes such as texture reading (texture mapping), setting / changing color data, semi-transparent compositing, and anti-aliasing to determine the final drawing color of the pixels that make up the image, and outputting (drawing) the drawing color of the perspectively transformed object to a frame buffer (a buffer that can store image information on a pixel-by-pixel basis; VRAM, rendering target). That is, pixel processing involves per-pixel processing that sets or changes image information (color, normal, brightness, alpha value, etc.) on a pixel-by-pixel basis.

[0113] This generates an image seen from a virtual camera (given viewpoint) set in the object space. If there are multiple virtual cameras (viewpoints), the image can be generated so that the images seen from each virtual camera can be displayed as split images on one screen.

[0114] The vertex processing and pixel processing performed by the rendering processing unit 509 may be realized by hardware that makes rendering processing of polygons (primitives) programmable using a shader program written in a shading language, known as a programmable shader (vertex shader or pixel shader). A programmable shader allows for programmable processing on a vertex or pixel basis, thereby providing a high degree of freedom in the rendering processing content and significantly improving expressiveness compared to fixed rendering processing by hardware.

[0115] The audio processing unit 510 performs sound processing based on the results of various processes performed by the CPU 511, generates acoustic signals such as background music, sound effects, or voice, and outputs them to an external output device.

[0116] (4) Flower Offering Stand Figure 6 shows the appearance of the flower offering stand for altars 6 according to this embodiment. As shown in the figure, the flower offering stand for altars 6 is used to offer decorative materials 63b including plants, and includes a flower vase 63a that is a container for holding the decorative materials 63b, a name tag 64 that displays information, and a two-dimensional code 21 displayed on the surface of the name tag 64.

[0117] The decorative materials 63b are ornaments, including plants and flowers, that are placed on the altar 51. They add a sense of life and beauty to the floral tribute table and express the dignity and respect of the funeral. The decorative materials 63b are selected based on the theme of the altar, the season, or the will of the sender.

[0118] The vase 63a is a container filled with, for example, a sponge-like flower support material, into which the stems of the flowers are inserted for support, and a base for receiving the flower support is provided inside the vase 63a. The vase 63a is the part of the container that holds the decorative material 63b. A water reservoir is provided inside, allowing the plants and flowers that make up the decorative material 63b to remain fresh for a long time. The vase 63a has a beautiful and sturdy structure, maintaining the dignity of the funeral while supporting the weight of the decorative material 63b.

[0119] The name tag 64 is the part that displays the sender of the floral tribute and related information, and is supported by the stem 64b inserted into the flower vase 63a, and is designed to display information without spoiling the overall appearance of the altar flower stand 6. The sender of the floral tribute and related information displayed on the surface of the name tag 64 include the sender's name, a message for the flowers, and other necessary information.

[0120] In this embodiment, the two-dimensional code 21 is displayed on the surface of the name tag 64 and encodes information into a two-dimensional graphic. By reading the two-dimensional code 21 with a device such as a smartphone, it becomes possible to view information that would be difficult to write directly on the name tag 64 (long messages, photos, videos, etc.). This allows the sender to share the deep meanings and memories that they have put into the flowers.

[0121] (5) Guarantee System As described above, this embodiment is provided with a guarantee system 9 that guarantees value information of various digital contents and virtual currencies. Specifically, as shown in Fig. 5(b), the guarantee system 9 includes a communication interface 93, an authentication unit 92, a value information transaction execution unit 94, a value information transaction database 91a, a key information database 91b, and an account database 91c.

[0122] The communication interface 93 is a module that transmits and receives data to and from other communication devices via the Internet 2, and in this embodiment, is connected to the content server 3. The authentication unit 92 is a computer or software with that function that verifies the legitimacy of an accessing person, and performs authentication processing based on a user ID that identifies each user. In this embodiment, the authentication unit 92 obtains, via the Internet 2, a user's unique public address, public key, user ID, password, etc. from an information processing terminal, such as a PC or smartphone, used by the accessing person, and verifies whether the accessing person has the right to access the content and whether the accessing person is the person in question by comparing the information with the key information database 91b.

[0123] The value information transaction execution unit 94 is a module that handles value information such as digital content, points, virtual currency, and NFT as virtual coins. These various types of value information are linked to the public accounts of their legitimate owners, and by presenting the public account relationship, it is possible to prove that one is the legitimate owner of the value information. Furthermore, only the legitimate owner can carry out transfer procedures such as assignment of the value information. In this embodiment, the value information transaction execution unit 94 includes a guarantee system linkage function, a public address management unit 94b, a legitimacy verification unit 94c, and a data update unit 94d.

[0124] The guarantee system cooperation function is a module that is requested by devices of other service institutions, such as the content server 3, to carry out processes related to token transactions, such as credit for energy transactions, security management, transaction records, and storage of service history, and cooperates with these devices to carry out the processes. In this embodiment, the guarantee system cooperation function provides information such as transaction values ​​of various value information to the content server 3.

[0125] The public address management unit 94b functions as an address issuing unit that issues public addresses generated from public keys in a public key cryptosystem to identify specific users, and private keys that can be paired with the public keys to identify the public keys and are used for electronic signatures for energy transactions via the public addresses, and these issued public addresses and their associated key information are stored in a key information database 91b.

[0126] The legitimacy verification unit 94c is a module that verifies that various value information related to value information transactions belongs to the current owner through legitimate transactions and has not been tampered with.The legitimacy of the value information can be confirmed using the public key of the current owner linked to the public account, and all transactions related to the value information are stored in the value information transaction database 91a, and the legitimacy can be confirmed by comparing the value information transaction database 91a based on the public key.

[0127] The data update unit 94d is a module that acquires power information related to various types of value information, adds a public address related to a new value information owner, and changes the value information owner certified in the distributed ledger, thereby transferring the ownership of the value information. The data updates by this data update unit 94d are protected by advanced security, and are designed to provide strong protection against double transfers and tampering with transaction history.

[0128] (6) Generative AI In this embodiment, the generative AI 7 is a cloud-based system that operates on an external server, and generates content in cooperation with the virtual space data generation unit 36c of the content server 3. This generative AI 7 may be a single generative AI service, or may be a system in which multiple generative AIs are selected as appropriate. Note that, although the present embodiment uses a cloud-based system, the present invention is not limited to this, and the generative AI 7 may be a standalone system that can operate offline on the content server 3.

[0129] The generation system AI7 is connected to the generation control input information acquisition unit 366 as a data input module via the generation processing execution unit 368, and acquires prompt input (text, image, audio, etc.), user data input (video, audio, personal information, etc.), and sensor data input (camera, microphone, biometrics).

[0130] The generative AI 7 also includes a data preprocessing module, which performs data normalization and cleaning, feature extraction, and input data enhancement and expansion, such as increasing the resolution of low-resolution images. The generative AI 7 also includes a model selection and application module, which selects and applies AI models tailored to specific tasks, such as image generation, video generation, audio generation, text generation, and 3D model generation. The generative AI 7 also includes a generation module, as shown in FIG. 17, which applies these trained AI models to generate content based on input data. The generation module also includes functions such as optimizing output based on user selections and feedback and generating personalized content through additional learning (fine tuning). The generative AI 7 also includes an output adjustment module, which corrects and adjusts the generated results, thereby improving image and video resolution, removing and tuning audio noise, and checking text grammar and consistency.

[0131] The generation system AI 7 also has a function of generating training data for learning by collecting and analyzing prompt data D1, video and still image data D2, related media data, and environment and performance data D4 from each user as generation control input information via a generation control input information acquisition unit 366, and in this embodiment, this function is performed by the machine learning control unit 367 of the content server 3. The analysis results by the machine learning control unit 367 are input to a generation processing execution unit 368 and used for machine learning.

[0132] The machine learning control unit 367 is a module that trains the cloud-based generation system AI 7 or the AI ​​stored in standalone form in the generation processing execution unit 368 to make appropriate judgments, and generates training data from prompt data D1, videos and still images D2, related media D3, and environmental and performance data D4 collected by the generation control input information acquisition unit 366, and trains various AI models based on this training data.

[0133] The generative AI 7 generates content using so-called deep learning. In this embodiment, the algorithm implemented in this generative AI 7 is a learning and recognition system that includes a multi-layered neural network, particularly one with three or more layers, and mimics the mechanisms of the human brain. When image data or other data is input to this recognition system, the data is propagated sequentially from the first layer, and learning is repeated in each subsequent layer. During this process, the internal features of the image are automatically calculated.

[0134] These features are essential variables necessary for solving problems and characterize specific concepts. The generative AI 7 also receives prompt data D1, video and still image data D2, related media data, and environmental and production data D4. It hierarchically extracts multiple feature points from these data and recognizes patterns based on hierarchical combinations of the extracted feature points. An overview of this recognition process is shown in Figures 17 and 18. As shown in the figures, the recognition function module of the generative AI 7 is a multi-class classifier that is configured with multiple events and detects a feature vector 702 (e.g., "features of the deceased's voice"), an object containing specific feature points, from among multiple objects. This recognition function module includes an input unit (input layer) 707, a first weighting factor 708, a hidden unit (hidden layer) 709, a second weighting factor 710, and an output unit (output layer) 711.

[0135] At this time, multiple feature vectors 702 are input to the input unit 707 (AN3 in the example of FIG. 18 ). A first weighting coefficient 708 weights the output from the input unit 707. A hidden unit 709 (AN2) performs nonlinear transformation on the linear combination of the output from the input unit 707 and the first weighting coefficient 708. A second weighting coefficient 710 weights the output from the hidden unit 709. An output unit 711 (AN1) calculates the classification probability of each class (e.g., greetings from the deceased, etc.). Although three output units 711 are shown here, this is not limiting. The number of output units 711 is the same as the number of events that the pattern classifier can detect. Increasing the number of output units 711 increases the number of events that the event classifier can detect, such as recognizable device types.

[0136] (Virtual Funeral Method) (1) Overall Processing of Virtual Funeral The virtual funeral method of the present invention can be implemented by operating the virtual funeral system described above. Figure 8 is a sequence diagram showing the overall operation of the virtual funeral system. Note that the processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, steps in the processing procedure described below can be omitted, replaced, or added as appropriate depending on the embodiment.

[0137] On the real user U2 side, when the real user U2 enters a facility such as a temple 5a, the real user U2 is captured by a capture system 5 installed on the premises, and a connection process is performed between the real user U2 and the capture system 5. In the connection process between the smartphones 1a and 1b and the capture system 5, first, when the smartphone 1a enters a short-range wireless communication network such as Wi-Fi, a link connection request is sent from the smartphone 1a to the capture system 5 (S101). This connection request includes an authentication request.

[0138] In the authentication process on the capture system 5 side (S201), an authentication request is transferred to the content server 3, and the authentication process on the capture system 5 is completed based on the result of the authentication process on the content server 3 (S301). That is, the authentication process request included in the link connection request is transferred to the content server 3, and the content server 3 that receives it executes the authentication process to identify the real user (S302) and notifies the capture system 5 of the authentication result. In response to this authentication result, the capture system 5 permits access by the user, executes a link connection between the capture system 5 and the smartphone 1 on the real user U2 side (S202), and establishes short-range wireless communication (S102).

[0139] Once the link is established in this way, a capture process is started to acquire capture information from video and audio signal acquisition means such as cameras 52 and microphones installed in the venue, and pressure sensors placed on the floor (S203), and the capture information detected by smartphone 1a (position information, movement information, shooting information, audio recording, ambient light information, etc.) is also acquired by capture system 5. The capture information acquired by capture system 5 is sent to content server 3 (S204), where it is analyzed as real-space information (S304).

[0140] Meanwhile, the Internet user sends an authentication request to the content server 3 via the user terminal (S401), and the content server 3 executes the authentication process (S301). If the authentication process for the Internet user is successful and access to the content server 3 is permitted, the Internet user is allowed to enter the virtual funeral parlor, and by transmitting user operations (S402), the Internet user can control the remote avatar. These operations on the Internet user's side are reflected in the virtual space information generated by the content server 3 (S303).

[0141] In this way, the real user side combines the video and sensor information captured in real space with the virtual funeral home in virtual space through access to the content server 3 from the internet user side, allowing a virtual remote avatar and a real avatar based on movements in the real world to exist in a single virtual space. The captured video and sensor information are combined to create a data set of the real user's movements. At this time, the content server 3 synchronizes the virtual space data of the virtual funeral home with the data set acquired from the real user to integrate the data.

[0142] The captured real user's location information is then converted into the coordinate system of the virtual funeral home. This conversion process involves mapping the layout of the real funeral home with that of the virtual funeral home, and processing is performed to ensure that the real user's movements are accurately reproduced in the virtual space. For example, the direction and distance the real user travels in the funeral home is represented as the movement of an avatar in the virtual space. Furthermore, the captured movement information (walking, hand gestures, head movements, etc.) is analyzed before being converted into avatar movements, including a process to identify the type of movement and select an appropriate animation.

[0143] Additionally, a real avatar is generated in the virtual space based on the acquired real user's motion data, reflecting the user's captured movements and facial expressions. For example, the movements and shape of the real avatar based on real-world capture can be combined with the customized and designed features of the remote avatar to create a consistent avatar form in the virtual space.

[0144] Specifically, real avatars generated from captured information of real users are individually sculpted based on the user's height, body type, and movement characteristics, while remote avatars can also be customized with clothing, hairstyles, accessories, etc. based on the profile and preferences provided by the internet user.

[0145] Furthermore, the real-world actions of the real user and the virtual actions of the remote user are reflected in real time by each avatar. For example, when a real user actually burns incense at a funeral home, that user's real avatar will express the same burning action in the virtual space. At the same time, the gestures and facial expressions of the avatar selected by the remote user are updated in real time based on the user's actions. Furthermore, interactions between avatars and with the environment are simulated in real time in the virtual space and reproduced as interactive responses within the virtual space. This allows real users and online users to interact with each other and influence the environment within a virtual funeral home.

[0146] The virtual space information thus generated is sent to the capture system 5 and the internet user (S305). The capture system 5 analyzes the virtual space information and controls the synchronized avatar. The internet user's smartphone 1b also analyzes the virtual space information and controls the remote avatar (S403). The virtual space is then displayed and output on the internet user's mount display (S404). On the real user U2 side, the capture system 5 generates an augmented reality space (S206) and displays and outputs it on the real user U2's mount display (S103). Using the generated avatars, the real user and internet user can interact with each other in the virtual funeral home. The real user's real-world ceremony actions (such as offering incense) are reproduced in the virtual space through the real avatar, allowing the internet user to view and experience them.

[0147] (2) Floral Offering Information Presentation Process In the virtual funeral described above, floral tributes prepared in the real world can be displayed as graphics in the virtual space and displayed for viewing by other users. Figure 9 shows the procedure for the floral tribute information presentation process in this embodiment. As shown in the figure, first, all users (including both real users and online users) display a virtual funeral as virtual reality or augmented reality on their smartphones 1 or mounted displays (S501). At this time, each floral offering stand installed in the real funeral hall is assigned a unique two-dimensional code, and this two-dimensional code contains information for identifying the floral offering stand (such as an identification ID, the name of the floral offering stand, and location information).

[0148] In this state, the two-dimensional code displayed on the flower stand is photographed (S502). This photographing method may be performed using the camera built into the smartphone 1a, or by simply capturing the code in the camera 52 installed at the venue, or by simply bringing the code into the display screen (field of view) of the mount display.

[0149] The two-dimensional code thus captured is decoded and converted into text data or the like (S503). This conversion process decodes the information contained in the two-dimensional code and converts it into text data. The converted data, in this case, is text information such as a URL, and smartphones 1a and 1b can access the content server 3 according to this URL (S504). This communication is performed via a wireless Internet connection, a mobile data connection, or the like.

[0150] Then, in the virtual space, the content server 3 generates a 3D object corresponding to the flower stand at a specified position within the virtual space. This position is determined based on the actual position information of the flower stand contained in the two-dimensional code. The generated 3D object of the flower stand is displayed in real time within the virtual funeral home and is visible to all users participating in the virtual space.

[0151] The presentation information access unit 34a of the content server 3 searches the presentation information database 35d for specific flower offering information corresponding to the transmitted data and delivers it to each user (S505). This flower offering information is displayed as a web page by the delivery unit 34 and can be viewed on the smartphone 1 (S506 and S507). The presentation information access unit 34a then transmits the flower offering information via the Internet 2 to the capture system 5 or to an application on each user's smartphone.

[0152] Finally, the mounted display displays the received flower offering information and presents it to each user (real-life user or online user) (S508). This display may be in the form of text, images, or other visual formats. This series of processes allows each user to scan a specific two-dimensional code and directly access the flower offering information associated with that two-dimensional code and distributed on the content server 3. In this way, the smartphone 1 provides each attendee with the flower offering information as digital information, such as a web page that combines various content such as text information, images, and videos, via the physical two-dimensional code.

[0153] In this embodiment, a virtual floral tribute can also be provided by a web user via remote control. This virtual floral tribute may appear only in the virtual space, or an alternative floral tribute stand may be installed in the real funeral hall. For example, a web user selects the type of floral tribute and a message through a virtual funeral participation application. The selected floral tribute information is transmitted to the content server 3, and the content server 3 generates a virtual floral tribute object based on the transmitted floral tribute information and places it at a specified location in the virtual funeral hall. The generated floral tribute object is then displayed in real time within the virtual funeral hall and is visible to all participating users.

[0154] Furthermore, in order to substitute real floral tributes for the virtual floral tributes provided by this remote operation at a real funeral hall, the online user can select an option to have the floral tributes selected by the user placed in the real funeral hall as real tributes in addition to being displayed in the virtual space, and the floral tribute order information is automatically sent to a floral tribute service provider, which arranges for delivery, and the real floral tributes delivered to the funeral hall are placed by funeral hall staff at a predetermined location corresponding to the coordinates in the virtual space. The real floral tributes are accompanied by a two-dimensional code that links them to the floral tribute object in the virtual space, and a real user visiting the funeral hall can scan the code to find out who provided the flowers and the message attached to them.

[0155] Through this process, internet users can participate in virtual funerals from remote locations, remember the deceased through floral tributes, and build deeper connections with real users by choosing the option to have physical floral tributes delivered to the funeral home.

[0156] Furthermore, in this embodiment, digital content is presented as a gift to the person who offered the floral tribute. This process involves first registering and confirming floral tribute information. Specifically, when an internet user offers floral tribute to a virtual funeral, the information (user name, type of floral tribute, message, etc.) is recorded on the content server 3, and the floral tribute is confirmed by the content server 3 confirming that the floral tribute has been correctly placed in the virtual space or the real funeral hall. Next, the digital content to offer as a gift is selected.

[0157] The operator of the virtual funeral service prepares digital content (such as digital bouquets, memorial videos, and digital letters of thanks) to be given to users who have provided floral tributes, and customizes the digital content, if necessary, by incorporating messages of gratitude from the deceased or their family members. The digital content gifting process is then executed. At this time, the users who provided floral tributes are notified by email or in-app notification from the content server 3 that they will receive digital content in return. The users can access and download the digital content using a link or code included in the notification, and each user can view and save the digital content they received as a gift.

[0158] (3) Operation During Value Information Transfer Transaction Here, the value information transfer process will be described in detail. Fig. 11 is a flow diagram illustrating the processing procedure during value information transfer according to this embodiment, and Fig. 12 illustrates the relationship between the public key and the private key according to this embodiment.

[0159] In this embodiment, the mechanism of a distributed ledger system is used for value information transfer processing and account processing related to value information transfer. Here, an example will be described in which a seller Ua sells (transfers) value information, such as digital content or virtual currency provided as a condolence gift or a return gift, to a new buyer Ub through a guarantee system 9, which is a blockchain interface. As shown in FIG. 11 , this value information purchase and sale transaction includes step S501 of issuing a public address and a private key, step S502 of registering related service history information, and step S503 of executing a rights transfer process.

[0160] First, in step S501, in the content server 3, the public address management unit 94b functions as an address issuing unit, and this public address management unit 94b issues a pair of a public address PA3 unique to the value information trading platform and a private key SK3 corresponding to this public address PA3. Specifically, as illustrated in FIG. 12 , the content server 3 uses a random number generator or the like to generate the private key SK3 associated with the public address unique to the value information trading platform using public key cryptography. The random number generator may be, for example, built into the public address management unit 94b as a program. As described above, this private key SK3 is used for the electronic signature of a transaction in which the paired public address PA3 is the source of value information transfer (here, a sale from the value information trading platform to buyer Ub).

[0161] Next, the content server 3 generates a public key PK3 from the private key SK3 based on an electronic signature algorithm such as Elliptic Curve Digital Signature Algorithm (ESDSA). The generated public key PK3 and the private key SK3 form a key pair in a public key cryptosystem. Due to the nature of this public key cryptosystem, it is possible to generate the public key PK3 from the private key SK3, but it is impossible to generate the private key SK3 from the public key PK3 in terms of the amount of calculation required. In other words, it is not possible to identify the private key SK3 from the public key PK3, but it is possible to identify the public key PK3 from the private key SK3. Note that the type of electronic signature algorithm used is not limited to Elliptic Curve DSA and may be selected appropriately depending on the embodiment.

[0162] Next, the content server 3 generates a public address PA3 from the public key PK3 by applying a one-way hash function such as SHA-256 or RIPEMD-160 to the public key PK3. For example, the content server 3 can generate a transaction public address PA3 by applying SHA-256 twice to the public key PK3. In other words, this transaction public address PA3 is a hash value of the public key used to sign the transaction described above, and is used to identify the transfer destination and transfer source of the value information. Note that because a one-way hash function is used to generate the transaction public address PA3, as shown in FIG. 12, it is possible to generate the transaction public address PA3 from the public key PK3, but it is configured so that it is not possible to generate the public key PK3 from the transaction public address PA3.

[0163] In the next step S502, the seller Ua, who is the electricity seller, records transaction history data associated with each piece of value information, such as the history of services provided to the value information trading platform, in the node, linking it to the public transaction address PA3 generated in step S501. Specifically, as illustrated in FIG. 13, performance data acquired by the content server 3 is linked to the public transaction address PA3 and made public. This performance data can be freely viewed by anyone who obtains the public key PK3 related to the public transaction address PA3. As a result, anyone can verify whether there has been any fraud or tampering in the history or transaction history of the power generation method, power generation location, etc. from which the value information is derived.

[0164] Then, in step S503, the content server 3 performs a transaction of rights transfer to the public transaction address PA3 generated in step S501 in accordance with predetermined value information transfer conditions. Then, when the transfer is completed, the content server 3 ends the processing related to this operation example. Here, an application executed on the value information control terminal 40 or the like is used to exchange various value information related to this embodiment. Therefore, in Figure 11, an application that executes the mechanism for value information transaction is also installed in the public address management unit 94b of the content server 3, and this application controls the public transaction address managed by the platform.

[0165] While the value information value information belongs to the seller Ua, the value information is stored in the seller Ua's value information control terminal 40, where the public address PAa unique to the seller Ua is associated with the paired private key SKa, and when a transfer procedure is carried out in the value information trading platform, the seller Ua can use the value information control terminal 40 to temporarily transfer the value information from the public address PAa (transfer source) to the trading public address PA3 (transfer destination) generated by the value information trading company in step S501.

[0166] In response to this, a buyer Ub who wishes to purchase new value information can use his / her own value information control terminal 40 to obtain the public key PK3 to which the value information transaction value information is linked, as illustrated in Figure 11, and the buyer Ub can view power generation data, transaction progress information, and related value information-specific history related to the value information linked to the transaction public address PA3 of the value information transaction platform.

[0167] Specifically, an application is also installed in the value information control terminal 40 of the buyer Ub, and this application manages the public address PAb held by the buyer Ub. The buyer's own private key SKb is associated with the public address PAb, which allows the buyer Ub to further transfer value information from his or her public address PAb to another person. In other words, using each private key SKb, the buyer Ub can freely use the value information stored in the public address PAb and its transaction history. Here, the buyer Ub uses the application in the value information control terminal 40 to receive the value information transferred from the transaction public address PA3 specific to the value information transaction to the public address PAb.

[0168] (4) Operation of the Assurance System Here, the mechanism of the distributed ledger system employed in the above-described assurance system will be described in detail. In this embodiment, the assurance system 9 provides a blockchain interface service. This service includes multiple nodes that store at least some or all of the value information data (NFTs, virtual currencies, other objects, etc.) generated by the content server 3. These nodes aggregate the stored data at predetermined times into blocks, use the blocks to form a blockchain, and share the blockchain among the multiple nodes and store it as a distributed ledger.

[0169] 13, when issuing, transferring, or destroying various types of value information, the virtual funeral system according to this embodiment issues a key pair of a public key PKa and a private key SKa based on a public key cryptosystem through the guarantee system 9, and generates a public address PAa from the public key PKa corresponding to the issued value information. This public address PAa is used as an address indicating the transferee (buyer Ub) and transferor (seller Ua) in the value information transaction contract, while the private key SKa is used for the electronic signature of the transaction in which the public address PAa is the transfer source.

[0170] A value information transaction according to this embodiment is carried out between two nodes on a P2P (Peer-to-Peer) network 30 (here, between a seller Ua and a buyer Ub), and the transaction information is broadcast and shared among the nodes 90a to 90f within the P2P network 30. As a result, a transaction history database (a so-called blockchain) based on a distributed ledger system is formed on the P2P network 30, and various types of value information and the transaction history of value information transactions are stored.

[0171] In this embodiment, the transaction history database of this distributed ledger system executes, approves, and manages value information transaction contracts when issuing various types of value information or rewriting owners through the content server 3. In order to mediate transactions between seller Ua and buyer Ub, the intermediary for value information transactions (each value information control terminal 40) generates a public transaction address PA3 unique to the value information transaction platform (content server 3), and relays the transfer of the value information, assuming that the value information being traded is temporarily deposited in the value information transaction platform.

[0172] Then, the parties to the transaction (seller Ua and buyer Ub) use the value information trading system 100 to transfer the value information from the current seller Ua to the public transaction address PA3 specific to the value information trading platform, thereby initially receiving the value information, and then transferring it to the new buyer Ub via the public address PA3, thereby establishing a sales contract for the value information trading platform between seller Ua and buyer Ub.

[0173] As a result, the transferee, buyer Ub, can receive the value information at his or her public address PAb, and can view the service history linked to this public address PA3 and use the service. The public address may be issued by the content server 3, or by software on each transaction user terminal, or by the server of an independent service management institution or financial institution. Here, the detailed mechanism of this electronic cryptocurrency transaction will be explained in detail using Figures 13 to 16. Figure 13 illustrates the definition of transactions (transactions) related to the issuance, transfer, and cancellation of value information, and Figures 14 to 16 illustrate portions of the value information transaction history (blockchain).

[0174] The transaction history regarding the issuance, transfer, and cancellation of each piece of value information is defined as a chain of a series of electronic signatures, as exemplified in FIG. 14. When the owner of each piece of value information transfers its transaction history to the next owner, the owner digitally signs the hash value of the immediately preceding transaction and the hash value of the public key of the next owner with his or her own private key, and adds these to the transaction history of the value information. Note that one-way hash functions such as SHA-256 and RIPEMD-160 are used to calculate these hash values. At this time, when the latest hash value is digitally signed, the hash value is acquired by the hash value acquisition unit 27c as hash value D50 to be used as a base vector for generating environmental value digital art.

[0175] 14 illustrates, as a specific example of a transaction, a scene in which various types of value information are transferred from owner Z to owner A, from owner A to owner B, and further from owner B to owner C. In this case, when transferring value information from owner A to owner B, owner A adds to the value information a hash value of the transfer transaction from owner Z to owner A and a hash value of the public key of owner B, the next owner, digitally signed with owner A's private key.

[0176] Owners of value information after this transaction, including owner B, can determine whether this transaction has been tampered with by comparing the value obtained by decrypting this electronic signature with owner A's public key with the hash value of the transfer transaction from owner Z to owner A and the hash value of owner B's public key. Similarly, when transferring value information from owner B to owner C, owner B adds to the value information the hash value of the transfer transaction from owner A to owner B and the hash value of the public key of owner C, the next owner, digitally signed with owner B's private key. This makes it possible to determine whether the transfer transaction from owner B to owner C has been tampered with.

[0177] Various types of value information can be defined as a chain of such digital signatures. Here, the hash value of the public key is a public address. In other words, the value information stored in this public address can only be transferred by someone who can issue a digital signature for a value information transaction with this public address as the transfer source, i.e., by someone who has the private key corresponding to this public address. For this reason, the private key is generally kept secret so as not to be leaked to anyone other than the owner. Note that the value information and data related to it, such as transaction history, are stored in a public address linked to the current owner. Furthermore, since this digital signature alone cannot verify that any of the past owners of this value information has multiple-used (multiple-transferred) the value information, the value information transaction mechanism according to this embodiment uses a mechanism called a blockchain, exemplified in FIGS. 15 and 16, to prevent this multiple use.

[0178] As illustrated in FIGS. 15 and 16 , each block recorded in the value information stores multiple transactions, a nonce, and the hash value of the immediately preceding block. The nonce is a disposable random value used in cryptographic communications. The node (miner) 90a-90f that first discovers this value acts as the approver and updates the blockchain by adding the block in which the nonce was discovered to the end of the blockchain. This results in a consistent transaction history being recorded in the blockchain. By sharing this blockchain among all nodes 90a-90f participating in the P2P network 30, a consistent transaction history can be shared across the entire P2P network 30. In other words, this blockchain serves as part or all of the value information transaction database 91a and key information database 91b in the assurance system 9 described above. In this embodiment, value information transactions based on public key cryptography involve transactions of various types of value information using this mechanism.

[0179] (Operations and Effects) As described above, this embodiment provides a new format for attending funerals in both virtual and real space. Internet users can participate by operating virtual remote avatars from remote locations, and real users can participate as virtual synchronized avatars via real-world facilities. This allows many people to participate in events to remember and mourn the deceased without being bound by physical distance.

[0180] The virtual space management unit manages and controls the virtual space, including the virtual funeral hall, while the real space management unit acquires geographical elements such as real funeral halls. This enables real-time integration between the real world and the virtual world, providing participants with a highly immersive experience. The capture unit acquires the movements of real users, and the virtual space data generation unit uses this information to generate synchronized avatars and related objects in the virtual space. This allows real-world movements to be reflected in the virtual world in real time, allowing participants to feel as if their actions are actually having an impact in the virtual space.

[0181] Furthermore, the virtual reality display unit displays virtual space data according to the remote avatar's viewpoint, allowing internet users to experience the virtual funeral as if they were participating in it through their own avatar. Also, by digitizing flowers and offerings provided by real users and sharing related information in the virtual space, users can leave a tangible mark on their feelings for the deceased.

[0182] This embodiment realizes a new style of funeral that allows all those who remember the deceased, including those in remote locations, to gather together to mourn the deceased. This system meets the needs of mourning in modern society and brings about innovation in the way people remember the deceased.

[0183] Furthermore, in the virtual funeral system according to this embodiment, for example, information about the flowers and their sender (flower offering information) is presented via a two-dimensional code 21 attached to a flower offering stand 6 displayed on the altar 51 of a funeral hall (temple 5a), and a mechanism is provided in which real users and internet users visiting the funeral hall (temple 5a) can view the flower offering information via an app on their smartphones 1a and 1b.

[0184] Furthermore, in this embodiment, a life simulation model is created using machine learning-based generative AI based on data from the deceased's life (video, audio, written records, etc.), and then appears in the virtual funeral. This deceased avatar is not simply a static digital image, but a dynamic model capable of reproducing the deceased's speech and behavioral patterns, allowing for a certain degree of interaction with virtual funeral attendees (e.g., audio playback of messages from the deceased, recreating their movements, etc.). For example, by recreating the deceased's words and facial expressions, funeral attendees can feel a deeper connection with the deceased, enabling a more immersive memorial experience. Furthermore, this technology can be applied to virtual funerals not only for real deceased individuals, but also for historical figures and fictional characters.

[0185] Furthermore, according to this embodiment, the virtual space data generation unit acquires user input information, and the generative AI recommends the optimal avatar (appearance and clothing), allowing the user to select the appearance of a synchronized avatar or remote avatar from the AI's suggestions. This allows for a virtual space experience optimized for each individual user. By having the AI ​​suggest the optimal avatar, the personalization of the virtual funeral is improved, allowing the user to select appropriate clothing, just as if attending a real funeral, thereby increasing the realism of the virtual space ritual. Furthermore, the costumes and accessories generated by this AI can be sold and purchased, potentially opening up new business opportunities.

[0186] Furthermore, according to this embodiment, a virtual value issuing unit is provided to issue and manage points and digital content that have exchange value for real currency, and when virtual value information is exchanged between users, a certain percentage of the value is treated as a donation. For example, when purchasing or donating flowers or offerings in a virtual space, a portion of the payment amount is automatically donated. This allows transactions in the virtual space to contribute to donations and charitable activities in the real world. By combining this with NFT and blockchain technology, the flow of donations can be visualized and fraud can be prevented. Furthermore, beyond the scope of virtual funerals, the purchase and exchange of digital items can form an economic sphere, enabling integration with virtual currencies.

[0187] The present invention is not limited to the above-described embodiments, and the components can be modified and embodied in practice without departing from the spirit of the invention. Furthermore, various inventions can be created by appropriately combining the components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments.

[0188] OB1...Flower stand (3D object) RA1...Remote avatar SA2...Synchronized avatar U1...Internet user U2...Real user 1 (1a, 1b)...Smartphone 2...Internet 3...Content server 4...Virtual space (virtual funeral) 5...Capture system 5a...Temple 6...Flower stand for altar 11...Communication interface 12...Input interface 12a...Touch panel 12b...Camera 13...Output interface 13a...Display 14...Application execution unit 15...Memory 21...Two-dimensional code 22...Wireless base station 23...Access point 31...Communication interface 32...Location information management unit 33...Authentication unit 34...Distribution unit 34a...Presented information access unit 35a...Real space database 35b...Virtual funeral database 35c...User database 35d...Presented information database 36...Virtual funeral progress unit 36a...Virtual space management unit 36b...Real space management unit 36c...Virtual space data generation unit 36d...User collaboration unit 50...Local server device 51...Altar 52...Camera 63a...Vase unit 63b...Decorative material 64...Name tag unit 64b...Axis unit 112...Movement / action processing unit 141...Virtual funeral condolence call processing unit 142...Synchronization processing unit 143...AR processing unit 144...Position information acquisition unit 145...Output control unit 146...Display data generation unit 501...Capture information acquisition unit 502...Object information generation unit 503...Texture processing unit 504...Model processing unit 505...Data control unit 506...Parameter setting unit 506a...Mouse 506b...Keyboard 507...Object space control unit 508...Virtual camera control unit 509...Rendering processing unit 510...Audio processing unit 511...CPU 512...Memory 513: Communication interface 514: Storage 515: Output interface 516: Input interface

Claims

1. A virtual funeral system that allows internet users to participate in a virtual funeral held in a virtual space as a virtual remote avatar remotely controlled via a content server on a communications network, and allows real users to participate as virtual synchronized avatars through facilities in the real world, comprising: a virtual space management unit that manages and controls a virtual space including a virtual funeral hall set on the coordinates of the virtual space; a real space management unit that acquires geographical elements in the real space, including the three-dimensional outline of the funeral hall set in the real space, on the coordinates of the real space; a capture unit that acquires the real user's current position and movement in the real space; a virtual space data generation unit that generates virtual space data that causes the synchronized avatar and related objects to appear in the virtual space based on the real user's current position and movement acquired by the capture unit; and a distribution unit that distributes the virtual space data so that it can be viewed via a communications network, wherein the virtual space data generation unit causes the internet user's remote avatar to appear in the virtual space in response to the internet user's remote control.

2. The virtual funeral system according to claim 1, further comprising a virtual reality display unit that displays the virtual space data according to the viewpoint of the remote avatar that appears in the virtual space.

3. The virtual funeral system described in claim 2, characterized in that the related objects include 3D data that has been digitized from the actual flowers or offerings provided by the real user, the actual objects are displayed with an identification code that identifies them, and the identification code is linked to presented information about the real user who provided the actual object, the capture unit recognizes the identification code of the actual object, and the virtual space data generation unit displays the presented information linked to the recognized identification code so that it can be viewed in response to a selection operation by the Internet user.

4. A virtual funeral system as described in claim 3, further comprising a presentation information access unit that reads the identification code displayed on the actual object and accesses the presentation information linked to the identification code.

5. The virtual funeral system described in claim 1, characterized in that when generating the virtual space data, the virtual space data generation unit makes the deceased of the virtual funeral appear in the virtual space as a virtual deceased avatar, and the deceased avatar is a life simulation model generated by a generative AI that has undergone machine learning based on data regarding the deceased.

6. The virtual funeral system of claim 1, characterized in that the virtual space data generation unit, when generating the virtual space data, acquires generation control input information entered by the real user or the Internet user, and causes a synchronized avatar or remote avatar with the appearance and clothing recommended by the generation system AI based on the generation control input information to appear in the virtual space in a selectable manner.

7. The virtual funeral system of claim 1, further comprising a virtual value issuing unit that issues points or digital content that have exchange value for real currency as virtual value information, wherein the virtual value issuing unit has the function of calculating a value equivalent to a predetermined percentage of the transferred quantity when the virtual value information is exchanged, and processing the calculated value of the virtual value information as a donation.

8. A virtual funeral method in which internet users participate in a virtual funeral held in a virtual space as a virtual remote avatar remotely controlled via a content server on a communications network, and real users can participate as virtual synchronized avatars through facilities in the real world, comprising: a virtual space management step in which a virtual space management unit manages and controls a virtual space including a virtual funeral hall set on the coordinates of the virtual space via the content server; a real space management step in which a real space management unit acquires geographical elements in the real space including the three-dimensional outline of a funeral hall set in the real space on the coordinates of the real space; a capture step in which a capture unit acquires the real user's current position and movement in the real space; a virtual space data generation step in which a virtual space data generation unit generates virtual space data in which the synchronized avatar and related objects appear in the virtual space based on the real user's current position and movement acquired by the capture unit; and a distribution step in which a communication unit distributes the virtual space data so that it can be viewed via the communications network. A virtual funeral method characterized in that, in the virtual space data generation step, the virtual space data generation unit makes the remote avatar of the Internet user appear in the virtual space in response to remote control by the Internet user.

9. The virtual funeral method of claim 8, further comprising a virtual reality display step in which a virtual reality display unit displays the virtual space data according to the viewpoint of the remote avatar appearing in the virtual space through the content server.

10. The virtual funeral method described in claim 9, characterized in that the related objects include 3D data that has been digitized from the actual flowers or offerings provided by the real user, the actual objects are displayed with an identification code that identifies them, and the identification code is linked to presented information about the real user who provided the actual object, the capture unit recognizes the identification code of the actual object in the virtual space data generation step, and the virtual space data generation unit displays the presented information linked to the recognized identification code in a viewable manner in response to a selection operation by the internet user in the virtual space data generation step.

11. A virtual funeral method as described in claim 10, further comprising a presentation information access step in which a presentation information access unit reads the identification code displayed on the actual object through the content server and accesses the presentation information linked to the identification code.

12. The virtual funeral method described in claim 8, characterized in that in the virtual space data generation step, the virtual space data generation unit, when generating the virtual space data, makes the deceased of the virtual funeral appear in the virtual space as a virtual deceased avatar, and the deceased avatar is a life simulation model generated by a generative AI that has undergone machine learning based on data regarding the deceased.

13. The virtual funeral method described in claim 8, characterized in that in the virtual space data generation step, the virtual space data generation unit acquires generation control input information entered by the real user or the Internet user when generating the virtual space data, and causes a synchronized avatar or remote avatar with the appearance and clothing recommended by the generation system AI based on the generation control input information to appear in the virtual space in a selectable manner.

14. A virtual funeral method as described in claim 8, further comprising a virtual value issuing step in which the virtual value issuing unit issues points or digital content that have exchange value for real currency as virtual value information, and in said virtual value issuing step, said virtual value issuing unit has the function of calculating the value of a predetermined percentage of the transferred quantity when said virtual value information is exchanged, and processing the calculated value of the virtual value information as a donation.

15. A virtual funeral program that allows Internet users to participate in a virtual funeral held in a virtual space as a virtual remote avatar remotely controlled via a content server on a communications network, and allows real users to participate as virtual synchronized avatars through facilities in the real world, the virtual funeral program comprising: a virtual space management unit that manages and controls a virtual space including a virtual funeral hall set on the coordinates of the virtual space; a real space management unit that acquires geographical elements in the real space, including the three-dimensional outline of the funeral hall set in the real space, on the coordinates of the real space; a capture unit that acquires the real user's current position and movement in the real space; a virtual space data generation unit that generates virtual space data that causes the synchronized avatar and related objects to appear in the virtual space based on the real user's current position and movement acquired by the capture unit; and a distribution unit that distributes the virtual space data so that it can be viewed via a communications network, wherein the virtual space data generation unit causes the Internet user's remote avatar to appear in the virtual space in response to remote control by the Internet user.

16. The virtual funeral program described in claim 15, characterized in that the computer further functions as a virtual reality display unit that displays the virtual space data according to the viewpoint of the remote avatar that appears in the virtual space.

17. The virtual funeral program described in claim 16, characterized in that the related objects include 3D data that has been digitized from the actual flowers or offerings provided by the real user, the actual objects are displayed with an identification code that identifies them and the identification code is linked to presented information about the real user who provided the actual object, the capture unit recognizes the identification code of the actual object, and the virtual space data generation unit displays the presented information linked to the recognized identification code so that it can be viewed in response to a selection operation by the internet user.

18. The virtual funeral program described in claim 17, characterized in that the computer further functions as a presentation information access unit that reads the identification code displayed on the actual object and accesses the presentation information linked to the identification code.

19. The virtual funeral program described in claim 15, characterized in that, when generating the virtual space data, the virtual space data generation unit makes the deceased of the virtual funeral appear in the virtual space as a virtual deceased avatar, and the deceased avatar is a life simulation model generated by a generative AI that has undergone machine learning based on data regarding the deceased.

20. The virtual funeral program described in claim 15, characterized in that the virtual space data generation unit, when generating the virtual space data, acquires generation control input information entered by the real user or the Internet user, and causes a synchronized avatar or remote avatar with the appearance and clothing recommended by the generation system AI based on the generation control input information to appear in the virtual space in a selectable manner.

21. The virtual funeral program of claim 15, further comprising causing the computer to function as a virtual value issuing unit that issues points or digital content that have exchange value for real currency as virtual value information, and wherein the virtual value issuing unit has the function of calculating a value that is a predetermined percentage of the transferred quantity when the virtual value information is exchanged, and processing the calculated value of the virtual value information as a donation.

Images