Memorial video system
A networked system using AI to generate memorial videos from still images addresses the lack of pre-existing video data, enabling the creation of personalized videos for the deceased.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- ALLKNOT CO LTD
- Filing Date
- 2024-10-23
- Publication Date
- 2026-05-11
AI Technical Summary
Existing image display systems for the deceased require videos taken during the person's lifetime, making it impossible to create a memorial video for individuals without such footage.
A network-connected system comprising first and second terminals and a server, utilizing artificial intelligence to create a video from still images of the deceased, using reference data to simulate facial expressions and transmit the video to a display device.
Enables the creation of a video memorial portrait for individuals without prior video recordings, allowing families to remember and honor their deceased loved ones.
Smart Images

Figure 2026076030000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a posthumous video system.
Background Art
[0002] In recent years, various proposals have been made regarding inventions for reminiscing about the deceased. For example, Patent Document 1 proposes an image display system capable of simply and realistically displaying a video of the deceased during their lifetime.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] )]]However, in the above-described image display system, in order to display a video of the deceased, a video of the person taken during their lifetime is required. Therefore, there is a problem that a video cannot be displayed for a person who died without having a video taken.
[0005]
Means for Solving the Problems
[0006] To solve the above problems, the memorial video system according to the present invention comprises a plurality of first terminals that can be connected to a network, a plurality of second terminals that can be connected to the network, and a server that can be connected to each of the plurality of first terminals and each of the plurality of second terminals via the network. The server has a server recording device capable of recording data and a server control device that comprehensively controls each part of the server based on the data recorded in the server recording device. The first terminal has a first terminal recording device capable of recording data, a first terminal control device that comprehensively controls each part of the terminal based on the data recorded in the first terminal recording device, and a first terminal display device that displays the operating status of the data recorded in the first terminal recording device. The second terminal has a second terminal recording device capable of recording data, a second terminal control device that comprehensively controls each part of the terminal based on the data recorded in the second terminal recording device, and a second terminal display device that displays the operating status of the data recorded in the second terminal recording device. The server recording device records reference data consisting of a large number of still images and videos of people, still images of the target person, and an application that creates videos based on the still images. When the still image data is transmitted from the first terminal to the server via the network, the server control device records the still image data in the server recording device, creates a video based on the still images using the reference data and the application recorded in the server recording device, transmits the created video to the second terminal via the network, the second terminal control device records the video in the second terminal recording device, and displays the recorded video on the second terminal display device.
[0007] To solve the above problems, the memorial video system according to the present invention comprises a plurality of terminals that can connect to a network, and a server that can connect to each of the plurality of terminals via the network. The server has a server recording device capable of recording data, and a server control device that comprehensively controls each part of the server based on the data recorded in the server recording device. The terminal has a terminal recording device capable of recording data, a terminal control device that comprehensively controls each part of the terminal based on the data recorded in the terminal recording device, and a terminal display device that displays the operating status of the data recorded in the terminal recording device. The server recording device records reference data consisting of a large number of still images and videos of people, still images of the target person, and an application that creates a video based on the still images. When the data of the still images is transmitted from the terminal to the server via the network, the server control device records the data of the still images in the server recording device, creates a video based on the still images using the reference data and the application recorded in the server recording device, and transmits the created video to the terminal via the network. The terminal control device records the video on the terminal recording device and displays the recorded video on the terminal display device. [Effects of the Invention]
[0008] Because the memorial video system according to the present invention has the above configuration, it can display a video memorial portrait even for people for whom no video was taken during their lifetime. [Brief explanation of the drawing]
[0009] The drawings illustrate specific embodiments of the present invention, including not only essential components of the invention but also optional and preferred embodiments. [Figure 1] Figure 1 is a block diagram that conceptually illustrates the memorial video system according to the embodiment. [Figure 2] Figure 2 is a front view showing each of the multiple first terminals and each of the second terminals in the memorial video system shown in Figure 1. [Figure 3] Figure 3 is a block diagram that conceptually explains the server included in the memorial video system shown in Figure 1. [Figure 4] Figure 4 is an explanatory diagram showing the still image sent to the server shown in Figure 3. [Figure 5] Figure 5 is an explanatory diagram showing some images of the video created on the server shown in Figure 3. [Figure 6] Figure 6 is a front view showing the second terminal placed in the Buddhist altar. [Modes for carrying out the invention]
[0010] [Embodiment] Embodiments for carrying out the present invention will be described in detail below with reference to the drawings. The present invention is not limited to the contents described in the following embodiments. Furthermore, the components described below include those that can be easily imagined by those skilled in the art, and those that are substantially the same. Moreover, the components described below can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the present invention.
[0011] [First Embodiment] Figure 1 is a block diagram conceptually illustrating the memorial video system 1 according to this embodiment. Figure 2 is a block diagram conceptually illustrating each of the multiple first terminals 2A and each of the second terminals 2B provided in the memorial video system 1 shown in Figure 1. Figure 3 is a block diagram conceptually illustrating the server 3 provided in the memorial video system 1 shown in Figure 1. Figure 4 is an explanatory diagram showing a still image PI transmitted to the server 3 shown in Figure 3. Figure 5 is an explanatory diagram showing some images of the video DI created in the server 3 shown in Figure 3. Figure 6 is a front view showing the second terminal 2B located in the Buddhist altar BU. The memorial video system 1 according to this embodiment will be described below using Figures 1 to 6.
[0012] The memorial video system 1 in this embodiment comprises, for example, a plurality of first terminals 2A, a plurality of second terminals 2B, and a server 3, as shown in Figure 1. The plurality of first terminals 2A, the plurality of second terminals 2B, and the server 3 are connected to a network (for example, the internet) NT1 by wire or wireless. Furthermore, the first terminals 2A and the server 3 can communicate with each other via the network NT1. In addition, the second terminals 2B and the server 3 can communicate with each other via the network NT1.
[0013] Each of the multiple terminals 2 is a portable electronic computer, such as a smartphone, tablet, or notebook PC (Personal Computer). Each of the multiple terminals 2 is connected to the network NT1 via wireless communication, for example.
[0014] The first terminal 2A is, for example, an information processing terminal used by an ordinary person. The configuration of the first terminal 2A and the configuration of the second terminal 2B are identical. Therefore, in Figure 2, the configuration of the second terminal 2B is shown in parentheses. In the memorial video system 1 according to this embodiment, for example, the first terminal 2A is a smartphone owned by the deceased's grandchild.
[0015] Each of the multiple first terminals 2A includes a first terminal control device 21A and a first terminal recording device 22A, as shown in Figure 2. The first terminal control device 21A comprehensively controls each part of the first terminal 2A. The first terminal recording device 22A stores various data, such as applications that operate each part of the first terminal 2A. Furthermore, the first terminal control device 21A can record various data in the first terminal recording device 22A.
[0016] Furthermore, the first terminal 2A includes, for example, a first terminal display device 23A that displays the operating status of information (e.g., applications, etc.) recorded in the first terminal recording device 22A.
[0017] Furthermore, the first terminal 2A includes, for example, a first terminal operation device such as an operation button displayed on the first terminal display device 23A.
[0018] Furthermore, the first terminal 2A includes a first image acquisition device 24A that is a camera. When the first terminal 2A operates an application related to the camera with the first terminal control device 21A and displays a shooting target on the first terminal display device 23A, and then operates the first terminal operation device, an image of the shooting target is recorded in the first terminal recording device 22A by the first image acquisition device 24A.
[0019] The second terminal 2B is, for example, an information processing terminal used by ordinary people. In the posthumous video system 1 according to the present embodiment, for example, the second terminal 2B is a smartphone owned by the child of the deceased.
[0020] Each of the plurality of second terminals 2B includes a second terminal control device 21B and a second terminal recording device 22B as shown in FIG. 2. The second terminal control device 21B comprehensively controls each part of the second terminal 2B. The second terminal recording device 22B stores various data such as applications that operate each part of the second terminal 2B. In addition, the second terminal control device 21B can record various data in the second terminal recording device 22B.
[0021] Also, the second terminal 2B includes, for example, a second terminal display device 23B that displays the operating state of information (such as an application) recorded in the second terminal recording device 22B.
[0022] Furthermore, the second terminal 2B includes, for example, a second terminal operation device such as an operation button displayed on the second terminal display device 23B.
[0023] Furthermore, the second terminal 2B is equipped with a second image acquisition device 24B, which is a camera. When the second terminal 2B operates the first terminal operating device while the second terminal control device 21B is running a camera-related application and the target to be photographed is displayed on the second terminal display device 23B, the second image acquisition device 24B records an image of the target to be photographed on the second terminal recording device 22B.
[0024] Server 3 is, for example, a computer operated and managed by the operating company that operates the memorial video system 1. Server 3 is, for example, a computer such as a workstation.
[0025] The server 3 shown in Figure 3 is connected to network NT1, for example, via a connection line W. The server 3 is then connected to multiple terminals 2A and 2B via network NT1. The server 3 comprises a server control device 31 and a server recording device 32.
[0026] Furthermore, server 3 includes server input devices 33, such as a mouse 33a and a keyboard 33b, and server output devices 34, such as a display 34a and a speaker 34b.
[0027] The server control device 31 comprehensively controls each part of the server 3. The server recording device 32 stores various data, such as applications that operate each part of the server 3. The server control device 31 can also record data in the server recording device 32.
[0028] The memorial video system 1 according to this embodiment utilizes artificial intelligence technology or deep learning technology.
[0029] For example, the server recording device 32 of server 3 stores multiple reference data sets used in, for example, artificial intelligence or deep learning technologies, and also records applications that create videos based on still images. More specifically, the reference data sets include still images of calm facial expressions of people who are neither smiling nor angry, and videos of people whose calm facial expressions change to smiling expressions. In other words, reference data consisting of a large number of still images and videos of people is recorded in the server recording device 32. For example, the people in the reference data include elderly women and elderly men, but also include facial expressions of various people of all ages and genders.
[0030] In the memorial portrait video system 1 according to this embodiment, as described later, when still image data is transmitted from the first terminal 2A to the server 3 via the network NT1, the server control device 31 records the still image data in the server recording device 32, and uses the application and reference data recorded in the server recording device 32 to create a video based on the still image.
[0031] Next, we will explain the operation of the memorial video system 1 described above.
[0032] The owner of the first terminal 2A, for example, took a still image (see Figure 4) PI of the person PE in question using the first image acquisition device 24A while the person was still alive, and recorded the data of the still image PI in the first terminal recording device 22A.
[0033] Subsequently, the target individual PE died. Therefore, the owner of the second terminal 2B desired a video of the target individual PE and sent still image PI data from the first terminal 2A to the server 3 via network NT1.
[0034] When the server control device 31 receives data of a still image PI from the first terminal 2A via the network NT1 to the server 3, it records the data of the still image PI in the server recording device 32. The still image PI is, for example, an image of the deceased with a calm expression, neither smiling nor angry, as shown in Figure 4.
[0035] Meanwhile, the server control device 31 of server 3 creates a video based on the still image PI, using the still image data, reference data, and application recorded in the server recording device 32.
[0036] More specifically, the server control device 31 uses a still image PI of the deceased, which shows a calm expression that is neither smiling nor angry, as a base to create a video DI of the deceased, which shows a change from a calm expression that is neither smiling nor angry to a smiling expression (see Figure 5). The server control device 31 then records the data of this video DI into the server recording device 32.
[0037] Next, the server control device 31 transmits the video DI data to the second terminal 2B. Upon receiving the video DI data at the second terminal 2, the second terminal control device 21B operates the second terminal operating device, causing the second terminal control device 21B to display the deceased's video DI on the second terminal display device 23B. For example, as shown in Figure 6, with the second terminal 2B placed in the Buddhist altar BU, the second terminal control device 21B displays the deceased's video DI on the second terminal display device 23B.
[0038] As described above, the memorial video system 1 according to this embodiment includes a plurality of first terminals 2A that can be connected to a network NT1, a plurality of second terminals 2B that can be connected to a network NT1, and a server 3 that can be connected to each of the plurality of first terminals 2A and each of the plurality of second terminals 2B via the network NT1. The server 3 has a server recording device 32 that can record data, and a server control device 31 that comprehensively controls each part of the server 3 based on the data recorded in the server recording device 32. The first terminal 2A has a first terminal recording device 22A that can record data, a first terminal control device 21A that comprehensively controls each part of the first terminal 2A based on the data recorded in the first terminal recording device 22A, and a first terminal display device 23A that displays the operating status of the data recorded in the first terminal recording device 22A. The second terminal 2B includes a second terminal recording device 22B capable of recording data, a second terminal control device 21B that comprehensively controls each part of the second terminal 2B based on the data recorded in the second terminal recording device 22B, and a second terminal display device 23B that displays the operating status of the data recorded in the second terminal recording device 22B. The server recording device 32 records reference data consisting of a large number of still images and videos of people, still image PIs of the target person PE, and an application that creates a video DI based on the still image PIs. When data of still image PIs is transmitted from the first terminal 2A to the server 3 via the network NT1, the server control device 31 records the data of the still image PIs in the server recording device 32, creates a video DI based on the still image PIs using the reference data and application recorded in the server recording device 32, and transmits the created video DI to the second terminal 2B via the network NT1. The second terminal control device 21B records the video DI in the second terminal recording device 22B and displays the recorded video DI on the second terminal display device 23B. According to the memorial video system 1 of this embodiment, with the above configuration, even if no video was taken of a person during their lifetime, a video DI of the deceased can be created based on a still image PI, so that the family can remember the deceased.
[0039] In the memorial video system 1 according to the above embodiment, the server control device 31 may create multiple still images (for example, 5) from the video DI and transmit the created multiple still images to the second terminal 2B via the network NT1. The second terminal control device 21B then records the multiple still images in the second terminal recording device 22B and displays the recorded multiple still images on the second terminal display device 23B. By displaying the multiple still images in order at predetermined timings, a slideshow composed of the multiple still images can be displayed on the second terminal display device 23B.
[0040] [Second Embodiment] Next, the memorial video system 1 according to the second embodiment will be described. In the memorial video system 1 according to the second embodiment, the terminal that transmits still images PI and the terminal from which video DI is transmitted from the server 3 are the same. In other words, the memorial video system 1 according to this embodiment comprises a first terminal 2A, which is a terminal, and a server 3.
[0041] In the following description, components of the memorial video system 1 according to the second embodiment that are the same as those of the memorial video system 1 according to the first embodiment will be denoted by the same reference numerals and their descriptions will be omitted.
[0042] The memorial video system 1 according to this embodiment comprises a plurality of first terminals (terminals) 2A that can be connected to a network NT1, and a server 3 that can be connected to each of the plurality of first terminals 2A via the network NT1. The server 3 has a server recording device 32 that can record data, and a server control device 31 that comprehensively controls each part of the server 3 based on the data recorded in the server recording device 32. The first terminals (terminals) 2A have a first terminal recording device (terminal recording device) 22A that can record data, a first terminal control device (terminal control device) 21A that comprehensively controls each part of the first terminal based on the data recorded in the first terminal recording device, and a first terminal display device (terminal display device) 23A that displays the operating status of the data recorded in the first terminal recording device 22A. The server recording device 32 records reference data consisting of a large number of still images and videos of people, still image PI of the target person PE, and an application that creates a video DI based on the still image PI. When still image PI data is transmitted from the first terminal 2A to the server 3 via the network NT1, the server control device 31 records the still image PI data in the server recording device 32, creates a video DI based on the still image PI using the reference data and application recorded in the server recording device 32, and transmits the created video DI to the first terminal via the network NT1. The first terminal control device 21A records the video DI in the first terminal recording device 22A and displays the recorded video DI on the first terminal display device 23A.
[0043] Furthermore, in the above-described embodiment of the memorial video system 1, the first terminal 2A that transmits still image PI is a smartphone. However, this invention is not limited to this. For example, in the above-described embodiment of the memorial video system 1, the first terminal 2A may be a desktop computer. More specifically, a still image is taken with a smartphone different from the first terminal 2A, and then the data of the still image is transferred to the desktop computer. This desktop computer is then the first terminal 2A, and the data of the still image PI is transmitted from this desktop computer to the server 3.
[0044] The above description is based on embodiments of the memorial video system 1 according to the present invention, but the present invention is not limited to these embodiments, and various modifications are possible without departing from the spirit of the invention. Such modifications without departing from the spirit of the invention are also included within the technical scope of the present invention, and this will be clear to those skilled in the art from the description of the claims. [Explanation of symbols]
[0045] 1. Memorial Video System 2 terminals 21A, 21B Terminal control device 22A, 22B Terminal Recording Device 23A, 23B Terminal Display Device 3 servers 31 Server Control Unit 32 Server recording device DI video NT1 Network PI still image PE (Private Exposure) - Persons subject to PE
Claims
1. Multiple first terminals that can connect to the network, Multiple second terminals that can connect to the aforementioned network, A server that can be connected to each of the plurality of first terminals and each of the plurality of second terminals via the network, Equipped with, The server comprises a server recording device capable of recording data, and a server control device that comprehensively controls each part of the server based on the data recorded in the server recording device. The first terminal includes a first terminal recording device capable of recording data, a first terminal control device that comprehensively controls each part of the first terminal based on the data recorded in the first terminal recording device, and a first terminal display device that displays the operating status of the data recorded in the first terminal recording device. The second terminal comprises a second terminal recording device capable of recording data, a second terminal control device that comprehensively controls each part of the second terminal based on the data recorded in the second terminal recording device, and a second terminal display device that displays the operating status of the data recorded in the second terminal recording device. The server recording device records reference data consisting of a large number of still images and videos of people, still images of the target person, and an application that creates videos based on the still images. The aforementioned server control device, When the data of the still image is transmitted from the first terminal to the server via the network, the data of the still image is recorded in the server recording device. The server recording device records the reference data and the application to create a video based on the still images. The created video is transmitted to the second terminal via the network. The second terminal control device records the video on the second terminal recording device and displays the recorded video on the second terminal display device. A memorial portrait video system characterized by the following features.
2. Multiple devices that can connect to the network, A server that can be connected to each of the multiple terminals via the aforementioned network, Equipped with, The server comprises a server recording device capable of recording data, and a server control device that comprehensively controls each part of the server based on the data recorded in the server recording device. The terminal comprises a terminal recording device capable of recording data, a terminal control device that comprehensively controls each part of the terminal based on the data recorded in the terminal recording device, and a terminal display device that displays the operating status of the data recorded in the terminal recording device. The server recording device records reference data consisting of a large number of still images and videos of people, still images of the target person, and an application that creates videos based on the still images. The aforementioned server control device, When the data of the still image is transmitted from the terminal to the server via the network, the data of the still image is recorded in the server recording device. The server recording device records the reference data and the application to create a video based on the still images. The created video is transmitted to the terminal via the network. The terminal control device records the video on the terminal recording device and displays the recorded video on the terminal display device. A memorial portrait video system characterized by the following features.