Image display system, server, display device, image display method, and program

Abstract

To provide an image display system, or the like, which can simply display a realistic image of a deceased person in his or her lifetime so as to suit a memorial service of the deceased person.SOLUTION: An image display system 1 is configured by connecting an imaging system 2, a server 3, and a display system 4 over a network 5 so as to communicate with each other. The imaging system 2 captures an image of a registered member in his or her lifetime, and uploads the image to the server 3. The server 3 stores member information 321 or living image data 323, or the like, of the registered member. In the living image data 323, a living image 323c is stored in association with a member ID 321a or an AR trigger 323d. The display means 4 includes a board 43 or a screen 43A having a marker 42 serving as the AR trigger 323d, and a display device 41. The display device 41 acquires the living image 323c associated with the marker 42 from the server 3, and AR-displays the image (superimposed on a real space as a background) when recognizing the marker 42.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an image display system, a server, a display device, an image display method, and a program, and more particularly to an image display technology suitable for memorial services for the deceased. [Background technology]

[0002] Regarding the display of images for memorial services for the deceased, for example, Patent Document 1 discloses a funeral method that combines a screen installed at the funeral altar with a slide projector, a video projector, and a switching means for switching between these two types of projectors, and uses the slide projector to project still images of the deceased onto the screen at the start and end of the funeral to ensure a solemn atmosphere at the funeral, and during the eulogy, projects video or slide images of the deceased's activities while they were alive onto the screen, thereby leaving a vivid impression of the deceased in the memories of those attending.

[0003] Furthermore, with regard to the management and distribution of data left behind by the deceased during their lifetime, Patent Document 2 discloses an Internet Buddhist altar system in which, based on death information from a death information providing server and will information from a will information management server, an information management server distributes document data, image data, and other information left behind by the deceased during their lifetime to an Internet Buddhist altar server, and the Internet Buddhist altar server distributes document data, image data, and other information left behind by the deceased during their lifetime to the terminals of the deceased's surviving family members, etc., in response to a distribution request from the deceased's surviving family members, etc., so that people who were friends with the deceased during their lifetime in online communities, etc., and the deceased's surviving family members, etc., can easily view information such as document data, image data, etc. left behind by the deceased during their lifetime.

[0004] Patent document 3 also describes an invention related to the transmission of pre-death messages, in which the trustor records the message they wish to convey to their surviving family and attendees at a future funeral using their own voice or image, and entrusts this as a pre-death message to the trustee via an information transmission means, the trustee stores the entrusted pre-death message in a database as recorded information, and when information of the trustor's death is obtained, the trustor reads the pre-death message from the database and sends it to a specific funeral home via the Internet, and the funeral home discloses the pre-death message at the funeral.

[0005] Patent Document 4 describes a deceased person information management system that records information about a specified subscriber (such as voice data and image data of the specified subscriber while he / she is alive, and voice data, image data, or other data of copyrighted works created by the specified subscriber while he / she is alive) in a database based on the wishes of the specified subscriber who subscribes to the telephone service provided by a telecommunications carrier, and provides that information to other specified subscribers after the death of the specified subscriber. This makes it possible to notify other specified subscribers of messages or images that the specified subscriber wanted to convey when the death of the specified subscriber is confirmed.

[0006] Regarding funeral services using the Internet, Patent Document 5 discloses a cloud-based perpetual memorial service system. This system, accessible from a terminal by members who signed a service contract while they were alive or their surviving family members, stores each member's personal information, digital content provided by each member, and instruction data describing each member's wishes regarding post-death handling on an Internet-based perpetual memorial site. It also stores a death register and video data of a virtual worship facility generated based on these. This system not only enables worship services to be held on the cloud, but also accurately reflects the deceased's wishes regarding post-death operations, preserves the data the deceased wished to preserve, and safely disseminates the deceased's career and achievements, making them available for third parties to search on search engines. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Publication No. 10-0243871 [Patent Document 2] Japanese Patent Application Laid-Open No. 2008-009579 [Patent Document 3] Japanese Patent Application Laid-Open No. 2009-032220 [Patent Document 4] Japanese Patent Application Laid-Open No. 2009-038708 [Patent Document 5] Japanese Patent Application Publication No. 2018-081656 Summary of the Invention [Problem to be solved by the invention]

[0008] However, as mentioned above, although many technologies have been proposed to preserve messages (audio and images) and data left by the deceased during their lifetime and provide them to their bereaved families, there is still room for improvement in terms of displaying them in a way that will resonate with the bereaved families.

[0009] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an image display system etc. that can easily and realistically display images of the deceased when they were alive, and is suitable for memorial services for the deceased. [Means for solving the problem]

[0010] In order to achieve the above-mentioned object, the first invention is an image display system comprising: a storage means for storing images of the deceased person taken during their lifetime, linked to an AR trigger that triggers AR display; and a display means for, upon recognition of the AR trigger, retrieving from the storage means and displaying the image taken during their lifetime linked to the recognized AR trigger; the image display system further comprising a member registration means for performing member registration processing in order to use the image display system; wherein images taken during their lifetime of multiple members, each registered separately by the member registration means, are linked to one AR trigger and stored; and the display means reads out and displays the corresponding image taken during their lifetime from the storage means based on the input member information.

[0011] According to the image display system of the first invention, an image of the deceased person taken while they were alive is linked to an AR (Augmented Reality) trigger and stored in a storage means. When the display means recognizes the AR trigger, the image of the deceased taken while they were alive that is linked to the recognized AR trigger is retrieved from the storage means and displayed. This allows the image of the deceased taken while they were alive to be displayed in augmented reality against the backdrop of real space, making it easier to remember the deceased and focus on them. Furthermore, because the image can be easily displayed using AR technology, it can be used on various occasions for memorial services, making it possible to make memorial services a habit and maintain a spirit of mourning for the deceased. Furthermore, the augmented reality display makes it possible to feel closer to the deceased.

[0012] In the first invention, the system may further include a viewing member registration means for accepting registration as a viewing member in association with a member registered by the member registration means, and the display means may read out from the storage means and display an image of the member in his / her lifetime associated with the viewing member on the display means when the display means logs in as the viewing member.

[0013] The device may further include a setting unit for accepting the setting of the AR trigger.

[0014] The display means may also include a board that displays a marker that serves as the AR trigger, and a display device that includes a camera that reads the marker displayed on the board and a display that displays the image of the person before death.

[0015] The display device may be a display device equipped with a glasses-type or goggle-type display.

[0016] The second invention is a server comprising a storage means for storing an image of the deceased person taken before death, linked to an AR trigger that triggers AR display; an image transmission means for transmitting the image taken before death to a display means that, upon recognizing the AR trigger, retrieves the image taken before death linked to the AR trigger from the storage means and displays it; and a member registration means for performing member registration processing to use the image display system, wherein the storage means stores images taken before death of multiple members who are each registered separately by the member registration means, linked to one AR trigger, and the display means reads out and displays the corresponding image taken before death from the storage means based on input member information.

[0017] The second invention provides a server that stores an image of the deceased person taken before they died, linked to an AR trigger, and transmits the image of the deceased taken before they died linked to the recognized AR trigger to the display means when the display means recognizes the AR trigger.

[0018] The third invention is a display device equipped with a display, comprising: a communication means for communicating with a server equipped with a member registration means for performing member registration processing; a recognition means for recognizing an AR trigger that triggers AR display; and a display means for, when the recognition means recognizes the AR trigger, acquiring an image of the deceased person in his / her lifetime that is stored in the memory means of the server and linked to the recognized AR trigger, and displaying the image on the display; wherein the memory means stores images of the deceased in their lifetime of multiple members who are each registered separately by the member registration means, linked to one AR trigger; and the display means reads out and displays the corresponding image in his / her lifetime from the memory means based on the input member information.

[0019] The third invention provides a display device that communicates with a server to obtain images of the deceased person taken while they were alive, and when an AR trigger is recognized, displays on the display the images of the deceased taken while they were alive that are stored and linked to the recognized AR trigger.

[0020] The fourth invention is an image display method characterized by including the steps of: a server performing a member registration process; the server storing an image of the deceased person taken during their lifetime in a memory unit, linking the image of the deceased person taken during their lifetime to an AR trigger that triggers AR display, and storing the image of the deceased taken during their lifetime of multiple members who are each registered as members separately for one AR trigger; and a display device, upon recognizing the AR trigger, retrieving and displaying the corresponding image taken during their lifetime that is linked to the recognized AR trigger and based on the input member information.

[0021] According to the fourth invention, an image of the deceased person from their lifetime is linked to an AR trigger and stored in a memory unit. When the display device recognizes the AR trigger, the image of the deceased from their lifetime linked to the recognized AR trigger is retrieved from the server's memory unit and displayed. This allows the image of the deceased from their lifetime to be displayed in augmented reality with the real world as the background, making it easier to remember the deceased and focus on them. Furthermore, because the image can be easily displayed using AR technology, it can be used on various occasions for memorial services, making it possible to make memorial services a habit and maintain a spirit of mourning for the deceased. Furthermore, the augmented reality display makes it possible to feel closer to the deceased.

[0022] The fifth invention is a program for causing a computer to function as a server comprising a storage means for storing images of the deceased person taken before their death in association with an AR trigger that triggers AR display, an image transmission means for transmitting the images taken before their death to a display means that, upon recognizing the AR trigger, retrieves the images taken before their death that are associated with the AR trigger from the storage means and displays them, and a member registration means for performing member registration processing, wherein the storage means stores images taken before their death of multiple members who are each separately registered by the member registration means in association with one AR trigger, and the program causes the display means to read out and display the corresponding images taken before their death from the storage means based on input member information.

[0023] According to the fifth aspect of the present invention, it is possible to make a computer function as the server of the second aspect of the present invention.

[0024] The sixth invention is a program for causing a display device having a display to function as a communication means for connecting to a server having a member registration means for performing member registration processing, a recognition means for recognizing an AR trigger that triggers AR display, and a display means for, when the recognition means recognizes the AR trigger, acquiring an image of the deceased person before their death that is stored in the memory unit of the server and linked to the recognized AR trigger, and displaying the image on the display, wherein the memory unit stores images of multiple members who have been registered separately by the member registration means, each linked to a single AR trigger, and the display means is a program that reads out the corresponding image before their death from the memory unit based on the input member information and displays it.

[0025] According to the sixth aspect of the present invention, the display device can function as the display means in the image display system of the first aspect of the present invention, or as the display device of the third aspect of the present invention. [Effects of the Invention]

[0026] According to the present invention, it is possible to provide an image display system etc. that can easily and realistically display images of the deceased when they were alive and is suitable for memorial services for the deceased. [Brief explanation of the drawings]

[0027] [Figure 1] FIG. 1 shows the overall configuration of an image display system 1. [Figure 2] Block diagram showing the hardware configuration of the imaging system 2 [Figure 3] FIG. 10 shows the data structure of member information 321 stored in the server 3. [Figure 4] FIG. 10 shows the data structure of the image data 322 for a memorial portrait stored in the server 3. [Figure 5] FIG. 10 is a diagram showing the data structure of pre-mortem image data 323 stored in the server 3. [Figure 6] Hardware configuration of Server 3 [Figure 7] 1 is a block diagram showing the hardware configuration of a display device 41. [Figure 8] 1 is a diagram showing the functional configuration of a control device 21, a server 3, and a display device 41 of an image display system 1. [Figure 9] FIG. 10 shows the data structure of member information 321A linked to information on browsing members 321e. [Figure 10] Examples of the AR trigger 323d in the display system 4. (a) An example in which the image 42a and the frame 42b displayed on the board 43 are used as the AR trigger 323d. (b) An example in which an arbitrary image (memorial tablet 42c) is used as the AR trigger 323d. [Figure 11] An example in which a frame 42d or an image 42e displayed on a screen 43A is used as an AR trigger 323d [Figure 12] Display example (appearance) of the pre-death image 323c on the board 43 in FIG. 10(a) [Figure 13] Display example (appearance) of premortem image 323c on screen 43A in FIG. 11 [Figure 14] A diagram illustrating the flow of funeral services using the image display system 1. [Figure 15] Flowchart showing the flow of member registration processing [Figure 16] Flowchart showing the flow of antemortem image capture processing [Figure 17] Flowchart showing the flow of display processing [Figure 18] FIG. 10 is a diagram illustrating a flow of a service using the image display system 1 of the second embodiment. [Figure 19] FIG. 10 is a diagram showing an example of antemortem image data 323 in which a validity period 323e is set. [Figure 20] FIG. 10 is a diagram showing the functional configuration of an image display system 1 according to a second embodiment. [Figure 21] 10 is a flowchart illustrating the flow of display processing in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0029] [First embodiment] First, a second embodiment of the present invention will be described. Fig. 1 is a diagram showing the overall configuration of an image display system 1 according to the present invention. The image display system 1 is configured by a server 3 and a display system 4 that are communicatively connected via a network 5. Furthermore, an imaging system 2 is communicatively connected to the server 3 via the network 5 as necessary.

[0030] The photography system 2 is a photography means including, for example, a camera 22 and a control device 21. The photography system 2 takes images (still images or video) of registered member A (deceased person) who uses the image display system 1 while he or she is still alive. Hereinafter, images taken while he or she is still alive will be referred to as "images before death." The subject of photography is a person who registered as a member to use the image display system 1 while he or she was still alive.

[0031] Camera 22 is a camera used by a photography company (cameraman) or a fixedly installed camera. When camera 22 takes an image of a registered member while he or she was alive, it issues a photography ID that is identification information for the image, and transmits the taken image (still image or video) and the photography ID to control device 21. The communication connection between camera 22 and control device 21 may be either wired or wireless.

[0032] Control device 21 is a terminal (such as a PC or tablet) that performs image processing as necessary on images captured by camera 22 and uploads the images to server 3, and includes control unit 201, storage unit 202, communication unit 203, input unit 204, display unit 205, peripheral device I / F unit 206, and bus 209. Note that the camera 22 may have a configuration in which the functions of control device 21 are included, or control device 21 may be integrated with camera 22 (such as a tablet with a camera).

[0033] The control unit 201 includes a CPU (Central Processing Unit). Processing Unit), ROM (Read Only Memory) Only Memory), RAM (Random The CPU loads programs stored in the storage unit 202, ROM, recording media, etc. into a work memory area on the RAM and executes them, and drives and controls each device connected via the bus 209.

[0034] The storage unit 202 is a flash memory, an HDD (Hard Disk Drive), or the like, and stores programs executed by the control unit 201, data necessary for program execution, an OS (Operating System), etc. As for programs, a control program equivalent to an OS and an application program for acquiring images from the camera 22, processing the images, and uploading the images to the server 3 are stored. These program codes are read out as needed by the control unit 201 and transferred to the RAM, and then read out by the CPU and executed as various means.

[0035] The communication unit 203 has a communication control device, a communication port, etc., and is a communication interface that mediates communication between the control device 21 and the network 5, and is capable of controlling communication with the server 3 and other computers via the network 5. The network 5 includes a LAN (Local Area Network), a WAN (Wide Area Network) that is connected over a wider area, or a public communication line such as the Internet, a base station, etc. The network 5 may be wired or wireless.

[0036] The display unit 205 is realized by a display device such as a liquid crystal display, or a display with a touch panel that also serves as the input unit 204. The display unit 205 displays various screens related to user operations and selections, and accepts user input of instructions by touching the screen. The input unit 204 is composed of the above-mentioned touch panel, or a keyboard, a mouse, various buttons, etc., and inputs input signals to the control unit 201.

[0037] The peripheral device I / F unit 206 is a port for connecting peripheral devices, and transmits and receives data to and from peripheral devices such as the camera 22 via the peripheral device I / F unit 206. The connection with the peripheral device may be wired or wireless. While the example in FIG. 2 shows an example in which one camera 22 is connected to the control device 21 via the peripheral device I / F unit 206, there may be multiple cameras 22. The bus 209 is a path that mediates the transmission and reception of control signals, data signals, etc. between the devices.

[0038] Next, a description will be given of the server 3. The server 3 is a computer that stores and manages member information 321, image data for a memorial portrait 322, and image data 323 in the image display system 1, as shown in FIG.

[0039] Member information 321 is information about a registered member (user A) who has registered to use image display system 1. FIG. 3 is a diagram showing an example of the data configuration of member information 321. As shown in FIG. 3, member information 321 stores member ID 321a, password 321b, member's personal information 321c, contact information 321d of the member's relatives, etc. Personal information 321c is personal information of user A, such as user A's address, name, date of birth, and email address, entered in the member registration process performed between user A's terminal (not shown) and server 3 via a website or dedicated app set up by the administrator of image display system 1, etc. Member ID 321a is identification information of the member set in the member registration process. Password 321b is an authentication password required when logging in to image display system 1.

[0040] FIG. 4 is a diagram showing an example of the data configuration of the memorial portrait image data 322. The memorial portrait image data 322 is data for managing a memorial portrait image 322b used as a memorial portrait of a registered member. As shown in FIG. 4, a member ID 322a, a photography ID 322b, and a memorial portrait image 322c are stored in association with each other. The memorial portrait image 322c is an image of a registered member taken before death by a terminal of registered member user A or a camera of a funeral director, and is uploaded to the server 3 and stored in the storage unit 302. The member ID 322a is the member ID 321a (FIG. 3) of the member information 321 of the image display system 1. The photography ID 322b is information for identifying the memorial portrait image 322c, and is assigned to each memorial portrait image 322c when it is photographed or registered.

[0041] The pre-death image data 323 is data for managing pre-death images 323c (still images or video). The pre-death images 323c are images taken of the registered member (user A) before his / her death. The pre-death images 323c are uploaded from the control device 21 of the photography system 2 to the server 3 and stored in the storage unit 302 of the server 3. In this embodiment, an example is described in which the pre-death images 323c are taken by the camera 22 of the photography system 2 provided by a funeral director or the like, but the present invention is not limited to this. Images may be taken by the registered member (user A) himself / herself, or by his / her family, relatives, acquaintances, etc. and uploaded to the server 3 from any terminal. The memorial portrait image 322c is a still face photograph to be used at a funeral or the like, but the pre-death images 323c may be video or full-body images, or may show activities that user A engaged in before his / her death.

[0042] Fig. 5 is a diagram showing an example of the data configuration of the pre-death image data 323. As shown in Fig. 5, the pre-death image data 323 is stored in association with a member ID 323a, an image ID 323b, a pre-death image 323c, an AR trigger 323d, etc. The member ID 323a is the member ID 321a of the member information 321 of the image display system 1. The image ID 323b is identification information of the pre-death image 323c, and is assigned to each pre-death image 323c.

[0043] The image 323c shows the AR (Augmented Reality) The pre-mortem image 323c is stored in association with an AR trigger 323d, which is a trigger for an augmented reality (Augmented Reality) display. By associating the pre-mortem image 323c with the AR trigger 323d, an augmented reality display can be performed. Specifically, for example, when a marker-type (image recognition-type) AR trigger 323d is recognized by the camera 406 of the display device 41, the pre-mortem image 323c can be superimposed and displayed in real space. The AR trigger 323d is not limited to markers such as simple, clear black and white figures, but may be a specific photograph, illustration, text, or the like. The AR trigger 323d may also be a position-recognition-type AR trigger 323d triggered by position information (GPS information), a space-recognition-type AR trigger 323d triggered by real-world space (height difference, size, depth, etc.) via a camera or sensor, an object-recognition-type (3D recognition-type) AR trigger 323d triggered by a specific three-dimensional solid object, or a voice-recognition-type AR trigger 323d triggered by voice information obtained by a microphone, etc. Setting the AR trigger 323d will be described later.

[0044] The premortem image 323c is not limited to a two-dimensional image, but may be a three-dimensional image drawn in a three-dimensional image space in the x, y, and z directions.

[0045] In response to a request from the display device 41 of the display system 4, the server 3 transmits the pre-mortem image data 323 stored in the storage unit 302 to the display device 41 of the display system 4.

[0046] Fig. 6 is a diagram showing the hardware configuration of the server 3. As shown in Fig. 6, the server 3 can be realized by a computer configured by connecting, for example, a control unit 301, a storage unit 302, and a communication unit 303 via a bus 309. However, the configuration is not limited to this and various other configurations can be used as appropriate.

[0047] The functions of the control unit 301, the storage unit 302, and the communication unit 303 are substantially the same as those of the control unit 201, the storage unit 202, and the communication unit 203 described above. The storage unit 302 of the server 3 stores programs for causing the server 3 to execute the member registration process, the pre-death image capturing process, and the display process, which will be described later. Each of these processes will be described later. The server 3 may be configured with multiple computers for each function. For example, the server 3 may be configured with multiple computers, such as a member registration server, an image storage server, and an image transmission server, and the processes may be shared.

[0048] Next, the display system 4 will be described. The display system 4 shown in Fig. 1 includes a display device 41, a board 43 on which a marker 42 serving as an AR trigger 323d is printed or attached, and the like. The display device 41 is a device used by the user to view the premortem image 323c acquired from the server 3, and may be, for example, a glasses-type or goggle-type display device called smart glasses or a head-mounted display, or may be a tablet, a smartphone, a PC monitor, or the like. In this embodiment, the display device 41 will be described using smart glasses as an example.

[0049] The smart glasses (display device 41) are a wearable device worn on the head like eyeglasses. The smart glasses (display device 41) have a main body and a display (display unit) 405. The main body has a control unit 401, a memory unit 402, a communication unit 403, an input unit 404, a camera 406, a microphone 407, a speaker 408, a peripheral device I / F unit 409, a location information acquisition unit (GPS) 410, a sensor 411, etc. The display (display unit) 405 has a transparent display, allowing the user to view the image displayed on the display with the real space as the background. This allows the user to overlay the pre-mortem image 323c on the real space.

[0050] Fig. 7 is a diagram showing the hardware configuration of the display device 41. As shown in Fig. 7, the display device 41 is configured by connecting a control unit 401, a storage unit 402, a communication unit 403, an input unit 404, a display (display unit) 405, a camera 406, a microphone 407, a speaker 408, a peripheral device I / F unit 409, a position information acquisition unit 410, a sensor 411, and the like via a bus 419. However, the configuration of the display device 41 is not limited to this, and various other configurations may be used as appropriate. For example, the display device 41 may be configured by connecting a controller 412 equipped with various operation buttons and the like to the peripheral device I / F unit 409.

[0051] The control unit 401 is composed of a CPU, a ROM, a RAM, etc. The CPU loads programs stored in the storage unit 402, the ROM, a recording medium, etc. into a work memory area on the RAM and executes them, driving and controlling each unit connected via a bus 419. The ROM permanently stores programs such as the computer's boot program and BIOS, as well as data. The RAM temporarily stores loaded programs and data, and also has a work area used by the control unit 401 to perform various processes. The control unit 401 functions as each functional unit of the display device 41 by reading and executing the programs.

[0052] 8, the control unit 401 of the display device 41 functions as a login processing unit 44, an image acquisition unit 45, an AR trigger recognition unit 46, an image display unit 47, etc. Details of each unit will be described later.

[0053] The storage unit 402 of the display device 41 is, for example, a storage device such as a flash memory. The storage unit 402 stores programs executed by the control unit 401, data necessary for program execution, an operating system, etc. These program codes are read out by the control unit 401 as needed and transferred to RAM, and then read out and executed by the CPU. The storage unit 402 also stores a program for executing a display process, which will be described later. The display process will be described in detail later.

[0054] The communication unit 403 has a communication device such as a wireless LAN, Bluetooth (registered trademark), infrared, or short-range wireless communication, and controls communication with the network 5, etc., communication with Bluetooth-compatible devices, or communication with a contactless IC card, etc. The display device 41 is connected to the server 3 via the network 5 for communication, and is capable of sending and receiving various data including the antemortem image data 323.

[0055] The location information acquisition unit 410 is a GPS (Global Positioning System) The location of the device may be detected by a signal from a satellite, such as the GPS Positioning System, or by the strength of radio waves from a wireless base station for mobile phones or an access point for Wi-Fi communication. The location information acquisition unit 410 notifies the control unit 401 of the acquired location information.

[0056] The sensor 411 includes, for example, a nine-axis sensor (geomagnetic sensor, acceleration sensor, gyro sensor), and acquires information on the direction in which the display device 41 is facing, its attitude (tilt and rotation), and its movement.

[0057] The display 405 (display unit) is a see-through display device, and is provided, for example, in each of the eye sections of the display unit of the smart glasses. The display 405 displays display information input under the control of the control unit 401. The display on the display 405 may be either 2D (two-dimensional display) or 3D (stereoscopic display).

[0058] The camera 406 includes a center camera arranged in the center of the display device 41 and stereo cameras arranged on the left and right sides. The microphone 407 inputs surrounding sounds and transmits them to the control unit 401. The speaker 408 outputs the sounds transmitted from the control unit 401. The camera 406 is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide The camera 406 of the display device 41 is a camera that uses an imaging element such as a GaN (GaN Semiconductor) image sensor, and captures moving or still images. In the present invention, the camera 406 of the display device 41 is used for recognizing the AR trigger 323d, etc.

[0059] The peripheral device I / F unit 409 is a port for connecting peripheral devices, and data is sent and received to and from the peripheral devices via the peripheral device I / F unit 409. The connection with the peripheral devices may be wired or wireless. The display device 41 is connected to a controller 412 and the like via the peripheral device I / F unit 409.

[0060] The controller 412 has a touch panel display, a communication I / F, various buttons, etc., and inputs operation instructions to the smart glasses (display device 41) by operating the touch panel or buttons. Operation instructions to the smart glasses (display device 41) may be input not only from the controller 412, but also by voice instructions via the microphone 407. Furthermore, an operation screen, etc. may be displayed on the smart glasses (display device 41), and hand movements, etc. may be recognized by the camera 406 to perform operations (gesture operations) on the operation screen, etc.

[0061] Next, the functional configuration of the image display system 1 will be described with reference to Fig. 8. As shown in Fig. 8, the control device 21 of the photography system 2 has a photography processing unit 25, an image processing unit 26, and an image upload unit 27. The server 3 has a member registration unit 31, an image acquisition unit 32, a storage unit 302, an image transmission unit 34, an AR trigger setting unit 35, etc. The display device 41 has a login processing unit 44, an image acquisition unit 45, a storage unit 402, an AR trigger recognition unit 46, an image display unit 47, etc.

[0062] The photographing processing unit 25 of the control device 21 photographs images of registered members before their death using one or more cameras 22. The photographing method is arbitrary, but should be in accordance with the display method in the display system 4.

[0063] The image processing unit 26 of the control device 21 takes in the image data captured by the imaging processing unit 25 and generates a pre-mortem image 323c. The image processing unit 26 accepts editing operations for the captured image data to edit a movie, perform background transparency processing, generate a three-dimensional image, etc.

[0064] The image processing unit 26 also associates the generated pre-mortem image 323c with an AR trigger 323d. The AR trigger 323d may be a marker-type AR trigger that uses a predetermined graphic, image, or the like as a trigger for AR display, or may be any graphic or image generated by a user or the like using the control device 21. Other information (position information, space information, audio information, three-dimensional object information, etc.) may also be set as the AR trigger 323d.

[0065] The image upload unit 27 of the control device 21 uploads the captured and generated pre-life image 323c to the server 3. The image upload unit 27 transmits the member ID 321a (323a), the image ID 323b issued by the control device 21, and the AR trigger 323d together with the pre-life image 323c.

[0066] The image acquisition unit 32 of the server 3 receives the pre-mortem image 323c, the member ID 321a (323a), the image ID 323b, and the AR trigger 323d transmitted from the photography system 2 (control device 21), and stores them in the storage unit 302 as pre-mortem image data 323.

[0067] The image transmission unit 34 of the server 3 transmits the corresponding pre-mortem image data 323 in response to a request from the display system 4 (the display device 41).

[0068] The member registration unit 31 of the server 3 performs member registration processing for a user of the image display system 1 (user A; the person photographed in the pre-death image 323c). The member registration unit 31 provides a predetermined member registration screen via, for example, a website or app operated by a funeral home or the operator of the image display system 1, and accepts input of information required for member registration from user A's terminal (not shown). When personal information 321c such as user A's address, name, date of birth, and email address, and contact information 321d of relatives, etc. are entered on the member registration screen, the member registration unit 31 of the server 3 issues a member ID 321a and a password 321b, and stores them together with the entered information (personal information 321c, contact information 321d, etc.) as member information 321 in the storage unit 302 of the server 3. When member registration is completed, the member registration unit 31 transmits a registration completion notice to user A's terminal. The member registration unit 31 also accepts registration as a browsing member (user B) linked to the registered member (user A). A viewing member is a member who is permitted to view the before-life images 323c of a registered member (user A). To register as a viewing member, for example, the member ID 321a and password 321b of the registered member (user A) are entered. The member registration unit 31 issues a viewing member ID 321e and a viewing password, and registers them in association with the member information 321 of the registered member (user A).

[0069] 9 is a diagram showing member information 321A linked to information on browsing members. As shown in FIG. 9, one or more browsing member IDs 321e are stored linked to member IDs 321a, etc. of registered members.

[0070] The AR trigger setting unit 35 accepts setting of an AR trigger 323d to be linked to the pre-mortem image 323c. The AR trigger 323d may be set by a funeral director or an operator of the image display system 1, or a user (registered member or browsing member) may set a desired object (a graphic, an arbitrary image, a code, audio information, position information, spatial information, object information, etc.) as the AR trigger 323d. Furthermore, when a pre-mortem image 323c to which an AR trigger 323d is not linked is uploaded, the control unit 301 of the server 3 may link a predetermined AR trigger 323d to the pre-mortem image 323c.

[0071] FIG. 10(a) illustrates an example in which an image 42a (an arbitrary image such as a Buddha statue) drawn on a board 43 is set as the AR trigger 323d, and a frame 42b drawn around the periphery of the board 43 is set as the AR trigger 323d. FIG. 10(b) illustrates an example in which a user (registered member or browsing member) sets a desired object as the AR trigger 323d. The example in FIG. 10(b) illustrates an example in which, after the death of a registered member, a relative sets a memorial tablet 42c as the AR trigger 323d. In this case, the browsing member logs in to the server 3 using the member ID 321a or browsing member ID 321e of the registered member (deceased), takes a photo of the AR trigger (memorial tablet 42c) to be registered using a device (not shown) such as a smartphone or tablet, and uploads the image to the server 3. The AR trigger setting unit 35 stores the registered image as the AR trigger 323d by linking it to the image data 323 linked to the member ID 321a.

[0072] When the image display system 1 of the present invention is used at the home of the deceased or a relative, an image of something to be seen at a memorial service (such as a Buddhist statue or Buddhist altar implements) can be set as the AR trigger 323d, as shown in Fig. 10. When the image display system 1 is used in a large venue such as a funeral hall, an image displayed on a large screen or screen 43A, or a portion of that image 42e, or a screen frame 42d, can be set as the AR trigger 323d, as shown in Fig. 11, so that many people can view the image at the same time. In this case, the procedure for registering the AR trigger 323d is the same as for the memorial tablet 42c.

[0073] In addition, location information obtained by GPS or the like may be used as the AR trigger 323d. For example, location information of a home or a cemetery may be set as the AR trigger 323d. Also, audio information may be used as the AR trigger 323d. For example, a specific spoken voice such as "hello" or the sound data of a bell (ring) may be set as the AR trigger 323d. In these cases, a browsing member logs in to the server 3 using the member ID 321a or browsing member ID 321e of a registered member, inputs information (location information, audio information, etc.) of the AR trigger 323d to be registered on a device (not shown) such as a smartphone or tablet, and uploads the input location information, audio information, etc. to the server 3. The AR trigger setting unit 35 stores the registered location information and audio information in association with the pre-death image data 323 associated with the member ID 321a. Furthermore, multiple AR triggers 323d may be associated with one pre-death image 323c, or multiple pre-death images 323c may be associated with one AR trigger 323d.

[0074] Returning to the explanation of FIG. 8 , the login processing unit 44 of the display device 41 performs login processing so that user B (viewing member) who is holding a memorial service for the deceased (registered member) can use the image display system 1. In the login processing, user B inputs user A's member ID 321a and password 321b from the input unit 404 or controller 412 of the display device 41. Alternatively, a QR code (registered trademark) containing user A's member ID 321a and password 321b is printed, attached, or displayed on the board 43, screen 43A, or the like of the display system 4, and the QR code is read by the camera 406 of the display device 41. The login processing unit 44 accesses the server 3 using the input or read member ID 321a and password 321b, and performs login processing with the server 3. If authentication is successful, login is completed, and the image display system 1 can be used. If user B is a viewing member, user B logs in to the server 3 using the viewing member ID 321e and viewing password.

[0075] When the login is completed, the image acquisition unit 45 requests the server 3 to acquire the corresponding pre-death image data 323 based on the login information (member ID 321a or browsing member ID 321e). When the pre-death image data 323 is transmitted from the image transmission unit 34 of the server 3, the image acquisition unit 45 receives the pre-death image data 323 and stores it in the storage unit 402. The pre-death image data 323 is associated with information on an AR trigger 323d that serves as a display trigger.

[0076] The AR trigger recognition unit 46 recognizes the AR trigger 323d. For example, if the AR trigger 323d is a graphic 42b or an image 42a drawn on the board 43 or the like as shown in FIG. 10(a), when the graphic 42b or the image 42a is input from the camera 406 of the display device 41, the AR trigger recognition unit 46 analyzes the image and recognizes that the AR trigger 323d has been input.

[0077] When the AR trigger recognition unit 46 recognizes the input of the AR trigger 323d, the image display unit 47 acquires the pre-mortem image 323c stored in the storage unit 402 and displays it on the display unit (display) 405.

[0078] FIG. 12 is a diagram showing an example of how the pre-mortem image 323c appears. FIG. 12 shows how the pre-mortem image 323c appears when the board 43 shown in FIG. 10(a) is installed in the home of the deceased or a bereaved family member, and the board 43 is viewed using the display device 41. A browsing member (user B) wears the display device 41 after logging in. When the display device 41 recognizes the AR trigger 323d (image 42a or frame 42b) of the board 43 based on input information from the camera 406, it displays the pre-mortem image 323c. If the display device 41 is a glasses-type or goggle-type device, the pre-mortem image 323c is viewed superimposed on the real space that can be seen through the transparent display 405 as a background. In other words, the pre-mortem image 323c can be viewed with the board 43 as a background.

[0079] 13 shows how the pre-death image 323c appears when the screen 43A shown in FIG. 11 is installed in a funeral hall or the like and the screen 43A is viewed using the display device 41. A viewing member (user B) wears the display device 41 after logging in. When the display device 41 recognizes the AR trigger 323d (frame 42d, image 42e) on the screen 43A based on input information from the camera 406, it displays the pre-death image 323c. If the display device 41 is in the form of glasses or goggles, the pre-death image 323c can be viewed with the screen 43A as a background.

[0080] The display device 41 is not limited to a glasses-type device (smart glasses), and a tablet, smartphone, PC, or the like equipped with a camera 406 and a display 405 can also be used.

[0081] Next, the flow of funeral services using the image display system 1 will be described with reference to Fig. 14. In Fig. 14, the boxes shown with solid lines represent processing steps using the image display system 1, and the boxes shown with dashed lines represent steps performed by people. In the following description, User A is a registered member of the image display system 1 who is the deceased person, and User B is a relative or the like of User A.

[0082] User A uses a smartphone, PC, or the like to access a website (funeral service site) provided by a funeral business or the like and performs a member registration process (step S1). User A sends personal information 321c, such as address, name, date of birth, and email address, to the funeral service site (server 3). The funeral service site (server 3) registers the received information as member information 321, issues a member ID 321a, and sends it together with a password 321b to User A's terminal (step S2).

[0083] Fig. 15 is a flowchart showing the details of the flow of the member registration process executed between the server 3 and user A's terminal (user terminal). As shown in Fig. 15, the control unit 301 (member registration unit 31) of the server 3 sends a member registration screen to user A's terminal (step S101) and accepts input of information necessary for member registration. User A's terminal displays the member registration screen on its display unit (step S102). User A inputs information about user A (such as name, address, date of birth, email address, contact information for relatives) on the member registration screen (step S103). The user terminal transmits the input information about the user to the server 3 (step S104).

[0084] When the server 3 (member registration unit 31) receives the information about user A (step S105), it issues a member ID 321a and a password 321b, associates them with the received information about the user, and stores them in the storage unit 302 as member information 321 (step S106). The control unit 301 of the server 3 sends a member registration completion notice to the registered email address (user terminal) (step S107). The member registration completion notice notifies the user that member registration has been completed, and includes the member ID 321a, password 321b, etc. When the user terminal receives the member registration completion notice, it displays it on the display unit (step S108).

[0085] Once membership registration is complete, User A goes to the funeral home facility, or the funeral home visits User A, and takes a memorial portrait image 322b and a pre-death image 323c. The taken memorial portrait image 322b is linked to User A's member ID 321a (322a) and saved as memorial portrait image data 322 on the server 3. The pre-death image 323c is also linked to User A's member ID 321a (323a) and saved as pre-death image data 323 on the server 3 (Step S3).

[0086] Fig. 16 is a flowchart showing the flow of the antemortem image capturing process. As shown in Fig. 16, the funeral director uses the camera 22 of the photography system 2 to capture an image of the registered member (user A) before death (step S201), and transmits the image data from the camera 22 to the control device 21 (step S202).

[0087] When the control device 21 receives image data from each camera 22 (step S203), it performs image processing based on the operation of an operator (funeral director, operator of the image display system 1, or video editor) (step S204). In the image processing of step S204, the control device 21 starts a predetermined editing application, displays an operation screen, accepts the operator's operation, generates an image to be used as an AR trigger 323d, performs background transparency processing on the image, generates a 3D image, creates a movie, etc. Then, the control device 21 assigns an image ID 323b to the generated pre-death image 323c, and uploads it to the server 3 together with the member ID 321a (323a) of the registered member (user A) (step S205).

[0088] The server 3 stores the pre-mortem image 323c, image ID 323b, member ID 321a (323a), and AR trigger 323d transmitted from the control device 21 of the photography system 2 in the storage unit 302 as pre-mortem image data 323 (step S206).

[0089] The image processing in step S204 may be performed on the server 3 side, rather than by the control device 21. That is, an editing application and an operation screen may be provided to the operator's terminal via a funeral service site (website). Also, the image taken by the camera 22 (the antemortem image 323c) may be uploaded directly from the camera 22 to the server 3.

[0090] Returning to the explanation of FIG. When user A dies (step S4), for example, user B, a relative of user A, is contacted by the hospital (step S5). User B goes to the hospital upon receiving the contact (step S6). User B or the hospital contacts the funeral home (step S7). The funeral home references the member information 321 on server 3 to confirm that user A is a registered member (step S8). The funeral home also confirms the relationship to user B (step S9). Step S9 is performed to confirm whether user B is a user who can use the image display system 1 using user A's member information. The funeral home then transports the body from the hospital to the funeral hall (step S10) and begins making arrangements for the funeral venue and the coffin (step S11).

[0091] Before the funeral begins, the funeral director installs the display system 4 in the funeral hall (step S12).

[0092] The relatives (user B) go to the funeral hall (step S13), and the funeral begins at the scheduled time. At the specified timing, user B puts on display device 41 and looks at screen 43A on which image 42e or frame 42d serving as AR trigger 323d is displayed. Display device 41 performs display processing to display image 323c of the deceased person in his / her lifetime (step S14).

[0093] 17 is a flowchart showing the flow of the display process in step S14. Here, the display process using the display system 4 that uses the marker 42, which is the AR trigger 323d, and the eyeglass-type display device 41 (smart glasses) will be described.

[0094] User B uses camera 406 of display device 41 to read a QR code (registered trademark) (not shown) or the like, which contains information about the member ID 321a and password 321b of the deceased person (registered member) and is displayed on screen 43A or the like (step S301). Control unit 401 (login processing unit 44) of display device 41 sends a login request to server 3 along with member ID 321a and password 321b (step S302). Server 3 performs authentication processing based on the received member ID 321a and password 321b, and if authentication is successful, performs login processing for display device 41 (step S303). Note that in steps S301 to S303, if User B has already registered as a browsing member, login processing may be performed using browsing member ID 321e. Furthermore, member registration processing for the deceased person (registered member) as a browsing member may be performed between display device 41 and server 3.

[0095] Next, the control unit 401 (image acquisition unit 45) of the display device 41 transmits a request to the server 3 to transmit the pre-mortem image data 323 (step S304). The server 3 reads out the pre-mortem image data 323 linked to the corresponding member ID 321a (or browsing member ID 321e) from the storage unit 302 (step S305) and transmits it to the display device 41 (step S306). The display device 41 receives the pre-mortem image data 323 (step S307) and stores it in the storage unit 402 (step S308).

[0096] Thereafter, when the marker 42 is captured by the camera 406 of the display device 41, the control unit 401 (the AR trigger recognition unit 46) recognizes the AR trigger 323d 42 (step S309). The control unit 401 (the image display unit 47) of the display device 41 causes the display 405 to display the pre-mortem image 323c (step S310).

[0097] For example, if the life images 323c of multiple members are stored in association with one AR trigger 323d, the server 3 reads out from the storage unit 302 the life images 323c associated with the login information (member ID 321a and viewing member ID 321e) received from the display device 41, and transmits them to the display device 41 to display them. Therefore, even if the same marker 42 (AR trigger 323d) is recognized on each display device 41, different life images 323c of the deceased can be displayed on each display device 41. When the image display system 1 is used at a memorial event for many deceased people, a joint cemetery, or the like, each member can view the life images 323c of the deceased related to them on the display device 41.

[0098] As described above, the image display system 1 of the present invention can display not only a memorial portrait of the deceased but also images of the deceased when they were alive at funerals, etc. Since the images 323c of the deceased when they were alive can be displayed in virtual reality using AR technology, attendees can feel closer to the deceased and feel closer to them.

[0099] [Second embodiment] Next, a second embodiment of the present invention will be described. Memorial services for the deceased are not only held at funerals, but also at memorial services for the first, third, and seventh anniversaries, the anniversary of death, and other occasions, as well as at folk and social customs such as Obon and equinoxes, and other events. Memorial services for war dead, major accidents, natural disasters, and the like are also held on specific days. In the second embodiment of the present invention, an example will be described in which a valid period for AR display is set, and when an AR trigger 323d is recognized by the display device 41 within the valid period, an image 323c of the deceased is displayed. The hardware configuration of the image display system 1 of the second embodiment is the same as that of the first embodiment. In the following description, the same components will be assigned the same reference numerals.

[0100] FIG. 18 is a diagram showing the flow of a service using the image display system 1 of the second embodiment of the present invention. FIG. 18 shows the processing carried out after the death of a registered member. Membership registration and taking of pre-death images 323c are performed in the same manner as steps S1 to S3 of FIG. 14 and the flowchart of FIG. 15, and it is assumed that member information 321 and pre-death image data 323 of user A (deceased) are stored in the server 3. In addition, in FIG. 18, the boxes shown with solid lines represent processing steps using the image display system 1, and the boxes shown with dashed lines represent steps performed by a person.

[0101] After the death of a registered member (user A), the funeral director or the like notifies user A's relative or the like (user B) of user A's member ID 323a and password 321b (step S21(1)). Alternatively, user B becomes a browsing member and links user A's member information 321 with user B's browsing member ID 321e (step S21(2)).

[0102] The server 3 (funeral home operator or operator of the image display system 1) sets a validity period 323e (displayable period) for the user A's image data 323 (AR trigger 323d) (step S22). Examples of the validity period 323e include specific memorial days determined from the date of death, such as the anniversary of user A's death, the seventh day after death, the 49th day after death, the first anniversary, the third anniversary, the seventh anniversary, etc., as well as periods of folk, regional, or customary rites and events, such as Obon, Higan, etc., and periods before and after these. The validity period 323e may also be the date of a memorial event for war dead, an accident, a natural disaster, or the like. The validity period 323e may be determined and set by the server 3 based on the user's date of death or the date of the event, or, for example, the funeral home operator or operator of the image display system 1 may access the server 3 from a terminal such as a PC and perform the validity period setting process using the member ID 321a of the target registered member. The server 3 stores the validity period 323e in association with the pre-mortem image 323c.

[0103] FIG. 19 is a diagram showing an example of pre-death image data 323A in the second embodiment. As shown in FIG. 19, the pre-death image data 323A stores a validity period 323e associated with a member ID 323a, an image ID 323b, a pre-death image 323c, and an AR trigger 323d. The validity period 323e associated with the pre-death image 323c may be one period or multiple periods. Furthermore, if multiple pre-death images 323c of user A are stored, the validity period 323e may be set for each pre-death image 323c. Furthermore, a different AR trigger 323d may be set for each validity period 323e. In this case, for example, a marker 42 (AR trigger 323d) displayed on the board 43, screen 43A, etc. can be used for each validity period 323e, such as an AR trigger 323d for Obon and an AR trigger 323d for the anniversary of death.

[0104] The funeral director delivers the display system 4 (the AR display board 43 and the display device 41) to the address of the user B (step S23). The user B receives the display system 4 and installs it in a desired location during the set valid period 323e, such as the Obon period (step S24).

[0105] User B logs in to the server 3 from the display device 41 (step S25). The login may be performed by launching a dedicated app installed on the display device 41 and using User A's member ID 321a and password 321b, or by using the browsing member ID 321e and browsing password registered by User B. If the login is successful, the display device 41 acquires the pre-death image data 323 linked to the member ID 321a (browsing member ID 321e) from the server 3. The display device 41 recognizes the AR trigger 323d, and if the validity period 323e is not expired, the display device 41 displays User A's pre-death image 323c (step S26).

[0106] 20 is a diagram showing the functional configuration of an image display system 1 according to the second embodiment. The difference from the first embodiment is that a server 3A according to the second embodiment further includes a valid period setting unit 36 ​​and a valid period determination unit 37.

[0107] The validity period setting unit 36 ​​determines the validity period 323e of the user A's pre-death image 323c based on the user A's date of death, the date of the memorial service determined from the date of death, and the date of memorial service customarily held in the user A's place of residence (Obon period, equinox, etc.), and stores the validity period 323e linked to the pre-death image 323c.

[0108] Alternatively, the validity period setting unit 36 ​​may be configured to accept the setting of the validity period 323e through an operation by a funeral director or the like. In order to set the validity period 323e, it is desirable that the server 3A provides a user interface such as a validity period setting screen (site). The validity period setting screen (site) accepts input of the member ID 321a and the validity period 323e to be set. If there are multiple before-life images 323c of user A, the validity period 323e may be set for each before-life image 323c. Also, a different AR trigger 323d may be set for each validity period 323e.

[0109] The valid period determination unit 37 determines whether the date and time when the request to transmit the pre-mortem image data 323 is received from the display device 41 is within the valid period 323e set by the valid period setting unit 36. If the date and time is within the valid period 323e, the pre-mortem image 323c linked to the AR trigger 323d is transmitted to the display device 41 by the image transmission unit 34.

[0110] FIG. 21 is a flowchart illustrating the detailed flow of the display process from step S25 to step S26 in FIG.

[0111] Similar to the display process (FIG. 17) of the first embodiment, user B uses camera 406 of display device 41 to read a QR code (not shown) or the like, which includes information about the member ID 321a and password 321b of the deceased person (registered member) and is displayed on screen 43A or the like (step S401). The control unit 401 (login processing unit 44) of display device 41 transmits a login request to server 3 together with member ID 321a and password 321b (step S402). The server 3 performs authentication processing based on the received member ID 321a and password 321b, and if the authentication is successful, performs login processing of the display device 41 (step S403). In steps S401 to S403, if user B has already been registered as a browsing member, login processing may be performed using browsing member ID 321e. Furthermore, member registration processing of the deceased person (registered member) as a browsing member may be performed between display device 41 and server 3.

[0112] Next, the control unit 401 (image acquisition unit 45) of the display device 41 transmits a request to the server 3 to transmit the pre-mortem image data 323 (step S404). The control unit 301 of the server 3 reads out the pre-mortem image data 323 linked to the corresponding member ID 321a from the storage unit 302 (step S405).

[0113] The control unit 301 (validity period determination unit 37) of the server 3 determines whether the date and time when the request to transmit the antemortem image data 323 was received from the display device 41 is within the validity period 323e set by the validity period setting unit 36 ​​(step S406). If it is determined that the date and time is not within the validity period 323e (step S406; No), the control unit 301 of the server 3 transmits an error notification to the display device 41 (step S407). The display device 41 displays the error notification, and the process returns to step S401.

[0114] If it is within the validity period 323e (step S406; Yes), the control unit 301 (image transmission unit 34) of the server 3 transmits the before-life image 323c linked to the member ID 321a to the display device 41. If multiple before-life images 323c are linked to one member ID 321a, only the before-life image 323c that falls within the validity period 323e is transmitted (step S408).

[0115] The display device 41 receives the premortem image data 323 (step S409) and stores it in the storage unit 402 (step S410).

[0116] Thereafter, when the marker 42, which is the AR trigger 323d, is captured by the camera 406 of the display device 41, the control unit 401 (the AR trigger recognition unit 46) recognizes the AR trigger 323d (step S411). The control unit 401 (the image display unit 47) of the display device 41 displays the pre-mortem image 323c on the display 405 (step S412).

[0117] As described above, in the second embodiment, the valid period of the AR display can be set, so that the user B can perform a memorial service for the deceased at an appropriate timing. In addition, the user can develop the habit of performing memorial services.

[0118] Note that the process flow and the method of displaying pre-mortem images in each of the above-described embodiments are merely examples and are not limited thereto. For example, the display device 41 may recognize the AR trigger 323d and then request the server 3 to transmit the pre-mortem image data 323. Furthermore, when displaying the pre-mortem images 323c, stereoscopic display or holographic display may be performed. These display methods can be realized by using known technologies (for example, the stereoscopic image display device disclosed in Japanese Patent Application Laid-Open No. 2017-28692 or the image display device disclosed in Japanese Patent Application Laid-Open No. 2015-0090408).

[0119] While the preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that those skilled in the art can conceive of various modifications and alterations within the scope of the technical ideas disclosed in this application, and it is understood that these modifications and alterations also fall within the technical scope of the present invention. [Explanation of symbols]

[0120] 1. Image display system 2. Shooting system 3...Server 4. Display system 5. Network 21...Control device 22...Camera 25: Image processing section 26...Image processing unit 27...Image upload section 31...Member Registration Department 32...Image acquisition unit 34...Image transmission unit 35...AR trigger setting section 41...Display device 42 AR trigger (marker) 43...Board 43A...Screen 44: Login processing section 45...Image acquisition unit 46...AR trigger recognition unit 47...Image display section 321...Member information 322...Image data for memorial portraits 323...Image data from before death

Claims

1. a storage means for storing an image of the deceased person taken while they were alive, in association with an AR trigger that triggers AR display; a display means for, when the AR trigger is recognized, acquiring from the storage means the antemortem image associated with the recognized AR trigger and displaying the acquired image; An image display system comprising: a member registration means for performing a member registration process to use the image display system; Further provided with For one AR trigger, images of a plurality of members who are registered separately by the member registration means are linked and stored, The image display system is characterized in that the display means reads out the corresponding pre-death image from the storage means based on the input member information and displays it.

2. The information processing system further includes a browsing member registration means for accepting registration as a browsing member in association with the member registered by the member registration means, The image display system according to claim 1, characterized in that the display means reads out from the storage means an image of the member before his or her death that is linked to the viewing member and displays it on the display means that is logged in as the viewing member.

3. 3. The image display system according to claim 1, further comprising a setting unit that accepts a setting for the AR trigger.

4. The display means a board displaying a marker serving as the AR trigger; a display device including a camera that reads the markers displayed on the board and a display that displays the images of the person before death; 4. The image display system according to claim 1, further comprising:

5. 5. The image display system according to claim 4, wherein the display device is a display device having an eyeglass-type or goggle-type display.

6. a storage means for storing an image of the deceased person taken while they were alive, in association with an AR trigger that triggers AR display; an image transmitting means for transmitting the pre-mortem image to a display means for acquiring the pre-mortem image associated with the recognized AR trigger from the storage means and displaying the image; a member registration means for performing a member registration process to use the image display system; A server comprising: The storage means stores images of a plurality of members, each registered separately by the member registration means, taken before death in association with one AR trigger; The server is characterized in that the display means reads out the corresponding antemortem image from the storage means based on the input member information and displays it.

7. A display device having a display, a communication means for communicating with a server having a member registration means for performing member registration processing; a recognition means for recognizing an AR trigger that is a trigger for displaying AR; a display means for, when the recognition means recognizes the AR trigger, acquiring an image of the deceased person in his / her lifetime that is associated with the recognized AR trigger and stored in a storage means of the server, and displaying the image on the display; Equipped with The storage means stores images of a plurality of members, each registered separately by the member registration means, taken before death in association with one AR trigger; The display device is characterized in that the display means reads out the corresponding pre-death image from the storage means based on the input member information and displays it.

8. a step in which the server performs member registration processing; a step in which the server stores an image of the deceased person taken while they were alive in a storage unit in association with an AR trigger that triggers AR display, and stores images of the deceased taken while they were alive of multiple members who are each registered as members in association with one AR trigger; When the display device recognizes the AR trigger, the display device retrieves the corresponding antemortem image linked to the recognized AR trigger and based on the input membership information from a storage unit of the server and displays the image; An image display method comprising:

9. Computer, a storage means for storing an image of the deceased person taken while they were alive, in association with an AR trigger that triggers AR display; an image transmitting means for transmitting the pre-mortem image to a display means for acquiring the pre-mortem image associated with the recognized AR trigger from the storage means and displaying the image; Membership registration means for performing member registration processing; A program for causing a server to function as a server comprising: The storage means stores images of a plurality of members, each registered separately by the member registration means, taken before death in association with one AR trigger; A program that causes the display means to read out the corresponding pre-death image from the storage means based on the input member information and display it.

10. A display device having a display, a communication means for communicating with a server having a member registration means for performing member registration processing; recognition means for recognizing an AR trigger that is a trigger for AR display; a display means for, when the recognition means recognizes the AR trigger, acquiring an image of the deceased person in his / her lifetime that is associated with the recognized AR trigger and stored in a storage unit of the server, and displaying the image on the display; A program for functioning as The storage unit stores images of a plurality of members, each registered separately by the member registration means, taken before death in association with one AR trigger; The display means is a program that reads out the corresponding pre-death image from the storage unit based on the input member information and displays it.

Images