Funeral system, server, display device, body image display method, and program

Abstract

To provide a funeral system configured to show the body of a deceased person even in a location that is apart from a funeral venue, a server, a display device, a deceased person's body image display method, and a program.SOLUTION: A funeral system 1 is configured by connecting an imaging system 2, a server 3, and a display system 4 over a network 5 to communicate with each other. The imaging system 2 includes a camera 21 and a control apparatus 21 arranged in, for example, a main venue of a funeral to image the body of a deceased person 20. The control apparatus 21 uploads the image captured by the camera 22 to a server 3. The server 3 stores deceased person's body image data 323 captured by the imaging system 2. The server 3 transmits the deceased person's body image data 323 to a display device 41 of a display system 4 in another venue. The display system 4 includes an AR marker 42 and a display device 41, and acquires the deceased person's body image data 323 from the server 3 for AR display.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a funeral system, a server, a display device, a body image display method, and a program, and more particularly to a video display technology for funeral services. [Background technology]

[0002] Funerals are often held in the residence of the deceased or the bereaved family, and relatives, friends, and acquaintances who live far away have to spend a lot of time, money on transportation, and accommodation to travel to the venue. It is also physically demanding. As a solution to this problem, an idea has been proposed to set up a large screen in a venue separate from the main funeral venue, display a video of the funeral in the separate venue, and attend online.

[0003] Furthermore, with regard to the display of images at funerals, for example, Patent Document 1 discloses a funeral method that combines a screen installed at the funeral altar with a slide projector, a video projector, and a switching means for switching between these two types of projection devices, and uses the slide projector to project still images of the deceased onto the screen at the start and end of the funeral to ensure a solemn atmosphere at the funeral, and during the eulogy, projects video or slide images of the deceased's activities while they were alive onto the screen, thereby leaving a vivid impression of the deceased in the memories of attendees.

[0004] Furthermore, regarding funeral services that use the Internet, Patent Document 2 discloses a cloud-based perpetual memorial service system. This system stores each member's personal information, digital content provided by each member, and instruction data describing each member's wishes regarding post-death handling on an Internet-based perpetual memorial site accessible from a terminal by members who signed a service contract while they were alive or their surviving family members. The system also stores video data of a death register and virtual worship facility generated based on these. This not only allows for worship services to be held on the cloud, but also accurately reflects the deceased's wishes regarding post-death operations, stores data that the deceased wished to leave behind, and safely disseminates the deceased's career and achievements, making them available for third parties to search on search engines. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 10-0243871 [Patent Document 2] Japanese Patent Application Publication No. 2018-081656 Summary of the Invention [Problem to be solved by the invention]

[0006] However, even if the funeral is shown on video or images of the deceased were shown, attendees of the funeral held at a different venue cannot see the body of the deceased in person. This makes it difficult for them to fully experience the experience and to fully say goodbye to the deceased.

[0007] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a funeral system etc. that allows people to view the body of the deceased even if they are located far from the funeral venue. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, a first invention is a system comprising: a photographing means for photographing the body of a deceased person; a storage means for storing the image of the body photographed by the photographing means; and a display means for use in a venue separate from the main venue of the funeral of the deceased, which acquires the image of the body from the storage means and displays it; The image of the corpse is linked to an AR marker, and the display means includes a display device equipped with a recognition means for recognizing the AR marker, and when the recognition means recognizes the AR marker, the display device displays the image of the corpse linked to the AR marker recognized by the recognition means. This is a funeral system characterized by the following.

[0009] According to the funeral system of the first invention, the body of the deceased is photographed by a photographing means, the photographed image of the body is stored in a storage means, and the image of the body is retrieved from the storage means and displayed by a display means used in a venue separate from the main venue of the deceased's funeral. This allows the body of the deceased to be seen even in a venue separate from the funeral venue, giving a sense of reality and enabling people to spend their time saying goodbye to the deceased to the fullest.

[0010] moreover, No. 1 According to the funeral system of the present invention, by using AR (Augmented Reality) technology, it is possible to superimpose an image of the corpse onto real space, allowing attendees at a different funeral venue to view the image of the corpse in augmented reality.

[0011] Also, 1 In the invention, it is preferable that the image of the corpse and the AR marker have orientation information, and the display means calculates a viewpoint position in the three-dimensional image space based on the relationship between the position and orientation of the display device and the position of the AR marker, and displays the image of the corpse as if viewed from the calculated viewpoint position. This allows the viewpoint to be moved according to the position and orientation of the display device and the image of the corpse to be displayed. Also, 1 In the invention, the display means can be configured by a plurality of tablet terminals arranged around the AR marker.

[0012] It is also desirable to further include image processing means for generating a three-dimensional image of the body based on images taken from multiple positions by the photographing means, the storage means for storing the three-dimensional image of the body, and the display means for displaying the three-dimensional image, thereby enabling a more realistic display of the image.

[0013] The display means is a display device equipped with a glasses-type or goggle-type display. Su It can be configured as follows.

[0014] The photographing means may photograph an image of the body before the funeral, or the photographing means may photograph an image of the body at the funeral hall during the funeral, and the display means may acquire and display the image of the body in real time via a network.

[0015] It is also desirable to further provide a member registration means for performing member registration processing to use the funeral system. Since the funeral system is available to members who have registered in advance, funeral preparations and arrangements for image data can be smoothly carried out.

[0016] No. 2 The invention is a server comprising: a storage means for storing an image of the corpse of a deceased person photographed by a photographing means, linking the image to an AR marker; and an image transmission means for transmitting the image of the corpse to a display means which acquires the image of the corpse from the storage means and displays it on the display device, the image transmission means transmitting the image of the corpse to the display means which displays the image, the image transmission means transmitting the image of the corpse to the display means so that the display device can superimpose the image of the corpse linked to the AR marker recognized by the recognition means on the real space.

[0017] No. 2 This invention provides a server that stores images of a body and transmits them to a display means used in a venue other than the main venue of the funeral of the deceased.

[0018] Third The invention is a display device used in a venue other than the main venue of the funeral of the deceased, and is equipped with a communication means for connecting to a server, and a display means for acquiring and displaying an image of the deceased's corpse that is associated with an AR marker and stored in the memory means of the server, and further equipped with a recognition means for recognizing the AR marker, and when the recognition means recognizes the AR marker, the display device displays an image of the corpse associated with the recognized AR marker superimposed on real space.

[0019] No. 3 This invention provides a display device that is communicatively connected to a server and that acquires and displays images of the body of a deceased person stored in the server.

[0020] Fourth The invention is a corpse image display method comprising: a photographing step of photographing the corpse of the deceased using a photography system; a step in which a control device of the photography system uploads the photographed image of the corpse to a server; a step in which the server stores the image of the corpse in a memory unit linked to an AR marker; and a step in which a display device that is used in a venue other than the main funeral venue of the deceased and is capable of recognizing the AR marker retrieves the image of the corpse from the memory unit of the server and displays it, wherein in the step of displaying the image of the corpse, when the display device recognizes the AR marker, it displays the image of the corpse linked to the recognized AR marker by superimposing it on real space.

[0021] No. 4 According to this invention, the body of the deceased is photographed using a photography system, the photographed image of the body is uploaded and stored on a server, and a display device used at a venue other than the main venue of the deceased's funeral retrieves the image of the body from the server and displays it. This allows the body of the deceased to be viewed even at a venue far from the funeral venue, giving the feeling of being at the funeral and allowing people to fully spend their time saying goodbye to the deceased.

[0022] No. 5 The invention is a program for causing a computer to function as: a storage means for storing an image of the corpse of a deceased person photographed by a photographing means, linking the image to an AR marker; and an image transmission means for transmitting the image of the corpse to a display means used at a venue other than the main venue of the funeral of the deceased, the display means including a display device equipped with a recognition means for recognizing the AR marker. The image transmission means transmits the image of the corpse to the display means so that the display device, upon recognizing the AR marker by the recognition means, can display the image of the corpse linked to the AR marker superimposed on real space.

[0023] No. 5 According to the invention of the third aspect, it is possible to make a computer function as the server of the invention of the fourth aspect.

[0024] No. 6 The invention is a program for causing a display device used at a venue other than the main venue of the funeral of the deceased to function as a communication means for connecting to a server, a display means for acquiring and displaying an image of the deceased's corpse that is associated with an AR marker and stored in the storage means of the server, and further functioning as a recognition means for recognizing the AR marker, and the display device, when it recognizes the AR marker by the recognition means, displays an image of the corpse associated with the recognized AR marker superimposed on real space.

[0025] No. 6 According to this invention, it is possible to make the display device function as the display means in the funeral system of the first or second invention, or as the display device of the fifth or sixth invention. [Effects of the Invention]

[0026] According to the present invention, a funeral system or the like can be provided that allows the body of the deceased to be viewed even in a location far from the funeral venue. [Brief explanation of the drawings]

[0027] [Figure 1] Diagram showing the overall configuration of the funeral system 1 [Figure 2] Block diagram showing the hardware configuration of the imaging system 2 [Figure 3] FIG. 10 shows the data structure of member information 321 stored in the server 3. [Figure 4] FIG. 10 shows the data structure of the image data 322 for a memorial portrait stored in the server 3. [Figure 5] FIG. 10 shows the data structure of the corpse image data 323 stored in the server 3. [Figure 6] Hardware configuration of Server 3 [Figure 7] 1 is a block diagram showing the hardware configuration of a display device 41. [Figure 8] FIG. 1 is a diagram showing the functional configuration of a control device 21, a server 3, and a display device 41 of a funeral system 1. [Figure 9] FIG. 1 is a diagram showing an example of a photographing method in the photographing system 2. [Figure 10] FIG. 1 shows (a) an example of an installation of an AR marker 42 in a display system 4, and (b) an example of a display (appearance). [Figure 11] A diagram showing an example of installation of display system 4 [Figure 12] FIG. 10 shows another example of the display system 4. [Figure 13] A diagram showing an example of service operation using the funeral system 1 [Figure 14] Flowchart showing the flow of member registration processing [Figure 15] Flowchart showing the process of photographing a corpse image [Figure 16] Flowchart showing the flow of display processing [Figure 17] A diagram explaining live video recording at the funeral venue DETAILED DESCRIPTION OF THE INVENTION

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0029] 1 is a diagram showing the overall configuration of a funeral system 1 according to the present invention. The funeral system 1 is configured by a photography system 2, a server 3, and a display system 4, which are communicatively connected via a network 5. In this specification, the term "funeral" is used to mean an opportunity to say goodbye to the deceased, such as a wake, funeral, memorial service, or "farewell party."

[0030] The photographing system 2 is a photographing means that is installed in, for example, the main hall of the funeral and includes a camera 22 and a control device 21. The photographing system 2 photographs the body of the deceased person 20.

[0031] The camera 22 is a camera used by a photography company (cameraman) or a fixedly installed camera. When the camera 22 captures an image of the body of the deceased 20, it issues a photography ID, which is identification information for the image, and transmits the captured image (still image or video) and the photography ID to the control device 21. The communication connection between the camera 22 and the control device 21 may be either wired or wireless.

[0032] Control device 21 is a terminal (such as a PC or tablet) that performs image processing as necessary on images captured by camera 22 and uploads the images to server 3, and includes control unit 201, storage unit 202, communication unit 203, input unit 204, display unit 205, peripheral device I / F unit 206, and bus 209. Note that the camera 22 may have a configuration in which the functions of control device 21 are included, or control device 21 may be integrated with camera 22 (such as a tablet with a camera).

[0033] The control unit 201 includes a CPU (Central Processing Unit). Processing Unit), ROM (Read Only Memory) Only Memory), RAM (Random The CPU loads programs stored in the storage unit 202, ROM, recording media, etc. into a work memory area on the RAM and executes them, and drives and controls each device connected via the bus 209.

[0034] The storage unit 202 is a flash memory, an HDD (Hard Disk Drive), or the like, and stores programs executed by the control unit 201, data necessary for program execution, an OS (Operating System), etc. As for programs, a control program equivalent to an OS and an application program for acquiring images from the camera 22, processing the images, and uploading the images to the server 3 are stored. These program codes are read out as needed by the control unit 201 and transferred to the RAM, and then read out by the CPU and executed as various means.

[0035] The communication unit 203 has a communication control device, a communication port, etc., and is a communication interface that mediates communication between the control device 21 and the network 5, and is capable of controlling communication with the server 3 and other computers via the network 5. The network 5 may be a LAN (Local Area Network) or a WAN (Wide Area Network) that is connected over a wider area for communication. The network 5 may be wired or wireless.

[0036] The display unit 205 is realized by a display device such as a liquid crystal display, or a display with a touch panel that also serves as the input unit 204. The display unit 205 displays various screens related to user operations and selections, and accepts user input of instructions by touching the screen. The input unit 204 is composed of the above-mentioned touch panel, or a keyboard, a mouse, various buttons, etc., and inputs input signals to the control unit 201.

[0037] The peripheral device I / F unit 206 is a port for connecting peripheral devices, and transmits and receives data to and from peripheral devices such as the camera 22 via the peripheral device I / F unit 206. The connection with the peripheral devices may be wired or wireless. The example in FIG. 2 shows an example in which multiple cameras 22a, 22b, 22c, ... are connected to the control device 21 via the peripheral device I / F unit 206. Note that the number of cameras 22 is arbitrary. The bus 209 is a path that mediates the transmission and reception of control signals, data signals, etc. between the devices.

[0038] Next, we will explain the server 3. The server 3 is a computer that stores and manages member information 321, image data for a memorial portrait 322, and corpse image data 323 in the funeral system 1, as shown in FIG.

[0039] Member information 321 is information about a user (user A, described later) who has registered to use the funeral system 1. FIG. 3 is a diagram showing an example of the data configuration of member information 321. As shown in FIG. 3, member information 321 stores member ID 321a, password 321b, member's personal information 321c, contact information 321d for relatives, etc. Personal information 321c is personal information about the user entered during the member registration process performed between the user's terminal (not shown) and server 3 via a website or dedicated app set up by the operator of funeral system 1, and includes the user's address, name, age, contact information for relatives, etc. Member ID 321a is identification information for the member set during the member registration process. Password 321b is an authentication password required when logging in to the funeral system 1.

[0040] FIG. 4 is a diagram showing an example of the data configuration of the memorial portrait image data 322. The memorial portrait image data 322 is data for managing a memorial portrait image 322c used as a memorial portrait of a registered member. As shown in FIG. 4, the memorial portrait image data 322 stores a member ID 322a, a photography ID 322b, and a memorial portrait image 322c, linked to each other. The memorial portrait image 322c is an image of the registered member taken before death using the registered member's terminal or a camera at the funeral home, and is uploaded to the server 3 and stored in the storage unit 302. The member ID 322a is the member ID 321a (FIG. 3) in the member information 321 of the funeral system 1. The photography ID 322b is information for identifying the memorial portrait image 322c, and is assigned to each memorial portrait image 322c when it is photographed or registered.

[0041] The corpse image data 323 is data for managing the corpse image 323c (still image or video). The corpse image 323c is an image of the corpse of a registered member after his or her death, and is taken by the camera 22 of the imaging system 2 before or during the wake or funeral. The corpse image 323c is uploaded from the control device 21 of the imaging system 2 to the server 3 and stored in the memory unit 302 of the server 3. FIG. 5 is a diagram showing an example of the data configuration of the corpse image data 323. As shown in FIG. 5, the corpse image data 323 is stored in association with a member ID 323a, an image ID 323b, a corpse image 323c, an AR marker 323d, etc. The member ID 323a is the member ID 321a of the member information 321 of the funeral system 1. The image ID 323b is identification information for the corpse image 323c and is assigned to each corpse image 323c.

[0042] The corpse image 323c may be stored in association with an AR (Augmented Reality) display trigger (AR marker 323d). By associating the corpse image 323c with the AR marker 323d, an augmented reality display can be performed. Specifically, for example, when the camera 406 of the display device 41 recognizes the AR marker 323d, the corpse image 323c can be displayed superimposed on real space. The AR marker 323d is not limited to simple, clear black-and-white shapes, and specific photographs, illustrations, text, and other images can be used. Furthermore, the trigger for AR display is not limited to a marker (image). It is also possible to use location information (GPS information), real-world spatial information (elevation, size, depth, etc.) obtained through a camera or sensor, a specific three-dimensional object, audio information obtained through a microphone, etc., as the AR display trigger.

[0043] The corpse image 323c is not limited to a two-dimensional image, but may be a three-dimensional image drawn in a three-dimensional image space in the x, y, and z directions. The three-dimensional image is generated by scanning (photographing) the corpse from multiple directions and positions and synthesizing these images.

[0044] The server 3 transmits the body image 323c taken at the main venue to the display device 41 of the display system 4 at the separate venue.

[0045] Fig. 6 is a diagram showing the hardware configuration of the server 3. As shown in Fig. 6, the server 3 can be realized by a computer configured by connecting, for example, a control unit 301, a storage unit 302, and a communication unit 303 via a bus 309. However, the configuration is not limited to this and various other configurations can be used as appropriate.

[0046] The functions of the control unit 301, storage unit 302, and communication unit 303 are substantially the same as those of the control unit 201, storage unit 202, and communication unit 203 described above. The storage unit 302 of the server 3 stores programs for causing the server 3 to execute the member registration process, corpse image capturing process, and display process described below. Each of these processes will be described later. The server 3 may be configured with multiple computers for each function. For example, the server 3 may be configured with multiple computers, such as a member registration server, an image storage server, and an image transmission server, and the processes may be shared.

[0047] Next, the display system 4 will be described. As shown in Fig. 1, the display system 4 includes a display device 41 used in a venue separate from the main funeral venue (referred to as the separate venue), and, if necessary, a sheet or stand (hereinafter referred to as sheet 43) on which an AR marker 42 is printed. The display device 41 is a device used by a user to view the body image 323c acquired from the server 3, and may be, for example, a glasses-type or goggle-type display device called smart glasses or a head-mounted display, or may be a tablet, smartphone, PC monitor, or the like. In this embodiment, smart glasses will be used as an example of the display device 41.

[0048] The smart glasses (display device 41) are a wearable device worn on the head like eyeglasses. The smart glasses (display device 41) have a main body and a display (display unit) 405. The main body has a control unit 401, a memory unit 402, a communication unit 403, an input unit 404, a camera 406, a microphone 407, a speaker 408, a peripheral device I / F unit 409, a location information acquisition unit (GPS) 410, a sensor 411, etc. The display (display unit) 405 has a transparent display, allowing the user to view the image displayed on the display with the real space as the background. This allows the user to superimpose a corpse image 323c on the real space.

[0049] 7 is a diagram showing the hardware configuration of the display device 41. As shown in Fig. 7, the display device 41 is configured by connecting a control unit 401, a storage unit 402, a communication unit 403, an input unit 404, a display (display unit) 405, a camera 406, a microphone 407, a speaker 408, a peripheral device I / F unit 409, a position information acquisition unit 410, a sensor 411, and the like via a bus 419. However, the configuration of the display device 41 is not limited to this, and various other configurations may be used as appropriate. For example, the display device 41 may be configured by connecting a controller 412 equipped with various operation buttons to the peripheral device I / F unit 409.

[0050] The control unit 401 is composed of a CPU, a ROM, a RAM, etc. The CPU loads programs stored in the storage unit 402, the ROM, a recording medium, etc. into a work memory area on the RAM and executes them, driving and controlling each unit connected via a bus 419. The ROM permanently stores programs such as the computer's boot program and BIOS, as well as data. The RAM temporarily stores loaded programs and data, and also has a work area used by the control unit 401 to perform various processes. The control unit 401 functions as each functional unit of the display device 41 by reading and executing the programs.

[0051] 8, the control unit 401 of the display device 41 functions as a login processing unit 44, an image acquisition unit 45, an AR marker recognition unit 46, an image display unit 47, etc. Details of each unit will be described later.

[0052] The storage unit 402 of the display device 41 is, for example, a storage device such as a flash memory. The storage unit 402 stores programs executed by the control unit 401, data necessary for program execution, an operating system, etc. These program codes are read out by the control unit 401 as needed and transferred to RAM, and then read out and executed by the CPU. The storage unit 402 also stores a program for executing a display process, which will be described later. The display process will be described in detail later.

[0053] The communication unit 403 has a communication device such as a wireless LAN, Bluetooth (registered trademark), infrared, or short-range wireless communication, and controls communication with the network 5, etc., communication with Bluetooth-compatible devices, or communication with a contactless IC card, etc. The display device 41 is connected to the server 3 via the network 5 and is capable of transmitting and receiving various data including the corpse image data 323.

[0054] The location information acquisition unit 410 may detect the location of the device itself using signals from satellites such as a GPS (Global Positioning System), or may detect the location of the device itself using the strength of radio waves from a wireless base station for mobile phones or an access point for Wi-Fi communication. The location information acquisition unit 410 notifies the control unit 401 of the acquired location information.

[0055] The sensor 411 includes, for example, a nine-axis sensor (geomagnetic sensor, acceleration sensor, gyro sensor), and acquires information on the direction in which the display device 41 is facing, its attitude (tilt and rotation), and its movement.

[0056] The display 405 (display unit) is a see-through display device, and is provided, for example, in each of the eye sections of the display unit of the smart glasses. The display 405 displays display information input under the control of the control unit 401. The display on the display 405 may be either 2D (two-dimensional display) or 3D (stereoscopic display).

[0057] The camera 406 includes a center camera arranged in the center of the display device 41 and stereo cameras arranged on the left and right sides. The microphone 407 inputs surrounding sounds and transmits them to the control unit 401. The speaker 408 outputs the sounds transmitted from the control unit 401. The camera 406 is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 406 of the display device 41 is a camera that uses an imaging element such as a Metal Oxide Semiconductor (MIS) image sensor, and captures moving or still images. In the present invention, the camera 406 of the display device 41 is used to recognize the AR marker 323d.

[0058] The peripheral device I / F unit 409 is a port for connecting peripheral devices, and data is sent and received to and from the peripheral devices via the peripheral device I / F unit 409. The connection with the peripheral devices may be wired or wireless. The display device 41 is connected to a controller 412 and the like via the peripheral device I / F unit 409.

[0059] The controller 412 has a touch panel display, a communication I / F, various buttons, etc., and inputs operation instructions to the smart glasses (display device 41) by operating the touch panel or buttons. Operation instructions to the smart glasses (display device 41) may be input not only from the controller 412, but also by voice instructions via the microphone 407. Furthermore, an operation screen, etc. may be displayed on the smart glasses (display device 41), and hand movements, etc. may be recognized by the camera 406 to perform operations (gesture operations) on the operation screen, etc.

[0060] Next, the functional configuration of the funeral system 1 will be described with reference to Fig. 8. As shown in Fig. 8, the control device 21 of the photography system 2 has a photography processing unit 25, an image processing unit 26, and an image upload unit 27. The server 3 has a member registration unit 31, an image acquisition unit 32, a storage unit 302, an image transmission unit 34, etc. The display device 41 has a login processing unit 44, an image acquisition unit 45, a storage unit 402, an AR marker recognition unit 46, an image display unit 47, etc.

[0061] The photography processing unit 25 of the control device 21 takes images of the body of the deceased person 20 using one or more cameras 22. Any photography method may be used, but it should be in accordance with the display method used in the display system 4. For example, when a 3D image is displayed in the display system 4, photography is performed using a method of 3D scanning of the body. The photography system 2 used in this case, as shown in FIG. 9, for example, places multiple cameras 22 on a plane 221 perpendicular to the body axis of the body, centered on the body axis, and scans (photographs) the entire body while moving in the body axis direction. Note that while the example in FIG. 9 shows photography of only the body, photography may also be performed with the body placed in a coffin.

[0062] The image processing unit 26 of the control device 21 takes in the image data captured by the photography processing unit 25 and generates a corpse image 323c. When the photography processing unit 25 obtains image data by a 3D scan as shown in FIG. 9, the image processing unit 26 can generate a 3D image based on this image data. Any known method can be used to generate a 3D image. For example, a 3D image can be obtained by combining multiple image data obtained by 3D scanning in a virtual 3D image space based on the position information of each camera 22. To display a 3D image on a 2D display, a viewpoint (virtual camera) and a light source are set at predetermined positions in the virtual 3D image space, and a 2D image projected from the viewpoint is displayed. Note that depending on the display device 41, it may also be possible to generate and display a stereoscopic image.

[0063] Furthermore, when AR display is performed in the display system 4 at a different venue, the image processing unit 26 links the generated corpse image 323c with the AR marker 323d. The AR marker 323d may have orientation information and be associated with the orientation (direction) information of the corpse image 323c in the three-dimensional image space. For example, as shown in FIG. 10(a), a figure with characters (not limited to kanji characters but may be alphabets, etc.) or symbols indicating "east," "west," "south," and "north" written within a frame is used as the AR marker 42, and the head side of the corpse image 323c is set to the north and the feet side to the south.

[0064] The image upload unit 27 of the control device 21 uploads the photographed and generated body image 323c to the server 3. The image upload unit 27 transmits the member ID 321a (323a) of the deceased person 20, the image ID 323b issued by the control device 21, and the AR marker 42 (323d) together with the body image 323c.

[0065] The image acquisition unit 32 of the server 3 receives the body image 323c, the member ID 321a (323a) of the deceased 20, the image ID 323b, and the AR marker 42 (323d) transmitted from the photography system 2 (control device 21), and stores them in the memory unit 302 as body image data 323.

[0066] The image transmission unit 34 of the server 3 transmits the body image 323c of the deceased person 20 in response to a request from the display system 4 (display device 41) located at a separate venue.

[0067] The member registration unit 31 of the server 3 performs member registration processing for a user (user A) of the funeral system 1. The member registration unit 31 provides a predetermined member registration screen via, for example, a website or app operated by a funeral company or an operator of the funeral system 1, and accepts input of information required for member registration from user A's terminal (not shown). When personal information 321c such as user A's address, name, date of birth, and email address, as well as contact information 321d of relatives, etc. are input on the member registration screen, the member registration unit 31 of the server 3 issues a member ID 321a and a password 321b, and stores them together with the input information (personal information 321c, contact information 321d, etc.) as member information 321 in the storage unit 302 of the server 3. When member registration is completed, the member registration unit 31 transmits a registration completion notice to user A's terminal.

[0068] The login processing unit 44 of the display device 41 performs a login process for user C, who is seeing off the deceased 20 at a separate venue, to use the funeral system 1. In the login process, user C inputs the member ID 321a and password 321b of user A (deceased 20) via the input unit 404 or controller 412 of the display device 41. Alternatively, a QR code containing the member ID 321a and password 321b of user A (deceased 20) is printed, attached, or displayed on the sheet 43 of the display system 4, and the QR code is read by the camera 406 of the display device 41. The login processing unit 44 accesses the server 3 using the input or read member ID 321a and password 321b, and performs a login process with the server 3. If the authentication is successful, the login is completed, and the funeral system 1 can be used. Note that user C (a mourner at a separate venue) may also register as a new member of the funeral system 1 as a browsing member. In this case, User C is registered in association with the membership information 321 of User A (deceased person 20), and is permitted to view the body image 323c of User A (deceased person 20).

[0069] When the login is completed, the image acquisition unit 45 requests the server 3 to acquire the corpse image data 323 linked to the corresponding member ID 321a (323a). When the corpse image data 323 is transmitted from the image transmission unit 34 of the server 3, the image acquisition unit 45 receives the corpse image data 323 and stores it in the storage unit 402. The corpse image data 323 is linked to information on the AR marker 42 that triggers its display.

[0070] The AR marker recognition unit 46 recognizes the AR marker 42. For example, if the AR marker 42 is a figure or image drawn on a sheet 43 or the like as shown in FIG. 10(a), when the figure or image is input from the camera 406 of the display device 41, the AR marker recognition unit 46 performs image analysis and recognizes that the AR marker 42 has been input.

[0071] When the AR marker recognition unit 46 recognizes the input of the AR marker 42, the image display unit 47 displays the corpse image 323c stored in the storage unit 402 on the display unit (display) 405. Note that if the AR marker 323d is not linked to the corpse image data 323, the corpse image 323c is displayed on the display unit (display) 405 even if the AR marker 323d is not recognized.

[0072] FIG. 10(b) is a diagram showing an example of how the corpse image 323c appears. In the example of FIG. 10(b), the deceased person 20 is placed in a coffin and photographed (scanned) with the head (face) exposed. A mourner 40 (user C) at a separate venue wears a display device 41 after login processing. When the display device 41 recognizes the AR marker 42 shown in FIG. 10(a) based on input information from the camera 406, it displays the corpse image 323c at the position of the AR marker 42 (or a predetermined position) as shown in FIG. 10(b). If the display device 41 is a glasses-type or goggle-type device, the corpse image 323c is viewed superimposed on the real space that can be seen through the transparent display 405.

[0073] The image display unit 47 of the display device 41 determines the viewpoint position of the corpse image 323c in the three-dimensional image space from the relationship between the position and attitude (rotation, tilt) of the display device 41 and the position of the AR marker 42, and displays the corpse image 323c projected from the viewpoint position on the display 405. Specifically, the image display unit 47 analyzes the positional relationship (distance, direction) between the display device 41 and the AR marker 42 from the shape and size of the AR marker 42 (image) input from the camera 406, angle information input from the sensor 411, etc., and displays the corpse image 323c viewed from the viewpoint position corresponding to the positional relationship on the display 405. This allows the attendee 40 (user C) to move to a desired position by himself / herself to approach the corpse image 323c and see the face.

[0074] The display device 41 is not limited to a glasses-type device (smart glasses), and a tablet 41A or a PC equipped with a camera 406 and a display 405 can also be used. FIG. 11(a) is a plan view of the display system 4 viewed from above. As shown in FIG. 11(a), multiple tablets 41A are arranged around a sheet 43 (AR marker 42). In this case, multiple tablets 41A are arranged with the camera 406 side facing inward (toward the AR marker 42) and the display 405 facing outward. It is desirable to adjust the height position of the tablet 41A using a stand 415 or the like so that it is easily visible to the attendees 40 (user C).

[0075] Fig. 11(b) is a diagram showing how a mourner 40 looks at the tablets 41A arranged as shown in Fig. 11(a). The display 405 of each tablet 41A displays a body image 323c from a viewpoint that corresponds to the relationship between the position and posture of each tablet 41A (its camera 406) and the position of the AR marker 42. The number of tablets 41A arranged is not limited to the example shown in the figure, and it is sufficient to arrange at least one tablet 41A.

[0076] In this embodiment, an example is described in which the AR marker 42 is recognized and the corpse image 323c is displayed, but the present invention is not limited to this, and the corpse image 323c may be displayed on the display device 41 without using the AR marker 42.

[0077] FIG. 12 shows another example of the configuration of the display system 4. The left diagram of FIG. 12(a) is a perspective view of the coffin-shaped display device 41B seen from the side. The coffin-shaped display device 41B has a display 405 on the top surface of the coffin model and a control unit 401 inside. In the example of FIG. 12(a), the display 405 is shown to be located at the head position, but the size, number, and location of the display 405 are arbitrary. For example, the display 405 may be large enough to cover the entire top surface of the coffin or may be located on the side. The control unit 401 of the coffin-shaped display device 41B obtains corpse image data 323 (an image of the face in the example of FIG. 12(a)) from the server 3 and displays it on the display 405. As shown in the right diagram of FIG. 12(a), the mourner 40 can view the corpse image 323c as if the deceased 20 were actually placed in the coffin.

[0078] 12(b) shows an example of a stereoscopic display device 41C. The stereoscopic display device 41C has a transparent reflector 417 placed at a predetermined angle inside a fully transparent or front-transparent rectangular parallelepiped or fully transparent cylindrical case, and a projector 405C projects an image onto the transparent reflector 417. As a result, as shown in the right diagram of FIG. 12(b), a body image 323c is displayed three-dimensionally as if floating in space, a well-known technique (see, for example, JP 2017-028692 A).

[0079] In the photographing system 2, the corpse is photographed in an appropriate manner depending on the position, size, and display mechanism of the display 405 of the display device 41 used in the display system 4, such as a glasses-type or goggle-type display device 41, a tablet 41A, a coffin-type display device 41B, a stereoscopic display device 41C, etc., and a corpse image 323c is generated.

[0080] Next, the flow of funeral services using the funeral system 1 will be described with reference to Figure 13. In Figure 13, the boxes shown in solid lines represent processing steps using the funeral system 1, and the boxes shown in dashed lines represent steps performed by people. In the following description, User A is a member who registers with the funeral system 1 and will become the deceased person 20, User B is a relative of User A, and User C is a person who lives far from the main venue.

[0081] User A uses a smartphone, PC, or the like to access a website (funeral service site) provided by a funeral business operator or the like and performs a member registration process (step S1). User A sends personal information 321c, such as address, name, date of birth, and email address, to the funeral service site (server 3). The funeral service site (server 3) registers the received information as member information 321, issues a member ID 321a, and sends it to User A together with a password 321b (step S2).

[0082] Fig. 14 is a flowchart showing the details of the flow of the member registration process executed between the server 3 and user A's terminal (user terminal). As shown in Fig. 14, the control unit 301 (member registration unit 31) of the server 3 sends a member registration screen to user A's terminal (step S101) and accepts input of information necessary for member registration. User A's terminal displays the member registration screen on its display unit (step S102). User A inputs information about user A (such as name, address, date of birth, email address, contact information for relatives) on the member registration screen (step S103). The user terminal transmits the input information about the user to the server 3 (step S104).

[0083] When the server 3 (member registration unit 31) receives the information about user A (step S105), it issues a member ID 321a and a password 321b, associates them with the received information about the user, and stores them in the storage unit 302 as member information 321 (step S106; FIG. 3). The control unit 301 of the server 3 sends a member registration completion notice to the registered email address (user terminal) (step S107). The member registration completion notice notifies the user that member registration has been completed, and includes the member ID 321a, password 321b, etc. When the user terminal receives the member registration completion notice, it displays it on the display unit (step S108).

[0084] Once the membership registration is complete, User A goes to the funeral home facility, or the funeral home visits User A, and takes a picture of the memorial portrait 322b. The taken memorial portrait image 322c is linked to User A's member ID 321a (322a) and saved as memorial portrait image data 322 on Server 3 (Step S3).

[0085] When User A dies (Step S4), for example, User B, a relative of User A, is contacted by the hospital (Step S5). User B contacts the funeral home upon receiving the contact (Step S6). The funeral home references the member information 321 on Server 3 to confirm that User A is a member (Step S7), and begins making arrangements for the funeral venue and the coffin (Step S9). Meanwhile, the body is transported from the hospital to the main funeral venue (Step S8).

[0086] Before the funeral begins, the funeral director photographs the body of User A using the photography system 2 (step S10).

[0087] Fig. 15 is a flowchart showing the flow of the body image capturing process. As shown in Fig. 15, the funeral director captures an image of the body of the deceased 20 (user A) using the camera 22 of the capturing system 2 (step S201), and transmits the image data from the camera 22 to the control device 21 (step S202). The installation method of the camera 22 and the capturing method are to be performed in accordance with the display method of the display system 4. For example, when a 3D image is to be displayed using an AR marker 42 including orientation information as shown in Fig. 10, the entire body of the body is 3D scanned using a scanner equipped with multiple cameras 22 as shown in Fig. 9.

[0088] When the control device 21 receives image data from each camera 22 (step S203), it processes the image to generate a 3D image including orientation information and associates it with the AR marker 323d (step S204). Then, it assigns an image ID 323b to the generated body image 323c and uploads it to the server 3 together with the member ID 321a (323a) of the deceased person 20 (step S205).

[0089] The server 3 stores the body image 323c, the image ID 323b, and the member ID 321a (323a) transmitted from the control device 21 of the imaging system 2 in the storage unit 302 as body image data 323 (step S206).

[0090] The image processing in step S204 may be performed on the server 3 side instead of the control device 21. The image taken by the camera 22 (corpse image 323c) may be uploaded directly from the camera 22 to the server 3.

[0091] Returning to the explanation of FIG. The funeral director asks User B (a relative or the like) about the residential areas of the funeral attendees (step S11). The funeral director sets up the coffin of User A (deceased person 20) in the main funeral hall and begins preparations for the funeral (step S12). The funeral director also prepares a separate funeral hall in the residential area of ​​attendees and installs display system 4 therein (step S13).

[0092] At the scheduled time, the funerals begin at the main venue and the separate venue (steps S14 and S15). User B (relatives) and nearby acquaintances attend the funeral at the main venue (step S16) and come face to face with the body of the deceased 20 (user A) (step S17). Meanwhile, user C, who is in an area far from the main venue, attends the funeral at the separate venue (step S18). At the separate venue, the body image 323c is displayed on the display system 4. User C at the separate venue can view the body image 323c of the deceased 20 (user A) without going to the main venue (step S19).

[0093] 16 is a flowchart showing the flow of the display process in step S19. Here, the display process using the display system 4 that uses the AR marker 42 and the eyeglass-type display device 41 (smart glasses) is described. In the separate venue, a sheet 43 on which the AR marker 42 indicating the four directions, north, south, east, and west, is drawn is set up on a predetermined stand or the like.

[0094] User C uses the camera 406 of the display device 41 to read a QR code (not shown) or the like that includes information on the member ID 321a and password 321b of the deceased 20 (step S301). The control unit 401 (login processing unit 44) of the display device 41 sends a login request together with the member ID 321a and password 321b to the server 3 (step S302). The server 3 performs authentication processing based on the received member ID 321a and password 321b, and if the authentication is successful, performs login processing for the display device 41 (step S303).

[0095] Next, the control unit 401 (image acquisition unit 45) of the display device 41 transmits a request to the server 3 to transmit the corpse image data 323 (step S304). The server 3 reads out the corpse image data 323 linked to the corresponding member ID 321a from the storage unit 302 (step S305) and transmits it to the display device 41 (step S306). The display device 41 receives the corpse image data 323 (step S307) and stores it in the storage unit 402 (step S308).

[0096] Thereafter, when the AR marker 42 is captured by the camera 406 of the display device 41, the control unit 401 (AR marker recognition unit 46) recognizes the AR marker 42 (step S309). The control unit 401 (image display unit 47) of the display device 41 calculates the viewpoint position (direction and distance of user C) from the relationship between the position and orientation of the display device 41 and the position of the AR marker 42 (step S310), and displays the corpse image 323c on the display 405 so that it appears according to the calculated viewpoint position (step S311). If the user C moves and the positional relationship between the display device 41 and the AR marker 42 changes, steps S310 to S311 are repeated each time, and the corpse image 323c is displayed on the display 405 so that it appears based on the positional relationship between the display device 41 and the AR marker 42.

[0097] While FIG. 13 illustrates the case where the body image 323c is captured before the funeral, the body image 323c may alternatively be captured during the funeral. FIG. 17 illustrates an example of the installation of the imaging system 2 when imaging is performed during the funeral. As shown in the figure, multiple cameras 22a-22h are installed in various directions (north, northeast, east, southeast, south, southwest, west, and northwest) diagonally above the coffin 11 containing the deceased 20, and video is captured. The images captured by each of the cameras 22a-22h, along with the position information of each of the cameras 22a-22h, are input to the control device 21. It is acceptable for attendees (user B) to appear in the images. The images captured by each of the cameras 22a-22h and the position information of each of the cameras 22a-22h are uploaded to the server 3 along with the member ID 321a and transmitted in real time to the display system 4 (display device 41) at a separate venue for display. In the display system 4, the control unit 401 (image display unit 47) of the display device 41 determines which of the cameras 22a to 22h should display the image captured by, based on the relative positions of the AR marker 42 and the display device 41. For example, if the display device 41 is located to the west of the AR marker 42, the image captured by the camera 22g is displayed. Note that the image does not necessarily need to be displayed in real time; for example, the body image 323c may be re-captured at predetermined times, such as at a flower arrangement ceremony, and the image displayed on the display system 4 may be updated.

[0098] The display system 4 may display the pre-taken body image 323c until halfway through the funeral, and then switch to live video midway. Users at other venues can view the deceased 20 and the funeral even if they cannot attend the main venue, and can spend time saying goodbye to the deceased 20 with all their heart.

[0099] While the preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that those skilled in the art can conceive of various modifications and alterations within the scope of the technical ideas disclosed in this application, and it is understood that these modifications and alterations also fall within the technical scope of the present invention. [Explanation of symbols]

[0100] 1. Funeral system 2. Shooting system 3...Server 4. Display system 5. Network 11...Coffin 20...Deceased 21...Control device 22...Camera 25: Image processing section 26...Image processing unit 27...Image upload section 31...Member Registration Department 32...Image acquisition unit 34...Image transmission unit 40……Person in attendance 41...Display device 41A...Tablet 41B………Coffin-shaped display 41C: 3D display 42...AR marker 43...Seat 44: Login processing section 45...Image acquisition unit 46: AR marker recognition unit 47...Image display section 321...Member information 322...Image data for memorial portraits 323... Corpse image data

Claims

1. a photographing means for photographing the body of the deceased; a storage means for storing the image of the body photographed by the photographing means; a display means for displaying an image of the body of the deceased at a venue separate from the main venue of the funeral of the deceased, the display means acquiring the image of the body from the storage means; Equipped with The image of the corpse is linked to an AR marker, the display means includes a display device equipped with recognition means for recognizing the AR marker; When the recognition means recognizes the AR marker, the display device displays an image of the corpse associated with the recognized AR marker in a superimposed manner on a real space. A funeral system characterized by:

2. the image of the body and the AR marker have orientation information; The funeral system described in claim 1, characterized in that the display means calculates a viewpoint position in a three-dimensional image space based on the relationship between the position and orientation of the display device and the position of the AR marker, and displays the image of the corpse as if viewed from the calculated viewpoint position.

3. 3. The funeral system according to claim 1, wherein the display means includes a plurality of tablet terminals arranged around the AR marker.

4. The imaging device further includes an image processing unit that generates a three-dimensional image of the body based on images taken from a plurality of positions by the imaging unit, The storage means stores a three-dimensional image of the body, 4. The funeral system according to claim 1, wherein the display means displays the three-dimensional image.

5. 5. A funeral system according to claim 1, wherein the display means is a display device equipped with a glasses-type or goggle-type display.

6. 6. The funeral system according to claim 1, wherein the photographing means photographs an image of the body before the funeral.

7. The photographing means photographs an image of the body at the main venue during the funeral, 7. The funeral system according to claim 1, wherein the display means acquires and displays images of the body in real time via a network.

8. 8. The funeral system according to claim 1, further comprising a member registration means for performing member registration processing in order to use the funeral system.

9. a storage means for storing an image of the body of the deceased photographed by the photographing means in association with the AR marker; an image transmitting means for transmitting an image of the body to a display means that acquires an image of the body from the storage means and displays the image; and a display device that is used in a venue other than the main venue of the funeral of the deceased and includes a recognition means for recognizing the AR marker. Equipped with The server is characterized in that the image transmission means transmits an image of the corpse to the display means so that when the recognition means recognizes the AR marker, the display device can superimpose an image of the corpse associated with the AR marker recognized by the recognition means onto real space.

10. A display device to be used at a venue other than the main venue of the funeral of the deceased, A communication means for communicating with the server; a display means for acquiring and displaying an image of the body of the deceased person, which is stored in association with the AR marker in the storage means of the server; Equipped with further comprising recognition means for recognizing the AR marker; A display device characterized in that when the recognition means recognizes the AR marker, an image of the corpse linked to the recognized AR marker is superimposed on real space and displayed.

11. a photographing step of photographing the body of the deceased using a photographing system; A step in which a control device of the imaging system uploads the photographed image of the body to a server; The server stores the image of the body in a storage unit in association with the AR marker; a step of displaying an image of the body on a display device that is used in a venue separate from the main venue of the funeral of the deceased and that is capable of recognizing the AR marker; and Including, A corpse image display method characterized in that in the step of displaying the image of the corpse, when the display device recognizes the AR marker, it displays the image of the corpse linked to the recognized AR marker superimposed on real space.

12. Computer, a storage means for storing an image of the body of the deceased photographed by the photographing means in association with the AR marker; an image transmitting means for transmitting an image of the body to a display means including a display device that is used in a venue other than the main venue of the funeral of the deceased and that includes a recognition means for recognizing the AR marker; A program for functioning as The image transmission means is a program that transmits an image of the corpse to the display means so that when the recognition means recognizes the AR marker, the display device can superimpose an image of the corpse associated with the AR marker recognized by the recognition means onto real space.

13. Display devices used in venues other than the main venue of the deceased's funeral, A communication means for connecting to the server; a display means for acquiring and displaying an image of the body of the deceased person, which is stored in association with the AR marker in the storage means of the server; A program for functioning as further functioning as a recognition means for recognizing the AR marker; The display device is a program that, when the recognition means recognizes the AR marker, displays an image of the corpse associated with the recognized AR marker superimposed on real space.

Images