Image Processing System
The image processing system addresses the challenge of enhancing visitor engagement in tourist facilities by replacing visitor faces with character images in selfies, thereby improving enjoyment and repeat visits.
Patent Information
- Application Number
- JP2020209874
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-12-18
- Publication Date
- 2025-01-15
- Estimated Expiration
- 2040-12-18
AI Technical Summary
Existing mixed reality technologies are not effectively applicable to enhance visitor engagement and unity with characters in predetermined areas like tourist facilities.
An image processing system that allows visitors to take selfies using mobile terminals, processes these images through a server with a character database, and replaces visitor faces with character images, displaying the transformed images on the terminals within the designated area.
Enhances visitor engagement and unity with characters, improving the enjoyment and repeat visitation rates by making visitors feel as if they have transformed into characters within the facility.
Smart Images

Figure 0007613906000001 
Figure 0007613906000002 
Figure 0007613906000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing system, and more particularly to an image processing system that replaces a part of a self-taken image of oneself with a part of a character image and displays the replaced image on a mobile terminal.
[0002] In recent years, a technology has been used that uses mixed reality technology to overlay a three-dimensional CG camera image onto a mockup camera image in a head-mounted display (hereinafter referred to as HMD), making the wearer of the HMD feel as if he or she is handling a real camera when handling the mockup camera (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2005-108108 A Summary of the Invention [Problem to be solved by the invention]
[0004] Recently, various tourist facilities have been constructed. In designated areas of tourist facilities, it is important to ensure that visitors have a fun time and return many times. For example, by making visitors feel as if they are spending time with the characters of the attractions, the sense of unity with the characters can be improved, making them feel more enjoyable. However, the technology described in Patent Document 1 has little relevance to designated areas of tourist facilities, and it is difficult to apply it to designated areas of tourist facilities as it is.
[0005] Therefore, an object of the present invention is to make visitors in a specified area feel a sense of unity with the characters. [Means for solving the problem]
[0006] The image processing system of the present invention is an image processing system comprising: a portable device with which an attendee in a specified area can take a selfie; and a server that processes the selfie image of the attendee taken by the attendee on the portable device to generate a display image to be displayed on the portable device, wherein the server includes a database that stores image data of a character, and generates the display image by replacing a part of the image of the attendee in the selfie image taken by the attendee on the portable device with a part of the image of the character selected by the attendee, and when the portable device is registered on the server, controls the display of the selfie image on the portable device while the attendee is within the specified area. Prohibit and on the mobile device The display image generated by the server Show The present invention is characterized by the following. Effect of the Invention
[0007] The present invention allows visitors to a specified area to feel a sense of unity with the characters. [Brief description of the drawings]
[0008] [Figure 1] 1 is a system diagram showing a configuration of an image processing system according to an embodiment. [Diagram 2] 4 is a flowchart showing the operation of the image processing system according to the embodiment. [Diagram 3] FIG. 13 is a diagram showing a selfie image taken by a visitor using a mobile terminal. [Figure 4] FIG. 13 is a diagram showing a display image displayed on a visitor's mobile terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] An image processing system 100 according to an embodiment will be described below with reference to the drawings. In the following description, a case where the image processing system 100 is applied to a theme park 80 will be described. Here, the theme park 80 is a tourist facility whose entirety is produced based on a specific theme such as a culture, country, story, movie, or era. As shown in FIG. 1, the image processing system 100 is composed of first to fourth mobile terminals 13, 16, 23, and 26 held by first to fourth visitors 11, 14, 21, and 24 of the theme park 80, and a server 40 connected to each of the mobile terminals 13, 16, 23, and 26 via a communication line 50 such as the Internet or a telephone line.
[0010] The first mobile terminal 13 carried by the first visitor 11 has a photographing function, and the first visitor 11 can take a selfie by taking a picture of himself / herself with the first mobile terminal 13 carried by the first visitor 11. The first mobile terminal 13 transmits a selfie image 61 (see FIG. 3) to the server 40, and receives a display image 62 (see FIG. 4) generated by the server 40 and displays it on the display. The same is true for the second to fourth mobile terminals 16, 23, 26.
[0011] The server 40 is a computer having a CPU 42, which is a processor that performs information processing, and a memory 44 that stores programs, operation data, and the like. A database 46 is stored in the memory 44. Image data of the character 30 is stored in the database 46. The server 40 processes the selfie image 61 received from each of the mobile terminals 13, 16, 23, and 26, generates a display image 62 to be displayed on the display of each of the mobile terminals 13, 16, 23, and 26, and transmits the display image 62 to each of the mobile terminals 13, 16, 23, and 26. In addition, the server 40 can control the display of each display when each of the mobile terminals 13, 16, 23, and 26 is registered.
[0012] Next, the operation of the image processing system 100 of the embodiment will be described with reference to Figures 2 to 4. In the following description, it is assumed that there are two families in the theme park 80: a first family 10 consisting of a first visitor 11 and a second visitor 14, and a second family 20 consisting of a third visitor 21 and a fourth visitor 24. The first family 10 will be described below.
[0013] 2, when the first family member 10 enters the theme park 80, the first and second mobile terminals 13, 16 are registered in the server 40 as the mobile terminals of the first family member 10. As a result, while the first and second visitors 11, 14 are in the theme park 80, the server 40 restricts the first and second mobile terminals 13, 16 from displaying the selfie images 61 taken by the first and second visitors 11, 14 on the display, and causes the display image 62 generated by the server 40 to be displayed on the display. Next, as shown in step S102 in FIG. 2, the first visitor 11 registers in the server 40 the characters 30 into which the first and second visitors 11, 14 of the first family member 10 would like to transform in the theme park 80.
[0014] As shown in step S103 of FIG. 2, when the first visitor 11 of the first family 10 takes a selfie with the first mobile terminal 13, as shown in step S104 of FIG. 2, the first mobile terminal 13 transmits the selfie image 61 shown in FIG. 3 to the server 40.
[0015] The server 40 generates the display image 62 in step S105 of Fig. 2. The display image 62 is generated as follows.
[0016] The selfie image 61 received by the server 40 from the first mobile terminal 13 includes the appearance of the first visitor 11 and the background. The server 40, while referring to the database 46 in which the image of the character 30 is stored, replaces the face 12, which is part of the image of the appearance of the first visitor 11, with the face 32 of the character 30 selected by the first family member 10 in step S102 of Fig. 2, to generate the display image 62 shown in Fig. 4. The server 40 then transmits the display image 62 to the first mobile terminal 13 in step S106 of Fig. 2.
[0017] When the first mobile terminal 13 receives the display image 62 from the server 40 in step S107 of FIG. 2, the first mobile terminal 13 displays the display image 62 on the display of the first mobile terminal 13.
[0018] As described above, when the first visitor 11 takes a selfie with the first mobile terminal 13, the face 12 of the first visitor 11 is displayed on the display of the first mobile terminal 13 as the face 32 of the character 30. This makes the first visitor 11 feel as if he or she has transformed into the character 30, and the first visitor 11 feels a sense of unity with the character 30, making the theme park 80 even more enjoyable. This can increase the repeat visit rate of the first visitor 11.
[0019] In addition, since the first mobile terminal 13 is registered with the server 40, the server 40 restricts the first mobile terminal 13 from displaying the selfie image 61 taken by the first visitor 11 while the first visitor 11 is in the theme park 80, and causes the first mobile terminal 13 to display the display image 62 generated by the server 40. Therefore, if the first visitor 11 takes a selfie while in the theme park 80, the display image 62 is always displayed on the display. Therefore, the first visitor 11 can feel as if he or she has transformed into the character 30 at all times while in the theme park 80.
[0020] In the above description, the first visitor 11 takes a selfie of only himself / herself, but if the first visitor 11 takes a selfie of both himself / herself and the second visitor 14, the server 40 generates a display image 62 in which the faces 12, 15 of the first and second visitors 11, 14 in the selfie image 61 are replaced with the faces 32 of the characters 30, and transmits the display image 62 to the first mobile terminal 13 for display. Also, the second visitor 14 can register a character different from the first visitor 11 in the server 40. In this case, the server 40 generates a display image 62 in which the faces 12, 15 of the first and second visitors 11, 14 in the selfie image 61 are replaced with the faces 32 of the characters 30 registered separately, and transmits the display image 62 to the first mobile terminal 13 for display.
[0021] Furthermore, when the first and second mobile terminals 13, 16 are registered in the server 40 as the mobile terminals of the first family 10, the server 40 prohibits the first and second mobile terminals 13, 16 from displaying other family members who have registered their mobile terminals. Therefore, if the second family 20 has registered the third and fourth mobile terminals 23, 26 in the server 40 as the mobile terminals of the second family 20, the server 40 prohibits the first and second mobile terminals 13, 16 from displaying images of the third visitor 21 and the fourth visitor 24 of the second family 20. Therefore, if images of the third visitor 21 and the fourth visitor 24 of the second family 20 are included in the selfie image 61 captured by the first and second mobile terminals 13 and 16, the server 40 replaces the faces 12 and 15 of the first and second visitors 11 and 14 with the face 32 of the character 30, and replaces the images of the third visitor 21 and the fourth visitor 24 included in the selfie image 61 with an image of the background.
[0022] As a result, the first and second mobile terminals 13, 16 do not display the second family 20 on their displays, making them feel as if they are the only ones in the theme park 80. This makes the first and second visitors 11, 14 feel as if the theme park 80 is exclusively for the first family 10, allowing them to enjoy themselves in the theme park 80. This also makes it possible to increase the repeat visit rate of the first and second visitors 11, 14.
[0023] In the above description, the process is described for the case where the first visitor 11 of the first family 10 takes the selfie image 61, but the process is similar for the case where the third visitor 21 of the second family 20 takes the selfie image 61. When the third visitor 21 takes a selfie image including both himself and the fourth visitor 24, the server 40 generates a display image 62 in which the faces 22, 25 of the third and fourth visitors 21, 24 in the selfie image 61 are replaced with the face 32 of the character 30, and transmits the display image 62 to the third mobile terminal 23 for display. In addition, when the selfie image 61 taken by the third and fourth mobile terminals 23, 26 includes images of the first visitor 11 and the second visitor 14 of the first family 10, the server 40 replaces the images of the first visitor 11 and the second visitor 14 included in the selfie image 61 with an image of the background.
[0024] This allows the third and fourth visitors 21, 24 to feel as if they have transformed into the character 30 and as if the theme park 80 is available exclusively for them. This allows the third and fourth visitors 21, 24 to enjoy themselves in the theme park 80. This also increases the repeat visit rate of the third and fourth visitors 21, 24.
[0025] In the above description, the server 40 prohibits the first and second mobile terminals 13, 16 from displaying the second family member 20 who has registered the mobile terminal, and replaces the image with a background image when the third visitor 21 and the fourth visitor 24 of the second family member 20 are included in the selfie image 61, but this is not limited as long as the second family member 20 is not displayed on the display. For example, the server 40 may prohibit the first and second mobile terminals 13, 16 from taking a photo that includes the second family member 20. Specifically, when an image of the second family member 20 is included on the display, the server 40 may prevent the shutters of the first and second mobile terminals 13, 16 from being released.
[0026] Although the above describes the case where the image processing system 100 is applied to the theme park 80, the image processing system 100 can also be applied to specific areas other than the theme park 80, such as amusement parks, botanical gardens, zoos, etc. [Explanation of symbols]
[0027] 10,20 Family, 11,14,21,24 Visitor, 12,15,22,25,32 Face, 13,16,23,26 Mobile terminal, 30 Character, 40 Server, 42 CPU, 44 Memory, 46 Database, 50 Communication line, 61 Selfie image, 62 Display image, 80 Theme park, 100 Image processing system.
Claims
[Claim 1] A mobile device that allows visitors in a designated area to take selfies; a server that processes a selfie image of the visitor taken by the visitor with the mobile terminal and generates a display image to be displayed on the mobile terminal, The server, A database for storing image data of characters; generating the display image by replacing a part of an image of the visitor in the selfie image taken by the visitor with the mobile terminal with a part of an image of the character selected by the visitor; when the mobile device is registered in the server, prohibiting the display of the selfie image on the mobile device while the visitor is in a predetermined area, and displaying the display image generated by the server on the mobile device; An image processing system comprising:
Citation Information
Patent Citations
Image output device, image output method, image output processing program, image distribution server, and image distribution processing program
JP2004302939A
Operating device and method for three-dimensional CG and calibration device for position / attitude sensor
JP2005108108A
Information superimposing terminal and added image superimposing system
JP2006148618A
Image synthesis device and control method thereof
JP2010086178A
Image processor, image processing method, and program
JP2011070623A