Information processing device, information processing method, program, and image provision system
The information processing device aligns image processing between device-created and self-taken images by managing and transmitting specific processing information, addressing user discomfort in photo sticker creation systems.
Patent Information
- Application Number
- JP2023120492
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-07-25
- Publication Date
- 2025-02-06
AI Technical Summary
Users experience discomfort when comparing images created in a photo sticker creation device with self-taken images due to differing image processing content.
An information processing device and method that manages and transmits specific image processing information to a user's mobile terminal, ensuring consistent image processing between images created in the device and self-taken images.
Eliminates discomfort by aligning image processing between device-created and self-taken images, providing a seamless integration of both image types.
Smart Images

Figure 2025017462000001_ABST
Abstract
Description
[Technical field]
[0001] The present technology relates to an information processing device, an information processing method, a program, and an image providing system, and in particular to an information processing device, an information processing method, a program, and an image providing system that can eliminate the sense of incongruity in selfie images. [Background technology]
[0002] Conventionally, a photo sticker creation device is known. The photo sticker creation device takes a picture of a user, allows the user to edit the photographed image, and prints the edited image on a sticker sheet to provide the user. The photo sticker creation device is installed in amusement facilities and the like.
[0003] The flow of a game provided by the photo sticker creation device typically involves taking a photo of the user in the shooting space as the subject, then moving the user to the editing space, editing the image according to the operations performed in the editing space, and printing the edited image on sticker paper.
[0004] There is also a membership-based service that provides users with images created in a game using a photo sticker creation device as image data, rather than as printed matter. Users who play the game can create an account to use the service, and then use a mobile device such as a smartphone to access an image acquisition site and view the images created in the game on the screen of the mobile device.
[0005] On the other hand, in recent years, an increasing number of photo sticker creation devices are equipped with a configuration for taking pictures of the user playing a game with their own mobile device (so-called selfie). For example, Patent Document 1 discloses a photo creation game machine equipped with a mobile device holder for holding a mobile device with a photographing function on at least a part of the vertical surface included in the housing. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2020-8674 A Summary of the Invention [Problem to be solved by the invention]
[0007] Images created in the game of the photo sticker creation device are subjected to image processing according to the model of the photo sticker creation device. Also, images taken by the user himself with his own mobile terminal (hereinafter referred to as "selfie images") may be subjected to image processing by an image processing application (processing app) installed on the mobile terminal.
[0008] Here, if the content of image processing applied to each image is different, the user will feel uncomfortable when comparing the image created in the game using the photo sticker creating device with the self-portrait image.
[0009] The present technology has been made in consideration of such circumstances, and is intended to make it possible to eliminate the sense of incongruity that appears in self-portrait images. [Means for solving the problem]
[0010] The information processing device of the present technology is set for each model of photo sticker creation device and includes an information management unit that manages specific information that specifies image processing for a captured image taken in a photo creation game, and a transmission processing unit that transmits the specific information corresponding to the model of the photo sticker creation device to a mobile terminal of a user who is photographed as the subject of the captured image, and the specific information is an information processing device used for the image processing for a terminal image captured by the photographing function of the mobile terminal.
[0011] The information processing method of the present technology is an information processing method in which an information processing device manages specific information that is set for each model of photo sticker creation device and specifies image processing for a captured image taken in a photo creation game, and transmits the specific information corresponding to the model of the photo sticker creation device to a mobile terminal of a user who was photographed as the subject of the captured image, and the specific information is used for the image processing of a terminal image captured by the photography function of the mobile terminal.
[0012] The program of the present technology is a program that causes a computer to acquire specific information that is set for each model of photo sticker creation device and specifies image processing for a captured image taken in a photo creation game, the specific information corresponding to the model of the photo sticker creation device being sent to a mobile terminal of a user who was photographed as the subject of the captured image, and to use the specific information to execute a process of applying the image processing to a terminal image captured by the photography function of the mobile terminal.
[0013] The image providing system of the present technology is an image providing system that includes an information management unit that is set for each model of photo sticker creation device and manages specific information that specifies image processing for a captured image taken in a photo creation game, an information acquisition unit that acquires the specific information corresponding to the model of the photo sticker creation device and sent to a mobile terminal of a user who was photographed as the subject of the captured image, and an image processing unit that uses the specific information to perform the image processing on a terminal image captured by the photography function of the mobile terminal.
[0014] In this technology, specific information is set for each model of photo sticker creation device and specifies the image processing for a captured image taken in a photo creation game, and the specific information corresponding to the model of the photo sticker creation device is sent to the mobile terminal of a user who was photographed as the subject of the captured image, and is used for the image processing for a terminal image captured by the photography function of the mobile terminal. Effect of the Invention
[0015] According to the present technology, it is possible to eliminate the sense of incongruity that appears in self-portrait images.
[0016] Note that the effects described here are not necessarily limited to those described above, and may be any of the effects described in this specification. [Brief description of the drawings]
[0017] [Figure 1] 1 is a diagram illustrating an example of the configuration of an image providing system according to an embodiment of the present technology. [Diagram 2] FIG. 11 is a diagram showing an example of information uploaded from the photo sticker creating device. [Diagram 3] FIG. 1 is a diagram showing an example of a usage form of an image providing service. [Figure 4] FIG. 13 is a diagram showing a display example of a My Page screen. [Diagram 5] FIG. 11 is a diagram showing an example of how images are managed in an image management server. [Figure 6] FIG. 13 is a diagram showing an example of a confirmation screen display. [Figure 7] FIG. 13 is a diagram showing an example of how an image is specified by an image management server. [Figure 8] FIG. 13 is a diagram showing an example of how an image is specified by an image management server. [Figure 9] FIG. 2 is a diagram showing an example of the flow of information in an image providing system. [Figure 10] 2 is a block diagram showing an example of a hardware configuration of an image management server; [Figure 11] 2 is a block diagram showing an example of a functional configuration of an image management server; [Figure 12] FIG. 11 is a diagram illustrating an example of image processing parameters. [Figure 13] FIG. 2 is a block diagram showing a configuration example of a mobile terminal. [Figure 14] 13 is a flowchart illustrating a process executed by an image management server. [Figure 15] 11 is a flowchart illustrating a process executed by a mobile terminal. [Figure 16]FIG. 11 is a diagram showing another example of the flow of information in the image providing system. [Figure 17] 13 is a flowchart illustrating a process executed by an image management server. [Figure 18] FIG. 13 is a diagram illustrating an example of a member DB. [Figure 19] 13 is a flowchart illustrating a process executed by an image management server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0018] Hereinafter, modes for carrying out the present technology (hereinafter, referred to as embodiments) will be described in the following order. 1. About the image provision service 2. Selfies and their strangeness 3. First embodiment (transmission of specific information to a mobile terminal in response to access) 4. Second embodiment (transmission of specific information to a pre-linked mobile terminal) 5. Third embodiment (transmission of specific information to a mobile terminal based on face information) 6. About the Program
[0019] <1. About the image provision service> (System Configuration) FIG. 1 is a diagram illustrating an example of the configuration of an image providing system.
[0020] The image providing system of FIG. 1 is configured by connecting an image management server 1, a photo sticker creating device 2, and a mobile terminal 3 via the Internet 11.
[0021] 1 shows only one photo sticker creating device 2, but in reality, multiple photo sticker creating devices 2 sold by the same manufacturer are provided. The mobile terminals 3 are smartphones of users (users) who use the photo sticker creating device 2, and are provided for example in the same number as the number of users who use the photo sticker creating device 2.
[0022] The photo sticker creating device 2 is a game machine that provides a photo creating game. The photo sticker creating device 2 is installed in an amusement facility such as a game center or a store.
[0023] Users of the photo sticker creating device 2 are mainly high school girls and young women. In the photo sticker creating device 2, multiple users, mainly two or three people per group, can enjoy the game. Of course, in the photo sticker creating device 2, one user can also enjoy the game.
[0024] In the photo sticker creation device 2, the user takes a photograph, being the subject of the photograph. The user performs an editing operation to combine a composite image, such as handwritten characters or a stamp image, with the photographed image obtained by the photographing operation, and edits the photographed image into a colorful image.
[0025] In one game provided by the photo sticker creating device 2, multiple shots are taken, and multiple shot images, for example, five shot images, are obtained. Editing is also performed on each of the multiple shot images, and multiple edited images are created. The user receives the sticker paper on which the edited images are printed, and the series of games is completed.
[0026] In this way, the photo sticker creating device 2 has a function as a photographing device that takes a picture of the user as a subject.
[0027] The photo sticker creating device 2 includes a computer that controls the overall operation of the photo sticker creating device 2, a camera that photographs the user, an editing monitor that is used by the user to edit the captured image obtained by photographing with the camera, a printer that prints the image on a print medium such as sticker paper, etc. Details of the configuration of the photo sticker creating device 2 are disclosed in, for example, JP 2018-64220 A.
[0028] The photo sticker creating device 2 provides the images created in the game to the user by printing them on sticker paper, and also by making the images viewable on the mobile terminal 3. The photo sticker creating device 2 transmits (uploads) the images created in the game to the image management server 1.
[0029] The image management server 1 receives images uploaded from the photo sticker creation device 2 and stores them by assigning a predetermined URL, etc. The image management server 1 provides an image providing service that provides images to users who access the server by operating a mobile terminal 3.
[0030] The image providing service is a membership-based service that enables viewing of images on the mobile terminal 3 and downloading of images to the mobile terminal 3. It may also be possible to use the image providing service to perform image editing and the like.
[0031] After the user of the portable terminal 3 finishes the game using the photo sticker creating device 2, the user operates the portable terminal 3 to access the image management server 1 and uses the image providing service to view images.
[0032] An application for displaying a screen of the image providing service provided by the image management server 1 is installed in the mobile terminal 3.
[0033] Other mobile terminals such as tablet terminals, and terminals such as PCs (personal computers) and TVs (television receivers) that can send and receive various information with servers on the Internet 11 may also be used as information processing terminals for using the image provision service.
[0034] (About uploaded information) The type of image uploaded will vary depending on the model of the photo sticker creation device 2, as follows:
[0035] (1) When all edited images created in one game are uploaded (2) When all edited and photographed images created in one game are uploaded
[0036] In the case of (1) above, if five photos are taken in one game, five edited images created from the five photos taken will be uploaded. The five photos that were the basis for the edits will not be uploaded.
[0037] In the case of (2) above, if five photos are taken in one game, a total of 10 images will be uploaded: five edited images and five taken images.
[0038] Depending on the model, some games allow up to six photos to be taken in one game. The number of photos uploaded may vary depending on the number of photos taken.
[0039] FIG. 2 is a diagram showing an example of information uploaded from the photo sticker creating device 2. As shown in FIG.
[0040] 2, management information is added to an image uploaded from the photo sticker creating device 2. The management information is information that is generated in the photo sticker creating device 2 in order to manage the uploaded images, and is transmitted to the image management server 1. In the image management server 1, the uploaded images are managed in association with each piece of information included in the management information.
[0041] The management information includes a sticker ID, an image selection flag, and an email address.
[0042] The sticker ID is an ID that is issued by the photo sticker creating device 2 for each game according to a predetermined rule. Since it is an ID that is issued every time a game is played, it can also be said to be an ID for identifying the game.
[0043] For example, the sticker ID is printed on the edge of the sticker paper on which the edited image is printed and is notified to the user. When the user of the mobile terminal 3 who has logged in to the image providing service inputs the sticker ID while looking at the edge of the sticker paper, the image created in the game by the user of the mobile terminal 3 is identified in the image management server 1. In this way, the sticker ID is used to identify the image created by each user.
[0044] The image selection flag is a flag that indicates an image selected by the user during the game as an image to be saved on the My Page screen.
[0045] For example, at a predetermined timing, such as when editing of a photographed image is completed, one image to be edited is selected using the screen displayed on the editing monitor. As will be described later, the My Page screen is a user-dedicated screen that is assigned to each user who has registered as a member, and is used for viewing images managed in the image management server 1.
[0046] The email address is the email address of the user entered during the game.
[0047] The email address of the user is used by the image management server 1, for example, to notify the user of the URL assigned as the image storage destination by email. When there are two users, the email address of each user is included in the management information.
[0048] For example, at a predetermined timing, such as when editing of a captured image is completed, an email address is entered using a screen displayed on the editing monitor.
[0049] (Member type) In order to use the image providing service provided by the image management server 1, the user must register as a member and create an account for the image providing service.
[0050] Membership registration is performed, for example, by operating the mobile terminal 3 to access a specific site and setting a user ID and password with the registration screen displayed. The user's email address is used as the user ID.
[0051] By using an email address as the user ID, as described above, it becomes possible for the image management server 1 to identify the user who played the game based on the email address included in the management information sent from the photo sticker creation device 2 along with the image.
[0052] Instead of an email address, various types of identification information such as a telephone number, a social networking service (SNS) ID, etc. may be used as information for identifying a user.
[0053] The types of members include, for example: (1) Free Membership (2) Paid membership
[0054] A free member is a member who does not pay membership fees.
[0055] Free members are allowed to save only one image on the My Page screen that is created in the photo sticker creating device 2 in one game and uploaded from the photo sticker creating device 2. The image that can be saved on the My Page screen is one image selected by the user during the game.
[0056] When a free member user performs an operation to save an unsaved image, one image selected during the game is saved on the My Page screen.
[0057] A free member may be allowed to save not just one image, but multiple images on the My Page screen.
[0058] A paid member is a member who is required to pay a membership fee of a specified amount, for example, 300 yen / month.
[0059] Paid members are allowed to save all images created in the photo sticker creating device 2 in one game and uploaded from the photo sticker creating device 2 on their My Page screen.
[0060] When a paid member performs an operation to save an unsaved image, all images created in one game are saved on the My Page screen.
[0061] In this way, the number of images that can be saved on the My Page screen differs depending on whether the member is a free member or a paid member, which are the types of members for using the image providing service.
[0062] (Service Usage) FIG. 3 is a diagram showing an example of how the image providing service is used.
[0063] 3A and 3B, the image providing service can be used in two ways: using a dedicated application 3A installed in a mobile terminal 3, and using a Web browser 3B. The dedicated application 3A is, for example, an application prepared by a service provider of the image providing service (the manufacturer of the photo sticker creating device 2).
[0064] 3A, when a user activates the dedicated application 3A, the dedicated application 3A accesses the image management server 1. On the display of the mobile terminal 3, a login screen is displayed by the dedicated application 3A as appropriate.
[0065] When a login operation is performed using a user ID and password, a screen such as a My Page screen for using the image provision service is displayed on the display of the mobile terminal 3 based on the information sent from the image management server 1.
[0066] On the other hand, as shown in FIG. 3B, when a user accesses the image management server 1 by launching a Web browser 3B and entering a specific URL, a login screen is displayed by the Web browser 3B on the display of the mobile terminal 3 as appropriate.
[0067] When a login operation is performed using a user ID and password, a screen such as a My Page screen for using the image provision service is displayed on the display of the mobile terminal 3 based on the information sent from the image management server 1.
[0068] In this way, the user can use the image providing service via the dedicated application 3A or via the Web browser 3B.
[0069] (My Page screen) FIG. 4 is a diagram showing a display example of the My Page screen.
[0070] The My Page screen is displayed on the display 21 of the mobile terminal 3 based on information transmitted from the image management server 1 when the user starts the dedicated application 3A and performs a login operation, or when the user starts the Web browser 3B and accesses the image management server 1 and performs a login operation. The My Page screen shown in Fig. 4 is a screen displayed by the dedicated application 3A or the Web browser 3B.
[0071] Here, the user of the portable terminal 3 is the same person as the user of the photograph sticker creating device 2 who played the game using the photograph sticker creating device 2.
[0072] In the image management server 1, the user who performed the login operation is identified based on the user ID, and information regarding images saved by the user is transmitted to the mobile terminal 3.
[0073] The name of the image provision service, "PPPLINK," is displayed in the upper left corner of the My Page screen in Figure 4.
[0074] Below the name of the image providing service, a menu area 31 is formed in which buttons used to select various items are arranged. For example, the menu area 31 includes a button to be operated when displaying a My Page screen, a button to be operated when browsing beauty-related information, and the like.
[0075] In the thumbnail area 32 below the menu area 31, images created by the user of the mobile terminal 3 using the photo sticker creating device 2 are displayed as thumbnail images.
[0076] 4, thumbnail images P21 to P26 are displayed in two rows in the thumbnail area 32. The thumbnail images P21 to P24 are displayed in their entirety, and only the upper portions of the thumbnail images P25 and P26 are displayed.
[0077] For ease of explanation, the thumbnail images shown in FIG. 4 have not been edited, but the images displayed on the My Page screen will be edited as appropriate depending on the user's membership type, etc.
[0078] Many more images are arranged below the thumbnail images P21 to P24. The user can switch the display range of the thumbnail area 32 to display other thumbnail images by placing a finger on the surface of the display 21 and performing a swipe operation or the like. For example, when a specific thumbnail image is tapped, the image selected by the tap operation is enlarged and displayed on the My Page screen.
[0079] In this way, the user can view the images created when playing the game as a user of the photo sticker creating device 2 on the My Page screen.
[0080] The images displayed on the My Page screen as described above are images that have been uploaded from the photo sticker creating device 2 to the image management server 1 and that the user has selected to save.
[0081] That is, in order for the user to view an image created using the photo sticker creating device 2 on the My Page screen, the user must perform an operation to save (obtain) the image uploaded from the photo sticker creating device 2.
[0082] (Regarding image management) FIG. 5 is a diagram showing an example of how images are managed in the image management server 1. As shown in FIG.
[0083] As shown in FIG. 5, the types of images managed by the image management server 1 include unsaved images P41 and saved images P42.
[0084] The unsaved image P41 is an image for which no operation has been performed to save it, and the saved image P42 is an image for which an operation to save it has been performed. The saved image P42 is an image to be displayed on the My Page screen.
[0085] Each image uploaded from the photo sticker creating device 2 is managed as an unsaved image P41 or a saved image P42 according to its attribute. The unsaved image P41 and the saved image P42 may be stored in physically different storage media.
[0086] An image uploaded from the photo sticker creating device 2 and stored in a predetermined storage area is first managed as an unsaved image P41.
[0087] A storage period, such as one week, is set for all unsaved images uploaded from the photo sticker creating device 2. Images uploaded from the photo sticker creating device 2 are stored in the storage area of the image management server 1 until the storage period expires. Images whose storage period has expired are, for example, deleted from the storage area.
[0088] When a user who has accessed the image management server 1 using the mobile terminal 3 performs an operation to save an image, the unsaved image P41 for which the operation to save has been performed is managed as a saved image P42 as indicated by the arrow A1. For example, the attributes set for each image are changed.
[0089] Images managed as saved images P42 continue to be stored in the storage area, for example, while the membership registration is valid and the user can use the My Page screen.
[0090] In this way, in order for a user to view an image created using the photo sticker creation device 2 on the My Page screen, the user must perform an operation to save the image before the storage period expires.
[0091] The unsaved image P41 is an image for which a storable period is set, whereas the saved image P42 displayed on the My Page screen is an image for which there is no time limit.
[0092] In addition, the saved image P42 is an image with no restrictions on how it can be used, and can be viewed on the My Page screen, as well as downloaded to the mobile terminal 3. The image downloaded to the mobile terminal 3 is saved in, for example, the local storage of the mobile terminal 3.
[0093] When a user operates the mobile terminal 3 to log in to the image providing service and performs an operation to save an unsaved image, a confirmation screen according to the user's membership type, etc. is displayed on the display 21 of the mobile terminal 3. Various operations for saving an unsaved image are prepared, as will be described later.
[0094] FIG. 6 is a diagram showing an example of a display of a confirmation screen for a free membership.
[0095] When a free member user performs an operation to save an unsaved image, the message "One image has been saved to your page" is displayed, as shown at the top of Figure 6, and the saved image is displayed below that as a thumbnail image.
[0096] As mentioned above, the image that a free member can save is one edited image (image with doodles) selected during the game. In Fig. 6, the rectangular frame surrounding the words "with doodles" represents a thumbnail image of the image with doodles. Note that "Pri" refers to an image created in the game of the photo sticker creation device 2.
[0097] The graffiti-containing image selected during the game is specified by an image selection flag included in the management information transmitted from the photo sticker creating device 2 together with the image.
[0098] Below each saved image, a message is displayed informing the user that there are unsaved images, and below that, multiple thumbnail images representing the unsaved images are displayed. In the example of Figure 6, nine graffiti-containing images are considered to be unsaved images.
[0099] Below the unsaved images are a save button 51 with the words "Save all Puri" and a confirm button 52 with the words "Check saved Puri." When the save button 51 is pressed, the screen transitions to a paid membership registration screen, and after registration is complete, the unsaved images are saved. When the confirm button 52 is pressed, the screen transitions to the My Page screen.
[0100] In the image management server 1, when a user performs an operation to save an unsaved image, an image that the user created in the game is identified and presented on the confirmation screen as described above.
[0101] The following describes how to specify an image created by a user when the user uses the image providing service via the dedicated application 3A and when the user uses the image providing service via the Web browser 3B.
[0102] FIG. 7 is a diagram showing an example of how the image management server 1 specifies an image.
[0103] FIG. 7 shows a specific example in which a user uses an image providing service via a dedicated application 3A.
[0104] When a user uses the image providing service via the dedicated application 3A, an image created by the user is identified based on the sticker ID entered on a specific screen (the application screen in FIG. 7A) of the dedicated application 3A, as shown in FIG. 7A. After the sticker ID is entered, a confirmation screen such as that described with reference to FIG. 6 is displayed.
[0105] In the image management server 1, based on the sticker ID input by the user, images associated with the same sticker ID are specified and presented to the user. As described above, the images uploaded from the photo sticker creating device 2 are managed in association with the sticker ID issued by the photo sticker creating device 2.
[0106] The user can also display the confirmation screen by operating the URL included in the image storage notification email sent after the game ends. After the game ends, the image management server 1 sends an image storage notification email, which is an email notifying the user of the URL where the image is to be saved.
[0107] The image saving notification email includes a dedicated application URL, which is a URL for launching a dedicated application 3A and displaying a confirmation screen, and a web browser URL, which is a URL for launching a web browser 3B and displaying the confirmation screen.
[0108] When the dedicated application URL is operated, the sticker ID information is stored in the URL, so the image created by the user can be identified without inputting the sticker ID. As described above, the image uploaded from the photo sticker creation device 2 is managed in association with not only the sticker ID but also the email address entered during the game.
[0109] In the image management server 1, when access is made using a URL for a dedicated application, an image associated with the same email address as the email address used to notify the URL is identified, and presented on the confirmation screen (app screen in Figure 7B) of the dedicated application 3A, as shown in Figure 7B.
[0110] FIG. 8 shows a specific example in which a user uses an image providing service via a Web browser 3B.
[0111] As shown in Fig. 8A, when an image providing service site is directly accessed via a Web browser 3B, the image created by the user is identified based on the sticker ID entered on a specific screen of the site (the service site in Fig. 8A). After the sticker ID is entered, a confirmation screen such as that described with reference to Fig. 6 is displayed.
[0112] Furthermore, as shown in FIG. 8B, when the web browser URL included in the image saving notification email is operated, the sticker ID information is stored in the URL, so that the image created by the user can be identified without entering the sticker ID.
[0113] In the image management server 1, when access is made using a web browser URL, an image associated with the same email address as the email address used to notify the URL is identified and presented on the confirmation screen of the web browser 3B (the service site in Figure 8B), as shown in Figure 8B.
[0114] When a user uses the image providing service via the dedicated application 3A, the image created by the user may be identified based on the user ID (email address) entered when logging in to the image providing service.
[0115] In this case, the email address entered by the user when logging in is managed by the dedicated application 3A. The image management server 1 checks whether the email address entered by the user when using the photo sticker creating device 2 and sent from the photo sticker creating device 2 as part of the management information matches the email address managed by the dedicated application 3A, thereby identifying the image created by the user.
[0116] The same applies when using the image providing service by directly accessing the site of the image providing service via the Web browser 3B.
[0117] <2. Selfies and their incongruity> In recent years, photo sticker creation devices that are equipped with a configuration for taking pictures of the user playing a game with their own mobile device (so-called selfie) are becoming more common. Patent Document 1 discloses a photo creation game machine that is equipped with a mobile device holder that holds a mobile device with a shooting function on at least a part of the vertical surface included in the housing.
[0118] The captured image (hereinafter, also referred to as a pre-image) created in the game of the photo sticker creation device is subjected to image processing according to the model of the photo sticker creation device. Also, the terminal image (self-portrait image) taken by the user with his / her own mobile terminal and saved in the mobile terminal may be subjected to image processing by an image processing application (processing app) installed in the mobile terminal.
[0119] Here, if the content of image processing applied to each image is different, the user will feel uncomfortable when comparing the image created in the game using the photo sticker creating device with the self-portrait image.
[0120] Therefore, in the image providing system of the present technology, the image management server 1 manages specific information that is set for each model of the photo sticker creating device 2 and that specifies image processing for a captured image (pre-image) captured in a photo creation game. Then, the image management server 1 transmits the specific information corresponding to the model of the photo sticker creating device 2 to the mobile terminal 3 of the user who was photographed as the subject of the pre-image. This realizes applying the same image processing to the self-portrait as to the pre-image.
[0121] <3. First embodiment> (Information flow in the image provision system) FIG. 9 is a diagram illustrating an example of an information flow in the image providing system according to the first embodiment of the present technology.
[0122] In the image providing system of Fig. 9, a model ID indicating the model of the photo sticker creating device 2 is uploaded from the photo sticker creating device 2 to the image management server 1 together with a plurality of pre-images (photographed images) obtained in one game (photo creating game). The model ID is included in the above-mentioned management information.
[0123] The content of the photo creation game provided by the photo sticker creating device 2 differs depending on the model, and the image processing applied to the preview image taken in the photo creation game also differs depending on the model.
[0124] In addition, a mobile terminal holder for holding the mobile terminal 3 is provided in the photographing space of the photo sticker creating device 2 so that the user can take a selfie of himself / herself playing the game with the mobile terminal 3. The user can take a selfie of himself / herself playing the game by performing a photographing operation with the mobile terminal 3 with the photographing function enabled placed on the mobile terminal holder in the photographing space. The selfie image is stored in the mobile terminal 3, and may be in the form of a still image or a moving image.
[0125] After the user finishes the game using the photo sticker creation device 2, the user can access the image management server 1 by operating the mobile terminal 3 and use the image providing service to view the pre-images and further download them to the mobile terminal 3. At this time, in response to the access from the mobile terminal 3, the image management server 1 transmits to the mobile terminal 3 specific information that specifies the image processing that has been performed on the pre-image.
[0126] As described above, the image processing applied to the pre-image differs for each model of the photo sticker creating device 2. The image management server 1 stores and manages specific information that is set for each model of the photo sticker creating device 2 and that specifies the image processing to be performed on the captured image taken in the photo creation game provided by the photo sticker creating device 2.
[0127] In the mobile terminal 3 that has acquired the specific information from the image management server 1, the pre-image is displayed on the My Page screen, while the stored self-portrait image can be subjected to image processing specified by the specific information by a processing application or the like. That is, the self-portrait image is subjected to the same image processing as the pre-image.
[0128] In the following, the configurations and operations of the image management server 1 and the mobile terminal 3 described above will be explained.
[0129] (Image management server configuration) FIG. 10 is a block diagram showing an example of the hardware configuration of the image management server 1. As shown in FIG.
[0130] The image management server 1 is composed of a computer (information processing device). The image management server 1 may be composed of multiple computers. When the image management server 1 is composed of multiple computers, the computers work together to realize various processes for providing the image provision service.
[0131] A central processing unit (CPU) 101, a read only memory (ROM) 102, and a random access memory (RAM) 103 are interconnected by a bus 104.
[0132] An input / output interface 105 is further connected to the bus 104. An input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are connected to the input / output interface 105.
[0133] The input unit 106 is composed of a keyboard, a mouse, etc. The output unit 107 is composed of a display, etc.
[0134] The storage unit 108 is composed of a hard disk, a non-volatile memory, etc. The storage unit 108 stores various information used to provide the image providing service, such as the program executed by the CPU 101, and images uploaded from the photo sticker creating device 2.
[0135] The communication unit 109 is an interface to the Internet 11. For example, the communication unit 109 communicates with the photo sticker creating device 2 and receives images uploaded from the photo sticker creating device 2. The communication unit 109 also communicates with the mobile terminal 3 and transmits various types of information, such as information used for screen display, to the mobile terminal 3.
[0136] The drive 110 controls writing of data to the removable medium 111 and reading of data from the removable medium 111 .
[0137] In the computer configured as above, the CPU 101 loads a program stored in the storage unit 108 into the RAM 103 and executes it, thereby performing processing for realizing an image providing service.
[0138] FIG. 11 is a block diagram showing an example of the functional configuration of the image management server 1. As shown in FIG.
[0139] 11, the image management server 1 is composed of a receiving processor 211, an information manager 212, an information storage unit 213, and a transmitting processor 214. At least some of the functional units shown in Fig. 11 are realized by the CPU 101 in Fig. 10 executing a predetermined program.
[0140] The reception processing unit 211 controls the communication unit 109 in FIG. 10 to receive management information including the pre-image and the model ID uploaded from the photo sticker creating device 2 and supplies it to the information management unit 212.
[0141] The information management unit 212 manages various types of information stored in the information storage unit 213. For example, the information management unit 212 stores information received by the reception processing unit 211 in the information storage unit 213, reads out information stored in the information storage unit 213, and supplies the information to the transmission processing unit 214.
[0142] The information storage unit 213 stores various information. Specifically, the information storage unit 213 stores the pre-image uploaded from the photo sticker creation device 2 in association with management information. The information storage unit 213 also stores specific information that is set for each model of the photo sticker creation device 2 and that specifies image processing for the pre-image taken in the photo creation game.
[0143] The specific information may be image processing parameters for image processing that differs depending on the model of the photo sticker creating device 2, or may be a model ID that indicates the model of the photo sticker creating device 2.
[0144] The image processing referred to here is, for example, processing of the face included in the image or makeup processing. Processing of the face includes processing of changing the size of the eyes and the size (contour) of the face. Makeup processing includes processing of applying eyeliner to the eye area, applying lipstick to the lip area, and applying blush to the cheek area.
[0145] These image processes are automatically performed on the pre-image in the photo creation game, regardless of the user's selection operation, etc. This allows pre-images with different finishes to be obtained for each model of photo sticker creating device 2.
[0146] FIG. 12 is a diagram showing examples of image processing parameters set for each model of the photo sticker creating device 2. As shown in FIG.
[0147] In the example of Fig. 12, eye size and small face (face size) are shown as image processing parameters set for each model of photo sticker creating device 2. Specifically, image processing parameters for enlarging the eye size to 120% and reducing the face size to 90% are set for model A photo sticker creating device 2, and image processing parameters for enlarging the eye size to 150% and reducing the face size to 80% are set for model B photo sticker creating device 2. Also, image processing parameters for enlarging the eye size to 110% and reducing the face size to 85% are set for model C photo sticker creating device 2.
[0148] In each of the photo sticker creating devices 2 of the models A, B, and C, image processing using these image processing parameters is performed on the pre-image.
[0149] Returning to the explanation of Fig. 11, the transmission processing unit 214 controls the communication unit 109 in Fig. 10 to transmit information stored in the information storage unit 213, supplied from the information management unit 212, to the mobile terminal 3. For example, the transmission processing unit 214 transmits, to the mobile terminal 3 of a user who has been photographed as a subject of a pre-image, specific information corresponding to the model of the photo sticker creation device 2 with which the user played the photo creation game.
[0150] (Mobile device configuration) FIG. 13 is a block diagram showing an example of the configuration of the mobile terminal 3. As shown in FIG.
[0151] As shown in FIG. 13, in addition to the display 21, the mobile terminal 3 is provided with a control unit 311, a communication unit 312, a memory 313, an operation unit 314, and a camera 315.
[0152] The control unit 311 is composed of a CPU, a ROM, a RAM, etc. The control unit 311 controls the overall operation of the mobile terminal 3 by executing a predetermined program.
[0153] An application execution unit 311A is implemented in the control unit 311. Various applications such as the dedicated application 3A are executed by the application execution unit 311A, thereby implementing processing related to the image providing service.
[0154] The communication unit 312 communicates with the image management server 1 via the Internet 11. The communication unit 312 receives information transmitted from the image management server 1 and outputs the information to the control unit 311. The communication unit 312 also transmits information provided by the control unit 311 to the image management server 1.
[0155] The memory 313 is configured by a flash memory or the like. The memory 313 corresponds to the local storage of the mobile terminal 3. When a removable memory card is attached to the mobile terminal 3, the memory card may be used as the local storage.
[0156] The memory 313 stores various information such as images downloaded from the image management server 1 and applications executed by the control unit 311 .
[0157] The operation unit 314 is configured with various buttons and a touch panel provided over the display 21. The operation unit 314 outputs to the control unit 311 a signal indicating the content of a user's operation.
[0158] The camera 315 takes pictures in response to operations by the user.
[0159] The display 21 is configured with an organic EL display, an LCD, etc. Based on the information received by the communication unit 312, the display 21 displays various screens as described above.
[0160] (Image management server operation) The process executed by the image management server 1 will be described with reference to the flowchart in Fig. 14. The process in Fig. 14 is executed after a photo creation game played by a user who owns a mobile terminal 3 and provided by the photo sticker creating device 2 is completed, and a pre-image and a model ID are uploaded and stored from the photo sticker creating device 2.
[0161] In step S11, the information management unit 212 determines whether or not the site of the image providing service has been accessed from the mobile terminal 3. Step S11 is repeated until there is access from the mobile terminal 3, and when it is determined that there has been access from the mobile terminal 3, the process proceeds to step S12.
[0162] In step S12, the information management unit 212 searches pre-images stored in the information storage unit 213 for a pre-image of the user corresponding to the accessed mobile terminal 3.
[0163] In step S13, the information management unit 212 searches for specific information corresponding to the model of the photo sticker creation device 2 with which the pre-image was taken from among the specific information stored in the information storage unit 213, based on the model ID (management information) linked to the searched pre-image.
[0164] In step S14, the transmission processing unit 214 transmits the specific information searched for by the information management unit 212 to the mobile terminal 3 that has been accessed.
[0165] (Mobile device operation) Next, the process executed by the mobile terminal 3 after accessing the image management server 1 will be described with reference to the flowchart in Fig. 15. The process in Fig. 15 is started when the application execution unit 311A executes the processing application in response to an instruction from the user, with the specific information received from the image management server 1 stored in a predetermined storage area such as the memory 313.
[0166] In step S31, the application execution unit 311A (processing application) acquires specific information (image processing parameters) stored in a predetermined storage area.
[0167] In step S32, the application execution unit 311A (editing application) uses the acquired specific information to perform image processing on the selfie image designated by the user.
[0168] For example, if the specific information is image processing parameters, the processing application performs image processing on the self-portrait image using the image processing parameters as is. If the specific information is the model ID of the photo sticker creating device 2, the processing application reads out image processing parameters corresponding to the model ID and performs image processing on the self-portrait image using the image processing parameters. The image processing parameters that are read out may be stored in the mobile terminal 3 together with the program that executes the processing application, or may be stored in the image management server 1 or another cloud.
[0169] Note that image processing using the specific information may be performed on a My Page screen (image management server 1) displayed by a dedicated application 3A, other than by a processing app installed on the mobile terminal 3. In this case, a selfie image is uploaded from the mobile terminal 3 to the image management server 1, and image processing using the specific information is performed on the selfie image displayed on the My Page screen, either automatically or in response to a user's selection operation.
[0170] According to the above process, the self-portrait image taken during a photo creation game is subjected to the same image processing as the pre-image created in the photo creation game, which makes it possible to eliminate the sense of incongruity that the self-portrait image gives when the user compares the pre-image and the self-portrait image.
[0171] In the above-described embodiment, after the photo creation game is completed, the specific information is transmitted in response to access from the mobile terminal 3 to the image management server 1. However, the present invention is not limited to this, and it is also possible to transmit the specific information without accessing the image management server 1 from the mobile terminal 3 after the photo creation game is completed, as shown in FIG.
[0172] In this case, the pre-image uploaded after the photo creation game is completed and the mobile terminal 3 that is the destination of the specific information that specifies the image processing performed on the pre-image need to be linked by some means.
[0173] <4. Second embodiment> In this embodiment, after the photo creation game ends, specific information is transmitted to the mobile terminal 3 of the user with whom cooperation was completed at the start of the photo creation game.
[0174] The linkage here means to associate a user with the photo creation game that the user plays. The linkage between the user and the photo creation game is executed, for example, by photographing a two-dimensional code presented by the photo sticker creation device 2 with the camera 315 of the mobile terminal 3 started by the dedicated application 3A at the start of the photo creation game. The linkage between the user and the photo creation game may also be executed, for example, by photographing a two-dimensional code with an embedded user ID (email address) displayed on the display 21 of the mobile terminal 3 by the dedicated application 3A at the start of the photo creation game with the camera of the photo sticker creation device 2. Note that the linkage between the user (the linkage between the user and the photo creation game) is not limited to the start of the photo creation game, but may be executed during or at the end of the photo creation game.
[0175] (Image management server operation) The process executed by the image management server 1 of this embodiment will be described with reference to the flowchart of FIG.
[0176] In step S51, the information management unit 212 determines whether or not there is a request for cooperation with the user. The request for cooperation with the user may be transmitted from the photo sticker creation device 2 with which the user is about to play the photo creation game, or may be transmitted from the user's mobile terminal 3 on which the dedicated application 3A is running.
[0177] Step S51 is repeated until a request for cooperation with the user is received, and if it is determined that a request for cooperation with the user has been received, the process proceeds to step S52.
[0178] In step S52, the information management unit 212 executes collaboration with the user based on the user ID included in the collaboration request with the user (associates the user with the photo creation game).
[0179] In step S53, the information management unit 212 determines whether the photo creation game associated with the user has been completed. Whether the photo creation game has been completed may be determined, for example, by whether the pre-image and management information created by the photo creation game have been uploaded from the photo sticker creation device 2.
[0180] Step S53 is repeated until the photo creation game is completed, and when it is determined that the photo creation game is completed, the process proceeds to step S54.
[0181] In step S54, the information management unit 212 searches for pre-images of the linked user from among the pre-images stored in the information storage unit 213.
[0182] In step S55, the information management unit 212 searches for specific information corresponding to the model of the photo sticker creation device 2 with which the pre-image was taken from among the specific information stored in the information storage unit 213, based on the model ID (management information) linked to the searched pre-image.
[0183] In step S56, the transmission processing unit 214 transmits the specific information searched for by the information management unit 212 to the mobile terminal 3 corresponding to the user ID (email address) of the user.
[0184] Then, in the mobile terminal 3, image processing is performed on the selfie image specified by the user using the transmitted specific information.
[0185] According to the above process, the self-portrait image taken during a photo creation game is subjected to the same image processing as the pre-image created in the photo creation game, which makes it possible to eliminate the sense of incongruity that the self-portrait image gives when the user compares the pre-image and the self-portrait image.
[0186] <5. Third embodiment> In this embodiment, specific information is transmitted to the mobile terminal 3 of the user whose face is included in the pre-image taken in the photo creation game after the photo creation game is completed.
[0187] In this case, the information storage unit 213 of the image management server 1 stores a member DB (Database) in which face images for each member (user) are registered.
[0188] FIG. 18 is a diagram illustrating an example of the member DB.
[0189] In the example of Fig. 18, the information included in the member DB is such that for each member number assigned to each member, an email address, which is also the user ID of the member (user), is associated with the file name of the face image of the member (user). Specifically, member No. 001 is associated with an email address "xxxxxx@abcd.ne.jp" and a face image "Face001.jpg", member No. 002 is associated with an email address "yyyyyy@efgh.com" and a face image "Face002.jpg", and member No. 003 is associated with an email address "zzzzzz@ijk123.jp" and a face image "Face003.jpg".
[0190] For example, the user's facial image itself is stored in a specified memory area of the information storage unit 213, and the facial image selected by the user from among the facial images extracted from the images saved on the My Page screen is registered in the member DB.
[0191] (Image management server operation) The process executed by the image management server 1 of this embodiment will be described with reference to the flowchart in Fig. 19. The process in Fig. 19 is executed after a photo creation game played by a user who owns a mobile terminal 3 and provided by the photo sticker creating device 2 is completed, and a pre-image and a model ID are uploaded and stored from the photo sticker creating device 2.
[0192] In step S71, the information management unit 212 extracts face information contained in the pre-image uploaded from the photo sticker creating device 2. The face information may be the image of the face area itself, or may be facial feature points.
[0193] In step S72, the information management unit 212 performs face recognition processing based on the extracted face information to identify the user from the member DB in the information storage unit 213. Usually, multiple users are often shown in a pre-image, so multiple users may be identified.
[0194] In step S73, the information management unit 212 searches for pre-images of the identified user from among pre-images stored in the information storage unit 213.
[0195] In step S74, the information management unit 212 searches for specific information corresponding to the model of the photo sticker creation device 2 with which the pre-image was taken from among the specific information stored in the information storage unit 213, based on the model ID (management information) linked to the searched pre-image.
[0196] In step S75, the transmission processing unit 214 transmits the specific information searched for by the information management unit 212 to the mobile terminal 3 corresponding to the user ID (email address) of the user.
[0197] Then, in the mobile terminal 3, image processing is performed on the selfie image specified by the user using the transmitted specific information.
[0198] According to the above process, the self-portrait image taken during a photo creation game is subjected to the same image processing as the pre-image created in the photo creation game, which makes it possible to eliminate the sense of incongruity that the self-portrait image gives when the user compares the pre-image and the self-portrait image.
[0199] <6. About the Program> The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.
[0200] The program to be installed is provided by being recorded on a removable medium such as an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. It may also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting.
[0201] The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.
[0202] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.
[0203] The effects described herein are merely examples and are not limiting, and other effects may also be present.
[0204] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.
[0205] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.
[0206] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.
[0207] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices. [Explanation of symbols]
[0208] 1 image management server, 2 photo sticker creation device, 3 mobile terminal, 211 reception processing section, 212 information management section, 213 information storage section, 214 transmission processing section
Claims
1. an information management unit that manages specific information that is set for each model of the photo sticker creation device and that specifies image processing for the captured image taken in the photo creation game; a transmission processing unit that transmits the specific information corresponding to the model of the photo sticker creating device to a mobile terminal of a user who is photographed as a subject of the photographed image; Equipped with The specific information is used for the image processing of a terminal image captured by a photographing function of the mobile terminal. Information processing device.
2. The specific information includes image processing parameters of the image processing, which differ depending on the model of the photo sticker creating device. The information processing device according to claim 1 .
3. the information management unit manages the captured image taken in the photo creation game in association with the specific information corresponding to a model of the photo sticker creation device; The captured image associated with the specific information is viewed on the mobile terminal to which the specific information was transmitted. The information processing device according to claim 2 .
4. The transmission processing unit transmits the specific information to the accessed mobile terminal after the photo creation game is completed.
4. The information processing device according to claim 2 or 3.
5. The transmission processing unit transmits the specific information to the mobile terminal of the user with whom cooperation has been completed in the photo creation game.
4. The information processing device according to claim 2 or 3.
6. The transmission processing unit transmits the specific information to the mobile terminal of the user of the face included in the photographed image photographed in the photo creation game.
4. The information processing device according to claim 2 or 3.
7. The image processing is face processing or makeup processing of the face included in the image.
7. The information processing apparatus according to claim 1.
8. An information processing device, managing specific information that is set for each model of the photo sticker creation device and that specifies image processing for the captured image taken in the photo creation game; Transmitting the specific information corresponding to the model of the photo sticker creating device to a mobile terminal of a user who was photographed as a subject of the photographed image; The specific information is used for the image processing of a terminal image captured by a photographing function of the mobile terminal. Information processing methods.
9. On the computer, acquiring specific information corresponding to the model of the photo sticker creation device, the specific information being set for each model of the photo sticker creation device and specifying image processing for a captured image taken in a photo creation game, the specific information being transmitted to a mobile terminal of a user who was photographed as a subject of the captured image; Using the specific information, the image processing is performed on a terminal image captured by a photographing function of the mobile terminal. A program for executing a process.
10. an information management unit that manages specific information that is set for each model of the photo sticker creation device and that specifies image processing for the captured image taken in the photo creation game; an information acquisition unit that acquires the specific information corresponding to the model of the photo sticker creation device, the specific information being transmitted to a mobile device of a user who was photographed as a subject of the photographed image; an image processing unit that performs the image processing on a terminal image captured by a photographing function of the mobile terminal using the specific information; An image providing system comprising:
Citation Information
Patent Citations
Photograph creation game machine
JP2020008674A