Systems and programs, etc.
The system integrates image capture and editing units to address inefficiencies and privacy concerns, offering enhanced user interaction and sharing capabilities through NFT generation and QR code integration.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- YUPITERU CORP
- Filing Date
- 2022-03-30
- Publication Date
- 2026-06-19
Smart Images

Figure 0007876175000001 
Figure 0007876175000002 
Figure 0007876175000003
Abstract
Description
Technical Field
[0001] The present invention relates to, for example, systems and programs.
Background Art
[0002] There is known a photographic editing apparatus that photographs a user with a camera, performs editing on the photographed image based on the user's operation, and transmits the edited image, which is the edited image, to an external system via a network or prints it on a medium such as a sticker sheet and provides it.
[0003] For example, there is known a print seal machine that photographs a subject including a plurality of users a plurality of times with a camera, the user edits the photographed image using a touch pen or the like, and prints the edited image on a sticker sheet, or a service using a print seal machine that can transmit the image to an external device via a network. In such a system, a photographed subject image is generated, a background image selected by the user is synthesized with this subject image, and then corrections are added to the size of the eyes, skin color, facial contour, etc., or editing processing such as overlaying characters or patterns called "scribbles" is performed to generate an image for printing. Also, there is a system in which a plurality of users who are photographed together can perform touch operations such as multi-touch operations using a plurality of touch pens or fingers on the display screen, so that friends can enjoy the process from photographing to editing together. Not limited to this, conventionally, various systems for photographing and editing the photographed photos have been proposed.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, the conventional system had various problems. Therefore, the present invention aims to provide a system and program, etc., that have superior characteristics compared to conventional systems.
[0006] The object of the present invention is not limited thereto, and the applicant intends to obtain rights through divisional applications, amendments, etc., for configurations that aim to obtain the effects derived from the components of the configuration disclosed in this specification and the drawings, etc. For example, problems that can be described in this specification as "~is possible" or "~is feasible" are disclosed in this specification. Each problem is described independently, and the applicant intends to obtain rights to each configuration for solving each problem independently through divisional applications, amendments, etc. Even if a problem is implicitly understood from the description in the specification, the applicant intends to include a part of the configuration described in this specification in the claims through amendment or divisional application. Furthermore, configurations that solve problems by combining these independent problems are also disclosed, and the applicant intends to obtain rights to them. [Means for solving the problem]
[0007] (1) A system comprising a shooting unit equipped with a first camera for taking images, and an editing unit installed in a separate location from the shooting space captured by the shooting unit, which edits the images captured by the first camera of the shooting unit in accordance with user operations,
[0008] It is preferable to have a second camera for photographing the user editing by the editorial department, and a function for processing images based on the images taken by the second camera and images based on the images taken by the camera unit in association with each other. In this way, images taken by the photography department can be associated with images of the user editing them in the editing department, and these images can be processed accordingly.
[0009] The image based on the image captured by the second camera may be the image captured by the second camera itself, or it may be an image that has been processed based on the image captured by the second camera.
[0010] The image based on the image captured by the aforementioned camera unit may be the image itself based on the image captured by the camera unit, or it may be an image obtained by processing the image captured by the aforementioned camera unit.
[0011] As a function for processing images based on images captured by the second camera and images based on images captured by the shooting unit, for example, as described in (2) below, it is preferable to have a function that prints images based on images captured by the second camera and images based on images captured by the first camera of the shooting unit onto the same sheet.
[0012] The function for processing images based on images taken with the second camera and images based on images taken with the main camera may also be a function for storing images based on images taken with the second camera and images based on images taken with the main camera in association with each other. In particular, it would be good to have a function to upload the stored images based on images taken with the second camera and images based on images taken with the main camera to a server that can be downloaded and displayed in association with the user's smartphone. As a way to make them display in association, for example, the image based on the image taken with the main camera could be displayed at the top of the smartphone app screen, and the image based on the image taken with the second camera that is associated with that image could be displayed at the bottom of the same screen. For example, it would bring back the fun of messing around with friends in a drawing booth and editing images.
[0013] Alternatively, for example, an image based on an image taken in the photography booth could be generated and uploaded to the server. This image could include a QR code containing the ID (or URL) of the image taken in the photography booth, or the ID (or URL) of the corresponding image taken with a second camera, in the corner of the image. It would also be good to print this image. For example, when a smartphone camera is held over a printed photo booth picture (hereinafter referred to as "puri"), the user accesses the URL in the QR code on the puri, downloads a video of people drawing on the puri from that URL, and displays it on the smartphone. Similarly, audio could be recorded and played back. The photography space is purely for taking pictures, so the act of taking the pictures is intentionally not filmed, thus achieving a balance between the special occasion and the everyday. Simply holding a smartphone over the puri brings back the fun of drawing with friends in the drawing booth. Showing this fun to other friends may also encourage them to take puri photos, contributing to expanding the user base.
[0014] The function for processing images based on images captured by the second camera and images based on images captured by the main camera should ideally involve saving both images together in a single image file. In particular, processing them into a single image file is recommended.
[0015] The function for associating and processing images based on images captured by the second camera and images based on images captured by the camera unit can be, for example, as described in (6) below, a process for generating an NFT (Non-Fungible Token) based on both the images captured by the second camera and the images captured by the camera unit. For example, the process for generating the NFT can be to generate a single image file containing both the images captured by the second camera and the images captured by the camera unit, and then send that image file to a server that generates NFTs to generate the NFT. Alternatively, for example, the server can generate a URL for downloading the generated NFT, and the generated URL can be sent to the user's pre-registered email address.
[0016] The images can be still images, but it is preferable to use moving images. The images can be photographs, but it is preferable to use movies. In particular, it is preferable to use still images for images taken with the first camera and moving images for images taken with the second camera. For example, on the screen of the aforementioned smartphone app, it is preferable to display an image based on a still image taken with the first camera at the top and an image based on an image taken with the second camera that is associated with that image at the bottom of the same screen.
[0017] For the shooting space, a so-called shooting booth is recommended. For a separate location from the shooting space, a location outside the shooting space but close to it is recommended. For example, an editing booth would be a good option for a separate location from the shooting space.
[0018] For editing, processing would be appropriate. For editing, processing that enhances the image would be appropriate. For editing, it would be particularly good to have a configuration that detects user actions and processes the image in response to those actions.
[0019] (2) The system may be provided with a function to print an image based on an image taken by the second camera and an image based on an image taken by the first camera of the shooting unit onto the same sheet.
[0020] By doing so, the images taken in the shooting space and the images taken in the editing department can be grasped at a glance just by looking at a single sheet. For example, in the shooting booth, an image taken with a proper pose and an image showing the state of editing applied to the video taken with the same pose in the editing department can be viewed on the same sheet. Therefore, it becomes easier for the user to recall the situation at the time of shooting at a glance.
[0021] (3) The image based on the image taken by the second camera may be configured as an image processed in consideration of the state of the user's processing of the image taken by the first camera with respect to the image taken by the second camera.
[0022] By doing so, the image based on the image taken by the second camera can be an image processed in consideration of the state of the user's processing of the image taken by the first camera. Therefore, it is possible to prevent an unprocessed image of oneself being photographed during editing from being printed or uploaded to the server, protecting privacy, and at the same time, since it is an image based on the image of oneself, it is also possible to leave its likeness.
[0023] The process of "processing in consideration" may be a process of recognizing the positions of each part of the face by image recognition and applying the state of the user's processing of each part of the face in the image taken by the first camera to the state of the user's processing of each part of the face in the image taken by the second camera.
[0024] (4) It is preferable to have a function of transmitting the image based on the image taken by the first camera to a terminal other than the editing department via a network, a function of editing the image based on the image taken by the first camera received via the network by a terminal other than the editing department, and a function of printing the edited image at a printing department installed at a location different from the shooting space and adjacent to the shooting space.
[0025] By doing so, an image based on the image captured by the first camera can be edited on a terminal other than the editing department. For example, editing can be performed on a terminal such as a smartphone or tablet of an artist who is in another location via a network. In particular, if the second camera is the camera of a terminal such as a smartphone or tablet of the artist, an image captured while the artist is editing can be associated with and processed together with the image of the user being captured. For example, the images of both can be printed on one sheet, or for example, on the screen of the aforementioned smartphone application, an image based on the image of the user captured by the shooting unit is displayed in the upper part, and an image based on the image of the artist captured by the second camera associated with that image is displayed in the lower part of the same screen. Also, especially if the configuration of (6) described later is also provided, an NFT that is a collaboration between the artist and the user can be generated.
[0026] (5) Record the information on the order and degree of processing of the image captured by the first camera by the editing department, and obtain, on a display unit different from the display unit of the editing department, the information on the history and an image based on the image captured by the camera in the shooting space. It is preferable to adopt a configuration in which at least a part of the history information is applied to the image based on the image captured by the camera in the obtained shooting space to reproduce the state of processing on the other terminal.
[0027] This way, the order and degree of processing can be reproduced and played back on another device. For example, the operation data from the graffiti machine in the editorial department is stored along with the print ID and time data. Time data of the pen writing position is also stored as operation data. When printing the print, the operation data itself or the print ID used to identify the operation data is printed as a QR code near the image. When a smartphone is held over the print, the print ID is identified from the QR code, etc., and based on the operation data associated with that print ID, the smartphone plays back the chronological operation of the graffiti and the resulting changes in the amount of paint added. Alternatively, when a smartphone is held over the print, the print's operation data is read from the QR code, etc., and the smartphone plays back the chronological operation of the graffiti and the resulting changes in the amount of paint added. Audio could also be recorded in a similar way and played back in sync with the operation. It would be particularly interesting to include a function in a smartphone app that repeatedly plays back the print from its state (applied state) to the state without paint added, and then changes it back to the applied state with normal playback.
[0028] (6) The configuration should include processing for generating an NFT (Non-Fungible Token) based on both an image based on an image captured by the second camera and an image based on an image captured by the first camera of the camera unit.
[0029] In this way, it is possible to generate a unique NFT based on both images taken in the shooting space and images taken in the editorial department documenting the editing process.
[0030] For example, to generate an NFT, one could create a single image file containing both an image based on the second camera and an image based on the first camera, and then send this image file to a server that generates NFTs to create the NFT. Alternatively, one could have the server generate a URL for downloading the generated NFT, and then send this URL to the user's pre-registered email address. (7) The program should be designed to enable a computer to implement the functions of any of the systems described in (1) through (6).
[0031] The inventions described in (1) to (7) above can be combined in any way. For example, one may combine all or part of the configuration of the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and onward. In particular, it is preferable to combine the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and onward. Alternatively, one may extract any configuration from the inventions described in (1) to (7) and combine the extracted configurations. The applicant of this application intends to obtain rights to inventions that include these configurations. Furthermore, even if there are descriptions such as "in the case of..." or "when...", these are not meant to be descriptions that limit the configuration to that case or time. These are merely examples of better configurations, and the applicant intends to obtain rights to configurations that do not fall under these cases or times. Also, even if there is a sequence of descriptions, it is not limited to that order. Configurations with some parts deleted or the order rearranged are also disclosed, and the applicant intends to obtain rights to them as well. [Effects of the Invention]
[0032] According to the present invention, it is possible to provide a system that is superior to conventional systems.
[0033] Furthermore, the effects of the present invention are not limited to those described herein. Effects derived from the components disclosed in this specification and the drawings are also disclosed, and the applicant intends to obtain rights to such components through divisional applications, amendments, etc. For example, phrases such as "can do" or "is possible" in this specification are descriptions that clearly indicate the effects to be achieved, and there are components that demonstrate effects even without such descriptions. Moreover, there are effects that can be grasped by the component even without such descriptions. [Brief explanation of the drawing]
[0034] [Figure 1]This figure shows the overall configuration of a system having an image processing function, which is a preferred embodiment of the apparatus according to the present invention. [Figure 2] (A) Perspective view of the photo sticker machine, (B) Top view of the photo sticker machine. [Figure 3] This is a block diagram of a photo sticker booth. [Figure 4] This is a flowchart for batch processing. [Figure 5] This diagram shows the selection screen for the first batch processing. [Figure 6] This diagram shows the image processing screen displayed during the image capture process and the processed image. [Figure 7] This diagram shows the screen for selecting between serving all ingredients together or individual parts. [Figure 8] This diagram shows the selection screen for the second batch processing. [Figure 9] This is a diagram showing the individual serving screen. [Figure 10] This diagram shows the screen for adjusting the overall amount of product added. [Figure 11] This is a diagram representing a screen with doodles on it. [Modes for carrying out the invention]
[0035] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. Note that the embodiments described below are just one example of the present invention, and the content of the present invention should not be interpreted as being limited based on the following description. <Description of a system with image processing capabilities>
[0036] The following describes an image processing system of one embodiment of the present invention with reference to Figure 1. The system consists of a photo sticker machine 100 and a server 200. The photo sticker machine 100 and the server 200 are connected to each other via wired or wireless communication means 300. Wired and wireless communication means include the Internet, mobile phone lines, Wi-Fi (registered trademark), LAN (Local Area Network), etc.
[0037] The photo sticker booths 100 are installed in tourist destinations, shopping streets, and shopping malls worldwide, and each photo sticker booth 100 is connected to a communication device 300. A cloud-based server 200, accessed by these photo sticker booths, is connected to the communication device 300. Terminals of companies that sell the photo sticker booths 100, operator terminals 600 that manage the locations where the photo sticker booths 100 are installed, and user terminals 500 of photo sticker booth users are connected to the server 200 via the communication device 300. In addition, terminals of other stores that have a predetermined spatial proximity to the locations where the photo sticker booths 100 are installed, such as tourist destinations, shopping streets, and shopping malls, are also connected to the server 200 via the communication device 300. The aforementioned operator terminals 600 include smartphones with touch panels and communication functions, portable tablets, personal computers, etc.
[0038] The Print Sticker Machine 100 includes our own Print Sticker Machine 100 and Print Sticker Machine 100 from several other companies. Our own (Company A) and other companies (Companies B, C, D, etc.) each have multiple models of Print Sticker Machine 100. Hereafter, in order to facilitate distinction, each Print Sticker Machine 100 will be given a name. The sections written with that name refer to each Print Sticker Machine 100. Our own Print Sticker Machine 100 includes the Print Sticker Machine 100 that has already been sold, "Mizu," and the Print Sticker Machine 100 that will be released this time, etc. Other companies' Print Sticker Machine 100 includes Company B's "105%," "Moruru," "Aoaza," "Mixme," "Shu4," etc., Company C's "Minna," "Boys&Girls," "HenshinTime," "MV," etc., and Company D's "Motemote," "Purisugiga," "Potato," etc. As mentioned above, each company installs and manages its own server 200, and generally, each company's own photo sticker booth 100 can access its own server 200. <Structure of 100 Print Sticker Machines>
[0039] The CubeFit photo sticker machine 100, which is the model mainly described here, will be explained below using Figure 2. As shown in Figure 2, the photo sticker machine 100 has a reception unit 110, a shooting unit 120, an editing unit 130, and a printing unit 140. The touch panels described below all have a display screen and a capacitive touch sensor or the like that is provided on the display screen and outputs the touch position of the display screen. Although omitted below, unless otherwise specified, each unit stores a program to realize each function, and a control unit equipped with a computer controls each unit based on the stored program to realize each function.
[0040] The reception unit 110 includes a first touch panel 111, a payment unit 112, and a first speaker 113. The first touch panel 111 displays information related to settings. It has a function to change the settings of the photo sticker machine 100 by detecting touch operations of the first touch panel 111 by the user. The payment unit 112 includes a cash slot 112a into which banknotes and coins are inserted, a card reader 112b for reading credit and debit cards, an electronic money reader 112c for reading electronic money, and a coin return unit 112d for returning coins.
[0041] The payment unit 112 processes the user's payment using cash, credit card, debit card, electronic money, etc. Once payment is complete, it detects the touch operation on the first touch panel 111 to determine the settings for the photo sticker machine 100 and processes the input of the user's email address. After the input of the user's email address is completed, the photo sticker machine 100 issues the user's ID. This ID is sent to the user terminal 500. The settings for the photo sticker machine 100 include selecting full-body or close-up shots and selecting a background. After the user has determined the settings for the photo sticker machine 100, instructions are displayed on the first touch panel 111 and played from the first speaker 113. Following these instructions, the user moves to the shooting unit 120 as shown by the arrow M1 in Figure 2(B).
[0042] The imaging unit 120 has a box-shaped space called the imaging space 121 and an entrance / exit 122 which is the opening of the imaging space 121. The imaging unit 120 is provided with a curtain 123 that closes the entrance / exit 122. In Figure 2(A), for convenience, only the upper part of the curtain 123 is shown, so that the inside of the imaging unit 120 is visible. The user can roll up the curtain 123 and enter the imaging space 121 through the entrance / exit 122.
[0043] On the back wall of the shooting space 121 of the shooting unit 120, a first camera 124, a light 125, a second touch panel 126, a second display unit 127, and a second speaker 128 are installed. The first camera 124 captures and acquires still images of the user within the shooting space 121. The light 125 emits light when the first camera 124 takes a picture, illuminating the user. The second touch panel 126 displays operating instructions for the user and the captured image of the user. The second speaker 128 plays operating guidance for the user.
[0044] The second touch panel 126 displays a "Start Shooting" button, and the second speaker 128 outputs an audio message indicating that shooting will begin when the "Start Shooting" button is tapped. When the system detects that the user has tapped the "Start Shooting" button, the first camera 124 begins shooting. The second display unit 127 is located next to the second touch panel 126. The second display unit 127 previews the user's face image after it has been edited or doodled, as captured by the first camera 124. Once shooting by the first camera 124 is complete, the second touch panel 126 displays an instruction to leave the shooting unit 120 and move to the editing unit 130, and the second speaker 128 plays an audio message indicating this instruction. Following this instruction, the user moves to the editing unit 130.
[0045] The editing unit 130 is equipped with a third touch panel 131, two stylus pens 132, a third speaker 133, a second camera 134, and a microphone 135. The third touch panel 131 displays the user's image captured by the first camera 124 of the shooting unit 120. The user can use the stylus pen 132 or their finger to add decorative effects such as scribbles, add stamps, or perform other edits such as decorating, transforming, or coloring different parts of their face. This system also includes a batch editing function that allows editing different parts at once. The second camera 134 captures images of the user as they are editing or enhancing their image in the editing unit 130. The microphone 135 captures the user's voice as they are editing or enhancing their image in the editing unit 130. The control unit 700, shown in Figure 2(A) described later, outputs the editing results to the printing device 141 described later, and also uploads them to the server 200 via the communication means 300.
[0046] The printing unit 140 includes a printing device 141 and a receiving unit 142 from which the printed stickers are discharged. The printing device 141 prints user images, which are captured by the first camera 124 and edited by the editing unit 130, onto the stickers. <Block diagram of the 100-size photo sticker booth>
[0047] The block diagram of the photo sticker machine 100 will be explained below using Figure 3. As shown in Figure 3, the photo sticker machine 100 has a control unit 700. The control unit 700 controls the photo sticker machine 100 as a whole. The control unit 700 has a CPU 701, RAM 702, and ROM 703. The CPU 701 functions as an arithmetic processing unit that performs calculations and other operations, and realizes various functions by executing various programs stored in ROM 703. RAM 702 is used as the work area for the CPU 701. ROM 703 stores various programs executed by the CPU 701, mapping data, etc.
[0048] The control unit 700 is connected to the first touch panel 111, the second touch panel 126, the third touch panel 131, the payment unit 112, the first camera 124, the second camera 134, the printing device 141, and the communication unit 150 for communication purposes. The control unit 700 also outputs signals to the first speaker 113, the second speaker 128, the light 125, the second display unit 127, and the third speaker 133. The control unit 700 receives audio signals acquired by the microphone 135. The communication unit 150 communicates with the server 200 via the communication means 300. The communication unit 150 may also communicate directly with the user terminal 500. <Bulk Serving Template Function>
[0049] The following describes an embodiment of the batch enhancement template function. In the following description, "enhancing" refers to applying image processing to various parts of a face image to make it look cuter, more beautiful, or more handsome. In the diagrams used in the following process, one user is shown using the photo sticker machine 100, but multiple people may use the photo sticker machine 100 simultaneously.
[0050] The flowchart for the "bulk application process" is explained below using Figure 4. In parallel with the "bulk application process," the control unit 700 performs "reception processing," which accepts user payment and user setting changes at the reception unit 110, and "photography processing," which takes a picture of the user at the photography unit 120.
[0051] When power is turned on to the photo sticker machine 100, the program proceeds to S111. If the control unit 700 determines that reception has started at the reception unit 110 (S111: YES), the program proceeds to S112. If the control unit 700 determines that reception has not started at the reception unit 110 (S111: NO), the process of S111 is repeated. The control unit 700 determines that reception has started when it determines that the user has paid the fee at the payment unit 112.
[0052] In S112, the control unit 700 reads the "first batch makeup selection screen" stored in the ROM 703 onto the first touch panel 111 and displays the first batch makeup selection screen as shown in Figure 5. The first batch makeup selection screen displays a screen for the user to select whether they are female or male. When the user selects either female or male, the selected gender is highlighted, and multiple batch makeup patterns corresponding to the gender are displayed. These batch makeup patterns are patterns that apply changes to different parts of the face (e.g., eyes, nose, mouth, etc.) all at once, and sample face images before and after the pattern is applied are displayed. The sample face image before the pattern is applied in each batch makeup pattern is not the user's face image, but a pre-stored female or male face image. If the selected gender is female, the multiple batch makeup patterns include natural, gal style, older sister style, mixed-race style, and ethnic style. If the selected gender is male, the multiple batch makeup patterns include natural, gal-boy style, older brother style, mixed-race style, and ethnic style. The user taps to select one of several batch-packing patterns. When it is detected that one batch-packing pattern has been selected, the selected batch-packing pattern is highlighted. The batch-packing selection screen displays a "Next" button and a "Select Later" button. If the user selects the "Next" button, the control unit 700 stores the selected batch-packing pattern in the RAM 702, and the program proceeds to S121. On the other hand, if it is detected that the user has selected the "Select Later" button, the control unit 700 stores in the RAM 702 that the user has selected a batch-packing pattern in the editorial department, and the program proceeds to S121. In this way, the user can select one of several batch-packing patterns displayed on the first touch panel 111 with a single touch input.
[0053] In S121, the control unit 700 executes the shooting process. Specifically, as shown in Figure 6, the control unit 700 displays the shooting process screen 126a on the second touch panel 126 and the processed image 127a on the second display unit 127. The shooting process screen 126a displays the user's face image 126b being captured in real time by the first camera 124 and the shooting start button 126c. The processed image 127a is the user's face image that has been processed, such as adding embellishments or drawing on it, from the user's face image being captured in real time by the first camera 124. In S112, if the user has not selected a batch embellishment pattern, the user's face image after applying multiple batch embellishment patterns is displayed as the processed image 127a, as shown in Figure 6. In S112, if the user has selected a batch embellishment pattern, the user's face image after applying the selected batch embellishment pattern is displayed as the processed image 127a. While the user is taking a picture with the shooting unit 120, it is difficult for them to imagine the final image after it has been enhanced and doodled on. However, by looking at the processed image 127a, which is a preview image displayed on the second display unit 127, the user can visualize the final image. When the user taps the shooting start button 126c, the user's face image, which was captured by the first camera 124 at that moment, is stored in the RAM 702, and the program proceeds to S131.
[0054] In S131, if the control unit 700 determines in S112 that the user selected "Select Later" on the "First Batch Pack Selection Screen", it proceeds to S132 in the program; otherwise, it proceeds to S151 in the program.
[0055] In S132, the control unit 700 reads the data for the "bulk serving / individual part serving selection screen" from the ROM 703 and displays the "bulk serving / individual part serving selection screen" as shown in Figure 7 on the third touch panel 131. The "bulk serving / individual part serving selection screen" displays buttons for "Serve all at once first?" and "Serve individual parts first?". If the control unit 700 determines that the user has tapped the "Serve all at once first?" button, it proceeds to S133. On the other hand, if the control unit 700 determines that the user has tapped the "Serve individual parts first?" button, it proceeds to S141.
[0056] In S133, the control unit 700 reads the "Second Batch Application Selection Screen" from the ROM 703 and displays the "Second Batch Application Selection Screen" shown in Figure 8 on the third touch panel 131. The "Second Batch Application Selection Screen" is basically the same as the "First Batch Application Selection Screen" shown in Figure 5, but differs from the "First Batch Application Selection Screen" in the following respects: The "Second Batch Application Selection Screen" does not have a "Select Later" button. Also, the sample face image before pattern application for each batch application pattern on the "Second Batch Application Selection Screen" is the user's face image captured by the first camera 124 of the shooting unit 120. Furthermore, the sample face image after pattern application for each batch application pattern on the "Second Batch Application Selection Screen" is an image in which various parts of the user's face image captured by the first camera 124 have been modified and applied. When the user selects either female or male, the selected gender is highlighted, and multiple batch application patterns corresponding to the gender are displayed. The user selects one batch application pattern from the multiple batch application patterns. Once a batch application pattern is selected, the selected batch application pattern is highlighted. When the user taps the "Next" button, the control unit 700 stores the selected batch filling pattern in the RAM 702 and advances the program to S135. In this way, the user can select one of the multiple batch filling patterns displayed on the third touch panel 131 with a single touch input.
[0057] In S135, the control unit 700 reads the "individual enhancement screen" from the ROM 703 and displays the "individual enhancement screen" shown in Figure 9 on the third touch panel 131. The "individual enhancement screen" is a screen for individually enhancing each part of a person's face, such as the eyes, nose, mouth, eyebrows, and eyelashes. The user's face 131k is displayed, with the image processing of the batch enhancement pattern selected in S133 applied to multiple different parts of the user's face. When the user taps a part of the person's face, a slider 131m corresponding to the degree of enhancement for that part is displayed. The control unit detects the user's movement of the slider and performs processing to individually adjust the degree of enhancement for each part of the user's face. In this way, the user can fine-tune the degree of enhancement for each part of their face after the batch enhancement pattern has been applied. There may be one type of parameter for adjusting the degree of enhancement for each part of the face, or there may be multiple types. The control unit 700 stores the results of individually adjusting the degree of enhancement for each part of the user's face in the RAM 702.
[0058] Furthermore, the "Individual Makeup Screen" displays a face image 131n of a collaborating model, talent, or character, and a speech bubble from around their mouth displays advice strings such as "Maybe you've added too much," "Looks good," and "Let's lengthen the eyelashes!", depending on the user's individual makeup application. The control unit 700 refers to the "Individual Makeup Advice Data" stored in the ROM 703 and, based on the balance between the part being adjusted and other parts, displays advice on the amount of makeup added to the part being adjusted in real time, depending on the individual makeup application, while the part being adjusted is being adjusted, and also outputs an audio signal of the advice to the first speaker 113, second speaker 128, and third speaker 133. The ROM 703 stores a "Learning Model Program," which is a program of a learning model that has learned the external image of over-applied makeup for comparison. The control unit 700 executes this "Learning Model Program" to estimate the probability of matching the currently adjusted user face image with the over-applied image. When the match probability is above a predetermined value, the control unit 700 notifies the user with the advice "Maybe you've added too much."
[0059] Since the advice is broadcast through the first speaker 113 to the third speaker 133, the advice is broadcast not only to the user who is currently processing the photos, but also to people around the photo sticker machine 100 who are waiting to use the machine. In this way, the advice is played not only through the third speaker 133 in the editorial department 130, but also through the first speaker 113 and the second speaker 128, so that people around the photo sticker machine 100 can take notice of it, and new customers can be acquired. In other words, the photo sticker machine 100 is usually used by groups of two to several people, but the announcements for the photo sticker machine 100 are mainly made to the user currently using it, and publicity to people outside the group is weak. However, by letting people waiting to use the photo sticker machine 100 know how the previous user used it, it can become a topic of conversation and contribute to increasing the repeat rate of the photo sticker machine 100. The speaker that announces the above-mentioned advice may be placed in a location independent of the photo sticker machine 100. The "Individual Serving Screen" displays an "Finish Individual Serving" button, and when the user taps the "Finish Individual Serving" button, the process in S135 ends and the program proceeds to S155.
[0060] In S141, the control unit 700 reads the "individual shaping screen" from the ROM 703 and displays the "individual shaping screen" as shown in Figure 9 on the third touch panel 131. The process in S141 is the same as the process in S135 described above, but the user's face image captured by the first camera 124 is displayed, and the user applies individual shaping to this face image. The control unit 700 stores the results of the user's individual adjustment of the degree of shaping on each part of the user's face in the RAM 702. When the user taps the "Finish Individual Shaping" button, the process in S141 ends, and the program proceeds to S142.
[0061] In S142, the control unit 700 reads the "Second Batch Plating Selection Screen" from the ROM 703 and displays the "Second Batch Plating Selection Screen" as shown in Figure 8 on the third touch panel 131. The process in S142 is the same as the process in S133 described above, but the sample face image before pattern application is the user's face image to which individual placing was applied in S141. When the user selects the "Next" button, the control unit 700 stores the selected batch placing pattern in the RAM 702. If the user taps the "Next" button, the program proceeds to S155. In this way, the user can select one batch placing pattern from among the multiple batch placing patterns displayed on the third touch panel 131 with a single touch input.
[0062] In S151, the control unit 700 reads the "individual enhancement screen" from the ROM 703 and displays the "individual enhancement screen" as shown in Figure 9 on the third touch panel 131. The processing in S151 is the same as the processing in S135 described above, but the user's face image captured by the first camera 124 is displayed with the image processing of the batch enhancement pattern selected by the user in S112 applied to multiple different parts of the user's face at once. The user then applies individual enhancements to this batch enhancement applied user face image. The control unit 700 stores the results of the user's individual adjustment of the enhancement level for each part of the user's face in the RAM 702. When the user taps the "Finish Individual Enhancement" button, the processing in S151 ends and the program proceeds to S155.
[0063] In S155, the control unit 700 reads the "Batch Filling Amount Adjustment Screen" from the ROM 703 and displays the "Batch Filling Amount Adjustment Screen" shown in Figure 10 on the third touch panel 131. The "Batch Filling Amount Adjustment Screen" displays the user's face image 131f before batch filling amount adjustment, the user's face image 131g after batch filling amount adjustment, a slider 131h for adjusting the batch filling amount, and a "Batch Filling Amount Adjustment Complete" button 131i. The user's face image 131f before batch filling amount adjustment is the user's face image after filling in S133, S135, S141, S142, and S151. The user can adjust the batch filling amount by sliding the slider 131h. The user's face image 131g after batch filling amount adjustment reflects the result of the user sliding the slider 131h in real time. When the user taps the "Complete Batch Filling Amount Adjustment" button 131i, the control unit 700 stores the user's batch filling amount adjustment result in the RAM 702, and the program proceeds to step S161.
[0064] In S161, the control unit 700 reads the "doodle screen" from the ROM 703 and displays the "doodle screen" shown in Figure 11 on the third touch panel 131. The "doodle screen" displays the user's face image 131a, multiple stamps 131b, a pen color selection screen 131c, a pen thickness selection screen 131d, a "print" button 131e, and a "request a doodle from a friend" button 131p. The user's face image 131a is the user's face image that has been enhanced in S133, S135, S141, S142, and S151, and the degree of enhancement has been adjusted in S155. The user can add a stamp to the enhanced user's face image 131a by tapping to select one of the multiple stamps 131b and dragging it to the desired position on the enhanced user's face image 131a. The user can select the desired pen color and thickness by tapping the pen color selection screen 131c and the pen thickness selection screen 131d. Then, the user can use the stylus pen 132 to draw on the user's face image 131a after it has been enhanced.
[0065] In S161, when the user taps the "Request a friend to draw on it" button 131p, the control unit 700 sends a message and a link to the drawing site to the SNS (Social Networking Service) account of a friend that has been registered in the app in advance, via the communication unit 150 and communication means 300. When the user's friend taps the link, the drawing screen site opens, and the user's friend can draw on the user's face image 131a on the drawing screen site. This drawing includes adding stamps. The content of the drawing by the user's friend on the drawing site is sent to the control unit 700 via the communication means 300 and communication unit 150. The control unit 700 reflects the content of the drawing by the user's friend on the user's face image 131a on the "drawing screen". In this way, people who are not in the editorial department 130 can also draw on the user's face. In the example described above, an example of having the user's friend draw on it was explained, but it may also be an embodiment in which a message and a link to the drawing site are sent to the SNS account of a professional such as an artist, and the professional draws on it.
[0066] In S161, the control unit 700 stores the content of the user's doodles (for example, doodles based on the position information on the third touch panel 131 of the stylus pen 132) in RAM 702 as doodle data time series data, linking it with time data, the user's ID, and the ID of the print sticker machine 100. Then, when the user taps the "Print" button 131e, the control unit 700 transmits the doodle time series data stored in RAM 702 to the server 200 via the communication unit 150 and communication means 300. Note that the user's doodles also include the addition of stamps. Based on the doodle time series data, the server 200 generates a video of the user adding doodles to their face image. When the user holds the screen of the user terminal 500 displaying a barcode or QR code over the second camera 134, the control unit 700 recognizes the user's ID from the barcode or QR code read by the second camera 134. The control unit 700 then transmits the recognized user ID and the ID of the photo sticker machine 100 to the server 200 via the communication unit 150 and the communication means 300. Upon receiving the user ID and the ID of the photo sticker machine 100, the server 200 sends an email containing a URL to play a video matching these IDs to the user's email address via the communication means 300. When the user taps the URL in the email, a video of the user adding doodles to their own face image is played. This video can be played in reverse, allowing the user to repeatedly return to the state without doodles by playing it in reverse, or to change back to the state with doodles by playing it normally. In this way, after using the photo sticker machine 100, the user can watch a video of themselves adding doodles to their own face image. Therefore, the user can later analyze the doodle process or share the video with friends and have fun. They can also advertise the photo sticker machine 100 through word of mouth. In addition to the user's doodles, there may also be embodiments that generate a video in which a batch of doodles, individual doodles, or adjustments to the degree of batch doodles are added to the user's face image. Alternatively, the microphone 135 may record audio such as the user's voice, and the audio may be played back together with the video.
[0067] In S161, the second camera 134 captures an image of the user drawing, associates it with the user ID, and stores it in RAM 702. The image of the user drawing includes both still images and videos. The control unit 700 stores the results of the user's editing, such as adding stamps or drawing on the user's face image 131a after the user has done so, in RAM 702. When the user taps the "Print" button 131e, the program proceeds to S162.
[0068] In S162, the control unit 700 outputs the data of the user's face image, which has been enhanced and edited by the user and stored in RAM 702, and the data of the user drawing on the image, which has also been stored in RAM 702, to the printing device 141, causing the printing device 141 to print a sticker. The data of the user drawing on the image may be the result of applying the batch enhancement or individual enhancement selected by the user. The sticker printed by the printing device 141 is discharged to the receiving unit. The sticker has both the user's face image, which has been enhanced and edited by the user, and the user drawing on the image printed on the same sheet. The control unit 700 also outputs the data of the user's face image, which has been enhanced and edited by the user and the data of the user drawing on the image, which have been stored in RAM 702, to the communication unit 150, linking them with the user's ID and the user's email address, and the communication unit 150 sends them to the server 200. When the processing in S162 is completed, the "batch enhancement processing" program ends. (Another embodiment) The process in S155 of Figure 4 may be executed after S133 or before S151. It may also be structured as follows:
[0069] (A-1) A system that performs predetermined image processing on a face image including at least a part of the face, comprising multiple patterns of image processing to be applied collectively to multiple different parts of the face, wherein when a user selects which pattern to apply, the system applies the selected pattern of image processing to multiple different parts of the face collectively.
[0070] In this way, users can apply image processing to multiple different parts of their face simultaneously simply by selecting their desired pattern from among several options.
[0071] For example, applying makeup to each part of the face is fun but time-consuming. However, this method allows you to maintain the fun while reducing the time required for application. Consequently, it becomes possible to increase the number of customers per unit of time, thereby boosting sales.
[0072] (A-2) The process of applying the selected pattern of image processing to multiple different parts of the face in a single operation should include a function that performs the processing on the face image after the image processing has been applied to at least one part of the face based on user input to the captured face image.
[0073] In this way, after the user applies image processing to a desired part of the face in a captured facial image, the user can then apply further image processing to multiple different parts of the face in the processed image simply by selecting a desired pattern from several options.
[0074] Therefore, users can first apply image processing individually to specific parts of the face they want to process, and then easily apply further image processing to multiple parts of the face at once to the resulting image.
[0075] (A-3) After applying the selected pattern of image processing to multiple different parts of the face in a single process to the captured face image, it is preferable to have a function that further applies image processing to at least one part of the face based on user input.
[0076] In this way, the user can simply select their desired pattern from several patterns and apply image processing to multiple different parts of the face in the resulting image all at once. Furthermore, the user can then further process specific parts of the face they want to enhance to obtain an image that closely matches their ideal.
[0077] (A-4) It is preferable to have a function that displays sample images before and after the application of the pattern. In this way, the user can look at the sample images and decide which of the multiple patterns of image processing to apply to multiple different parts of the face at once to choose from the sample images.
[0078] (A-5) The selection of the multiple patterns should be provided as a one-touch input within a single screen. In this way, it is easy to specify the pattern to be selected from among multiple patterns of image processing to be applied to multiple different parts of the face at once.
[0079] (A-6) The system comprises a reception unit, a shooting unit, an editing unit, and a printing unit, wherein the reception unit is equipped with a function for making the selection, and the editing unit is equipped with a function for displaying the image after image processing to which the pattern selected in the reception unit has been applied. In this way, the user can immediately view the image after image processing to which the pattern selected in the reception unit has been applied in the editing unit after taking the picture.
[0080] Furthermore, if the system is configured in such a way that the pattern selected at the reception desk cannot be changed by the editorial department, users will need to select a different pattern at the reception desk again and take the photo, resulting in additional charges and contributing to increased sales for the stores where the system is installed.
[0081] As an example of the above (1) to (6), for instance, a preset pattern that applies enhancements to facial components (parts) all at once could be prepared, and the user could select it and have it applied all at once. This could be done at the terminal in the drawing booth, but it could also be pre-applied at the reception machine. It would be good to allow the user to select the preset pattern to apply to the target from among several options. The preset pattern could be applied to the captured photo or video itself, or it could be applied to the image after the user has enhanced it. It would be good to allow the user to apply enhancements to individual parts, such as enhancing the eyes, after applying the preset pattern. (It could also be applied to the whole image using the enhanced individual parts as a base (it would be good to configure it so that the state of individual enhancements is not reset when the preset pattern is applied).)
[0082] Alternatively, the system could be configured so that the user determines the degree of deformation for each part (deforms them individually), and then the degree of deformation for all parts is changed at once. Unlike a template function, it would be better to simply increase or decrease the degree of deformation of a part all at once.
[0083] (A-7) The configuration should include processing to generate an NFT (Non-Fungible Token) based on both the face image before the predetermined image processing and the face image after the predetermined image processing. In this way, a unique NFT can be generated based on both the face image before the predetermined image processing and the face image after the predetermined image processing.
[0084] The process for generating an NFT involves creating a single image file containing both the image based on the image captured by the camera unit and the image after performing predetermined image processing on that image. This image file is then sent to a server that generates NFTs, allowing the NFT to be generated. Alternatively, the server can generate a URL for downloading the generated NFT, and this URL can be sent to the user's pre-registered email address. It is preferable to have a function that prints both the face image before the predetermined image processing and the face image after the predetermined image processing onto a single sheet. (A-8) The program should be designed to enable a computer to implement the functions of any of the systems described in (A-1) through (A-7). (B-1) A system that processes a captured image containing a human face in response to user input,
[0085] It is preferable to have a configuration that displays an image of a person other than the person who was photographed, and outputs an information in which advice information regarding the user operation or processing is output by a person other than the person who was photographed.
[0086] In this way, the output is generated in a manner that provides advice on user operation or processing from someone other than the person who was photographed (the user). Therefore, the user can change the content of the processing of their own photographed images based on advice from a third party.
[0087] For example, a learning model is equipped with images of excessively exaggerated textures for comparison, and the probability of matching the currently adjusted image with the exaggerated image is inferred and calculated. When the probability is above a predetermined value, a notification such as "Maybe it's too exaggerated" is issued.
[0088] In particular, it would be beneficial to configure the system to output an evaluation of the user's own enhancement techniques. This would make it easier to adjust the settings based on the evaluation, and it would also add an element of entertainment.
[0089] A good setup would be to display images of collaborating models, talents, or characters on the screen, and then display speech bubbles around their mouths with text or images of advice tailored to the user's actions, such as "Maybe you've overdone it," "Looks good," or "Let's make your eyelashes longer!"
[0090] (B-2) The configuration should include a function that outputs different information as advice information regarding the user operation or processing, depending on the degree of processing for each area of the face where the user operation was performed. In this way, users can receive advice based on the area of their face, for example, the degree of processing required for each facial feature.
[0091] In particular, when a user is adjusting the degree of material added to individual parts, it is beneficial to provide real-time advice on the degree of material added to the part being adjusted, taking into account the balance with the degree of material added to other parts. This advice may be given via voice so that the user can hear it.
[0092] (B-3) The system should be configured to include a function that allows for varying the amount of advice information output regarding the user operation or processing, depending on the amount of processing performed on the first facial part and the amount of processing performed on the second facial part. (B-4) The degree of processing is such that the face is processed in an unnatural way,
[0093] It is preferable to have a configuration that includes a function to output information indicating that the processing has been done to an unnatural degree when the user operation is performed to the extent described above.
[0094] (B-5) The output of advice information regarding the user operation or processing performed by a person other than the person being photographed should be configured to occur during the user operation.
[0095] (B-6) The output of advice information regarding the user operation or processing should be configured to include a function that outputs it to people other than the user who are in the vicinity of the device for taking the photographs.
[0096] In particular, while photo booths (also called photo editing machines) are typically used by groups of two to several people, the notification system primarily focuses on the person currently using the machine, with weak communication to those outside the group. If the photo editing is excessive, it would be good to have a system that uses speakers or a volume loud enough for people outside the machine, not just the user, to hear a message like, "You've edited it too much! You've edited it too much!" It would be better to have the notification output not to the user editing the photo, but to people around the device that takes the photo. Speakers facing outwards from the machine's casing should be installed away from the graffiti booth. Alternatively, speakers may be installed around the photo booth but in a location separate from the machine itself.
[0097] By attracting the attention of people around the photo booth, you can acquire new customers. You can also inform people waiting to use the photo booth about the previous group's experience, which can spark conversation and contribute to increasing repeat business.
[0098] (B-7) Output to people other than the user who are in the vicinity of the device for taking the images should be provided by audio output from a speaker located away from the editing machine that performs the processing. (B-8) The program should be designed to enable a computer to implement the functions of any of the systems described in (B-1) through (B-7).
[0099] (C-1) A system comprising an editing unit located in a separate location from the shooting space where the shooting unit is installed, which displays images taken by the shooting unit on a display unit and performs editing on the displayed images in response to user operations, wherein the shooting space is provided with a second display unit, which is a separate display unit from the display unit of the editing unit, and the system is equipped with a function to display images on the second display unit that have been processed in a way that is displayable on the display unit of the editing unit during editing by the editing unit.
[0100] This way, while shooting in the shooting space, you can see images with various types of processing applied to them that can be displayed on the editorial department's display. Therefore, it becomes easier to visualize the final image after editing (e.g., processing or doodles) by the editorial department while shooting. For example, if the shooting space has a function to take multiple consecutive shots, you can visualize the final image after doodles while taking the first shot, decide on the pose for the second shot, and repeat this process in the shooting space.
[0101] For example, when shooting in a shooting booth, a sample image with the enhancement applied automatically is displayed on the screen inside the booth immediately after shooting. The image with the enhancement applied automatically displayed inside the booth could be printed as a sticker as is, but it would be good to have a function to display it on the editing machine's display unit so that the user can further process it.
[0102] For example, at least two displays could be installed in the shooting booth, one below the camera and the other next to it. The display below the camera could show the video being shot, while the other display could show an image that has been processed in a way that makes it suitable for display on the editing booth's display panel.
[0103] (C-2) The second display unit may be provided with a function to simultaneously display images that have been processed with multiple different patterns, which can be displayed on the display unit of the editorial department during editing by the editorial department.
[0104] This allows you to shoot while being aware of multiple patterns with different processing. For example, if the system has a function for the editorial department to select one pattern from multiple patterns with different processing, you can decide which pattern to choose while shooting.
[0105] (C-3) The display unit may be provided with a function to display the processed image displayed on the second display unit for at least one of the following: for further processing or for printing. This allows for further processing or printing of the processed images displayed in the shooting booth. This feature would be particularly useful for editorial departments.
[0106] (C-4) The configuration should include a function to print images on a single sheet that have been processed with at least two different patterns from among multiple images processed with different patterns that can be displayed on the display unit of the editorial department. In this way, the user can obtain images with multiple different patterns and processing applied to them, as seen in the shooting space, printed on a single sheet.
[0107] In particular, it would be beneficial to have a function that prints an image with all different processing patterns applied to it onto a single sheet, from among the images with multiple different processing patterns that can be displayed on the display unit of the editorial department.
[0108] (C-5) The configuration should include processing to generate an NFT (Non-Fungible Token) based on images that have been processed with at least two different patterns from among multiple images that have been processed with different patterns that can be displayed on the display unit of the editorial department.
[0109] In this way, a unique NFT can be generated based on images that have been processed with at least two different patterns from among multiple images that have been processed with different patterns that can be displayed on the display unit of the editorial department.
[0110] For example, to generate an NFT, one process could involve creating an image file containing images with at least two different patterns applied to them, from among several images with different patterns that can be displayed on the editorial department's display unit. This image file could then be sent to an NFT generation server to generate the NFT. Alternatively, the server could generate a URL for downloading the generated NFT, and this URL could be sent to the user's pre-registered email address. (C-6) The program should be designed to enable a computer to implement the functions of the system described in any of (C-1) through (C-5).
[0111] (D-1) A system comprising a shooting unit equipped with a first camera for taking images, and an editing unit installed in a separate location from the shooting space captured by the shooting unit, which edits the images captured by the first camera of the shooting unit in accordance with user operations,
[0112] It is preferable to have a second camera for photographing the user editing by the editorial department, and a function for processing images based on the images taken by the second camera and images based on the images taken by the camera unit in association with each other. In this way, images taken by the photography department can be associated with images of the user editing them in the editing department, and these images can be processed accordingly.
[0113] The image based on the image captured by the second camera may be the image captured by the second camera itself, or it may be an image that has been processed based on the image captured by the second camera.
[0114] The image based on the image captured by the aforementioned camera unit may be the image itself based on the image captured by the camera unit, or it may be an image obtained by processing the image captured by the aforementioned camera unit.
[0115] As a function for processing images based on images captured by the second camera and images based on images captured by the shooting unit, for example, as described in (2) below, it is preferable to have a function that prints images based on images captured by the second camera and images based on images captured by the first camera of the shooting unit onto the same sheet.
[0116] The function for processing images based on images taken with the second camera and images based on images taken with the main camera may also be a function for storing images based on images taken with the second camera and images based on images taken with the main camera in association with each other. In particular, it would be good to have a function to upload the stored images based on images taken with the second camera and images based on images taken with the main camera to a server that can be downloaded and displayed in association with the user's smartphone. As a way to make them display in association, for example, the image based on the image taken with the main camera could be displayed at the top of the smartphone app screen, and the image based on the image taken with the second camera that is associated with that image could be displayed at the bottom of the same screen. For example, it would bring back the fun of messing around with friends in a drawing booth and editing images.
[0117] Alternatively, for example, an image based on an image taken in the photography booth could be generated and uploaded to the server. This image could include a QR code containing the ID (or URL) of the image taken in the photography booth, or the ID (or URL) of the corresponding image taken with a second camera, in the corner of the image. It would also be good to print this image. For example, when a smartphone camera is held over a printed photo booth picture (hereinafter referred to as "puri"), the user accesses the URL in the QR code on the puri, downloads a video of people drawing on the puri from that URL, and displays it on the smartphone. Similarly, audio could be recorded and played back. The photography space is purely for taking pictures, so the act of taking the pictures is intentionally not filmed, thus achieving a balance between the special occasion and the everyday. Simply holding a smartphone over the puri brings back the fun of drawing with friends in the drawing booth. Showing this fun to other friends may also encourage them to take puri photos, contributing to expanding the user base.
[0118] The function for processing images based on images captured by the second camera and images based on images captured by the main camera should ideally involve saving both images together in a single image file. In particular, processing them into a single image file is recommended.
[0119] The function for associating and processing images based on images captured by the second camera and images based on images captured by the camera unit can be, for example, as described in (6) below, a process for generating an NFT (Non-Fungible Token) based on both the images captured by the second camera and the images captured by the camera unit. For example, the process for generating the NFT can be to generate a single image file containing both the images captured by the second camera and the images captured by the camera unit, and then send that image file to a server that generates NFTs to generate the NFT. Alternatively, for example, the server can generate a URL for downloading the generated NFT, and the generated URL can be sent to the user's pre-registered email address.
[0120] The images can be still images, but it is preferable to use moving images. The images can be photographs, but it is preferable to use movies. In particular, it is preferable to use still images for images taken with the first camera and moving images for images taken with the second camera. For example, on the screen of the aforementioned smartphone app, it is preferable to display an image based on a still image taken with the first camera at the top and an image based on an image taken with the second camera that is associated with that image at the bottom of the same screen.
[0121] For the shooting space, a so-called shooting booth is recommended. For a separate location from the shooting space, a location outside the shooting space but close to it is recommended. For example, an editing booth would be a good option for a separate location from the shooting space.
[0122] For editing, processing would be appropriate. For editing, processing that enhances the image would be appropriate. For editing, it would be particularly good to have a configuration that detects user actions and processes the image in response to those actions.
[0123] (D-2) It is preferable to have a function to print an image based on the image captured by the second camera and an image based on the image captured by the first camera of the shooting unit onto the same sheet.
[0124] This way, images taken in the shooting space and images taken in the editorial department can be seen at a glance on a single sheet. For example, images taken in the shooting booth with a proper pose and images taken in the editorial department showing the editing process for that same pose can be seen on the same sheet. Therefore, it becomes easy for users to recall the circumstances of the shoot at a glance.
[0125] (D-3) The image based on the image captured by the second camera should be configured to be an image that has been processed by taking into account the user's processing of the image captured by the first camera in addition to the image captured by the second camera.
[0126] In this way, the image based on the image captured by the second camera can be processed to take into account the user's editing of the image captured by the first camera. Therefore, it is possible to prevent images of oneself being edited from being printed or uploaded to a server without processing, thereby protecting privacy, while also preserving one's likeness because the image is based on an image of oneself.
[0127] The "processing with consideration" can be performed by recognizing the position of each facial feature in the image, and then applying the processing status of each facial feature of the user in the image captured by the first camera to the processing status of each facial feature of the user in the image captured by the second camera.
[0128] (D-4) The system may include a function to transmit an image based on an image taken by the first camera to a terminal other than the editorial department via a network, a function to edit the image based on the image taken by the first camera received via the network at a terminal other than the editorial department, and a function to print the edited image at a printing unit located in a place other than the shooting space and adjacent to the shooting space.
[0129] In this way, images based on images taken with the first camera can be edited on a device other than the editorial department's. For example, editing can be done on an artist's smartphone or tablet located in a different location via the network. In particular, if the second camera is the camera on the artist's smartphone or tablet, images of the artist editing can be processed in association with images of the user. For example, both images can be printed on a single sheet, or, for example, the aforementioned smartphone app screen could display an image based on the user's image taken by the camera department at the top and an image based on the artist's image taken by the second camera, which is associated with that image, at the bottom of the same screen. Furthermore, if the configuration described in (6) below is also included, it becomes possible to generate NFTs that represent a collaboration between the artist and the user.
[0130] (D-5) The system is configured to record the history of the order and extent of image processing performed by the editorial department on the first camera, acquire an image based on the history information and the image taken by the camera in the shooting space on a display unit separate from the display unit in the editorial department, and apply at least a portion of the history information to the acquired image based on the image taken by the camera in the shooting space to reproduce the processing on the other terminal.
[0131] This way, the order and degree of processing can be reproduced and played back on another device. For example, the operation data from the graffiti machine in the editorial department is stored along with the print ID and time data. Time data of the pen writing position is also stored as operation data. When printing the print, the operation data itself or the print ID used to identify the operation data is printed as a QR code near the image. When a smartphone is held over the print, the print ID is identified from the QR code, etc., and based on the operation data associated with that print ID, the smartphone plays back the chronological operation of the graffiti and the resulting changes in the amount of paint added. Alternatively, when a smartphone is held over the print, the print's operation data is read from the QR code, etc., and the smartphone plays back the chronological operation of the graffiti and the resulting changes in the amount of paint added. Audio could also be recorded in a similar way and played back in sync with the operation. It would be particularly interesting to include a function in a smartphone app that repeatedly plays back the print from its state (applied state) to the state without paint added, and then changes it back to the applied state with normal playback.
[0132] (D-6) The configuration should include processing for generating an NFT (Non-Fungible Token) based on both an image based on an image captured by the second camera and an image based on an image captured by the first camera of the imaging unit.
[0133] In this way, it is possible to generate a unique NFT based on both images taken in the shooting space and images taken in the editorial department documenting the editing process.
[0134] For example, to generate an NFT, one could create a single image file containing both an image based on the second camera and an image based on the first camera, and then send this image file to a server that generates NFTs to create the NFT. Alternatively, one could have the server generate a URL for downloading the generated NFT, and then send this URL to the user's pre-registered email address. (D-7) The program should be designed to enable a computer to implement the functions of any of the systems described in (D-1) through (D-6).
[0135] The configurations shown above in (A-1) to (A-8), (C-1) to (C-6), (D-1) to (D-7), and (B-1) to (B-8) can be combined in any way. Alternatively, any configuration can be extracted from the configurations shown in (A-1) to (A-8), (C-1) to (C-6), (D-1) to (D-7), and (B-1) to (B-8), and the extracted configurations can be combined.
[0136] The applicant of this application intends to obtain rights to the invention including these configurations. Furthermore, even if there are descriptions such as "in the case of..." or "when...", these are not meant to describe a configuration that is limited to that case or time. These are merely examples of better configurations, and the applicant intends to obtain rights to configurations other than those described. Also, even if there is a sequence of descriptions, it is not limited to that sequence. Configurations with some parts deleted or the order rearranged are also disclosed, and the applicant intends to obtain rights to them as well.
[0137] Furthermore, the scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed herein. While the configurations for which patent protection is sought are specified in the appended claims, we intend to include configurations disclosed herein that are not currently specified in the claims in the future.
[0138] The present invention is not limited to the configuration described in the embodiments above. The components of each embodiment and modification described above can be arbitrarily selected and combined. Furthermore, any component of each embodiment and modification can be arbitrarily combined with any component described in the means for solving the invention, or any component that embodies any component described in the means for solving the invention. The present application intends to obtain rights to these as well through amendments or divisional applications. Even if there is a description such as "in the case of..." or "when...", it is not meant to be a configuration that is limited to that case or time. Configurations that do not fall under these cases or times are also disclosed, and the present application intends to obtain rights to them. Also, even if there is a sequence of descriptions, it is not limited to that order. Configurations with some parts deleted or the order rearranged are also disclosed, and the present application intends to obtain rights to them.
[0139] Furthermore, by converting to a design registration application, we intend to acquire rights to the overall design or a partial design. The drawing depicts the entire device with solid lines, but it is a drawing that includes not only the overall design but also partial designs claimed for parts of the device. For example, it is a drawing that includes not only a partial design for a part of the device's components, but also a partial design for a part of the device regardless of its components. A part of the device may be a component of the device, or a part of a component. We intend to acquire rights not only to the overall design, but also to a partial design where any part of the solid lines in the drawing is represented by dashed lines. In addition, all modules, components, and parts inside the device's casing that are shown in the drawing are independently tradable, and similarly, we intend to acquire rights to them by converting to a design registration application. [Explanation of symbols]
[0140] 100 photo sticker booths 110 Reception Department 111 First Touch Panel 112 Payment Department 112a Cash slot 112b Card reader 112c Electronic Money Reader 112d Coin Return Section 113 First Speaker 120 Photography Department 121 Shooting Space 122 Entrance / Exit 123 Curtains 124 First Camera 125 Light 126 Second touch panel 126a Shooting Processing Screen 126b Face image 126c Start recording button 127 Second display section 127a Image after processing 128 Second speaker 130 Editorial Department 131 Third Touch Panel 132 Stylus Pens 133 Third Speaker 134 Second Camera 135 Mike 140 Printing Department 141 Printing device 142 Receiving Section 150 Communications Department 200 servers 300 Communication methods 500 user terminals 600 Operator Terminals 700 Control Unit
Claims
1. A system comprising a shooting unit equipped with a first camera for capturing images, and an editing unit installed in a separate location from the shooting space captured by the shooting unit, which edits the images captured by the first camera of the shooting unit according to user operations, It is equipped with a second camera for photographing users who are editing by the editorial department, and has a function to process images based on images taken by the second camera and images based on images taken by the shooting unit, A system equipped with a function to print an image based on an image captured by the second camera and an image based on an image captured by the first camera of the shooting unit onto the same sheet.
2. A system comprising a shooting unit equipped with a first camera for capturing images, and an editing unit installed in a separate location from the shooting space captured by the shooting unit, which edits the images captured by the first camera of the shooting unit according to user operations, A system characterized by comprising: a function to transmit an image based on an image captured by the first camera to a terminal other than the editorial department via a network; a function to edit the image based on the image captured by the first camera received via the network at a terminal other than the editorial department; and a function to print the edited image at a printing unit located in a place separate from the shooting space and adjacent to the shooting space.
3. A system comprising a shooting unit equipped with a first camera for capturing images, and an editing unit installed in a separate location from the shooting space captured by the shooting unit, which edits the images captured by the first camera of the shooting unit according to user operations, The system is characterized by recording information about the order and extent of processing of images taken by the first camera by the editorial department, acquiring an image based on the history information and the images taken by the camera in the shooting space using a display device separate from the display unit in the editorial department, and applying at least a portion of the history information to the acquired image based on the images taken by the first camera in the shooting unit to reproduce the processing on the separate display device.
4. The editorial department is equipped with a second camera for photographing the user who is editing, and has a function for processing an image based on the image taken by the second camera and an image based on the image taken by the shooting unit in association with each other. The system according to claim 2 or 3, characterized by the above.
5. A system comprising a shooting unit equipped with a first camera for capturing images, and an editing unit installed in a separate location from the shooting space captured by the shooting unit, which edits the images captured by the first camera of the shooting unit according to user operations, It is equipped with a second camera for photographing users who are editing by the editorial department, and has a function to process images based on images taken by the second camera and images based on images taken by the shooting unit, A system characterized by performing processing to generate an NFT (Non-Fungible Token) based on both an image based on an image captured by the second camera and an image based on an image captured by the first camera of the imaging unit.
6. A program for a computer to implement the functions of the system described in any one of claims 1 to 5.