Service providing device, service providing method, and service providing program

Abstract

The present invention is a service providing device for providing a service related to an image of a user, the service providing device being provided with a processor, wherein the processor acquires state information including information related to a change in the state of the user and changes the content of the service on the basis of the state information.

Description

Service providing apparatus, service providing method, and service providing program

[0001] The present disclosure relates to a service providing apparatus, a service providing method, and a service providing program.

[0002] International Publication No. 2020 / 195642 describes changing the emotion of a character displayed on a display or changing shooting conditions or the like according to an evaluation based on an operation related to the user's evaluation of a photographed image. Japanese Patent Application Laid-Open No. 2005-301037 describes selectively setting a normal mode, a congestion mode, and an empty mode based on the elapsed time from the end of the previous customer's shooting to the entry of the next customer. In each mode, the waiting time for an operation instruction and the number of retake restrictions are different.

[0003] Japanese Patent Application Laid-Open No. 2020-197791 describes projecting a plurality of images separated positionally or temporally inside or outside a shooting box in a shooting space. Japanese Patent Application Laid-Open No. 2020-177162 describes presenting video content such as an advertisement toward the outside of the housing of a photo sticker machine.

[0004] One embodiment according to the technology of the present disclosure provides a service providing apparatus, a service providing method, and a service providing program that can improve user satisfaction.

[0005] A first aspect of the present disclosure is a service providing apparatus for providing a service related to a user's image, including a processor, the processor acquiring state information including information related to a change in the user's state, and changing the content of the service based on the state information.

[0006] The service includes a composition service for composing content into an image, and the processor may set the content based on the state information.

[0007] The processor may receive a selection of content to be composed into an image and set candidates for the content based on the state information during the selection of the content.

[0008] The system may also be equipped with a camera, and the processor may acquire images captured by the camera.

[0009] The processor may change the service content based on the status information while the image is being captured.

[0010] The processor accepts the selection of content to be composited into the image, and may set content different from the selected content based on the state information while the image is being captured.

[0011] The state information includes information about changes in the user's posture, and the processor may set at least one of the composite position, size, and orientation of the content in the image based on the changes in the user's posture while the image is being captured, as indicated by the state information.

[0012] The processor may set at least one of the image capture conditions and image processing conditions based on the state information while the image is being captured.

[0013] The service may include a service that captures video footage of the user using the service provider's equipment using a camera and outputs the video footage.

[0014] The processor may edit the video based on state information while the video is being captured.

[0015] The processor may acquire images from an external device.

[0016] The system further comprises at least one of a lighting device, a sound device, and a projection device, and the processor may set up a performance using at least one of the lighting device, sound device, and projection device based on state information.

[0017] The system may also include a display, and the processor may set the orientation of the display based on state information.

[0018] The service may also include a printer, and the service may include printing images onto a recording medium using the printer.

[0019] The processor may configure the state information items to reference based on the processes that make up the service.

[0020] The processor may obtain the user's demographic information and configure the service content based on that information.

[0021] The processor may configure the service content based on the environment in which the service provider is installed.

[0022] The service includes an advertising service to unspecified potential users in the vicinity of the service provider device while it is idle. The processor may acquire information about changes in the status of potential users and set the content of the advertising service based on the changes in the status of potential users.

[0023] A second aspect of this disclosure is a service provision method for providing a service relating to a user's image, wherein a computer acquires state information including information relating to changes in the user's state, and performs a process to change the content of the service based on the state information.

[0024] A third aspect of this disclosure is a service provision program for providing a service related to a user's image, wherein the computer acquires state information including information about changes in the user's state, and performs a process to change the content of the service based on the state information.

[0025] This figure shows an example of how the service provider is used. This is a schematic diagram of the service provider's configuration. This is a schematic diagram of the service provider's configuration. This figure shows an example of how the service provider is used in an isolated state. This is a block diagram showing an example of the hardware configuration of the service provider. This is a block diagram showing an example of the functional configuration of the service provider. This is a diagram illustrating an example of a synthesized service. This is a schematic diagram of the server device. This is a diagram illustrating an example of an output service. This is a diagram illustrating an example of an output service. This is a figure showing an example of service content according to status information, etc. This is a flowchart showing an example of service provision processing according to the first embodiment. This is a flowchart showing an example of service provision processing according to the second embodiment.

[0026] The following describes an example of an embodiment of the disclosed technology with reference to the drawings. In each drawing, identical or equivalent components and parts are given the same reference numerals, and redundant descriptions are omitted. Furthermore, the dimensional ratios in the drawings are exaggerated for illustrative purposes and may differ from actual ratios.

[0027] [First Embodiment] Referring to Figures 1 to 3, an example of the configuration of the service provision device (hereinafter referred to as "device 10") according to this embodiment will be described. Device 10 is a digital photo booth installed, for example, in the storefront of a retail store, a tourist facility, and a game center, and provides a service related to the image of the user 18.

[0028] Figure 1 shows an example of how the device 10 is used. Figure 2 shows the printer housing mechanism built into the device 10 in an unfolded state. Figure 3 shows the printed recording medium being ejected from the device 10.

[0029] The device 10 comprises a first housing 11 and a second housing 12 positioned on top of the first housing 11. The first housing 11 and the second housing 12 each contain at least one printer. As an example, the device 10 shown in Figure 2 has six printers 50A to 50F in the first housing 11 and four printers 50G to 50J in the second housing 12. Hereafter, when the printers 50A to 50J are not distinguished, they will simply be referred to as printer 50.

[0030] Each printer 50 is equipped with an independent storage mechanism for recording media, and each can print images on different types of recording media. Different types of recording media include, for example, instant film, inkjet paper, and sticker paper with different characteristics, those with the same characteristics but different sizes, and those with the same characteristics and size but different designs (base color and pattern, etc.).

[0031] Thus, by providing the device 10 with multiple printers 50 capable of printing on one type of recording medium, it is configured to be compatible with various recording media. The device 10 controls the device to selectively use at least one of the printers 50 to print an image onto the recording medium. The user 18 may, for example, be able to select which printer 50 to use (i.e., which recording medium to print the image on).

[0032] The device 10 is equipped with an outlet for ejecting printed recording media. As an example, the device 10 shown in Figure 3 is equipped with outlets 52A to 52J corresponding to each of the printers 50A to 50J. In the example in Figure 3, the recording media 96 on which the image has been printed by printer 50I is ejected from outlet 52I. Hereafter, when the outlets 52A to 52J are not distinguished, they will simply be referred to as outlet 52.

[0033] The printer 50 is configured to be housed inside the enclosure and deployed outside the enclosure. For example, as shown in Figures 1 and 3, the printer 50 is housed inside the enclosure when providing service. On the other hand, as shown in Figure 2, for example, the printer 50 is deployed outside the enclosure when performing maintenance or replenishing the recording medium. This deployment does not need to be performed simultaneously for all printers 50; it is also possible to deploy each printer 50 individually.

[0034] The first housing 11 and the second housing 12 can be coupled together and can provide services in both coupled and uncoupled states. "Coupling" refers to a connection involving physical contact, and includes mechanical coupling or magnetic coupling. Mechanical coupling includes, for example, coupling by fitting a convex portion and a concave portion, and coupling by screws.

[0035] In the examples shown in Figures 1 to 3, the second housing 12 is positioned on top of the first housing 11 in the combined state. This "positioned on top" does not mean that each housing is completely separated into an upper or lower section. For example, the protrusions and recesses of the first housing 11 and the second housing 12 may fit together, and a part of the second housing 12 may extend into the area of ​​the first housing 11. Also, for example, if skirts are provided on both ends of the second housing 12, the skirts may cover the outer surface of the first housing 11, and a part of the first housing 11 and the second housing 12 may overlap.

[0036] Figure 4 shows an example of how the device 10 is used in its separated state. In the example in Figure 4, the recording medium 96 printed by the printer 50E of the first housing 11, which has been separated from the second housing 12, is discharged from the output port 52E. Even in this case, operation input to the device 10 is performed using the touch panel 30 of the second housing 12.

[0037] In this way, by making the device 10 usable in both connected and separated states, the customizability and usability of the device 10 can be improved. For example, by placing the second housing 12 on a low stand 13 in the separated state, it becomes easier for shorter users 18, such as children and wheelchair users, to use it, thus realizing universal design. Also, for example, repairs and replacements can be performed on each housing, thus improving maintainability. Furthermore, for example, the first housing 11 can be used as a printer 50 for another device 10, or the second housing 12 can be used independently.

[0038] Next, an example of the hardware configuration of the device 10 will be described with reference to Figure 5. As described above, the device 10 comprises a first housing 11 and a second housing 12.

[0039] The first enclosure 11 includes a CPU (Central Processing Unit) 21, a non-volatile storage unit 22, a memory 24 as a temporary storage area, and a communication interface 25. The first enclosure 11 also includes a lighting device 26 and a plurality of printers 50A to 50F. The CPU 21, storage unit 22, memory 24, communication interface 25, and lighting device 26 are connected via a bus 28, such as a system bus and a control bus, and can exchange information with each other.

[0040] The storage unit 22 is implemented by a storage medium such as an HDD (Hard Disk Drive), SSD (Solid State Drive), and flash memory. The control program 23 is stored in the storage unit 22. The CPU 21 reads the control program 23 from the storage unit 22, expands it into the memory 24, and executes the expanded control program 23.

[0041] The communication interface 25 is an interface for communicating with the second enclosure 12, printers 50A to 50F, and other devices. For this communication, a wired communication standard such as Ethernet (registered trademark) or FDDI (Fiber Distributed Data Interface), or a wireless communication standard such as 4G, 5G, or Wi-Fi (registered trademark) may be used.

[0042] The lighting device 26 is configured to include, for example, an LED (Light Emitting Diode) light source equipped with RGB light-emitting elements, and the color and intensity of the light are adjustable. Also, as shown in Figure 3, the first housing 11 may be provided with a plurality of lighting devices 26 associated with each outlet 52. In the example in Figure 3, the first housing 11 is provided with lighting devices 26L corresponding to outlets 52A to 52C and lighting devices 26R corresponding to outlets 52D to 52F.

[0043] The second housing 12 includes a CPU 41, a non-volatile storage unit 42, a memory 44 as a temporary storage area, and a communication I / F 45. The second housing 12 also includes a touch panel 30, a camera 31, a microphone 32, an acoustic device 33, a lighting device 34, a projection device 35, and a plurality of printers 50G to 50J. The CPU 41, the storage unit 42, the memory 44, the communication I / F 45, the touch panel 30, the camera 31, the microphone 32, the acoustic device 33, the lighting device 34, and the projection device 35 are connected via a bus 48 such as a system bus and a control bus, and can exchange information with each other.

[0044] The storage unit 42 is realized by a storage medium such as an HDD, an SSD, and a flash memory. A service providing program 43 is stored in the storage unit 42. The CPU 41 reads the service providing program 43 from the storage unit 42, expands it in the memory 44, and executes the expanded service providing program 43. The CPU 41 is an example of the processor of the present disclosure.

[0045] The communication I / F 45 is an interface for communicating with the first housing 11, the printers 50G to 50J, the server device 60, and other devices. For this communication, for example, a standard for wired communication such as Ethernet or FDDI, or a standard for wireless communication such as 4G, 5G, or Wi-Fi is used.

[0046] The touch panel 30 has functions of both an input device and an output device. That is, input of various information to the device 10 and output (display) of various information from the device 10 are performed via the touch panel 30. Note that the input device may be constituted by independent hardware other than the touch panel 30 (for example, a button-type input device).

[0047] The camera 31 optically photographs the user 18, the user candidates, and the space where the device 10 is installed. The camera 31 includes a photographing optical system that forms an image of light, and an image sensor that outputs the formed optical image as an electrical image signal. As the image sensor, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge Coupled Device) image sensor, or the like is used.

[0048] The microphone 32 detects the voice of the user 18. The acoustic device 33 is a device that provides an auditory stimulus such as voice and music to the user 18, and is configured to include, for example, a speaker.

[0049] The lighting device 34 is configured to include, for example, an LED light source provided with RGB light emitting elements, and the color and amount of light can be adjusted. Further, as shown in FIG. 3, the second housing 12 may include a plurality of lighting devices 34 associated with each discharge port 52. In the example of FIG. 3, the second housing 12 includes a lighting device 34L corresponding to the discharge ports 52G to 52H and a lighting device 34R corresponding to the discharge ports 52I to 52J.

[0050] As shown in FIG. 1, the projection device 35 projects a projection image 98 onto at least one of the walls, floor, and ceiling around the device 10. Further, the projection device 35 may project the projection image 98 onto the body of the user 18. The projection device 35 includes a display unit that displays the projection image 98, and a projection optical system that projects projection light representing the projection image 98 displayed on the display unit. As the display unit, for example, a transmissive type configured by a combination of an LCD (Liquid Crystal Display) and a light source, or a reflective type configured by a combination of a DLP (Digital Light Processing) and a light source is used.

[0051] The installation position of the projection device 35 is not particularly limited. For example, as shown in FIG. 1, it can be provided on the ceiling and walls of the space where the device 10 is arranged. In this case, the control of the projection device 35 by the CPU 41 may be performed via wireless communication. Further, for example, the projection device 35 may be provided on the main body of the device 10, such as the upper surface of the second housing 12.

[0052] Device 10 can be, for example, a server computer, a personal computer, a smartphone, a tablet terminal, or a wearable terminal, as appropriate. For example, the CPU 41, storage unit 42, memory 44, communication interface 45, touch panel 30, camera 31, microphone 32, and sound device 33 in the second enclosure 12 may be implemented as a tablet terminal.

[0053] Next, an example of the functional configuration of the device 10 will be described with reference to Figure 6. The device 10 includes, as a functional configuration, an acquisition unit 80, a detection unit 81, a synthesis unit 82, an image processing unit 83, a shooting control unit 84, a performance control unit 85, a projection control unit 86, a display control unit 87, and an output unit 88. These functional units operate when the CPU 41 executes a service provision program 43.

[0054] The acquisition unit 80 acquires an image 90 of the user 18. "User image" refers to an image in which the user 18 is the subject, or any image that the user 18 inputs via an external device.

[0055] (Photography Service) The device 10 may also provide a photography service in which it takes images 90 on the spot using the camera 31. Specifically, the acquisition unit 80 acquires images of the user 18 taken by the camera 31 (images in which the user 18 is the subject). The acquisition unit 80 may also take multiple photographs of the user 18 using the camera 31.

[0056] Furthermore, the shooting control unit 84 may set the shooting conditions when taking a picture. These shooting conditions may include, for example, the camera orientation (angle), zoom magnification (angle of view), shutter speed, aperture value, white balance, ISO sensitivity, focus, and flash control. This enables optimal shooting according to the environment.

[0057] (Image Input Service) The device 10 may provide an image input service that accepts image input 90 from an external device. Specifically, the acquisition unit 80 acquires image 90 of user 18 from an external device. Examples of external devices include smartphones, tablet terminals, wearable devices, personal computers, server computers, USB memory, and memory cards.

[0058] For example, the acquisition unit 80 may acquire the image 90 by wirelessly pairing the user's smartphone or the like with the device 10. Alternatively, the acquisition unit 80 may acquire the image 90 already stored in cloud storage. Alternatively, the acquisition unit 80 may acquire the image 90 sent to a specific email address or messaging application.

[0059] Alternatively, for example, the device 10 may be provided with an input / output interface such as a USB port and a memory card slot, and the acquisition unit 80 may acquire the image 90 via this input / output interface. Alternatively, for example, the device 10 may be provided with a docking station for a smartphone or the like, and the image 90 may be acquired from the user 18's smartphone via the docking station.

[0060] (Synthesis Service) The device 10 may provide a synthesis service that synthesizes content 92 onto the user's image 90. Specifically, the synthesis unit 82 generates a synthesized image 94 by combining the image 90 and the content 92. "Synthesis" includes methods in which the image 90 and content 92 overlap, as well as methods in which the image 90 and content 92 do not overlap. For example, the image 90 and content 92 may be arranged horizontally or vertically and combined, or the content 92 may be placed along the outer perimeter of the image 90.

[0061] Figure 7 shows an example of a content selection screen D1 displayed on the touch panel 30 by the display control unit 87. The compositing unit 82 may be capable of compositing various contents 92 onto the image 90. The compositing unit 82 may also accept the selection of the contents 92 to be composited.

[0062] Specific methods of synthesis include, for example, the application of known techniques such as frame synthesis, stamp and sticker synthesis, AR (Augmented Reality) animation superimposition, and background synthesis. For example, the synthesis unit 82 may place predetermined content 92, such as figures, photographs, and illustrations, at positions corresponding to predetermined parts of a subject in the image 90 (e.g., head and limbs) (see the "hand heart" example in Figure 7). The predetermined parts of the subject in the image 90 can be identified using known posture estimation techniques that estimate the posture of the subject from the image.

[0063] For example, the compositing unit 82 may also composite content 92 corresponding to a specific theme onto the image (see the examples of "Halloween" and "Flowers" in Figure 7). For example, the compositing unit 82 may also composite content 92 such as real people like celebrities and athletes, as well as fictional characters from movies and comics onto the image 90.

[0064] (Image Processing Service) The device 10 may provide an image processing service for the image 90. Specifically, the image processing unit 83 may perform various image processing on the whole or a part of the image 90. For example, the image processing unit 83 may correct the brightness, saturation, contrast, lighting, noise, and resolution of the entire image 90. Alternatively, the image processing unit 83 may convert the entire image 90 to monochrome, sepia, or any other color tone.

[0065] For example, the image processing unit 83 may align images that are tilted due to the camera's tilt during shooting, both horizontally and vertically, or correct image distortion caused by wide-angle and fisheye lenses. For example, the image processing unit 83 may recognize the face portion in the image 90 and adjust the smoothness and brightness of the skin, or adjust the size of the eyes. For example, the image processing unit 83 may remove or blur the background portion in the image 90, or crop it to the optimal composition.

[0066] (Printing Service) The device 10 may provide a service of printing the user's image 90 onto a recording medium using the printer 50. Specifically, the output unit 88 controls the printer 50 to print the image 90 captured by the camera 31 onto the recording medium. Alternatively, the output unit 88 may control the printer 50 to print an image 90 input from an external device, a composite image 94, or an image 90 after image processing onto the recording medium instead of the image 90 captured by the camera 31.

[0067] Furthermore, the output unit 88 may accept a specification of the type of recording medium and select at least one printer 50 capable of printing on the specified recording medium. If printing to multiple recording media, the output unit 88 may select two or more printers 50 and control them to print in parallel.

[0068] (Storage Service) The device 10 may provide a storage service for saving the user 18's images 90 to a storage device. Specifically, the output unit 88 saves the images 90 to the server device 60 and manages the data in a format accessible from the user 18's terminal.

[0069] Figure 8 shows an example of the schematic configuration of the server device 60. The server device 60 includes a device DB (Database) 62, a customer DB 64, an image DB 66, and a video DB 68. Each DB is built by, for example, a software program that provides the functions of a database management system (DBMS). The server device 60 is configured to write and read data to and from each DB.

[0070] The device database 62 records the identification information (device ID) of the device 10 in association with the installation location of the device 10. The customer database 64 records the identification information (customer ID) of the user 18 in association with demographic information. Demographic information is demographic data used to quantitatively analyze the attributes and characteristics of the user 18, such as gender, age, number of people, relationships in groups (family and friends, etc.), physique, hobbies, preferences, occupation, income, and place of residence.

[0071] Image DB 66 records the data of image 90, the identification information (image ID) of image 90, the acquisition date and time, the acquisition source device ID, and the customer ID in association with each other. Alternatively, the image data itself may be stored in a separate storage device, and the address of the image data in that storage device may be recorded. The moving image DB 68 will be described later.

[0072] Figure 9 is an example of screen D2 showing the stored information of the image 90 displayed on the touch panel 30 by the display control unit 87. As shown in Figure 9, the output unit 88 may be controlled to display the stored information of the image 90 as a two-dimensional code 97 on the touch panel 30. The two-dimensional code 97 includes, for example, the address of the server device 60 and the image ID. The user 18 can access the image 90 by scanning the two-dimensional code 97 with their smartphone or the like.

[0073] Furthermore, as shown in Figure 10, the output unit 88 may be controlled to print the two-dimensional code 97 together with the image 90 onto the recording medium 96. In this case, the two-dimensional code 97 can be scanned at any time using the printed material, thus improving usability. Note that the two-dimensional code 97 can also be replaced with other coded codes such as barcodes, or with text data, etc.

[0074] (Video Output Service) The device 10 may also provide a video output service, which involves capturing video footage of the user 18 using the device 10 with the camera 31 and outputting the video footage. For example, the device 10 may store the video footage in a storage device accessible from the user 18's terminal.

[0075] Specifically, the output unit 88 may store the video in a server device 60 including a video database 68 and manage the data in a format accessible from the user 18's terminal. The video database 68 records the video data, video identification information (video ID), shooting date and time, acquisition source device ID, and customer ID in association. The video data itself may be stored in a separate storage device, and the address of the video data in that storage device may be recorded. Also, similar to the examples in Figures 9 and 10, the output unit 88 may output the video storage information as a two-dimensional code so that the user 18 can access the video.

[0076] Alternatively, for example, the output unit 88 may output video to a live streaming distribution function on a predetermined SNS 70 (Social Networking Service) platform. The SNS 70 account information may be registered in the customer DB 64 along with the customer ID, for example, and the user 18 may configure the settings in advance to enable smooth distribution.

[0077] (Performance Service) The device 10 may provide performance services using at least one of the lighting devices 26 and 34 and the sound device 33. Specifically, the performance control unit 85 sets the performance based on processes such as the shooting service, the compositing service, and the printing service. For example, the performance control unit 85 may provide a more elaborate lighting effect and sound notification than before when the printed recording medium 96 is ejected.

[0078] For example, the performance control unit 85 may turn on the lighting devices 26 and 34 corresponding to the discharge port 52 at the timing when the printed recording medium 96 is discharged, so that the user 18 can intuitively understand the discharge port 52. For example, the performance control unit 85 may provide a performance that makes the discharge port 52 intuitively understandable by adjusting the volume and speaker position of the sound device 33. For example, the performance control unit 85 may notify the user of the discharge port 52 by voice using the sound device 33, such as saying "It's coming out from the right."

[0079] (Projection Service) The apparatus 10 may also provide a projection service using the projection device 35. Specifically, the projection control unit 86 determines the content of the projected image 98 based on the processes that constitute the service, such as the shooting service, the synthesis service, and the printing service. For example, the projection control unit 86 may project a more elaborate projected image 98 than before at the time the printed recording medium 96 is ejected.

[0080] (Advertising Service) The device 10 may provide advertising services to unspecified potential users in its vicinity while in an idle state. "Idling state" refers to the state after the device 10 has been started and is waiting for a service request from a user 18. "Unspecified potential users" are people who may use the device 10, such as passersby.

[0081] For example, the performance control unit 85 may use at least one of the lighting devices 26 and 34 and the sound device 33 to perform effects that encourage the use of the device 10. Alternatively, for example, the projection control unit 86 may project a projection image 98 with content that encourages the use of the device 10. Alternatively, for example, the display control unit 87 may display a screen with content that encourages the use of the device 10 on the touch panel 30.

[0082] The above describes the basic functions of the device 10. However, the device 10 according to this embodiment further has a function to change the content of the service based on state information, which includes information regarding changes in the state of the user 18. This aims to enhance the user experience and improve satisfaction. The details of this function will be described below.

[0083] The detection unit 81 detects (acquires) state information of the user 18. The state information includes at least information about changes in the user 18's state. For example, the state information includes information about at least one of the following: changes in the user 18's facial expression, changes in voice, changes in posture, and changes in biometric information. The state information makes it possible to grasp, for example, changes in the user's tension and emotions in real time.

[0084] Specifically, the detection unit 81 may detect state information by analyzing camera footage obtained by the camera 31, which captures the user 18 using the device over time. For example, by recognizing facial expressions from the camera footage, changes in emotions such as smiles, surprise, and anger can be estimated. Alternatively, by estimating posture from the camera footage, changes in movement can be analyzed, and the user 18's movements and level of tension can be estimated. Furthermore, by tracking the user's gaze from the camera footage, the user 18's points of focus can be identified, and changes in their interest can be understood.

[0085] The detection unit 81 may also detect state information by analyzing multiple still images taken at predetermined timings or time intervals, instead of using camera footage.

[0086] Furthermore, the detection unit 81 may detect state information by analyzing audio signals obtained by collecting audio over time using the microphone 32 while the user 18 is using the device. For example, changes in emotion can be estimated by analyzing the tone, volume, and tempo of the voice from the audio signal. Alternatively, the user 18's interests and evaluation results can be estimated by recognizing specific keywords from the audio signal.

[0087] Furthermore, the detection unit 81 may detect state information based on the user 18's operation input via the touch panel 30. For example, the user 18's level of tension and proficiency in operation can be estimated from the strength and frequency of pressing the touch panel 30. Also, for example, the user 18's attention and tension can be estimated from the operation speed and reaction time.

[0088] Furthermore, the detection unit 81 may detect state information using various sensors such as three-dimensional sensors like LiDAR (Light Detection and Ranging), motion sensors, heat sensors, optical sensors, and pressure sensors. For example, if the sensors detect an increase in body temperature and pulse rate, it can be estimated that the user 18 is in an excited or stressed state.

[0089] Furthermore, the detection unit 81 may acquire demographic information of the user 18. Specifically, the detection unit 81 may detect demographic information based on at least one of the camera image and / or audio. Alternatively, the detection unit 81 may acquire demographic information that has been pre-recorded in the server device 60.

[0090] Furthermore, the detection unit 81 may acquire environmental information relating to the environment in which the device 10 is installed. The environmental information includes at least one of the following: information relating to the installation location of the device 10, information relating to the weather at the installation location, information relating to events at the installation location, and information relating to the date and time. "Installation location" includes, for example, a country, region, and facility (such as an amusement park, train station, and retail store). "Weather" includes, for example, cloud cover, rainfall, temperature, and humidity. "Events" include, for example, various events in the surrounding area or facility, such as fireworks displays, exhibitions, and sports days. "Date and time" includes, for example, the current year, month, day, day of the week, and public holidays.

[0091] Specifically, the detection unit 81 may detect environmental information based on at least one of the camera image and / or audio. For example, the detection unit 81 may detect weather from the camera image or event sounds (such as fireworks) from the audio. The detection unit 81 may also acquire information from websites and databases that provide environmental information. For example, the detection unit 81 may use an API (Application Programming Interface) to acquire weather-related information or access a tourist information website.

[0092] At least one of the synthesis unit 82, image processing unit 83, shooting control unit 84, production control unit 85, projection control unit 86, display control unit 87, and output unit 88 changes the content of the service based on at least one of state information, environmental information, and demographic information.

[0093] Figure 11 shows an example of the content of a service that is modified based on status information, etc. Figure 11 shows the correspondence between the information reference items, the reference timing (process), the target of modification, and the content of the modification. In this way, at least one of the synthesis unit 82, image processing unit 83, shooting control unit 84, production control unit 85, projection control unit 86, display control unit 87, and output unit 88 may set the items of status information to be referenced based on the process that constitutes the service.

[0094] The synthesis unit 82 may set the content 92 based on state information. For example, as shown in No. 1, the synthesis unit 82 may set the content 92 with a high degree of smiles based on changes in facial expression.

[0095] Furthermore, the synthesis unit 82 may set candidate content 92 based on the status information of the selected content 92. For example, the synthesis unit 82 may recommend other content 92 that are similar to the content 92 with a high smile rating.

[0096] Furthermore, the image synthesis unit 82 may change the content of the service based on the state information while the image 90 is being captured. Specifically, the image synthesis unit 82 may set a different content 92 from the selected content 92 based on the state information while the image 90 is being captured. For example, as shown in No. 2, the image synthesis unit 82 may change the content 92 as a surprise if it is estimated that there is little change in facial expression and voice volume detected during shooting, and that the tension is low.

[0097] Furthermore, the compositing unit 82 may set at least one of the compositing position, size, and orientation of the content 92 in the image 90 based on changes in the user 18's posture while the image 90 is being captured. As described above, the state information can include information regarding changes in the user 18's posture. This enables natural and appropriate compositing in accordance with the user 18's movements and poses.

[0098] For example, the compositing unit 82 may detect specific parts of the user 18, such as their face and limbs, and position the content 92 to dynamically follow those parts. Alternatively, the compositing unit 82 may enlarge or reduce the content 92 based on the user 18's movement towards or away from the camera 31. Furthermore, the compositing unit 82 may rotate the content 92 to match the angle when the user 18 tilts their body.

[0099] Furthermore, the synthesis unit 82 may set the content 92 based on demographic information. For example, as shown in No. 3, the synthesis unit 82 may recommend content 92 with high usage rates according to age group, hobbies, and preferences.

[0100] Furthermore, the synthesis unit 82 may set the content 92 based on environmental information. For example, for images taken at night or in rainy weather where the background is poorly captured, content 92 that covers the background may be set.

[0101] The image processing unit 83 may set image processing conditions for image 90 based on the state information while image 90 is being captured. For example, as shown in No. 4, the image processing unit 83 may propose various image processing methods during capture and select image processing conditions that receive a relatively high evaluation based on the user's reaction. Environmental information such as lighting conditions may also be considered when setting image processing.

[0102] The shooting control unit 84 may set the shooting conditions for the image 90 based on the state information while the image 90 is being captured. For example, as shown in No. 5, the shooting control unit 84 may adjust the angle of the camera 31 in real time based on changes in the user 18's posture during shooting. Alternatively, shooting conditions such as shutter speed may be set considering the speed of the user 18's movements and environmental information such as lighting conditions. This makes it possible to provide an optimal shooting experience that is tailored to the user's movements and the surrounding environment.

[0103] The performance control unit 85 may set up performances using at least one of the lighting device 34 and the sound device 33 based on the state information. For example, as shown in No. 6, if the performance control unit 85 estimates that the user 18's tension is low based on the state information (for example, if there is little change in facial expression and voice volume), it may enhance the performances using the lighting device 34 and the sound device 33. For example, the lighting device 34 may use bright and colorful lighting patterns to enhance the atmosphere or use flashing gradients to create a dynamic effect. Alternatively, the sound device 33 may play uplifting music or gradually increase the volume to create a sense of excitement.

[0104] For example, if the performance control unit 85 estimates that the user 18 is tense based on the state information (for example, if the user is expressionless and speaks softly), it may use a warm-colored lighting pattern or play calming music to create a relaxing atmosphere. For example, if the performance control unit 85 estimates that the user 18 is highly excited based on the state information (for example, if the user's movements and facial expressions are very active), it may turn on a strobe light or play rhythmic music to further enhance the excitement.

[0105] The projection control unit 86 may set the effects using the projection device 35 based on the status information. For example, as shown in No. 7, the projection control unit 86 may project a projection image 98 corresponding to the content of the speech and the tension, based on the facial expression, conversation content, and volume of the voice detected during filming.

[0106] The display control unit 87 may set the orientation of the touch panel 30 based on state information. For example, as shown in No. 8, the display control unit 87 may adjust the tilt angle of the touch panel 30 to match the height of the user 18 detected at the start of the experience. The display control unit 87 may also control the touch panel 30 to face downwards if the position of the user's face changes, such as when the user 18 bends down during shooting.

[0107] The display control unit 87 may set the content to be displayed on the touch panel 30 based on the status information. For example, as shown in No. 9, the display control unit 87 may change the guidance language according to the language of the user 18 detected at the start of the experience. In addition, if voice guidance is provided, the language of the voice guidance may be changed.

[0108] Furthermore, as shown in No. 10, the display control unit 87 may, for example, display instructions or provide voice guidance on the touch panel 30 if it is estimated that the user 18 is confused about how to operate the device based on the status information (for example, if there is a delay in operation input).

[0109] The output unit 88 may edit the video based on the state information while the video is being captured. For example, as shown in No. 11, the output unit 88 may extract scenes that are estimated to indicate a high level of tension in the user 18 based on the state information (for example, scenes where the user is smiling a lot and speaking loudly), and generate a digest video by concatenating the extracted scenes. Alternatively, the output unit 88 may change the content 92 to be synthesized and the image processing according to the tension of each scene in the digest video. For example, different effects may be added to each scene, or text such as "The best moment!" may be added.

[0110] As described above, the device 10 can provide advertising services to unspecified user candidates. In this case, the detection unit 81 may detect (acquire) information regarding changes in the state of user candidates based on camera images or the like. At least one of the performance control unit 85, projection control unit 86, and display control unit 87 may set the content of the advertising service based on changes in the state of user candidates. For example, as shown in No. 12, the display control unit 87 may be controlled to display content 92 that is likely to interest user candidates on the touch panel 30 based on changes in the state of user candidates.

[0111] The output unit 88 may output status information, etc., to a server device 60 or the like so that it can be used for marketing research such as the location and timing (event) of the installation of the device 10. For example, the output unit 88 may output time-series data showing the changes in the user 18's status throughout the entire service, along with metadata including demographic information and environmental information.

[0112] As for how to configure the service content of each of the above functional units, statistical methods may be used, for example. Specifically, the relationship between status information and changes may be statistically analyzed, and the service content may be determined based on a predetermined set of rules. Demographic information and environmental information may also be added to the items in the rule set.

[0113] Alternatively, the service content may be determined using a machine learning model that has been pre-trained to take state information as input and output the optimal service content. For example, the machine learning model can be obtained by learning the optimal relationship between state information and service content using past data. Alternatively, for example, a model that optimizes the service content based on real-time state information feedback using reinforcement learning techniques may be used. As machine learning models, deep learning models such as CNN (Convolutional Neural Network) and LSTM (Long Short-Term Memory) can be applied as appropriate. Demographic information and environmental information may also be added as input to the machine learning model.

[0114] Next, the operation of the apparatus 10 according to this embodiment will be described with reference to Figure 12. In the apparatus 10, the CPU 41 executes the service provision program 43, thereby executing the service provision process shown in Figure 12. This process is executed, for example, when a user gives an instruction to start execution.

[0115] In step S10, the detection unit 81 acquires state information, which includes at least information about changes in the user 18's state, based on camera images and the like. The detection unit 81 may also acquire demographic information and environmental information. In step S12, the acquisition unit 80 accepts whether or not to capture an image 90 with the camera 31.

[0116] If the camera 31 captures an image 90 (step S12 is Y), the process proceeds to step S14. In step S14, the synthesis unit 82 sets the content 92 to be synthesized based on the state information acquired in step S10. In step S16, the acquisition unit 80 captures an image 90 of the user 18. The display control unit 87 displays a preview screen on the touch panel 30 at the time of capture, which is a composite of the through image from the camera 31 and the content 92 set in step S14.

[0117] In step S18, the detection unit 81 reacquires user 18 status information based on camera images, etc. In step S20, the output unit 88 determines whether or not the capture of a predetermined number of images 90 has been completed. If the capture is not complete, steps S14 to S20 are repeated. In step S14 during repetition, the synthesis unit 82 sets the content 92 based on the status information acquired in the previous step S18.

[0118] If shooting is complete, the process proceeds to step S22. In step S22, the output unit 88 outputs a predetermined number of images 90 (composite images 94 with content 92 combined) to at least one of the printer 50 and the server device 60, and the process ends.

[0119] On the other hand, if the camera 31 does not capture an image 90 (step S12 is N), the process proceeds to step S24. The acquisition unit 80 acquires an image 90 of the user 18 from an external device. In step S26, the synthesis unit 82 sets the content 92 to be synthesized based on the state information acquired in step S10. In step S22, the output unit 88 outputs the synthesized image 94, which is the image 90 acquired in step S24 with the content 92 set in step S26 synthesized, to at least one of the printer 50 and the server device 60, and the process ends.

[0120] As described above, the apparatus 10 according to this embodiment is a service provision apparatus for providing a service related to the user's image, and includes a processor. The processor acquires state information, which includes information about changes in the user's state, and modifies the content of the service based on the state information.

[0121] In other words, the device 10 according to this embodiment can improve user satisfaction. Specifically, by detecting changes in the user's state, the service content can reflect the user's preferences and incorporate elements that respond to the user's emotions, thereby enhancing the user experience and improving satisfaction.

[0122] [Second Embodiment] The apparatus 10 according to the second embodiment has a function to determine the content of the projected image by the projection device 35 based on emotional information, including information about the user's emotions. This aims to further improve the performance effect. The details of this function will be described below. The basic configuration and functions of the apparatus 10 are the same as in the first embodiment, so some explanation will be omitted.

[0123] The detection unit 81 detects (acquires) emotional information, which includes information about the user 18's emotions. The emotional information includes information about at least one of the user 18's facial expressions, voice, actions, posture, and biometric information.

[0124] Specifically, the detection unit 81 may detect emotional information by analyzing camera footage obtained by capturing the user 18's actions over time using the device via the camera 31. For example, by recognizing facial expressions from the camera footage, emotions such as smiles, surprise, and anger can be estimated. Alternatively, by analyzing movements from the camera footage, it can be estimated that larger movements indicate feelings of joy and excitement.

[0125] The detection unit 81 may also detect emotional information by analyzing multiple still images taken at predetermined timings or time intervals, instead of using camera footage.

[0126] Furthermore, the detection unit 81 may detect emotional information by analyzing the audio signal obtained by collecting the voice uttered by the user 18 while using the device over time using the microphone 32. For example, emotions can be estimated by analyzing the tone, volume, and tempo of the voice from the audio signal. Alternatively, the emotions of the user 18 can be estimated by recognizing specific keywords from the audio signal.

[0127] The detection unit 81 may detect (acquire) motion information, including information about the user 18's movements. The motion information can be analyzed, for example, by estimating the posture from camera images. Alternatively, it can be detected and analyzed using, for example, a three-dimensional sensor such as LiDAR and a motion sensor.

[0128] The detection unit 81 may also detect (acquire) demographic information of the user 18. Furthermore, the detection unit 81 may acquire environmental information regarding the environment in which the device 10 is installed.

[0129] The projection control unit 86 determines the content of the projected image 98 projected by the projection device 35 based on the emotional information. Specifically, the projection control unit 86 determines the content of the projected image 98 depending on whether the emotional information satisfies predetermined conditions.

[0130] As shown in Figure 1, the projection control unit 86 may generate a projection image 98 that includes text based on emotional information. For example, the projection control unit 86 may generate a projection image 98 that includes a set phrase corresponding to the emotion, such as "HAPPY" for a happy emotion and "COOL" for a calm emotion. Alternatively, for example, the projection control unit 86 may generate a projection image 98 that includes text corresponding to what the user 18 says, such as "LOVE" when the user 18 says "I like it".

[0131] The projection control unit 86 may generate a projected image 98 with a design based on emotional information. "Design" includes various visual expressions such as color, pattern, shape, texture, and composition. For example, the projection control unit 86 may express the user 18's emotions by changing the color of the projected image 98, such as green for neutral emotions, red for happy emotions, and blue for calm emotions. Alternatively, for example, the projection control unit 86 may deliberately project a flashy image 98, such as a rainbow, when the user is feeling bored, in order to enhance the user 18's emotions.

[0132] Combining the above, the projection control unit 86 may determine the design of the text to be included in the projected image 98 (e.g., size, color, font, and texture) according to the emotional information. For example, if the volume of the voice spoken by the user 18 is loud and it is estimated that the user is highly emotional, the size of the text may be increased.

[0133] The projection control unit 86 may generate an image 90 with an effect based on emotional information as a projected image 98. The image 90 referred to here is an image of the user 18 taken by the camera 31 (hereinafter referred to as the captured image). "Effect" includes various image processing to add a visual change to the image 90. For example, the effect may be a filter to apply a uniform processing to the entire image, such as instant film-like processing or monochrome processing.

[0134] For example, the effect could be a style conversion that transforms a captured image (a realistic-looking image) into an arbitrary style such as a painterly or cartoonish style. In the example in Figure 1, a projected image 98, which is a captured image taken by user 18 and converted into a cartoon style, is shown as an example. For style conversion, a machine learning model that has been pre-trained to take image 90 as input and output an image converted into an arbitrary style may be used. In particular, a more desirable finish can be achieved by ensuring consistency between the design of the effect and the text. For example, a combination of cartoon-style speech bubble text and a cartoon-style style conversion may be used.

[0135] The projection control unit 86 may change the reference conditions based on the processes that constitute each service provided by the device 10. For example, in the shooting process, it may refer to whether or not the user 18 is feeling happy as a condition, and in the content selection process for the content 92 to be synthesized, it may refer to whether or not the user 18 is dissatisfied as a condition.

[0136] The projection control unit 86 may change the priority of the conditions it references based on the processes that constitute each service provided by the device 10. For example, in the shooting process, priority may be given to whether the user 18 is feeling happy, followed by whether or not they are dissatisfied. In the content selection process for the content 92 to be synthesized, priority may be given to whether or not the user 18 is dissatisfied, followed by whether or not they are feeling happy. Weights may also be assigned to each of these conditions.

[0137] The projection device 35 may be configured to change the projection position of the projected image 98. Specifically, the projection device 35 may be configured to switch between a first mode in which the projected image 98 is projected onto at least one of the walls, floor, and ceiling surrounding the device 10, and a second mode in which the projected image 98 is projected onto the body of the user 18.

[0138] The projection control unit 86 may determine the content of the projected image 98 based on the operation information. For example, the projection control unit 86 may generate a projected image 98 that includes an avatar that mimics the actions of the user 18. Alternatively, the projection control unit 86 may generate a projected image 98 that includes an effect that changes according to the user 18's actions, such as flower petals fluttering when the user 18 waves their hand.

[0139] The projection control unit 86 may dynamically control the projection position of the projected image 98 based on the operation information. For example, the projection control unit 86 may perform so-called projection mapping, which involves projecting the projected image 98 onto the body of the user 18.

[0140] The projection control unit 86 may determine the content of the projected image 98 based on demographic information. For example, the projection control unit 86 may generate a projected image 98 that is likely to make people smile, depending on their age group, hobbies, and preferences.

[0141] The services provided by the device 10 may include advertising services to unspecified user candidates, similar to the first embodiment. In this case, the detection unit 81 detects (acquires) information regarding the emotions of unspecified user candidates based on camera images, etc. The projection control unit 86 determines the content of the projected image based on the emotions of the user candidates.

[0142] Furthermore, the detection unit 81 may detect (acquire) information regarding the actions of unspecified user candidates. The projection control unit 86 may determine the content of the projected image based on the actions of the user candidates.

[0143] As for the method of determining the content of the projected image 98 by the projection control unit 86 described above, statistical methods may be used, for example. Specifically, the relationship between emotional information and the content of the projected image 98 may be statistically analyzed, and the service content may be determined based on a predetermined set of rules. Demographic information and environmental information may also be added to the items of the rule set.

[0144] Alternatively, for example, the projection image 98 may be determined using a machine learning model that has been pre-trained to take emotional information as input and output the optimal projection image 98. For example, the machine learning model can be obtained by learning the optimal relationship between emotional information and the projection image 98 using past data. Alternatively, for example, a model that optimizes the projection image 98 based on real-time emotional information feedback using reinforcement learning techniques may be used. As the machine learning model, for example, deep learning models such as CNN and LSTM can be applied as appropriate. Demographic information and environmental information may also be added to the input to the machine learning model.

[0145] Next, the operation of the apparatus 10 according to this embodiment will be described with reference to Figure 13. In the apparatus 10, the CPU 41 executes the service provision program 43, thereby executing the service provision process shown in Figure 13. This process is executed, for example, when a user gives an instruction to start execution.

[0146] In step S50, the detection unit 81 acquires emotion information, including information about the user 18's emotions, based on camera images and the like. The detection unit 81 may also acquire demographic information and environmental information. In step S52, the projection control unit 86 determines the content of the projected image 98 based on the emotion information and the like acquired in step S50. In step S54, the projection control unit 86 controls the projection device 35 to project the projected image 98 determined in step S52, and terminates this process.

[0147] As described above, the apparatus 10 according to this embodiment is a service provision apparatus for providing a service related to the user's image, and comprises a projection device 35 that projects a projected image 98 and a processor. The processor acquires emotion information, which includes information about the user's emotions, and determines the content of the projected image 98 based on the emotion information.

[0148] In other words, the device 10 according to this embodiment can improve the effect of the presentation. Specifically, by projecting images that reflect the user's emotions, the user experience can be improved. Furthermore, by projecting various variations according to the emotions, boredom can be prevented, thus encouraging repeat use. In addition, by projecting onto the surrounding walls, floor, and the user's body, it is easy to attract the attention of passersby and other people besides the user, thus achieving a high advertising effect.

[0149] In the embodiments described above, the device 10 is configured to have multiple printers 50 capable of printing on one type of recording medium, but it is not limited to this configuration. For example, the device 10 may be configured to have a supply mechanism that selectively supplies multiple types of recording media to the printers 50, so that one printer 50 can print on two or more types of recording media.

[0150] In the embodiments described above, the device 10 was described in which it is equipped with output ports 52A to 52J corresponding to each of the printers 50A to 50J. However, the device is not limited to this configuration, and the number of printers 50 and output ports 52 may differ. For example, the device 10 may be equipped with an output mechanism that guides recording media discharged from multiple printers 50 to a single output port. Alternatively, the device 10 may be equipped with an output mechanism that guides recording media discharged from a single printer 50 to any one of multiple output ports.

[0151] In the embodiments described above, the configuration in which the second housing 12 is positioned on top of the first housing 11 in the coupled state has been explained, but the invention is not limited to this configuration. For example, the second housing 12 may be positioned (coupled) to the left or right, or front or back, of the first housing 11.

[0152] In the embodiments described above, the device 10 is described in which it comprises one first housing 11 and one second housing 12, but it is not limited to this. For example, it may be configured to comprise multiple first housings 11 and multiple second housings 12. Alternatively, for example, it may be configured to comprise multiple first housings 11 and one second housing 12.

[0153] In each of the embodiments described above, each process is executed on any computer. Furthermore, any computer may execute these processes using a processor as hardware, a program as software, or a combination thereof. In this case, the processor is configured to work in cooperation with the program to execute the various processes in this embodiment, and can function as a unit or means in this embodiment. Also, the execution order of the processes by the processor is not limited to the order described and may be changed as appropriate. Any computer may be a general-purpose computer, a computer designed for a specific purpose, a workstation, or any other system capable of executing each process.

[0154] A processor may consist of one or more hardware components, and the type of hardware is not limited. For example, a processor may consist of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a programmable logic device such as an FPGA (Field Programmable Gate Array), a dedicated circuit for executing a specific process such as an ASIC (Application Specific Integrated Circuit), a GPU (Graphic Processing Unit), or an NPU (Neural Processing Unit). The type of hardware may also be a combination of different types of hardware. When multiple hardware components are configured to execute one or more processes of a processor, these components may reside in physically separate devices or in the same device. Furthermore, in any embodiment, the order of each process performed by the processor is not limited to the order described above and may be changed as appropriate. Hardware is composed of electrical circuits (circuitry) that combine circuit elements such as semiconductor elements.

[0155] Furthermore, the program may be firmware or software such as microcode. Alternatively, the program may be, for example, a group of program modules, each function of which may be implemented by a processor configured to perform its respective function. The program may be program code or multiple code segments stored on one or more non-temporary computer-readable media (e.g., storage media or other storage). The program may be divided and stored on multiple non-temporary computer-readable media located on physically separate devices. Program code or code segments may represent any combination of procedures, functions, subprograms, routines, subroutines, modules, software packages, classes, or instructions, data structures, or program statements. Program code or code segments may be connected to other code segments or hardware circuits by sending and receiving information, data, arguments, parameters, or memory contents.

[0156] Furthermore, although the above embodiment describes a configuration in which the service provision program 43 is pre-stored (installed) in the storage unit 42, the invention is not limited to this configuration. The service provision program 43 may be provided in the form of a recording medium such as a CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), or USB (Universal Serial Bus) memory. Alternatively, the service provision program 43 may be provided in the form of a download from an external device via a network.

[0157] The technology disclosed herein extends to all program products. A program product includes all forms of products for providing programs. For example, a program product includes programs provided via a network such as the Internet, as well as non-temporary computer-readable recording media such as CD-ROMs, DVD-ROMs, and USB memory sticks on which programs are stored.

[0158] The technology of this disclosure can also be appropriately combined with the above-described embodiments and modifications. The descriptions and illustrations shown above are detailed explanations of the parts relating to the technology of this disclosure and are merely examples of the technology of this disclosure. For example, the above descriptions of the configuration, function, operation, and effect are examples of the configuration, function, operation, and effect of the parts relating to the technology of this disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements added, or replaced from the descriptions and illustrations shown above, as long as they do not deviate from the spirit of the technology of this disclosure.

[0159] With respect to the above embodiments, the following additional notes are disclosed. [Addendum 1] A service providing device for providing a service related to a user's image, comprising a processor, wherein the processor acquires state information including information regarding changes in the user's state, and modifies the content of the service based on the state information. [Addendum 2] The service providing device according to Addendum 1, wherein the service includes a synthesis service for synthesizing content onto the image, and the processor sets the content based on the state information. [Addendum 3] The service providing device according to Addendum 2, wherein the processor accepts the selection of the content to be synthesized onto the image, and sets candidate content based on the state information while the content is being selected. [Addendum 4] The service providing device according to Addendum 2 or Addendum 3, further comprising a camera, wherein the processor acquires the image captured by the camera. [Addendum 5] The service providing device according to Addendum 4, wherein the processor modifies the content of the service based on the state information while the image is being captured. [Note 6] The service provider according to Note 5, wherein the processor accepts the selection of content to be composited onto the image, and sets content different from the selected content based on the state information while the image is being captured. [Note 7] The service provider according to Note 5 or Note 6, wherein the state information includes information regarding changes in the user's posture, and the processor sets at least one of the composite position, size, and orientation of the content in the image based on the changes in the user's posture while the image is being captured indicated by the state information. [Note 8] The service provider according to any one of Notes 5 to 7, wherein the processor sets at least one of the image capture conditions and image processing conditions based on the state information while the image is being captured. [Note 9] The service provider according to any one of Notes 4 to 8, wherein the service includes a service in which the camera captures a video image including the user using the service provider and outputs the video image.[Note 10] The service provider according to Note 9, wherein the processor edits the video based on the state information while the video is being captured. [Note 11] The service provider according to any one of Notes 2 to 10, wherein the processor acquires the video from an external device. [Note 12] The service provider according to any one of Notes 1 to 11, further comprising at least one of a lighting device, a sound device, and a projection device, wherein the processor sets up a performance using at least one of the lighting device, the sound device, and the projection device based on the state information. [Note 13] The service provider according to any one of Notes 1 to 12, further comprising a display, wherein the processor sets the orientation of the display based on the state information. [Note 14] The service provider according to any one of Notes 1 to 13, further comprising a printer, wherein the service includes printing the video onto a recording medium using the printer. [Note 15] The service provider according to any one of Notes 1 to 14, wherein the processor sets the items of the state information to be referenced based on the processes constituting the service. [Note 16] The service provider according to any one of Notes 1 to 15, wherein the processor acquires the demographic information of the user and sets the content of the service based on the demographic information. [Note 17] The service provider according to any one of Notes 1 to 16, wherein the processor sets the content of the service based on the environment in which the service provider is installed. [Note 18] The service includes an advertising service to unspecified user candidates in the vicinity of the service provider in an idling state, wherein the processor acquires information regarding changes in the state of the user candidates and sets the content of the advertising service based on the changes in the state of the user candidates.[Note 19] A service provision method for providing a service related to a user's image, wherein a computer acquires state information including information regarding a change in the user's state, and performs a process to change the content of the service based on the state information. [Note 20] A service provision program for providing a service related to a user's image, wherein a computer acquires state information including information regarding a change in the user's state, and performs a process to change the content of the service based on the state information.

[0160] The disclosure of Japanese Patent Application No. 2025-015172, filed on 31 January 2025, is incorporated herein by reference in its entirety. All documents, patent applications, and technical standards described herein are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

Claims

1. A service provider device for providing services related to a user's image, comprising a processor, wherein the processor acquires state information including information regarding changes in the user's state, and modifies the content of the service based on the state information.

2. The service provider according to claim 1, wherein the service includes a synthesis service for compositing content onto the image, and the processor sets the content based on the state information.

3. The service provision device according to claim 2, wherein the processor receives a selection of content to be synthesized on the image, and sets candidate content based on the state information while the content is being selected.

4. The service provision apparatus according to claim 2, further comprising a camera, wherein the processor acquires the image captured by the camera.

5. The service provision device according to claim 4, wherein the processor changes the content of the service based on the state information while the image is being captured.

6. The service provision device according to claim 5, wherein the processor accepts the selection of content to be synthesized on the image, and sets content different from the selected content based on the state information while the image is being captured.

7. The service provider according to claim 5, wherein the state information includes information relating to a change in the user's posture, and the processor sets at least one of the composite position, size, and orientation of the content in the image based on the change in the user's posture while the image is being captured as indicated by the state information.

8. The service provision device according to claim 5, wherein the processor sets at least one of the image capture conditions and image processing conditions based on the state information while the image is being captured.

9. The service provider according to claim 4, which includes a service that captures a video image of the user using the service provider with the camera and outputs the video image.

10. The service provision device according to claim 9, wherein the processor edits the video based on the state information while the video is being captured.

11. The service provision device according to claim 2, wherein the processor acquires the image from an external device.

12. The service provision device according to claim 1, further comprising at least one of a lighting device, a sound device, and a projection device, wherein the processor sets a performance using at least one of the lighting device, the sound device, and the projection device based on the state information.

13. The service providing device according to claim 1, further comprising a display, wherein the processor sets the orientation of the display based on the state information.

14. The service providing apparatus according to claim 1, further comprising a printer, wherein the service includes the service of printing the image onto a recording medium using the printer.

15. The service provider according to claim 1, wherein the processor sets the items of the state information to be referenced based on the processes that constitute the service.

16. The service provision device according to claim 1, wherein the processor acquires the user's demographic information and sets the content of the service based on the demographic information.

17. The service provider according to claim 1, wherein the processor sets the content of the service based on the environment in which the service provider is installed.

18. The service provider according to claim 1, wherein the service includes an advertising service to an unspecified list of potential users in the vicinity of the service provider while in an idle state, the processor acquires information regarding a change in the state of the potential users, and sets the content of the advertising service based on the change in the state of the potential users.

19. A service provision method for providing a service related to a user's image, wherein a computer acquires state information including information regarding a change in the user's state, and performs a process to change the content of the service based on the state information.

20. A service provision program for providing a service related to a user's image, wherein the computer acquires state information including information regarding changes in the user's state, and performs a process to change the content of the service based on the state information.

Images