Photographing system and photographing method

Abstract

To automatically photograph a user at appropriate timing.SOLUTION: A photographing system comprises a plurality of photographing apparatuses and a server device communicably connected to the plurality of photographing apparatuses. The server device includes: a user information acquisition unit that from a user terminal fitted to a user, acquires the biological information of the user, positional information, and identification information; a determination unit that analyzes a user state using the biological information and determines a photographing condition based on the user state; a selection unit that select at least one photographing apparatus from the plurality of photographing apparatuses on the basis of the positional information; a photographing control unit instructing the selected photographing apparatus to perform photographing on the photographing condition; a picture acquisition unit acquiring a photographed picture from the photographing apparatus; and a storage unit storing the photographed picture in association with the identification information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging system and an imaging method. [Background technology]

[0002] In theme parks and the like, a service is provided in which visitors are photographed, the printed photographs are attached to original mounts, and sold to the visitors. An automatic photography system has also been proposed in which a photography device is installed in the facility, and when a user approaches a photography spot, the photography device takes a photograph and acquires the user's ID information from the user's communication device, and the photographed image and the identification information are stored in a server. When the server receives an order from an order terminal in the facility, it searches for the user's photographed image based on the ID information, prints it out, and provides it to the user.

[0003] However, conventional automatic photography systems take pictures only when the user enters a photography spot, so they take pictures even when it is not suitable for taking pictures, such as when the user is not enjoying themselves or is not in the mood, and save the captured images. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6393360 [Patent Document 2] Patent No. 6094476 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide an imaging system and an imaging method that can automatically capture an image of a user at a suitable timing. [Means for solving the problem]

[0006] The photographing system of the present invention comprises a plurality of photographing devices, and a server device communicatively connected to the plurality of photographing devices. The server device has a user information acquisition unit that acquires biometric information, location information, and identification information of a user from a user terminal worn by the user, a determination unit that analyzes a user state using the biometric information and determines photographing conditions based on the user state, a selection unit that selects at least one photographing device from the plurality of photographing devices based on the location information, a photographing control unit that instructs the selected photographing device to perform photographing under the photographing conditions, an image acquisition unit that acquires photographed images from the photographing devices, and a memory unit that stores the photographed images in association with the identification information.

[0007] The photographing method of the present invention is a photographing method that uses a plurality of photographing devices and a server device communicatively connected to the plurality of photographing devices, in which the server device acquires biometric information, location information and identification information of the user from a user terminal worn by the user, analyzes the user status using the biometric information, determines photographing conditions based on the user status, selects at least one photographing device from the plurality of photographing devices based on the location information, and instructs the selected photographing device to perform photographing under the photographing conditions, the photographing device instructed by the server device to perform photographing performs photographing processing under the photographing conditions and transmits the photographed image to the server device, and the server device associates the photographed image received from the photographing device with the identification information and stores them in a memory unit. Effect of the Invention

[0008] According to the present invention, a user can be automatically photographed at a suitable timing. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic configuration diagram of an imaging system according to an embodiment of the present invention. [Diagram 2] FIG. 13 is a diagram showing an example of how a user terminal is worn. [Diagram 3] FIG. 2 is a functional block diagram of the server device. [Figure 4] 11 is a flowchart illustrating a shooting method. [Diagram 5] 11 is a flowchart illustrating a shooting method. [Figure 6] 11 is a flowchart illustrating a shooting method. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] 1 and 2, the photography system according to the embodiment of the present invention includes a server device 1, multiple photography devices 2, a user terminal 3 worn by each user U, and an image print device 4, and photographs the user U with the photography device 2 and provides data and prints of the photographed image to the user U. This photography system is installed in leisure facilities, tourist spots, etc., and the photography device 2 automatically photographs visitors and tourists.

[0012] The imaging device 2 may be fixed to a building or a pillar, or may be mounted on a drone to take aerial photographs.

[0013] The user terminal 3 is a wearable device attached to a part of the body, for example, a wristwatch-type or wristband-type sensor device attached to the wrist. The user terminal 3 has a biometric information detection unit that detects biometric information of the user U, a position detection unit that detects the current position of the user U, and a communication unit that communicates with the server device 1. In addition, the user terminal 3 is set with identification information that identifies each user.

[0014] The sensor unit detects the user's biometric information, such as heart rate (pulse rate), blood pressure, electrocardiogram waveform, body temperature, blood oxygen level, etc., using known techniques.

[0015] The position detection unit receives radio waves from a plurality of GPS satellites and detects position information indicating the current position.

[0016] The communication unit transmits user information including biometric information, location information, and identification information to the server device 1. The user information is transmitted at predetermined time intervals.

[0017] When the server device 1 receives the user information from the user terminal 3, it analyzes the user's state using the biological information included in the user information. For example, it analyzes whether the user is in a tense / excited state or a calm state based on the heart rate. In addition, it analyzes the user's stress level and excitement level using an electrocardiogram waveform. A publicly known algorithm can be used to analyze the user's state.

[0018] The server device 1 selects at least one image capturing device 2 capable of capturing an image of the user (where the user's position falls within the angle of view) from the position information included in the user information, and transmits an image capturing execution signal to the selected image capturing device 2. The server device 1 may also set image capturing conditions for the image capturing device 2 based on the analysis result of the user's state.

[0019] For example, when the user is in an excited state (when the degree of excitement is equal to or greater than a predetermined value), a shooting condition with a high zoom magnification is set so that the facial expression is easy to see. Also, since it is considered that the user is enjoying the facilities when the user is in an excited state, a shooting execution signal is sent to a plurality (all) of the shooting devices 2 capable of shooting the user so that the user can be shot from as many angles as possible. On the other hand, when the user is in a calm state, a shooting condition with a low zoom magnification is set so that the user's entire body is captured.

[0020] When the user's stress level is equal to or greater than a predetermined value, it is considered that the user is not enjoying the facility or the like, so even if there is an image capturing device 2 that captures the user in the field of view, no image capturing may be performed.

[0021] As a result, as shown in FIG. 1, an excited user U1 is photographed at a high zoom magnification by multiple surrounding camera devices 2, while a highly stressed user U2 is not photographed even if he is close to the camera devices 2.

[0022] The server device 1 acquires the captured image from the photographing device 2 that has transmitted the photographing execution signal. The server device 1 stores the identification information included in the user information in association with the captured image.

[0023] The user operates the user terminal 3 to input the identification information to the image print device 4. The image print device 4 notifies the server device 1 of the input identification information. When the server device 1 is notified of the identification information from the image print device 4, it transmits the captured image linked to the identification information to the image print device 4. The image print device 4 displays a list of the captured images received from the server device 1, and prints and outputs the image selected by the user on paper. The user can obtain a commemorative print. Alternatively, the user may log in to an image download site provided by the server device 1 using a smartphone or PC, input the identification information, and download the image data linked to the identification information.

[0024] With this type of photography system, the user's biometric information is detected, the user's condition is analyzed, and the user's image can be automatically captured at the appropriate timing and under the appropriate photographing conditions. In addition, since photography is not performed when the user is under high stress, the user does not have to view his / her facial expressions when he / she is not enjoying himself / herself when checking the list screen on the image printing device 4.

[0025] Next, the configuration of the server device 1 will be described. The server device 1 is a computer equipped with a communication unit, a storage unit, a CPU, etc., and the CPU executes a control program to realize the functions of a user information acquisition unit 11, a judgment unit 12, a photographing device selection unit 13, a photographing control unit 14, an image acquisition unit 15, an image search unit 16, and an editing unit 17, as shown in Fig. 3. The storage unit 10 stores photographing range information indicating a photographable range for each of the multiple photographing devices 2. The processing of each unit of the server device 1 will be described with reference to the flowchart of the photographing method shown in Fig. 4.

[0026] The user terminal 3 detects the biometric information and location information of the user (step S1), and transmits the user information including the biometric information, location information, and identification information to the server device 1 (step S2). The user information acquisition unit 11 of the server device 1 acquires the user information from the user terminal 3.

[0027] The determination unit 12 of the server device 1 analyzes the user's excitement level and stress level using the biological information included in the user information, and determines whether or not to perform imaging and the imaging conditions (step S3).

[0028] When it is determined that photography is to be performed, the photography device selection unit 13 selects at least one photography device 2 capable of photographing the user from the position information included in the user information and the photography range information of each photography device 2 stored in the storage unit 10 (step S4). For example, at least one photography device 2 is selected in order of proximity to the user. Also, when the determination unit 12 determines that the user is in an excited state (excitement level is a predetermined value or more), the photography device selection unit 13 may select multiple (or all) photography devices 2 capable of photographing the user.

[0029] The photographing control unit 14 instructs the selected photographing device 2 to perform photographing (step S5). The photographing control unit 14 may set photographing conditions of the photographing device 2 according to the state of the user. For example, the photographing condition of a high zoom magnification is set according to the excitement level of the user. The photographing device 2 performs photographing under the instructed conditions (step S6).

[0030] The image acquisition unit 15 acquires the captured image from the photographing device 2 (step S7), associates the captured image with the identification information included in the user information acquired in step S2, and stores the image in the storage unit 10 (step S8). This allows the captured image to be stored for each user.

[0031] Thereafter, when the identification information is notified from the image print device 4, the image search unit 16 searches for a captured image associated with the notified identification information and transmits it to the image print device 4. The image edited by the editing unit 17 may be transmitted to the image print device 4.

[0032] The editing unit 17 can edit the captured image by combining a design template image corresponding to the shooting location with the captured image. The editing unit 17 may apply an effect based on the user's state (excitement level, etc.) at the time of shooting to change the color or light. The editing unit 17 may also combine a numerical value or stamp representing the heart rate or excitement level with the captured image.

[0033] The image capturing device 2 may generate still image data or video data by the image capturing process. In the case of video data, the image capturing device 2 captures video for a predetermined time after receiving an instruction to start capturing from the server device 1. Alternatively, the server device 1 may instruct the user to start capturing video when a numerical value such as the user's excitement level reaches or exceeds a predetermined value, and instruct the user to stop capturing video when the numerical value falls below the predetermined value.

[0034] The server device 1 may generate one piece of video data by connecting the videos in order of excitement level.

[0035] The user terminal 3 may have the function of the determination unit 12 of the server device 1. In this case, the user terminal 3 detects the user's biometric information and analyzes the user's state. The user terminal 3 transmits the analysis result of the user's state, user information including position information and identification information to the server device 1. This can reduce the calculation load on the server device 1.

[0036] In the above embodiment, an example has been described in which the server device 1 instructs the photographing device 2 to perform photographing, but the user terminal 3 may have the functions of the determination unit 12 and the photographing control unit 14, analyze the user state, and instruct the photographing device 2 to perform photographing. The flow of photographing processing in this case will be described with reference to the flowchart shown in FIG.

[0037] When the photographing device 2 transmits radio waves and the user terminal 3 enters a predetermined area and receives the radio waves, a connection is established between the photographing device 2 and the user terminal 3 (step S11). The user terminal 3 notifies the photographing device 2 of its identification information. The user terminal 3 detects the user's biometric information (step S12), analyzes the user's excitement level and stress level, and determines whether or not to perform photographing and the photographing conditions (step S13).

[0038] The user terminal 3 instructs the camera device 2 with which the connection has been established to perform shooting (step S14). The user terminal 3 may set shooting conditions for the camera device 2 according to the user's status. The camera device 2 performs shooting based on the shooting instruction (step S15).

[0039] The photographing device 2 transmits the photographed image and the identification information notified from the user terminal 3 to the server device 1 (step S16). The server device 1 stores the photographed image and the identification information in association with each other (step S17). With this configuration, the calculation load on the server device 1 can be further reduced.

[0040] In the above embodiment, the configuration has been described in which the user's condition is analyzed from the user's biometric information and an instruction is given to the photographing device 2 to perform photographing, but each photographing device 2 may continuously photograph and store the photographed images in the storage unit 10 of the server device 1. The photographing device 2 may continuously photograph moving images or may continuously photograph still images at a predetermined time interval. The flow of photographing processing in this case will be described with reference to the flowchart shown in FIG.

[0041] The server device 1 acquires user information including biometric information, detection time of the biometric information, location information, and identification information from the user terminal 3 (step S21).

[0042] The server device 1 analyzes the user's state using the biological information included in the user information, and detects a suitable timing (time) for photographing, such as when the user is highly excited (step S22). The server device 1 also detects the position of the user at this time.

[0043] The server device 1 searches the storage unit 10 and extracts an image at the detected timing from images captured by a photographing device whose photographing range includes the detected position of the user (step S23).

[0044] The server device 1 stores the extracted image in the storage unit 10 in association with the identification information included in the user information (step S24).

[0045] The server device 1 may register the user's face image in advance, and when extracting images, a face search may be performed to preferentially extract images in which the user is smiling. In addition, among the extracted images, image processing such as blurring people other than the user or areas that are considered unnecessary may be performed.

[0046] Although the present invention has been described in detail with reference to specific embodiments, it will be apparent to those skilled in the art that various modifications can be made without departing from the spirit and scope of the invention. [Explanation of symbols]

[0047] 1. Server device 2. Imaging Device 3. User terminal 4. Image printing device

Claims

1. A server device connected to a plurality of image capture devices so as to be able to communicate with the plurality of image capture devices; The server device includes: A user information acquisition unit that acquires biometric information, location information, and identification information of a user from a user terminal worn by the user; a determination unit that analyzes a user's state by using the biometric information and determines an image capturing condition based on the user's state; a selection unit that selects at least one image capture device from the plurality of image capture devices based on the position information; an imaging control unit that instructs the selected imaging device to perform imaging under the imaging conditions; an image acquisition unit that acquires a photographed image from the photographing device; a storage unit that stores the captured image and the identification information in association with each other; having The determination unit analyzes a stress level of the user using the biological information, and determines not to perform image capture when the stress level is equal to or greater than a predetermined value.

2. The photographing system according to claim 1 , wherein the determination unit analyzes an excitement level of the user by using the biological information, and determines a zoom magnification at the time of photographing based on the excitement level.

3. The photographing system according to claim 2 , wherein the selection unit selects all photographing devices capable of photographing the user when the excitement level is equal to or greater than a predetermined value.

4. A server device connected to a plurality of image capture devices so as to be able to communicate with the plurality of image capture devices; The server device includes: a user information acquisition unit that acquires, from a user terminal worn by a user, an analysis result of analyzing a user state based on the biometric information of the user, position information, and identification information; a determination unit that determines a photographing condition based on an analysis result of the user state; a selection unit that selects at least one image capture device from the plurality of image capture devices based on the position information; an imaging control unit that instructs the selected imaging device to perform imaging under the imaging conditions; an image acquisition unit that acquires a photographed image from the photographing device; a storage unit that stores the captured image and the identification information in association with each other; having The analysis result includes a stress level of the user, and the determination unit determines not to perform photography if the stress level is equal to or greater than a predetermined value.

5. 1. A photographing method using a plurality of photographing devices and a server device communicably connected to the plurality of photographing devices, comprising: the server device acquires biometric information, location information, and identification information of the user from a user terminal worn by the user, analyzes a user state using the biometric information, determines photographing conditions based on the user state, selects at least one photographing device from the plurality of photographing devices based on the location information, and instructs the selected photographing device to perform photographing under the photographing conditions; the photographing device instructed by the server device to perform photographing performs photographing processing under the photographing conditions and transmits the photographed image to the server device; the server device stores the captured image received from the photographing device in a storage unit in association with the identification information; The server device analyzes a stress level of the user using the biological information, and determines not to perform image capture if the stress level is equal to or greater than a predetermined value.

Images