Photographing system, server device, and photographing method

A wearable biometric sensor and imaging device system captures significant emotional moments by analyzing user emotions, addressing the inconvenience of manual photography and subject discomfort.

JP2024169097AInactive Publication Date: 2024-12-05DAI NIPPON PRINTING CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023086290
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-12-05
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Individuals often miss capturing important moments due to the inconvenience of carrying a camera, and photographing while holding one can make subjects uncomfortable.

Method used

A wearable biometric sensor and imaging device attached to the user's body, connected to a server device, automatically captures images based on emotional analysis of the user's biometric data, storing significant moments.

Benefits of technology

Automatically captures and stores images of scenes that evoke strong emotions, ensuring natural expressions and user comfort.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169097000001_ABST
    Figure 2024169097000001_ABST
Patent Text Reader

Abstract

To provide a photographing system, a server device, and a photographing method that can automatically capture scenes that are important to a photographer.SOLUTION: A photographing system includes: a sensor 2 worn by a user U and configured to measure biometric information of the user U; a photographing device 1 that can be attached to the body of the user U; a server device 4 that acquires photographed data from the photographing device 1; and a determination unit 43 that performs, using the biometric information, emotion analysis of the user. The server device 4 stores, in a storage unit 40, the photographed images at a timing based on an analysis result of the emotion analysis.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging system, a server device, and an imaging method. [Background technology]

[0002] There are times in everyday life when I think, "I want to capture this moment right now," but I don't always have my camera with me, so I'm unable to capture it in a photograph.

[0003] If a photographer always has the camera ready to take a picture at any time, the subject may feel uncomfortable or tense, making it difficult to capture a natural expression. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6094476 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a photography system, a server device, and a photography method that can automatically photograph a scene that is important to a photographer. [Means for solving the problem]

[0006] The photographing system of the present invention comprises a sensor worn by a user and measuring the user's biometric information, a photographing device that can be attached to the user's body, a server device that acquires photographed data from the photographing device, and a determination unit that performs emotion analysis of the user using the biometric information, and the server device stores photographed images at times based on the results of the emotion analysis in a memory unit.

[0007] The server device of the present invention comprises a user information receiving unit that receives user information including biometric information from a sensor that measures the user's biometric information, a photographing data receiving unit that receives photographing data from an imaging device that can be attached to the user's body, a determination unit that performs emotion analysis of the user using the biometric information and determines whether or not there has been a change in emotion, and an extraction unit that extracts from the photographing data a photographed image at the time when the user's emotion changed, and stores the image in a memory unit.

[0008] The photographing method of the present invention uses a sensor that is worn by a user and measures the user's biometric information, a photographing device attached to the user's body, and a server device communicatively connected to the sensor and the photographing device, in which the server device acquires photographic data from the photographing device, acquires the biometric information from the sensor, performs emotion analysis of the user using the biometric information, and stores photographed images at times based on the analysis results in a memory unit. Effect of the Invention

[0009] According to the present invention, scenes that are important to the photographer can be automatically photographed. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic configuration diagram of an imaging system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a functional block diagram of the server device. [Diagram 3] 11 is a flowchart illustrating a photographing method according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] As shown in Fig. 1, an imaging system according to an embodiment of the present invention includes an imaging device 1, a sensor 2, a communication device 3, and a server device 4. The imaging device 1 is, for example, a digital camera with a communication function, and is attached to the body of a user U to capture an image of a subject H. The imaging device 1 transmits captured image data to the server device 4. It is preferable that the imaging device 1 be a shoulder-type stuffed animal or character headgear with a built-in camera so that the subject H does not feel uncomfortable or tense.

[0013] The sensor 2 is a wearable device attached to a part of the body, for example, a watch-type or wristband-type device attached to the wrist. The sensor 2 includes a biometric information detection unit that detects biometric information of the user U, a position detection unit that detects the current position of the user U, and a communication unit.

[0014] The biometric information detection unit detects the user's biometric information, such as heart rate (pulse rate), blood pressure, electrocardiogram waveform, body temperature, and blood oxygen level, using a known method. The position detection unit receives radio waves from multiple GPS satellites and detects position information indicating the current position. The communication unit of the sensor 2 transmits user information including the biometric information and position information to the server device 4.

[0015] The photographing device 1 and the sensor 2 are communicatively connected to a server device 4 via a communication device 3. The communication device 3 is, for example, a wireless LAN device. The photographing system according to this embodiment is introduced in leisure facilities, tourist spots, etc., and multiple communication devices 3 are installed within a certain range. As a result, for example, an image photographed by the photographing device 1 within the premises of a leisure facility is stored in the server device 4.

[0016] The image capturing device 1 continuously and automatically captures moving images, and transmits the moving image data to the server device 4. The sensor 2 continuously measures user information, and transmits the user information to the server device 4.

[0017] The server device 4 monitors the biometric information included in the user information received from the sensor 2, and performs emotion analysis of the user U. A publicly known method can be used for emotion analysis based on the biometric information. For example, when the server device 4 determines that the user U has been moved (emotions have changed) through emotion analysis, it extracts (captures) a still image at that timing from the video data.

[0018] This allows the user U to automatically save images of important scenes where the user thinks, "I want to keep this moment."

[0019] Next, a description will be given of the configuration of the server device 4. The server device 4 is a computer equipped with a communication unit, a storage unit, a CPU, etc., and the CPU executes a control program to realize the functions of a photographed data receiving unit 41, a user information receiving unit 42, a determination unit 43, an image extracting unit 44, and an editing unit 45, as shown in FIG.

[0020] The storage unit 40 of the server device 4 stores emotion analysis statistical data indicating statistical values ​​of biometric information corresponding to emotions. For example, the emotion analysis statistical data specifies statistical values ​​of what values ​​the biometric information will have when emotions such as "excitement," "nervousness," and "surprise" are felt. The processing of each unit of the server device 4 will be described with reference to the flowchart of the imaging method shown in FIG.

[0021] For example, in a leisure facility, an account is created for a user U who wishes to use the photography service and registered in the server device 4, and the user account is linked with identification information of the photographing device 1 and the sensor 2 and then lent to the user U. Alternatively, the user U may purchase the photographing device 1 and the sensor 2, and identification information of the purchased photographing device 1 and the sensor 2 may be linked to the user account. In this way, the photographing data received from the photographing device 1 and the user information received from the sensor 2 can be associated with the user U.

[0022] When the identification information of the photographing device 1 is linked to the user account, the server device 4 causes the photographing device 1 to start photographing processing. The photographing data receiving unit 41 of the server device 4 receives the photographing data (video data) from the photographing device 1 and stores it in the storage unit 40.

[0023] When the sensor 2 is attached to the body of the user U, it measures biological information of the user U. The sensor 2 also detects position information of the user U. The user information receiving unit 42 of the server device 4 receives the user information including the position information and identification information from the sensor 2, and stores it in the storage unit 40 (step S101).

[0024] The determination unit 43 refers to the emotion analysis statistical data and performs emotion analysis of the user U based on the biometric information included in the user information (step S102). When the biometric information included in the user information indicates a value identical (approximate) to the biometric information corresponding to emotions such as "excitement," "excitement," and "surprise" in the emotion analysis statistical data, the determination unit 43 determines that the user U is moved (step S103_Yes).

[0025] The image extraction unit 44 extracts an image (still image) from the video data at the timing when it is determined that the user U was moved, and stores the image in the storage unit 40 (step S104). The editing unit 45 may synthesize a template image such as a stamp corresponding to the determined emotion with the still image extracted from the video data. The still image extracted from the video data may be stored in association with information on the emotion of the user U determined by the determination unit 43.

[0026] If it is determined that the user U is not moved (No in step S103), no image is extracted from the video data.

[0027] While the service is being used (Yes in step S105), reception of photographed data and user information, emotion analysis, and image extraction are repeatedly performed.

[0028] When the user U ends the use of the service (step S105_No), for example, when the user returns the photographing device 1 and the sensor 2 at a counter in the leisure facility or requests termination, the server device 4 causes the photographing device 1 to stop the photographing process. Alternatively, when the user U leaves the grounds of the leisure facility and is out of the communication range of the communication device 3, the photographing device 1 can no longer communicate with the server device 4, and the photographing process may be ended.

[0029] In this way, according to this embodiment, it is possible to automatically save images of important scenes that touch the user U's heart and make him or her think, "I want to keep this moment."

[0030] By accessing a dedicated website using the user U's account information, the user U can check the saved images and download the data. The user U may check the saved images and provide feedback on their evaluation. For example, the user U may input an evaluation on whether the image is a scene that moved him or her.

[0031] Based on the feedback evaluation, the emotion analysis statistical data may be updated for the user U. For example, if the user U evaluates an image as not being emotionally moving, the emotion analysis statistical data is updated assuming that the value of the biometric information at the time when this image was generated (extracted) is not emotionally moving for the user U. This allows the preferences of the user U to be learned and reflected in the next shooting.

[0032] The image extracted by the image extracting unit 44 at the timing when it is determined that the user U's heart has been moved is not limited to one, and multiple still images may be extracted and stored at regular intervals like continuous photographs. Alternatively, a video of a certain period of time including the timing when it is determined that the user U's heart has been moved may be extracted and stored. Furthermore, a scene in which the subject looks good (one or multiple still images) may be cut out and stored from the extracted video of the certain period of time.

[0033] The faces (appearances) of the subject H and the user U may be registered in advance. The image extraction unit 44 may extract an image at a timing when the determination unit 43 determines that the user U is moved and the registered subject person is captured.

[0034] The determination unit 43 may perform emotion analysis of the subject H from the facial expression of the subject H captured in the shooting data. For example, emotion is analyzed from the movement of each part of the face associated with the facial muscles. The image extraction unit 44 may extract an image from the video data at the timing when the determination unit 43 determines that the user U has been moved based on the biometric information received from the sensor 2 and that the subject H has been moved based on the facial expression of the subject H captured in the shooting data.

[0035] When it is determined from the location information received from the sensor 2 that the user U is in a predetermined photography prohibited area, the server device 4 may control the photography device 1 to stop the photography process, or may stop emotion analysis based on biometric information so as not to extract and save images.

[0036] In the above embodiment, the sensor 2 is not limited to being worn on the arm, and may be, for example, a headgear type, a glasses type, an earring type, etc. The photographing device 1 and the sensor 2 may be built into a headgear imitating an animal or a character.

[0037] The photographing device 1 is not limited to a stuffed toy with a built-in camera, but may be a robot with a camera in the shape of an animal or character. The part of the robot with the built-in camera may be rotatable around one or more axes. This allows the camera to be pointed toward the subject H regardless of the posture of the user U, and the subject H can be photographed at a good angle.

[0038] The photographing device 1, which is a robot with a camera, may store emotion analysis statistical data and acquire biometric information from the sensor 2 to perform emotion analysis of the user U. The photographing device 1 may also detect position information.

[0039] A user terminal such as a smartphone owned by the user U may communicate with the image capturing device 1 and the sensor 2 to receive video data and user information, and transmit the received video data and user information (via the communication device 3) to the server device 4. When such a user terminal is used, the user terminal may analyze the emotions of the user U and detect location information.

[0040] The photography system according to this embodiment can be applied not only to leisure facilities and tourist spots, but also in homes and childcare facilities. A parent or a childcare worker wears the photography device 1 and the sensor 2 and photographs the child. When the photography device 1, which is a robot with a camera, receives biometric information from the sensor 2, it may start video shooting and emotion analysis, and extract an image at the moment when it is determined that the child was moved. The photography device 1 may not only be one that is attached to the user's body, but also a stationary or self-propelled camera-equipped robot.

[0041] Although the present invention has been described in detail with reference to specific embodiments, it will be apparent to those skilled in the art that various modifications can be made without departing from the spirit and scope of the invention. [Explanation of symbols]

[0042] 1. Imaging device 2 Sensors 3. Communications equipment 4. Server equipment

Claims

1. A sensor that is attached to a user and measures biological information of the user; An imaging device that can be attached to the user's body; A server device that acquires photographic data from the photographing device; a determination unit that performs emotion analysis of the user using the biometric information; Equipped with The server device stores, in a storage unit, images captured at a timing based on a result of the emotion analysis.

2. The photographing system according to claim 1 , wherein the server device stores the photographed image in association with a result of the emotion analysis.

3. The photographing system according to claim 1 , wherein the server device stores photographed images that are photographed at a timing based on a result of the emotion analysis and that include a preregistered photographed person.

4. The photographing system according to claim 1 , wherein the photographing device is built into a stuffed toy.

5. a user information receiving unit that receives user information including biometric information from a sensor that measures the biometric information of a user; an image capturing data receiving unit that receives image capturing data from an image capturing device that can be attached to the user's body; a determination unit that performs emotion analysis of the user using the biometric information and determines whether or not there is an emotion change; an extraction unit that extracts a captured image at a timing when the emotion of the user changes from the captured image data and stores the extracted image in a storage unit; A server device comprising:

6. 1. An imaging method using a sensor that is worn by a user and measures biological information of the user, an imaging device attached to a body of the user, and a server device communicably connected to the sensor and the imaging device, The server device acquires image capture data from the imaging device, acquires the biometric information from the sensor, performs emotion analysis of the user using the biometric information, and stores captured images at times based on analysis results in a memory unit.

Citation Information

Patent Citations

  • Aqueous ink composition

    JP1985094476A