Program, method, and system

Abstract

To provide an imaging system, an imaging method, an imaging program that are suitable for taking pictures of stuffed toys and can capture high-value-added images, and provide a stuffed toy.SOLUTION: An imaging system 5 includes an information terminal 10 and a stuffed toy 20 that can operate on the basis of specific information supplied from the information terminal 10, the information terminal 10 includes an imaging unit 100 that images an imaging area including the stuffed toy 20, and an imaging area information acquisition unit 104 that acquires imaging area information that is information relating to the imaging area, and the stuffed toy 20 includes at least one component 200, a drive unit 208 that operates the component 200, and a drive control unit 206 that controls the operation of the drive unit 208 on the basis of the imaging area information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a photography system, a photography method, a photography program, and a stuffed toy. In particular, the present invention relates to a photography system, a photography method, a photography program, and a stuffed toy that are suitable for taking pictures of stuffed toys. [Background technology]

[0002] A conventional communication device that performs a communication action toward a user includes a structure having a face part composed of a plurality of components, at least one of which corresponds to a component part that constitutes a face, a control means that controls the operation of the components to make the structure perform a gesture that expresses the communication action, and a detection means that detects the relative position of an object around the structure with respect to the structure, the detection means detects the position of the user's face, and the control means controls the operation of the components to make the structure perform a different gesture depending on the angle between the direction in which the face part is facing and the direction of the user's face as seen from the face part (see, for example, Patent Document 1). The communication device described in Patent Document 1 allows for natural communication action that takes into account the orientation of the user with respect to the face part of the structure. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-051701 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, the "nui-dori" culture of taking pictures in various places, such as indoors, outdoors, and travel destinations, with toys such as stuffed animals and dolls (hereinafter, these will be simply referred to as "stuffed animals") as the main characters has become widespread. In "nui-dori," pictures taken with stuffed animals as the main characters are uploaded to social networking services (SNS), etc., and enjoyed by many people. Here, in "nui-dori," the situation of the place where the stuffed animal is located, etc. is properly grasped, and an image appropriate to the situation is taken.

[0005] In addition, in "nui-dori," it is preferred to adjust the state of the stuffed animal to the surrounding situation, but with a stuffed animal that does not have a moving part or the like, it is difficult to make the stuffed animal take a pose that matches the surrounding situation. In addition, the communication device described in Patent Document 1 cannot take into account the surrounding situation of the stuffed animal, which is important in "nui-dori." In other words, although the communication device described in Patent Document 1 focuses on natural communication behavior between the user and the communication device, it cannot take into account the situation in which the stuffed animal is placed. In addition, the communication device described in Patent Document 1 cannot make the stuffed animal more lovable by adapting it to "nui-dori," or change the pose of the stuffed animal so that the user feels attached to it, and take an image including the stuffed animal.

[0006] Therefore, an object of the present invention is to provide a photography system, a photography method, a photography program, and a stuffed animal that are suitable for photography of stuffed animals and can capture images with high added value. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the present invention provides a photography system comprising an information terminal and a stuffed animal capable of operating based on specified information supplied from the information terminal, wherein the information terminal has an imaging unit which images an imaging area including the stuffed animal, and an imaging area information acquisition unit which acquires imaging area information which is information relating to the imaging area, and the stuffed animal has at least one component, a drive unit which operates the component, and a drive control unit which controls the operation of the drive unit based on the imaging area information. Effect of the Invention

[0008] According to the photography system, photography method, photography program, and stuffed animal of the present invention, it is possible to provide a photography system, photography method, photography program, and stuffed animal that are suitable for stuffed animal photography and can capture images with high added value. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram of an imaging system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a functional configuration block diagram of an information terminal according to the embodiment. [Diagram 3] FIG. 2 is a functional block diagram of a stuffed animal according to the present embodiment. [Figure 4] FIG. 1 is a schematic diagram of a stuffed animal according to an embodiment of the present invention. [Diagram 5] 3A and 3B are diagrams illustrating data configurations of each storage unit according to the embodiment. [Figure 6] FIG. 4 is a flow diagram of processing in the imaging system according to the present embodiment. [Figure 7] 5A to 5C are diagrams illustrating image processing by an image processing unit according to the embodiment. [Figure 8] 11 is a modified example of a flow chart of processing in the imaging system according to the present embodiment. [Figure 9] 11A and 11B are diagrams illustrating an example of creating additional information according to the embodiment. [Figure 10] FIG. 11 is a flow diagram of a process of an imaging system according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] [Embodiment Mode] <Overview of Imaging System 5> The photography system 5 according to the present embodiment includes an information terminal having a camera, and a toy such as a stuffed animal or a doll having a drive unit driven by a battery (hereinafter, in the present embodiment, referred to as a "stuffed animal"), and the drive unit operates in cooperation with the information terminal. That is, the drive unit of the stuffed animal operates based on information about the imaging area of ​​the camera, and the information terminal can capture an image in which the stuffed animal in the imaging area behaves as if it were the main character. That is, in the photography system 5, the information terminal grasps the situation of the imaging area including the stuffed animal, and the drive unit of the stuffed animal operates based on the situation grasped by the information terminal. Then, an image including this stuffed animal (the stuffed animal in motion or after a predetermined motion) is captured by the information terminal. As a result, the photography system 5 can capture an image with high added value suitable for stuffed animal photography, and can provide a stuffed animal that is highly lovable.

[0011] FIG. 1 shows an overview of an imaging system according to an embodiment of the present invention.

[0012] Specifically, the photography system 5 includes an information terminal 10 and a stuffed toy 20 having a drive unit operable based on predetermined information supplied from the information terminal 10. The information terminal 10 has a camera (imaging unit), and the camera captures an image of the imaging area. The predetermined information is information about the imaging area, such as an object 1 (e.g., a person) included in the imaging area, the scenery and background, the stuffed toy 20, other stuffed toys, the imaging location, and / or the date and time of imaging (hereinafter referred to as "imaging area information"). As an example, the information terminal 10 is in a state where it can accept an imaging instruction to instruct the camera to capture an image, and acquires the imaging area information of the imaging area in a shooting preparation state where it waits for the imaging instruction.

[0013] For example, as shown in Fig. 1(a), a case will be described in which an object 1 (person) and a stuffed toy 20 are included in the imaging area of ​​the information terminal 10. In this case, the information terminal 10 acquires information indicating that the person, which is the object 1, is included in the imaging area together with the stuffed toy 20, and information indicating the movement of the person as imaging area information by image analysis of the imaging area. The information terminal 10 can acquire imaging area information in real time and / or continuously. Then, the information terminal 10 supplies the acquired imaging area information to the stuffed toy 20 via wireless communication.

[0014] The stuffed toy 20 is configured with at least one component. As an example, the stuffed toy 20 has components such as a head, a body, four limbs, and ears, and is configured with a drive unit in a connection area between one component and another component adjacent to the one component, such as a connection area between the head and the body. The stuffed toy 20 also has a drive control unit that controls the operation of the drive unit based on the imaging area information.

[0015] When the drive control unit of the stuffed toy 20 acquires the imaging area information from the information terminal 10, the drive control unit operates the drive unit based on the imaging area information to operate the components. For example, the drive control unit operates each drive unit of the stuffed toy 20 to follow the movement of the person included in the imaging area, and operates each component of the stuffed toy 20. In the example of FIG. 1(b), the imaging area information includes information indicating a state in which the person, which is the object 1, is raising his / her right arm. Therefore, the drive control unit operates a drive unit that can raise the right arm of the stuffed toy 20 based on the imaging area information received from the information terminal 10, and puts the right arm of the stuffed toy 20 in a raised state. In this state, the information terminal 10 can capture an image of the stuffed toy 20.

[0016] As a result, the photography system 5 can capture an image in which the stuffed animal 20 included in the imaging area appears to be expressing emotions of its own accord together with the person (object 1) in the image, or to be acting independently.

[0017] The information terminal 10 is an information terminal having an imaging function, such as a mobile phone or smartphone having a camera function, a notebook computer having a camera function or capable of connecting a Web camera, a tablet PC, a PC having a camera function or capable of connecting a Web camera, a portable game console having a camera function or capable of connecting a Web camera, and / or a home game console having a camera function or capable of connecting a Web camera. The imaging system 5 according to this embodiment will be described in detail below, but it should be noted that the names, numerical values, etc. in the above and following descriptions are merely examples and are not limited to these names, numerical values, etc.

[0018] <Details of the Imaging System 5> Fig. 2 shows an example of the functional configuration of an information terminal according to this embodiment, and Fig. 3 shows an example of the functional configuration of a stuffed animal according to this embodiment. Fig. 4 shows an overview of an example of a stuffed animal according to this embodiment. Furthermore, Fig. 5 shows an example of the data configuration of each storage unit according to this embodiment.

[0019] [Overview of the configuration of the imaging system 5] The photographing system 5 according to the present embodiment includes an information terminal 10 and a stuffed toy 20 that operates based on imaging area information acquired by the information terminal 10. As shown in Fig. 2, the information terminal 10 includes an imaging unit 100, an imaging control unit 102 that controls the operation of the imaging unit 100, an imaging area information acquisition unit 104 that acquires information on the imaging area, an image analysis unit 106 that analyzes the image of the imaging area, an imaging area information storage unit 108 that stores the imaging area information, an information terminal side transmitting / receiving unit 110 that transmits and receives predetermined information, an instruction receiving unit 112 that receives an instruction from the outside, an image storage unit 114 that stores an image, an image processing unit 118 that executes image processing, an additional information generating unit 120 that generates additional information, a supply unit 122 that supplies a predetermined image and / or additional information to a predetermined server, a stuffed toy information storage unit 124 that stores information about the stuffed toy, a stuffed toy information update unit 126 that updates information about the stuffed toy, a friend information storage unit 128 that stores information about friends of the stuffed toy, and a display unit 130 that displays an image of the imaging area, etc.

[0020] Also, as shown in FIG. 3, the stuffed toy 20 has one or more constituent members 200 that constitute the stuffed toy 20, a stuffed toy side transceiver unit 202 that transmits and receives specified information, an operation information storage unit 204 that stores the operation scenario of the stuffed toy 20, etc., one or more drive units 208 that operate the constituent members 200, a drive control unit 206 that controls the operation of the drive units 208, a sensor 210 that measures acceleration, etc., a microphone 212, a speaker 214, a battery 220, a battery remaining amount confirmation unit 222 that confirms the remaining amount of the battery 220, and a charge / discharge control unit 224 that controls the charging and discharging of the battery.

[0021] All or part of the functions of each component of the information terminal 10 may be possessed by other components, or may be configured separately and independently. Also, some of the components of the information terminal 10 or some of the functions of each component may be possessed by the stuffed toy 20. Furthermore, some of the components of the stuffed toy 20 or some of the functions of each component may be possessed by the information terminal 10. For example, the information terminal 10 may have some of the functions of the operation information storage unit 204 and the drive control unit 206.

[0022] In a modified example of this embodiment, a server may have some of the functions of the information terminal 10 (for example, the image analysis unit 106), and the information acquired by the information terminal 10 (for example, image information of the imaging area) may be image-analyzed in the server, and the drive control unit 206 of the stuffed toy 20 may operate the drive unit 208 based on the image analysis results in the server. However, in the following, a form in which there is no server will be described.

[0023] [Details of the configuration of the imaging system 5: Configuration of the information terminal 10] (Imaging unit 100, imaging control unit 102) The imaging unit 100 captures an image of the imaging area. The imaging control unit 102 controls the operation of the imaging unit 100. For example, the imaging unit 100 is controlled by the imaging control unit 102 to capture an image (captured image) of the imaging area including the stuffed toy 20. Here, the imaging control unit 102 can cause the imaging unit 100 to capture an image in a state where imaging can be performed according to an imaging instruction from a user and where the imaging instruction is awaited before the imaging instruction is accepted (that is, a shooting preparation state). The imaging control unit 102 can also cause the imaging unit 100 to capture images in the shooting preparation state in real time and / or continuously. The imaging unit 100 can supply the images captured during the shooting preparation state to the imaging area information acquisition unit 104, the image analysis unit 106, and / or the display unit 130, and can also supply the images to the image storage unit 114 and / or temporarily store them in a predetermined memory. Then, for example, when the imaging control unit 102 receives an imaging instruction from a user, it causes the imaging unit 100 to capture an image, and causes the captured image of the imaging area at the time of the imaging instruction and / or at a predetermined period before and after that time to be stored in the image storage unit 114 and / or displayed on the display unit 130.

[0024] (Imaging area information acquisition unit 104) The imaging area information acquisition unit 104 acquires imaging area information, which is information related to the imaging area. The imaging area information acquisition unit 104 can acquire imaging area information in a shooting preparation state. The imaging area information acquisition unit 104 may acquire imaging area information in real time, or at predetermined time points along a time series, or at predetermined time intervals, of images continuously captured by the imaging unit 100 in a shooting preparation state. The imaging area information acquisition unit 104 supplies the acquired imaging area information to the imaging area information storage unit 108.

[0025] Here, the imaging area information is at least one piece of information selected from the group consisting of information on objects included in the imaging area, information on the background of the imaging area, position information of the imaging area (position information of the imaging position), imaging preparation state of the imaging area, date and time information at the time of imaging, temperature and humidity information, weather information, etc. Examples of objects include people, stuffed animals 20, stuffed animals other than the stuffed animal 20 that is the subject of the captured image, various items included in the imaging area, etc. Examples of information on objects include the type of object (if the object is a stuffed animal, the type of stuffed animal, etc.), the state of the object (the movement of the object, and if the object is a person, information on the action, posture, facial expression, etc. of the person), etc.

[0026] The imaging area information acquisition unit 104 may acquire, as imaging area information, information indicating whether or not another stuffed toy is present in the vicinity of the information terminal 10 (for example, within a predetermined distance from the information terminal 10. The predetermined distance is, for example, a distance at which wireless communication is possible with the information terminal side transmitting / receiving unit 110) although it is not included in the imaging area including the stuffed toy 20. For example, the imaging area information acquisition unit 104 determines whether or not communication is possible between the information terminal 10 and the other stuffed toy, and acquires, as imaging area information, information indicating that the other stuffed toy is present in the vicinity of the information terminal 10 if it is determined that communication is possible.

[0027] Alternatively, each of the multiple stuffed toys may be assigned a unique stuffed toy ID in advance, or the imaging area information acquisition unit 104 may assign a stuffed toy ID different from the stuffed toy 20 to a stuffed toy that is in the vicinity of the information terminal 10 and can communicate with the information terminal 10 each time the imaging preparation state is reached (if there are multiple stuffed toys, each of the multiple stuffed toys may be assigned a different ID). Then, the imaging area information acquisition unit 104 supplies commands to the drive control units 206 of the stuffed toys corresponding to each stuffed toy ID, each of which performs a different operation. Next, the imaging area information acquisition unit 104 identifies the stuffed toy included in the imaging area and the stuffed toy that is not included in the imaging area and is not included in the imaging area and exists in the vicinity of the information terminal 10, based on the operation of the stuffed toy included in the imaging area and the stuffed toy ID of the stuffed toy that has been supplied with the command corresponding to the operation. The imaging area information acquisition unit 104 may acquire this identification result as imaging area information.

[0028] The imaging area information acquisition unit 104 acquires the position information, date and time information, weather information, etc. of the imaging area using a GPS function, a clock function, a function for acquiring information from an external server, etc., of the information terminal 10. In addition, the imaging area information acquisition unit 104 acquires information on objects included in the imaging area and information on the background of the imaging area, etc., by image analysis of the captured image received from the imaging unit 100.

[0029] (Image analysis unit 106) That is, the information terminal 10 has an image analysis unit 106 that performs image analysis. The image analysis unit 106 analyzes an image of the imaging area in a shooting preparation state acquired by the imaging unit 100 and / or an image of the imaging area acquired by the imaging unit 100 in response to an imaging instruction, and generates the analysis result as imaging area information. The imaging area information acquisition unit 104 acquires the generated imaging area information. The image analysis unit 106 can perform image analysis using conventionally known image processing, pattern matching methods, etc.

[0030] The image analysis unit 106 can also read captured images of objects and backgrounds to be captured from the image storage unit 114 or an external server and learn them. In this case, the image analysis unit 106 can compare the learning result with the feature amount of the image of the captured area to identify what objects and backgrounds are included in the captured area. Furthermore, the image analysis unit 106 can also analyze the behavior and / or state of objects included in the captured area in real time. As an example, the image analysis unit 106 can compare a predetermined model of a specific object with the feature amount of an object included in the captured area to analyze what behavior the object is performing and / or what state it is in. Note that the image analysis unit 106 may recognize objects included in an image using, for example, Regional Convolutional Neural Network (R-CNN), high-speed RCNN, semantic segmentation, instance segmentation, etc.

[0031] For example, the image analysis unit 106 can analyze the image of the imaging area, identify whether an object included in the imaging area is a person, and if it is identified that the object is a person, identify the action and / or facial expression of the person. Also, the image analysis unit 106 can identify whether an object included in the imaging area is a stuffed toy, and if it is identified that the object is a stuffed toy, identify the characteristics of the stuffed toy (e.g., type, attributes, etc.). Furthermore, if the object included in the imaging area is an item other than a person (e.g., food and drink, merchandise, personal belongings, vehicles such as passenger cars, etc.), the image analysis unit 106 can identify what the item is (e.g., product name, etc.). Furthermore, the image analysis unit 106 can also identify what the background or scenery of the imaging area is.

[0032] (Imaging area information storage unit 108) The imaging region information storage unit 108 stores the imaging region information. The imaging region information storage unit 108 stores the imaging region information acquired by the imaging region information acquisition unit 104 in association with an imaging region ID that identifies the imaging region information. The imaging region information storage unit 108 can also store the imaging region information in further association with the date and time when the imaging region information was acquired (acquisition date and time). In other words, the imaging region information storage unit 108 can also store past imaging region information.

[0033] In this case, the image analysis unit 106 can analyze the image of the imaging area at the time when the imaging unit 100 captures an image of the imaging area in the imaging preparation state, and / or the image of the imaging area at a time before the time. As a result, for example, the image analysis unit 106 can generate information indicating what is captured in the imaging area at a time before the imaging unit 100 acquires a captured image in response to an imaging instruction (for example, information on the scenery, background, and changes therein, information on the actions and expressions of the person included in the imaging area, and changes therein, and / or information on the type of stuffed animal other than the stuffed animal 20 that is the subject included in the imaging area, etc.) as imaging area information. The imaging area information storage unit 108 supplies the stored information to a predetermined component in response to a request from another component of the information terminal 10.

[0034] (Information terminal side transmission / reception unit 110) The information terminal side transmitting / receiving unit 110 supplies the stuffed toy 20 with predetermined information from a predetermined component of the information terminal 10. The information terminal side transmitting / receiving unit 110 also receives predetermined information from a predetermined component of the stuffed toy 20. Furthermore, the information terminal side transmitting / receiving unit 110 can supply predetermined information from a predetermined component of the information terminal 10 to an external server or the like, and can also receive predetermined information from an external server or the like. The communication format is not particularly limited as long as it is wireless communication. For example, the information terminal side transmitting / receiving unit 110 can use short-range wireless communication such as Bluetooth (registered trademark). The same applies to the stuffed toy side transmitting / receiving unit 202. This allows the information terminal 10 and the stuffed toy 20 to wirelessly communicate with each other.

[0035] (Instruction receiving unit 112) The instruction receiving unit 112 receives various instructions from a user. For example, various instructions include an instruction to capture an image of an imaging area in an imaging preparation state. In response to the received instruction, the instruction receiving unit 112 supplies the instruction to a component of the information terminal 10 that executes the instruction, and the component that receives the instruction executes an operation according to the instruction.

[0036] (Image storage unit 114) The image storage unit 114 stores image information in association with an image ID that identifies an image. The image information includes an image of the imaging area in a shooting preparation state, a captured image captured by the imaging unit 100 in response to an imaging instruction, and / or a compositing image (including an image member used for compositing images) to be composited with the stuffed toy 20 included in the captured image. In this embodiment, the terms "image", "captured image", and "compositing image" include both still images and moving images. In addition, the still images and moving images may include accompanying audio information. The image storage unit 114 supplies the stored image information to a predetermined component member in response to a request from another component member of the information terminal 10.

[0037] (Plush toy information storage unit 124) The stuffed toy information storage unit 124 stores stuffed toy information, which is information about a stuffed toy, in association with a stuffed toy ID that identifies the stuffed toy. The stuffed toy information is information about the type, name, sex, attributes, personality, etc. of the stuffed toy. The stuffed toy information storage unit 124 can store stuffed toy information about stuffed toy 20 owned by the user and / or stuffed toy information about stuffed toy not owned by the user. The stuffed toy information storage unit 124 supplies predetermined information to predetermined components in response to requests from other components of the information terminal 10.

[0038] (Plushie Information Update Section 126) The stuffed toy information update unit 126 updates the stuffed toy information stored in the stuffed toy information storage unit 124. For example, when the instruction receiving unit 112 receives a predetermined instruction from the user, the stuffed toy information update unit 126 can update the stuffed toy information.

[0039] (Friend information storage unit 128) The friend information storage unit 128 stores friend-related information, which is a friend stuffed animal ID that identifies another stuffed animal (second stuffed animal) as a friend of the stuffed animal (first stuffed animal) identified by the stuffed animal ID in association with the stuffed animal ID, and information indicating the relationship between the first stuffed animal and the second stuffed animal (for example, information indicating the number of times that they have appeared together in the same captured image, and information on the degree of intimacy calculated based on the information indicating the number of times, etc.). The friend information storage unit 128 supplies the friend-related information to a predetermined component in response to an action from another component of the information terminal 10.

[0040] (Image processing control unit 116, image processing unit 118) The image processing control unit 116 controls the operation of the image processing unit 118. The image processing control unit 116 judges whether or not to composite a predetermined image at the display position of the stuffed animal 20 displayed on the display unit 130 based on the imaging area information and / or information such as the remaining battery level of the stuffed animal 20. Then, when the image processing control unit 116 judges that the images are to be composited, it causes the image processing unit 118 to execute the composite of the images. Note that the image processing unit 118 can also execute processes such as image conversion and deformation of the captured image and extraction of information such as feature amounts from the captured image in addition to the composite process of the images.

[0041] The image processing unit 118 is controlled by the image processing control unit 116 to generate a composite image by compositing a predetermined image at the display position of the display unit 130 of the stuffed toy 20 included in the imaging area. Then, the image processing unit 118 causes the composite image to be displayed on the display unit 130. The image processing unit 118 can also store the composite image in the image storage unit 114 in association with a composite image ID that identifies the composite image. The image processing unit 118 can generate a composite image by using an image for compositing stored in the image storage unit 114.

[0042] (Additional information generating unit 120) The additional information generating unit 120 generates additional information corresponding to the captured image captured by the imaging unit 100, i.e., additional information indicating what action the object and / or stuffed toy 20 included in the captured image is taking or what state it is in, based on the imaging area information. The additional information generating unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquiring unit 104, the imaging area information stored in the imaging area information storage unit 108, and / or the imaging area information stored in the image storage unit 114 at the time the captured image was captured. The additional information is text information, graphic information, etc. indicating what action or movement the object and / or stuffed toy 20 included in the imaging area is taking or what state it is in. For example, the additional information is text information such as lines, explanations, etc. generated based on the relationship between the object and stuffed toy 20 included in the imaging area, the combination of the object and stuffed toy 20, etc.

[0043] The additional information generating unit 120 may have, for example, a text information storage unit that stores text information such as explanatory text or lines predetermined for each type of object or stuffed animal in association with the imaging area information, and / or a text information acquiring unit that acquires text information from an external server. Based on the imaging area information, the additional information generating unit 120 may acquire text information corresponding to the type and action of the object included in the imaging area, the type of stuffed animal 20, and / or the type of the stuffed animal other than the stuffed animal 20 included in the imaging area from the text information storage unit or from an external server, and may use the acquired text information, or may use processed text information obtained by processing the acquired text information based on the imaging area information to generate additional information.

[0044] The additional information generating unit 120 may generate the additional information by using a Conditional Variational Auto-encoder (CVAE). Furthermore, the additional information generating unit 120 may generate text information as the additional information by using neural image annotating, which is a combination of a Convolutional Neural Network (CNN) that performs image recognition and a recurrent neural network.

[0045] The additional information may be information indicating the position of the imaging area included in the imaging area information, that is, text information suitable for the area or place where the image was captured. Furthermore, the additional information may be text information suitable for objects (people, other stuffed animals that can communicate with the information terminal 10, stuffed animals that cannot communicate with the information terminal 10, products, etc.) and backgrounds (scenery of tourist spots and scenic spots, movie screens, etc.) that appear together with the stuffed animal 20. For example, if the imaging area information includes information indicating the position where the image was captured, the additional information may be text information indicating that the user has arrived at the position (e.g., text information such as "I came to XX!" (where XX is the name of a place or a landmark)), and if the imaging area information includes information indicating the name of a specific product in the imaging area, the additional information may be text information related to the product (e.g., text information such as "I got XX!" (where XX is the product name)).

[0046] The additional information may be text information according to the weather, temperature, and / or humidity of the imaging area. The additional information may be text information (first text information) according to the number of times the stuffed animal 20 included in the imaging area has visited the imaging area, the number of times it has been captured in the imaging area together with other objects, and / or the number of times it has been captured together with other stuffed animals. For example, as the number of times the stuffed animal 20 has visited a certain location in an imaging area increases, the additional information generating unit 120 may generate text information with a special expression assuming that the recognition of the location by the stuffed animal 20 has improved (i.e., the stuffed animal 20 is perceived as personified). As the number of times other stuffed animals are captured together with the stuffed animal 20 increases, the additional information generating unit 120 may generate text information with a special expression (second text information) assuming that the friendliness of the stuffed animal 20 with the other stuffed animals has improved. The additional information generating unit 120 can generate the first text information and the second text information based on the past imaging area information stored in the imaging area information storage unit 108 and / or the past captured images stored in the image storage unit 114.

[0047] Furthermore, when the imaging area information indicates that the imaging area includes multiple stuffed toys, the additional information generating unit 120 can generate text information according to the combination of stuffed toys. In this case, the imaging area information acquiring unit 104 identifies the types of multiple stuffed toys included in the imaging area based on the image analysis result of the image analyzing unit 106 and the stuffed toy information stored in the stuffed toy information storage unit 124, and identifies the combination of stuffed toys. Then, the additional information generating unit 120 generates text information based on the identified combination of stuffed toys. Furthermore, when the imaging area includes a stuffed toy 20, while the imaging area information includes information indicating that there is another stuffed toy in the vicinity of the information terminal 10 but not included in the imaging area, the additional information generating unit 120 can also generate special text information (for example, text information such as "I want to be photographed with this other stuffed toy next time").

[0048] Furthermore, the stuffed animal 20 and the other stuffed animals may be associated with unique characteristics (such as gender and personality) (the unique characteristics are stored as stuffed animal information in the stuffed animal information storage unit 124). The additional information generating unit 120 may obtain information indicating the unique characteristics of the stuffed animal 20 contained in the imaging area information from the stuffed animal information storage unit 124 and generate text information based on the obtained information. For example, the additional information generating unit 120 generates text information in which the ending of the generated text is changed when the personality of the stuffed animal 20 is "quiet" or "mischievous". In addition, when multiple stuffed animals are included in the imaging area and / or when stuffed animals are included in the imaging area and in the vicinity of the information terminal 10, the additional information generating unit 120 may generate text information according to the intimacy between the stuffed animals. The intimacy between the stuffed animals is stored, for example, as friend-related information in the friend information storage unit 128.

[0049] The additional information generating unit 120 can also generate a plurality of pieces of text information based on information indicating the unique characteristics of the stuffed animal 20 included in the imaging area. When the instruction receiving unit 112 receives a selection instruction from the user, the additional information generating unit 120 determines the text information selected by the user as the additional information. In this case, the additional information generating unit 120 may cause the stuffed animal information updating unit 126 to update the stuffed animal information stored in the stuffed animal information storage unit 124 so that the characteristics corresponding to the text information selected by the user are associated with the stuffed animal 20 as new characteristics. For example, the additional information generating unit 120 generates one or more pieces of text information corresponding to other characteristics in addition to the text information corresponding to the unique characteristics of the stuffed animal 20 included in the imaging area. When the text information selected by the user from the plurality of pieces of text information is text information corresponding to other characteristics different from the text information corresponding to the characteristic, the additional information generating unit 120 causes the stuffed animal information updating unit 126 to update the characteristics of the stuffed animal included in the stuffed animal information stored in the stuffed animal information storage unit 124 to the other characteristics. This allows the characteristics of the stuffed animal 20 to be changed to the characteristics preferred by the user.

[0050] (Supply section 122) The supply unit 122 supplies the captured image and the additional information corresponding to the captured image to a predetermined server (for example, a server of a social network service (SNS)). When the instruction receiving unit 112 receives an instruction to post to the SNS from a user, the supply unit 122 supplies the captured image captured by the imaging unit 100 and the additional information to the predetermined server. As a result, the captured image in which the stuffed animal 20 is the main character is uploaded to the predetermined server together with the additional information.

[0051] [Details of the configuration of the photography system 5: Configuration of the stuffed toy 20] (Component 200) The stuffed toy 20 is configured with at least one component 200. As an example, as shown in FIG. 4, the stuffed toy 20 is configured with a head component 200a, a body component 200b connected to the head, ear components 200c and 200d provided on the head, arm components 200e and 200f provided on the body, and leg components 200g and 200h provided near the side of the body opposite to the side connected to the head. Each component of the stuffed toy 20 may have one or more drive units inside. For example, a plurality of drive units and connecting members connecting each drive unit may be provided at predetermined intervals along the longitudinal direction of the component members corresponding to the arms and ears of the stuffed toy 20 configured with a predetermined length, so that the arms and ears can be bent. The shape of the stuffed toy 20 and the components constituting the stuffed toy 20 are not limited to the example of FIG. 4. The shape of the stuffed toy 20 can be various animal shapes, various character shapes, etc. The shape and number of components constituting the stuffed toy 20 can also be determined appropriately depending on the overall shape and / or function of the stuffed toy 20. However, the stuffed toy 20 is configured without having an imaging unit such as a camera.

[0052] A component and another component adjacent to the component can be connected via a drive unit. For example, in the example of FIG. 4, the component 200a and the component 200b are connected via the drive unit 208a, and the head component 200a is configured to move relative to the body component 200b. Also, the component 200b and the right arm component 200e are connected via the drive unit 208b, the component 200b and the left arm component 200f are connected via the drive unit 208c, the component 200a and the right ear component 200c are connected via the drive unit 208d, the component 200a and the left ear component 200d are connected via the drive unit 208e, the component 200b and the right leg component 200g are connected via the drive unit 208i, and the component 200b and the left leg component 200h are connected via the drive unit 208j. The limbs and ears of stuffed animal 20 are also configured to move in the same manner as the head relative to the torso.

[0053] Moreover, a driving unit 208f is connected to one eye of the stuffed animal 20, and a driving unit 208g is connected to the other eye. The driving units 208f and / or 208g are configured to open and close the eyes and blink. Furthermore, the driving unit 208h provided in the mouth of the stuffed animal 20 is configured to change the shape of the mouth.

[0054] (Plush toy side transceiver 202) The stuffed toy side transmitting / receiving unit 202 receives predetermined information such as imaging area information from the information terminal 10, and supplies the received predetermined information to predetermined components of the stuffed toy 20. The stuffed toy side transmitting / receiving unit 202 also supplies predetermined information from predetermined components of the stuffed toy 20, such as information on the remaining battery level, to predetermined components of the information terminal 10.

[0055] (Operation information storage unit 204) The operation information storage unit 204 stores the remaining amount information of the battery 220, the imaging area information, and / or the operation information. The operation information storage unit 204 may store these pieces of information in association with a stuffed toy ID for identifying the stuffed toy 20. The operation information is information that specifies the operation of one or more components of the stuffed toy 20, such as the driving unit 208 and / or the speaker 214, and is information such as scenario information and audio information of the operation. The operation information storage unit 204 supplies predetermined operation information to the driving control unit 206 in response to an action of the driving control unit 206. Note that the information terminal 10 may have the operation information storage unit 204. In this case, the information terminal 10 supplies the operation information to the driving control unit 206. Alternatively, the information terminal 10 may have an operation information generation unit that generates operation information based on the imaging area information. The operation information generation unit supplies the generated operation information to the operation information storage unit 204 (in this case, the operation information storage unit 204 is included in the information terminal 10 or the stuffed toy 20).

[0056] (Drive control unit 206, drive unit 208) The driving unit 208 operates the components. The driving unit 208 is composed of, for example, an RC servo motor, a DC motor, and / or a potentiometer. The driving control unit 206 controls the operation of the driving unit 208 based on the imaging area information. For example, the driving control unit 206 operates the driving unit 208 using the operation information stored in the operation information storage unit 204 in association with the imaging area information received from the information terminal 10. The driving control unit 206 may make a predetermined change to the operation information according to the position of the imaging area included in the imaging area information, objects and other stuffed animals included in the imaging area together with the stuffed animal 20, the background of the imaging area, the weather and humidity at the time of imaging the imaging area, the relationship (for example, intimacy level) between the stuffed animal 20 and the other stuffed animals captured in the imaging area together with the stuffed animal 20, and the like.

[0057] (Sensor 210, microphone 212, speaker 214) The sensor 210 detects the touch of the user to the stuffed toy 20, the movement of the stuffed toy 20, and the like. For example, the sensor 210 is an acceleration sensor, a capacitance touch sensor, and the like. The microphone 212 acquires sounds around the stuffed toy 20. Furthermore, the speaker 214 outputs various sounds from the stuffed toy 20. For example, the drive control unit 206 may control the operation of the drive unit 208 based on information indicating the touch of the user to the stuffed toy 20 detected by the sensor 210, and / or information such as sound detected by the microphone 212. In this case, the operation information storage unit 204 may store the operation information in association with the information indicating the touch and the information such as sound, and the drive control unit 206 may operate the drive unit 208 based on the operation information corresponding to the information indicating the touch and the information of sound.

[0058] (Battery 220, battery remaining amount confirmation unit 222, charge / discharge control unit 224) The battery 220 supplies at least power to the drive unit 208 to operate the drive unit 208. The battery 220 supplies power to components that require power among the components that make up the stuffed animal 20. The battery remaining amount confirmation unit 222 monitors the battery 220 and confirms the remaining amount of the battery 220. The battery remaining amount confirmation unit 222 supplies information indicating the remaining amount of the battery to the information terminal 10 and / or the drive control unit 206. The charge / discharge control unit 224 controls the charging and discharging of the battery 220.

[0059] When the drive control unit 206 receives information about the remaining battery level from the battery level confirmation unit 222, it controls the operation of the drive unit 208 based on the remaining battery level. For example, when the remaining battery level is equal to or less than a predetermined value and exceeds a predetermined threshold, the drive control unit 206 controls the drive unit 208 so that the stuffed animal 20 behaves as if it is sleepy or hungry. For example, the drive control unit 206 can operate the drive units of the eyes of the stuffed animal 20 to realize a state in which the eyes of the stuffed animal 20 are closed, or operate the drive units of the ears to perform an action in which the ears gradually lower according to the remaining battery level.

[0060] In addition, the drive control unit 206 receives information on the remaining battery level from the battery remaining level confirmation unit 222, and when the remaining battery level is equal to or lower than a predetermined threshold level, sets the drive unit 208 to a predetermined state and stops the drive unit 208 in that state. That is, when the remaining battery level is not sufficient to operate the drive unit 208, the posture and expression of the stuffed animal 20 may not be suitable for a stuffed animal photography. Therefore, when the remaining battery level is equal to or lower than a predetermined threshold level, the drive control unit 206 controls the operation of the drive unit 208, and stops the operation of the stuffed animal 20 (i.e., the operation of the drive unit 208) after changing the posture and expression of the stuffed animal 20 to a posture and expression suitable for a stuffed animal photography so that a captured image that is not inappropriate for a stuffed animal photography can be captured. As a result, even if the remaining battery level is too low to operate the drive unit 208, the posture and expression of the stuffed animal 20 suitable for a stuffed animal photography can be maintained. Note that when the battery 220 is recharged and the remaining battery level exceeds a predetermined threshold level or a predetermined value, the drive control unit 206 can resume the operation of the drive unit 208.

[0061] [Processing flow of the imaging system 5] FIG. 6 shows an example of a processing flow in the imaging system according to this embodiment.

[0062] First, in a state where the stuffed toy 20 is in the imaging area of ​​the imaging unit 100, the imaging control unit 102 puts the imaging unit 100 into a shooting preparation state automatically or in response to an instruction from the user received by the instruction receiving unit 112 (step 10. Hereinafter, step is represented as "S"). Then, the imaging area information acquisition unit 104 acquires imaging area information of the imaging area based on an image being captured by the imaging unit 100 or a captured image (S12). The imaging area information acquisition unit 104 acquires, as imaging area information, information such as the presence or absence of an object in the imaging area, the type of the object (e.g., type indicating whether it is a person or an object) if an object is included (type indicating whether it is a person or an object), the action or state of the object, the background of the imaging area, the location of the imaging area, the date and time when the shooting preparation state started, and / or the temperature or weather of the imaging area by utilizing a GPS function, a clock function, etc., image recognition of the imaging area, and / or image analysis.

[0063] Then, the information terminal side transmitting / receiving unit 110 transmits the imaging area information acquired by the imaging area information acquiring unit 104 to the stuffed toy side transmitting / receiving unit 202 (S14). Note that the information terminal side transmitting / receiving unit 110 may transmit past imaging area information. When the stuffed toy side transmitting / receiving unit 202 receives the imaging area information, it supplies the imaging area information to the driving control unit 206 and causes the battery remaining amount checking unit 222 to check the remaining amount of the battery 220. Then, the battery remaining amount checking unit 222 checks the remaining amount of the battery 220 (S16). When the battery remaining amount checking unit 222 checks that the remaining amount of the battery 220 exceeds a predetermined value ("exceeds predetermined value" in S16), the driving control unit 206 controls the operation of a predetermined driving unit 208 based on the imaging area information (S18). Specifically, the driving control unit 206 acquires the operation information stored in the operation information storage unit 204 in association with the imaging area information, and operates the driving unit 208 based on the acquired operation information.

[0064] For example, the motion information storage unit 204 can store motion information indicating that the imaging area includes a person and that the person has performed a predetermined motion, in association with the imaging area information indicating that the person is to make the stuffed animal 20 follow the predetermined motion. As an example, when the received imaging area information includes information indicating that a person is included in the imaging area together with the stuffed animal 20 and that the person is performing the motion of raising his / her right hand, the drive control unit 206 operates the drive unit 208 connecting the body and right hand of the stuffed animal 20 based on the motion information stored in the motion information storage unit 204 in association with the imaging area information, and causes the stuffed animal 20 to perform the motion of raising its right hand.

[0065] The information terminal 10 may have the operation information storage unit 204 or may have an operation information generation unit that generates operation information based on imaging area information, in which case operation information is supplied from the information terminal 10 to the drive control unit 206 of the stuffed animal 20, and the drive control unit 206 can operate the drive unit 208 according to the received operation information. However, in this embodiment, an example will be described in which the stuffed animal 20 has the operation information storage unit 204.

[0066] Also, when the battery remaining amount confirmation unit 222 confirms that the battery remaining amount exceeds a predetermined threshold and is equal to or less than the predetermined value ("exceeds the threshold and is equal to or less than the predetermined value" in S16), the drive control unit 206 causes the drive unit 208 to execute a predetermined operation (S20). That is, the drive control unit 206 causes the stuffed animal 20 to execute an operation that allows the user to know that the battery remaining amount is decreasing. For example, when the battery remaining amount exceeds a predetermined threshold, the battery remaining amount confirmation unit 222 divides the range from the threshold to the predetermined value into a plurality of zones (predetermined value>threshold value) and confirms which zone the battery remaining amount belongs to. Then, the drive control unit 206 causes a predetermined drive unit 208 to execute a predetermined operation every time the battery remaining amount decreases and moves from a zone where the battery remaining amount is high to a zone where the battery remaining amount is low. As an example, the drive control unit 206 operates the drive unit 208d and drive unit 208e of the component member 200c and component member 200d of the ear connected to the head of the stuffed animal 20, and causes the ear to lower every time the battery remaining amount moves from a zone where the battery remaining amount is high to a zone where the battery remaining amount is low. The drive control unit 206 may also operate the drive units 208f and 208g for the eyes of the stuffed animal 20 to gradually close the eyes each time the battery level changes from a high to a low zone. In this case, the drive control unit 206 may operate the drive unit 208a provided between the head and the body, for example, to make the stuffed animal 20 perform a motion as if it were sleeping (for example, a motion like rowing a boat).

[0067] Furthermore, the drive control unit 206 may change the operating speed of the drive unit 208 depending on the remaining battery power. For example, the drive control unit 206 may increase the operating speed of the drive unit 208 as the remaining battery power increases (proportional to the remaining battery power). Alternatively, the drive control unit 206 may increase the operating speed of the drive unit 208 as the remaining battery power decreases (inversely proportional to the remaining battery power). This allows the behavior of the stuffed animal 20 to be changed depending on the remaining battery power.

[0068] Furthermore, when the battery remaining amount confirmation unit 222 confirms that the battery remaining amount is equal to or less than a predetermined threshold amount ("below threshold amount" in S16), the drive control unit 206 stops the operation of the drive unit 208 after putting the drive unit 208 in a specific state (S22). That is, the drive control unit 206 stops the operation of the drive unit 208 after putting the posture and expression of the stuffed animal 20 into a predetermined posture and expression before the battery remaining amount becomes insufficient to operate the drive unit 208, thereby maintaining this posture and expression. If the remaining amount of the battery is equal to or less than a predetermined threshold amount even if there is remaining battery amount, the drive control unit 206 stops the operation of the drive unit 208 until the battery remaining amount is restored by charging. This makes it possible to make the stuffed animal 20 assume a posture and show an expression that it would only do when the battery is dead. That is, by executing the above process when the remaining battery charge is insufficient for the operation of the driving unit 208, the posture and expression of the stuffed animal 20 that the user finds cute can be maintained even when taking a picture of the stuffed animal (that is, the operation of the driving unit can be stopped before the remaining battery charge reaches a level at which the driving unit cannot be driven, so that the operation of the stuffed animal 20 does not stop with a posture or expression that is unsuitable for imaging). Note that the above threshold value of the remaining battery charge is determined from the viewpoint of leaving in the battery 220 an amount of power that allows communication between the information terminal 10 and the stuffed animal 20, and from the viewpoint of leaving an amount of power that allows the driving unit 208 to operate in order to put the posture and expression of the stuffed animal 20 into a predetermined posture and expression.

[0069] Next, when the instruction receiving unit 112 receives an image capturing instruction from the user, the image capturing control unit 102 causes the image capturing unit 100 to capture an image (S24). The captured image captured by the image capturing unit 100 is supplied to the image storage unit 114 and / or the display unit 130.

[0070] Then, the image processing control unit 116 judges whether or not to apply image processing to the captured image captured by the imaging unit 100 based on the imaging area information and / or the information indicating the remaining battery level (S26). Specifically, the image processing control unit 116 refers to the imaging area information and judges to apply image processing to the image (Yes in S26) in cases where no action information is stored in the action information storage unit 204 in association with the imaging area information, or where the stuffed animal 20 cannot complete an action depending on the action information even if the action information is stored (for example, when the imaging area information includes information indicating the action or posture of a person included in the imaging area, but the stuffed animal 20 cannot follow the action or posture), etc.

[0071] When the image processing control unit 116 judges that the image processing is to be applied to the image, the image processing unit 118 applies the image processing to the captured image captured by the imaging unit 100 (S28). For example, when the imaging area information includes information indicating the posture of a person included in the imaging area and the operation information is a content that commands the driving unit to follow the posture, if the plush toy 20 cannot be made to take the posture due to the structure of the plush toy 20 (for example, when the person sits upright and the plush toy 20 cannot take the posture of sitting upright), the image processing unit 118 synthesizes an image of the plush toy sitting upright at the position where the plush toy 20 is displayed in the captured image captured by the imaging unit 100 (that is, the position of the plush toy 20 displayed on the display unit 130). In this case, the image of the plush toy 20 sitting upright (image for synthesis) is stored in the image storage unit 114, and the image processing unit 118 executes image processing (for example, image synthesis processing) using the image in the image storage unit 114. Then, the captured image to which the image processing has been applied is displayed on the display unit 130. The captured image that has been subjected to image processing can also be stored in the image storage unit 114 .

[0072] Furthermore, the image processing control unit 116 may refer to the imaging area information and determine whether or not to execute image processing depending on the status of the imaging area. The status of the imaging area is, for example, the date, time, location, weather, etc. of the imaging area. As an example, when the location of the imaging area is a predetermined location (for example, a tourist spot, a recreational spot, a scenic spot, etc.), the image processing control unit 116 may decide to execute image processing on a part or all of the captured image.

[0073] FIG. 7 shows an example of image processing by the image processing unit according to this embodiment.

[0074] For example, a case where the stuffed animal 20 is imaged with a five-story pagoda in a historical capital of Japan as a background will be described. In this case, the imaging area information acquisition unit 104 acquires information as imaging area information that the location of the imaging area is a specific location in Japan and that a traditional Japanese building is included in the background. Then, the image processing control unit 116 determines to execute image processing on a part of the captured image based on this information. For example, the image processing control unit 116 causes the image processing unit 118 to synthesize an image suitable for the location of the imaging area at the display position on the display unit 130 of the stuffed animal 20 included in the imaging area. As an example, an image of the stuffed animal 20 wearing a kimono and sitting upright is synthesized. As a result, as shown in FIG. 7, a composite image 22 showing a state in which the stuffed animal 20 is wearing a kimono and sitting upright with a five-story pagoda or the like in the background is displayed on the display unit 130. In this way, the image processing by the image processing unit 118 makes it possible to display on the display unit 130 a composite image in which the posture of the stuffed animal 20 is changed according to the location of the imaging area, or a composite image of the stuffed animal 20 that has been changed.

[0075] The image processor 118 may display the captured image of the stuffed toy 20 at the display position on the display unit 130 of the stuffed toy 20, and may synthesize an image onto a part of the captured image. For example, the captured image may be displayed for the head of the stuffed toy 20, and an image for synthesis may be synthesized onto the other parts excluding the head. In this way, even if the captured area information includes information indicating a posture or movement that the stuffed toy 20 cannot follow (that is, even if the captured area information includes information indicating a posture or movement that cannot be realized even if each driving unit of the stuffed toy 20 is operated), the image for synthesis showing the posture or movement can be synthesized onto the captured image.

[0076] The image processing unit 118 may make predetermined changes to the image to be synthesized depending on the position of the imaging area included in the imaging area information, objects or other stuffed animals included in the imaging area together with the stuffed animal 20, the background of the imaging area, the weather, temperature, and humidity at the time the imaging area is captured, and the relationship (e.g., intimacy) between the stuffed animal 20 and other stuffed animals that appear in the imaging area together with the stuffed animal 20.

[0077] Furthermore, the image processing control unit 116 can refer to the confirmation result of the battery remaining amount confirmation unit 222, and when the remaining battery amount is equal to or less than a predetermined threshold amount, determine that image processing should be performed on the image (Yes in S26). For example, when the remaining battery amount is equal to or less than a predetermined threshold amount, the image processing control unit 116 causes the image processing unit 118 to synthesize an image of the stuffed animal 20 sleeping at the display position of the display unit 130 of the stuffed animal 20 included in the imaging area, an image of the stuffed animal 20 with its eyes rolling at the display position of the eyes of the stuffed animal 20, an image displaying a predetermined figure or symbol around the stuffed animal 20 (for example, an image displaying a figure such as an exclamation mark around the face of the stuffed animal 20), or an image of the stuffed animal 20 hiding behind a predetermined object, or the like.

[0078] In this way, when the information terminal 10 captures an image, it is possible to display a composite image indicating that the battery level of the stuffed toy 20 is low, or to have the stuffed toy 20 perform a predetermined action, thereby making the user aware of the remaining battery level of the stuffed toy 20 when capturing an image. This makes it possible to prevent a situation in which an appropriate image cannot be captured due to the stuffed toy 20 having no remaining battery level when actually capturing an image of an image capturing area including the stuffed toy 20.

[0079] The compositing image used by the image processing unit 118 to composite images may be stored in the image storage unit 114, or may be acquired from an external server. The compositing image may be an image that can be acquired from a predetermined server that stores compositing images specific to a location where the image is captured.

[0080] On the other hand, if the image processing control unit 116 determines not to execute image processing (No in S26), the captured image is displayed on the display unit 130. The captured image can also be stored in the image storage unit 114.

[0081] [Modification of the processing flow of the imaging system 5] Fig. 8 shows an example of a modified processing flow in the imaging system according to this embodiment. Fig. 9 shows an example of creating additional information according to this embodiment. In the example of Fig. 8, substantially the same processing as in the example of Fig. 6 is executed, except that the step of S32 is executed between S24 and S30. Therefore, detailed description will be omitted except for the differences.

[0082] In the example of Fig. 8, additional information is generated for the captured image (S32). That is, first, the stuffed toy 20, objects, background, etc. included in the captured image are specified based on the captured area information (including information showing the result of the captured image analyzed by the image analysis unit 106) acquired by the captured area information acquisition unit 104. Then, the additional information generation unit 120 generates additional information suitable for the captured image based on the identification result.

[0083] As an example, a case where the imaging unit 100 captures an image of an imaging area as shown in Fig. 9 will be described. The image may be either an image captured by the imaging unit 100 in response to an imaging instruction, or an image captured by the imaging unit 100 in a state of preparation for imaging. In this case, the additional information generating unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquiring unit 104 for the image of the imaging area. For example, in Fig. 9, imaging area information is generated indicating that the imaging area includes a stuffed animal 20 and another stuffed animal 24 (a stuffed bird), ice cream is included in front of the stuffed animal 20 and the stuffed animal 24, and the size of the ice cream is larger than the mouths of the stuffed animal 20 and the stuffed animal 24.

[0084] In this case, the additional information generating unit 120 generates text information according to the situation of the imaging area. In the example of FIG. 9, the additional information generating unit 120 generates text information 26 as additional information such as "The ice cream looks delicious!" and "It's too big for us?!". The additional information generating unit 120 may generate audio information, symbol information, or the like according to the situation of the imaging area as additional information. Then, the additional information generating unit 120 associates the generated additional information with the captured image. In this case, the image storage unit 114 may also store the additional information generated by the additional information generating unit 120 in association with the stored captured image.

[0085] Then, the additional information generating unit 120 displays the generated additional information on the display unit 130 together with the captured image (S30). In this case, the instruction receiving unit 112 can receive an instruction from the user to post the captured image and additional information to a predetermined SNS. When the instruction receiving unit 112 receives the instruction, the supplying unit 122 posts the captured image and additional information to a predetermined server (posting process: S34). Note that the instruction receiving unit 112 may display a "post button" at a predetermined position on the display unit 130, and execute the posting process when the user taps the post button. This allows the user to easily and quickly post the captured image to the SNS together with additional information according to the imaging situation when capturing an image including the stuffed toy 20.

[0086] [Effects of the embodiment] The photography system 5 according to the present embodiment can capture images with high added value because it can change the pose and expression of the stuffed toy 20 according to the photography situation. That is, because it is possible to change the pose and expression of the stuffed toy 20 according to the situation around the stuffed toy 20, it is possible to enhance the lovability of the stuffed toy 20 and / or to take a composition in which the stuffed toy 20 that the user or the like feels attached to is the main character.

[0087] Furthermore, when an image is captured, the photography system 5 obtains the imaging area information of the imaging area in the photography preparation state, and operates each driving unit of the stuffed animal 20 based on this imaging area information, thereby obtaining a captured image of the stuffed animal 20 moving according to the situation at the time of capturing the image. This makes it possible to provide a captured image for stuffed animal photography with higher added value than before, and to provide a stuffed animal 20 that is highly lovable. Furthermore, the photography system 5 can cause the stuffed animal 20 to perform a predetermined action and / or stop further action after the predetermined action in response to a change in the remaining battery level of the stuffed animal 20 that is taken with the user when going out, so that an appropriate image can be captured according to the remaining battery level.

[0088] Furthermore, even if the added value of the captured image itself is not high, the photography system 5 can associate additional information with the captured image, so that the added value of the captured image and the additional information can be improved when the captured image is shared on a social networking site, for example. Furthermore, since the additional information can be linked to the captured image, both pieces of information can be uploaded to the social networking site easily and conveniently.

[0089] [Other embodiments] Fig. 10 shows an example of a process flow of an imaging system according to another embodiment. Note that steps S40, S42, S44, and S46 in Fig. 10 are substantially the same as steps S10, S12, S24, and S32 in Fig. 6, respectively, and therefore detailed explanations will be omitted except for the differences.

[0090] First, in a state where the stuffed toy 20 is placed in the imaging area of ​​the imaging unit 100, the imaging control unit 102 sets the imaging unit 100 to a shooting preparation state (S40). Then, the imaging area information acquisition unit 104 acquires imaging area information of the imaging area (S42). Next, when the instruction reception unit 112 receives an imaging instruction from the user, the imaging control unit 102 causes the imaging unit 100 to perform imaging (S44). Furthermore, the additional information generation unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquisition unit 104 (S46). The additional information generation unit 120 stores the captured image and the additional information corresponding to the captured image in the image storage unit 114. Next, when the instruction reception unit 112 receives an instruction from the user to post the captured image and the additional information to a predetermined server, the supply unit 122 transmits the captured image and the additional information corresponding to the captured image to the predetermined server (S48). The predetermined server is, for example, a server of an SNS, and the captured image and the additional information are posted to the SNS by the supply unit 122 transmitting the captured image and the additional information to the server. After the step of S46, the display unit 130 can display the additional information together with the captured image.

[0091] [Filming program] Each of the components of the imaging system 5 according to this embodiment shown in Fig. 1 to Fig. 10 can be realized by executing a program (i.e., an imaging program) in a processor such as a central processing unit (CPU), that is, by software processing. Also, each of the components can be realized by writing a program in advance into hardware as an electronic component such as an integrated circuit (IC). Note that software and hardware can also be used in combination.

[0092] The imaging program according to the present embodiment can be incorporated in advance in, for example, an IC or a ROM. The imaging program can also be provided as a computer program by recording it in an installable or executable file format on a computer-readable recording medium such as a magnetic recording medium, an optical recording medium, or a semiconductor recording medium. The recording medium storing the program may be a non-transient recording medium such as a CD-ROM or a DVD. Furthermore, the imaging program can be stored in advance in a computer connected to a communication network such as the Internet, and provided by downloading it via the communication network.

[0093] The shooting program in this embodiment acts on the CPU and the like to cause the shooting program to function as the imaging unit 100, imaging control unit 102, imaging area information acquisition unit 104, image analysis unit 106, imaging area information storage unit 108, information terminal side transmitting / receiving unit 110, instruction reception unit 112, image storage unit 114, image processing control unit 116, image processing unit 118, additional information generation unit 120, supply unit 122, stuffed toy information storage unit 124, stuffed toy information update unit 126, friend information storage unit 128, display unit 130, stuffed toy side transmitting / receiving unit 202, operation information storage unit 204, drive control unit 206, battery remaining capacity confirmation unit 222, and charge / discharge control unit 224, which are described in Figures 1 to 10.

[0094] Although the embodiments of the present invention have been described above, the above-described embodiments do not limit the invention according to the claims. It should be noted that not all of the combinations of features described in the embodiments are essential to the means for solving the problems of the invention. Furthermore, the technical elements of the above-described embodiments may be applied alone, or may be divided into multiple parts such as program parts and hardware parts and applied.

[0095] The imaging system according to this embodiment may also be referred to in the following appended claims, which should not be confused with the claims. (Additional note 1) A photography system including an information terminal and a stuffed toy that can operate based on predetermined information supplied from the information terminal, The information terminal, An imaging unit that captures an imaging area including the stuffed toy; an imaging area information acquisition unit that acquires imaging area information that is information about the imaging area; an additional information generating unit that generates additional information corresponding to the captured image captured by the imaging unit based on the imaging area information; An imaging system having the above configuration. [Explanation of symbols]

[0096] 1 Object 5. Shooting System 10 Information terminals 20, 24 Plush toys 22 Composite Image 26 Text information 100 Imaging unit 102 Imaging control unit 104 Imaging area information acquisition unit 106 Image Analysis Unit 108 Imaging area information storage unit 110 Information terminal side transmission / reception unit 112 Instruction Reception Department 114 Image Storage Unit 116 Image processing control unit 118 Image Processing Unit 120 Additional information generation unit 122 Supply section 124 Plush Toy Information Storage Unit 126 Plush Toy Information Update Department 128 Friend information storage section 130 Display section 200 Components 200a, 200b, 200c, 200d, 200e, 200f, 200g, 200h components 202 Plush toy side transmitter / receiver 204 Operation information storage section 206 Drive control unit 208 Drive unit 208a, 208b, 208c, 208d, 208e, 208f, 208g, 208h, 208i, 208j Drive unit 210 Sensors 212 Mike 214 Speakers 220 Battery 222 Battery level check section 224 Charge / discharge control unit

Claims

1. A photography system including an information terminal and a stuffed toy that can operate based on predetermined information supplied from the information terminal, The information terminal, An imaging unit that captures an imaging area including the stuffed toy; an imaging area information acquisition unit that acquires imaging area information that is information about the imaging area; having The stuffed toy is At least one component; A drive unit for operating the component members; a drive control unit that controls an operation of the drive unit based on the imaging area information; An imaging system having the above configuration.

2. The photographing system according to claim 1 , wherein the imaging area information acquisition unit acquires the imaging area information in a photographing preparation state in which the imaging unit waits for an imaging instruction.

3. The information terminal, A display unit that displays the imaging area; an image processing unit that synthesizes a predetermined image at a display position of the display unit of the stuffed toy included in the imaging area; The imaging system according to claim 1 or 2, further comprising:

4. The stuffed toy is A battery for operating at least the drive unit Further comprising:

4. The photographing system according to claim 1, wherein the drive control unit controls the operation of the drive unit based on a remaining battery charge of the battery.

5. The stuffed toy is A battery for operating at least the drive unit Further comprising: The photographing system according to any one of claims 1 to 3, wherein when the remaining battery charge of the battery falls below a predetermined standard, the drive control unit sets the drive unit to a predetermined state and stops the drive unit in that state.

6. The information terminal, 6. The photographing system according to claim 1, further comprising an additional information generating section that generates additional information corresponding to the image captured by the imaging section based on the imaging area information.

7. The information terminal, a supply section that supplies the captured image and the additional information corresponding to the captured image to a predetermined server; The imaging system according to claim 6 , further comprising:

8. A method for photographing an image including an information terminal and a stuffed toy that can be operated based on predetermined information supplied from the information terminal, comprising: An imaging area information acquisition step of acquiring imaging area information which is information regarding an imaging area including the stuffed toy; a drive control step of controlling the operation of a drive unit that drives at least one component member that configures the stuffed toy based on the imaging area information; A photographing method comprising:

9. A photography program for a photography system that takes an image including an information terminal and a stuffed toy that can operate based on predetermined information supplied from the information terminal, On the computer, An imaging area information acquisition function for acquiring imaging area information which is information regarding an imaging area including the stuffed toy; a drive control function for controlling the operation of a drive unit that drives at least one component member that configures the stuffed toy based on the imaging area information; A photography program that makes this possible.

10. A stuffed toy that can operate based on predetermined information provided from an information terminal, At least one component; A drive unit for operating the component members; a drive control unit that controls the operation of the drive unit based on imaging area information that is information about an imaging area of ​​the information terminal that includes the stuffed toy; A stuffed animal equipped with

Images