Information processing device, method and program, and information processing system

Abstract

To provide an information processing apparatus, method and program, and an information processing system that can perform imaging complying with content of an instruction.SOLUTION: An information processing apparatus 10 acquires an input of first information related to information about equipment used for imaging from a first terminal apparatus T1 of an imaging person P1, acquires an input of second information related to information about content of an instruction with respect to imaging from a second terminal apparatus T2 of a requesting person P2, derives settings of the equipment required for performing imaging complying with the instruction and an operation method of the equipment required for the settings based on the first information and on the second information, and outputs third information related to information about the operation method to the first terminal apparatus T1 of the imaging person P1.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing apparatus, method, program, and information processing system, and particularly relates to an information processing apparatus, method, program, and information processing system for processing information related to operation of equipment used for photographing. [Background Art]

[0002] Patent Document 1 describes a technique for searching for photographing collaborators using social media in relation to a photographing request.

[0003] Patent Document 2 describes a system that transmits images captured by a video camera to a client via a network.

[0004] Patent Document 3 describes a technique in which, between two cameras with different operation methods, a photographing operation performed on one camera is converted into an operation method for the other camera and displayed on a display unit of the other camera.

[0005] Patent Document 4 describes a technique for performing hierarchical guidance display to set desired photographing control settings. [Prior Art Documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2014-10825 [Patent Document 2] Japanese Unexamined Patent Application Publication No. 2006-14119 [Patent Document 3] Japanese Unexamined Patent Application Publication No. 2008-258744 [Patent Document 4] Japanese Unexamined Patent Application Publication No. 2007-201693 [Summary of the Invention]

[0007] One embodiment of the technology relating to the present disclosure provides an information processing device, method, and program, as well as an information processing system, that can perform photography in accordance with the content of instructions. [Means for solving the problem]

[0008] (1) An information processing device comprising a processor, wherein the processor receives input of first information relating to the equipment used for shooting, receives input of second information relating to the content of instructions for shooting, derives the settings of the equipment necessary to perform shooting in accordance with the instructions and the operating method of the equipment necessary for the settings based on the first and second information, and outputs third information relating to the operating method.

[0009] (2) The processor is the information processing device of (1) that outputs the second information.

[0010] (3) The second information consists of text information, and the processor extracts topics related to photography from the text information and derives settings corresponding to the topics, as described in (1) or (2).

[0011] (4) The information processing device (3) which, by referring to a first database that records information about the settings, derives the settings corresponding to the topic.

[0012] (5) The information processing device (4) is a processor that derives a setting corresponding to a topic by referring to a first database which records information relating topics and settings.

[0013] (6) An information processing device, any one of (1) to (5), which is a processor that retrieves information about the equipment manual from a second database that records information about the equipment manual, and derives an operating method based on the information about the manual.

[0014] (7) The information processing device of (6), wherein the first information includes information about the equipment manual, and the processor takes input of the first information and records the information about the equipment manual contained in the first information in the second database.

[0015] (8) The processor is an information processing device (6) or (7) that extracts the section from the equipment manual that describes how to operate the equipment necessary for setting up the equipment.

[0016] (9) The processor is an information processing device, one of (1) to (8), which receives input of first information from a first terminal, receives input of second information from a second terminal, and outputs third information and second information to the first terminal.

[0017] (10) The processor is the information processing device (9) that receives images taken in chronological order by the equipment and transmits them to the second terminal.

[0018] (11) An information processing device, any one of (1) to (10), which receives information about the equipment settings when an image was taken, and derives the equipment settings necessary to take a picture in accordance with the instructions and the method of operating the equipment necessary for the settings based on the first information, the second information and the information about the equipment settings when the image was taken.

[0019] (12) An information processing system comprising a first terminal owned by a first user who undertakes the photography, a second terminal owned by a second user who requests the photography, and one information processing device from (1) to (11), wherein the information processing device acquires input of first information from the first terminal, acquires input of second information from the second terminal, and outputs third information to the first terminal.

[0020] (13) An information processing method that obtains input of first information concerning the equipment to be used for shooting, obtains input of second information concerning the content of instructions for shooting, derives the settings of the equipment necessary to perform shooting in accordance with the instructions and the operation method of the equipment necessary for setting up the equipment based on the first and second information, and outputs third information concerning the operation method.

[0021] (14) An information processing program that causes a computer to implement: a function of acquiring an input of first information relating to information on equipment used for photographing; a function of acquiring an input of second information relating to information on the content of instructions for photographing; a function of deriving equipment settings necessary for performing photographing in accordance with the instructions and operation methods of the equipment necessary for the settings based on the first information and the second information; and a function of outputting third information relating to information on the operation methods. Brief Description of the Drawings

[0022] [Figure 1] A diagram illustrating an example configuration of an information processing system [Figure 2] A block diagram illustrating an example hardware configuration of a first terminal device [Figure 3] A block diagram illustrating an example hardware configuration of a second terminal device [Figure 4] A block diagram illustrating an example hardware configuration of a data storage server [Figure 5] A block diagram of main functions provided by an information processing device [Figure 6] A block diagram of main functions included in an instruction information analysis unit [Figure 7] A diagram illustrating an example of an equipment setting database [Figure 8] A diagram illustrating an example of a manual database [Figure 9] A diagram illustrating an example of display of operation information, instruction information, and setting information on a display [Figure 10] A sequence diagram of processing performed in the information processing system [Figure 11] A diagram illustrating a second embodiment of the information processing system [Figure 12] A block diagram of main functions provided by an information processing device [Figure 13] A diagram illustrating an example of display on a display of a second terminal device [Figure 14] A block diagram of main functions provided by an information processing device [Figure 15] A main block diagram of functions included in an instruction information analysis unit [Modes for carrying out the invention]

[0023] Preferred embodiments of the present invention will be described in detail below with reference to the attached drawings.

[0024] [First Embodiment] Matching services are known as services that act as intermediaries, connecting those who have a need with those who can supply it. In the field of photography, matching services are known to connect those who want to request photography with those who can do so. By using a matching service, it becomes possible to easily find someone who can handle the job and request photography, even for shoots held in remote locations.

[0025] However, matching services for photography services have a challenge in that it is difficult to specify the equipment to be used. As a result, it is difficult for photographers to understand how the client's shooting instructions correspond to the operations on their equipment, making it difficult to give detailed shooting instructions.

[0026] This embodiment describes an information processing system that enables photography that reflects the client's wishes when requesting photography from others using a matching service or the like.

[0027] [Information Processing Systems] The information processing system of this embodiment is configured to receive instructions for photography from a client, derive the operation method of the equipment necessary to perform photography according to those instructions, and present it to the photographer.

[0028] [System Configuration] Figure 1 shows an example of the configuration of an information processing system.

[0029] As shown in Figure 1, the information processing system 1 has a configuration comprising a first terminal device T1 owned by the photographer P1, a second terminal device T2 owned by the client P2, and an information processing device 10 that processes information acquired from the first terminal device T1 and the second terminal device T2. The information processing device 10 and the first terminal device T1 and the second terminal device T2 are connected to each other via a communication network 2. This communication network 2 is constructed using, for example, wireless communication networks such as 5G (5th Generation), 4G (4th Generation), 3G (3rd Generation), WiMAX (Worldwide Interoperability for Microwave Access), LTE (Long Term Evolution), and various base stations 2a, as well as the Internet.

[0030] In the information processing system 1 of this embodiment, photographer P1 corresponds to a first user who undertakes photography, and client P2 corresponds to a second user who requests photography. First terminal device T1 is an example of a first terminal, and second terminal device T2 is an example of a second terminal.

[0031] [First terminal device and second terminal device] The first terminal device T1 and the second terminal device T2 consist of computers equipped with communication functions. Specifically, they consist of mobile computers equipped with communication functions, such as smartphones, tablet devices, notebook PCs, and PDAs (Personal Data Assistance).

[0032] Figure 2 is a block diagram showing an example of the hardware configuration of the first terminal device. This figure shows an example where the first terminal device T1 is composed of a smartphone.

[0033] As shown in Figure 2, the first terminal device T1 includes a CPU 101, ROM 102, RAM 103, flash memory 104 that stores various programs and data including an operating system (OS), a display 105, a touch panel 106 that detects touch operations on the display screen, a GPS receiver 107 that receives GPS (Global Positioning Systems) signals, a camera 108 that electronically captures images, a microphone 109 that inputs audio, a speaker 110 that outputs audio, a communication unit 111 that wirelessly communicates with the nearest base station 2a etc. via antenna 111A, a short-range wireless communication unit 112 that communicates with external devices via antenna 112A, a sensor unit 113 that includes various sensors such as a geomagnetic sensor, a gyrocompass, and an acceleration sensor, and a media drive 114 that reads and writes data to a memory card 115.

[0034] The first terminal device T1 receives predetermined information input from the photographer P1 and transmits the input information to the information processing device 10. It also receives information transmitted from the information processing device 10 and outputs it to the display 105. In addition, it outputs sound from the speaker unit 110 as needed. The first terminal device T1 realizes these functions by having its processor, the CPU 101, execute a predetermined program.

[0035] Figure 3 is a block diagram showing an example of the hardware configuration of the second terminal device. This figure shows an example where the second terminal device T2 is composed of a smartphone.

[0036] figure 3As shown, the second terminal device T2, like the first terminal device T1, includes a CPU 201, ROM 202, RAM 203, flash memory 204, display 205, touch panel 206, GPS receiver 207, camera 208, microphone 209, speaker 210, communication unit 211 that wirelessly communicates with the nearest base station 2a etc. via antenna 211A, short-range wireless communication unit 212 that communicates with external devices via antenna 212A, sensor unit 213, and media drive 214 that reads and writes data to memory card 215.

[0037] The second terminal device T2 receives predetermined information from the client P2 requesting the imaging and transmits the input information to the information processing device 10. It also receives information transmitted from the information processing device 10 and outputs it to the display 205. In addition, it outputs sound from the speaker unit 210 as needed. The second terminal device T2 achieves these functions by having its processor, the CPU 201, execute a predetermined program.

[0038] [Information Processing Device] The information processing device 10 consists of a computer equipped with communication functions.

[0039] Figure 4 is a block diagram showing an example of the hardware configuration of a data storage server.

[0040] As shown in the figure, the information processing device 10 includes a CPU 11, ROM 12, RAM 13, an auxiliary storage device 14 for storing various programs and data including the OS, a display 15, a network I / F 16 (I / F: interface) for data communication using the communication network 2, a keyboard 17, a mouse 18, an optical drive 19, etc. The auxiliary storage device 14 is composed of, for example, flash memory including an SSD (Solid State Drive), an HDD (Hard Disk Drive), etc. The CPU 11 is an example of a processor.

[0041] Figure 5 is a block diagram of the main functions provided by the information processing device.

[0042] As shown in Figure 5, the information processing device 10 has functions such as an equipment information acquisition unit 10A, an instruction information acquisition unit 10B, an instruction information analysis unit 10C, an operation method derivation unit 10D, and an operation information output unit 10E. The functions of each unit are realized by the CPU 11 executing a predetermined program (information processing program).

[0043] The equipment information acquisition unit 10A acquires the input of equipment information (equipment information) for the equipment C to be used for shooting. The equipment information is acquired from the first terminal device T1. The photographer P1 who is contracted to shoot inputs the equipment information into the first terminal device T1 that he owns. When the first terminal device T1 receives the equipment information, it transmits the input equipment information to the information processing device 10. The equipment information acquisition unit 10A receives and acquires the equipment information transmitted from the first terminal device T1.

[0044] Here, the equipment information consists of information that identifies the equipment C used for shooting. Equipment C used for shooting is a camera. Cameras include devices equipped with camera functions. Therefore, so-called camera-equipped smartphones, camera-equipped tablet devices, etc., are also included in equipment C used for shooting. The equipment information consists of, for example, a combination of manufacturer name and model name. The manufacturer name is the name of the company that manufactured the product. The model name is synonymous with product name, model name, model number, etc. For example, if you use a camera of model "X-001" from "ABC Corporation", the equipment information will be "ABC,X-001". "ABC" is the manufacturer name, and "X-001" is the model name.

[0045] The input of equipment information can be configured in a way that allows direct text input of the manufacturer name and model name, or by allowing selection from a list of options. In the case of selecting from a list of options, first, a list of selectable manufacturer names is displayed on the display 105, and the photographer P1 is asked to select one of the displayed manufacturer names. , selectionThe names of models sold by the selected manufacturer are displayed on the display 105, and the photographer P1 is asked to select one of the displayed model names. For text input, the general text input function provided on the first terminal device T1 is used.

[0046] In this embodiment, "equipment information" is an example of first information relating to the equipment C used for shooting.

[0047] The instruction information acquisition unit 10B acquires input information (instruction information) regarding the content of instructions for shooting. The instruction information is acquired from the second terminal device T2. The person requesting the shooting, P2, inputs the instruction information into the second terminal device T2 that they own. When the second terminal device T2 receives the instruction information, it transmits the input instruction information to the information processing device 10. The instruction information acquisition unit 10B receives and acquires the instruction information transmitted from the second terminal device T2.

[0048] The input of instruction information may be configured, for example, by entering the instruction content as text, or by using known speech recognition technology to input it as voice. For text input, the general text input function provided in the second terminal device T2 is used.

[0049] As an example, in this embodiment, the instructions are expressed in natural language. Therefore, the instruction information consists of sentences expressed in natural language, and this sentences are represented as text information. For example, shooting instructions may be input in the form of expressions such as "Please take the picture with a soft feel" or "Please take the picture with a dynamic feel."

[0050] In this embodiment, "instruction information" is an example of second information relating to the content of instructions for taking a photograph.

[0051] The instruction information analysis unit 10C analyzes the instruction information acquired by the instruction information acquisition unit 10B and derives the equipment settings necessary to perform shooting according to the instructions.

[0052] Figure 6 is a block diagram of the main functions of the instruction information analysis unit.

[0053] As shown in the figure, the instruction information analysis unit 10C has functions such as a topic extraction unit 10C1 and an equipment setting derivation unit 10C2.

[0054] The topic extraction unit 10C1 analyzes the instruction information and extracts topics from the text that describes the content of the instructions. The topics extracted are those related to photography. The topic extraction unit 10C1 is composed of, for example, a topic model generated by machine learning (for example, a known topic model such as LDA (Latent Dirichlet Allocation)). The topic extraction unit 10C1 also performs processing such as splitting words from the text (morphological analysis) as needed.

[0055] The topic extraction unit 10C1 extracts the topic "make soft" from, for example, a shooting instruction such as "Please take the picture with a soft feel." Similarly, from a shooting instruction such as "Please take the picture with a dynamic feel," the topic "make dynamic" is extracted.

[0056] The equipment setting derivation unit 10C2 derives equipment (camera) settings corresponding to the topics extracted by the topic extraction unit 10C1. Here, the topics extracted by the topic extraction unit 10C1 are topics extracted from instruction information. Therefore, by deriving the equipment settings corresponding to the topics, equipment settings in accordance with the instructions are derived. In other words, the equipment settings necessary to perform shooting in accordance with the instructions are derived. Note that the equipment settings here are universal settings that apply to any shooting equipment (camera). For example, settings such as shutter speed (shooting time), aperture value (F-number), ISO sensitivity (ISO film speed; International Organization for Standardization film speed), exposure compensation amount, white balance, lens, etc.

[0057] In this embodiment, the equipment setting derivation unit 10C2 derives equipment settings corresponding to a topic by referring to the equipment setting database (Data Base: DB) 14A.

[0058] Figure 7 shows an example of an equipment configuration database.

[0059] The equipment settings database 14A records multiple terms related to photography, and each recorded term is associated with information about equipment settings (setting information). The recorded terms are terms that can be extracted as topics. In other words, the terms recorded in the equipment settings database 14A are extracted by the topic extraction unit 10C1. The terms recorded in the equipment settings database 14A consist of vocabulary in the field of photography. The equipment setting information consists of information about the equipment settings necessary to perform photography related to the associated term. For example, as shown in Figure 7, for the term "soften," the equipment setting information recorded is "aperture value: small, exposure compensation: positive." When shooting softly, bokeh is generally used and the image is shot brightly. Therefore, for the term "soften," setting information is recorded that the aperture value should be set small and the exposure compensation should be set to the positive side. Also, for the term "dynamic," the equipment setting information recorded is "aperture value: large, lens: wide-angle." When photographing landscapes or other subjects dynamically, a wide-angle lens is generally used. Use It also enhances contrast for sharper images. Therefore, the term "make dynamic" records setting information indicating the use of a wide-angle lens or zooming to the wide side, and setting a large aperture value.

[0060] The equipment setting derivation unit 10C2 obtains equipment setting information corresponding to the topic by referring to the equipment setting database 14A for the topic extracted by the topic extraction unit 10C1.

[0061] The equipment configuration database 14A is stored in the auxiliary storage device 14. In this embodiment, the equipment configuration database 14A is an example of a first database that records information related to settings.

[0062] The operation method derivation unit 10D derives the operation method for equipment C necessary to perform the settings derived by the instruction information analysis unit 10C. In this embodiment, the operation method derivation unit 10D derives the operation method for equipment C by referring to the manual database 14B.

[0063] Figure 8 shows an example of a manual database.

[0064] The manual database 14B records manual data for each piece of equipment. The manual data is recorded in association with, for example, the manufacturer name and model name. Therefore, the corresponding manual data can be identified from the manufacturer name and model name information obtained as equipment information. The operation method derivation unit 10D obtains the manual data for equipment C used by photographer P1 from the manual database 14B based on the equipment information obtained by the equipment information acquisition unit 10A.

[0065] Manual data consists of main text data describing operating procedures and index data. The main text data is recorded in a predetermined electronic document file format. For example, it is recorded in PDF (Portable Document Format). Index data is data for indexing, which arranges the main words and items described in the main text data in a specific order and records their location (page number). Manuals usually include an index. Therefore, the index data may be the same as the index provided in the manual. That is, the index data may be extracted from the manual and used as index data. Alternatively, index data may be generated individually to suit use in this system. In this case, index data corresponding to the equipment settings derived by the instruction information analysis unit 10C will be generated.

[0066] The manual database 14B is stored in the auxiliary storage device 14. In this embodiment, the manual database 14B is an example of a second database that records information regarding the manual for equipment C.

[0067] The operation method derivation unit 10D refers to index data to identify the page in the manual that contains the desired operation method (the section containing the operation method for the equipment necessary for the setting). In other words, in this embodiment, the operation method for equipment C necessary to perform the derived setting is found in the manual for equipment C, and the operation method for equipment C is derived. The operation method derivation unit 10D extracts the data from the main text data of the identified page and outputs it as operation method information (operation information). For example, if the setting "Aperture value: small, Exposure compensation: positive" is derived, the operation method derivation unit 10D outputs the operation information as follows: First, it identifies the page containing the operation method for "aperture value" and the page containing the operation method for exposure compensation from the index data of the manual for equipment C used by photographer P1. Next, it extracts the data from the main text data of the manual from the identified page. The extracted page data is output as operation information. In this embodiment, operation information is an example of third information related to operation method information.

[0068] The operation information output unit 10E outputs (transmits) operation information to the photographer P1's first terminal device T1. In this embodiment, instruction information and setting information are output along with the operation information.

[0069] The first terminal device T1 acquires (receives) operation information, instruction information, and setting information output (transmitted) from the operation information output unit 10E, and outputs (displays) them on the display 105.

[0070] Figure 9 shows an example of how operation information, instruction information, and setting information are displayed on the screen. The figure shows an example of operation information output in response to the shooting instruction, "Please take the picture with a soft touch."

[0071] As described above, the shooting instruction "Please take a picture with a soft feel" derives the setting information "Aperture value: small, Exposure compensation: positive". From this setting information, the data from the manual page describing how to adjust the aperture value and the manual page describing how to adjust the exposure compensation are output as operation information. Figure 9(A) shows an example where the data from the manual page describing how to adjust the aperture value is displayed as operation information. Figure 9(B) shows an example where the data from the manual page describing how to adjust the exposure compensation is displayed as operation information.

[0072] As shown in Figures 9(A) and (B), the display screen 105 of the first terminal device T1 is configured with four information display areas: the first area R1 to the fourth area R4. The first area R1 is the display area for "instruction content" information, where the instruction information is displayed. The second area R2 is the display area for "equipment settings" information, where the setting information is displayed. If the setting information includes multiple setting items, each item is numbered and displayed. The third area R3 is the display area for "operation method" information, where the information of the item to be operated is displayed. In other words, the information of the setting item to be operated is displayed. Figure 9(A) shows an example of the display when the setting item to be operated is "aperture value". Figure 9(B) shows an example when the setting item to be operated is "exposure compensation". The fourth area R4 is the manual display area, where the data from the page in the manual describing the operation method for the setting item to be operated is displayed. Figure 9(A) shows an example of the display of the data from the page in the manual describing the operation method for aperture value. Figure 9(B) shows an example of the display of the data from the page in the manual describing the operation method for exposure compensation. The data on the page displayed in area 4, R4, can be enlarged, reduced, and moved by pinch-in, pinch-out, and sliding gestures on the screen. A toggle button, B1, is displayed in area 4, R4. Touching the toggle button, B1, switches the displayed setting item.

[0073] Note: Figure 9 ofThe display format shown is just one example; various formats can be used to display operational information and other details.

[0074] [Operation of Information Processing Systems] Next, the sequence of processes (information processing method) performed in the information processing system 1 of this embodiment will be described.

[0075] As described above, the information processing system 1 of this embodiment is configured to receive instructions for photography from the client P2, derive the operation method of the equipment C necessary for taking photographs according to those instructions, and present it to the photographer P1. The connection between photographer P1 and client P2 is made using a known matching service, social networking service (SNS), etc. For example, on an electronic bulletin board using a computer network, client P2 posts the details of the request (subject to be photographed, location, date and time of shooting, etc.), and those who can undertake the request respond to the post, and a match is made. In addition, a method can be adopted in which users who match the details of client P2's request are extracted and presented from among users who have registered the conditions for photography that can be done in advance (subject to be photographed, location, date and time of shooting), and a match is made.

[0076] Figure 10 is a sequence diagram of the processing performed in the information processing system.

[0077] First, the photographer P1 inputs information about the equipment C to be used during shooting (equipment information) into the first terminal device T1 (step S1). The equipment information includes the manufacturer name and model name. The input equipment information is transmitted to the information processing device 10 (step S2). The information processing device 10 receives the equipment information transmitted from the first terminal device T1 and obtains the input equipment information (step S3).

[0078] Meanwhile, the client P2 who requested the filming inputs information about the content of the filming instructions (instruction information) into the second terminal device T2 (step S4). The instructions are input in sentences expressed in natural language. The input instruction information is transmitted to the information processing device 10 (step S5). The information processing device 10 receives the instruction information transmitted from the second terminal device T2 and obtains the input of the instruction information (step S6).

[0079] The information processing device 10 analyzes the acquired instruction information and derives the equipment settings necessary to perform shooting according to the instructions (step S7). In this process, the information processing device 10 first extracts a topic from the text indicating the content of the instruction. Next, it refers to the equipment setting database 14A and derives the equipment settings corresponding to the topic.

[0080] After deriving the equipment settings, the operation method for equipment C necessary to perform the derived settings is then derived (Step S8). In this process, the information processing device 10 derives the operation method for equipment C by referring to the manual database 14B. More specifically, the operation method is derived using the following procedure. First, based on the equipment information, the manual data for equipment C used by photographer P1 is obtained from the manual database 14B. Next, the index data contained in the manual data is referred to to identify the page in the manual that contains the desired operation method. That is, the page containing the operation method for performing the derived settings is identified. The data of the identified page is extracted from the main text data of the manual, and the operation information is derived.

[0081] The information processing device 10 outputs (transmits) the derived operation information to the photographer P1's first terminal device T1 (step S9).

[0082] The first terminal device T1 receives (receives) operation information output (transmitted) from the information processing device 10 (step S10) and displays it on the display 105 in a predetermined format (step S11). The photographer P1 checks the display on the display 105 of the first terminal device T1 (see Figure 9), operates the equipment C, and takes a photograph. The captured image is transmitted, for example, from the first terminal device T1 to the second terminal device T2 via the information processing device 10.

[0083] As explained above, according to the information processing system 1 of this embodiment, client P2 of The photographer P1 is presented with instructions on how to take photos according to the given instructions. This allows photographer P1 to give appropriate shooting instructions even if they are not familiar with the equipment. Furthermore, this enables photographer P1 to take photos that reflect the wishes of the client P2 when requesting photography services from others.

[0084] [Second Embodiment] Figure 11 shows a second embodiment of the information processing system.

[0085] In this embodiment, the information processing system 1 is configured to allow the client P2 to view images being captured by the photographer P1 in real time. In other words, it is configured to allow the live view video to be viewed on the client P2's second terminal device T2 (it is configured as a so-called live streaming system).

[0086] As shown in Figure 11, the equipment (camera) C owned by the photographer P1 and the first terminal device T1 are connected in a communicative manner, and the image displayed on the display Cd of equipment C is transmitted to the first terminal device T1. The image transmitted to the first terminal device T1 is transferred to the information processing device 10 via the communication network 2. The image transferred to the information processing device 10 is further transferred to the second terminal device T2 of the client P2 via the communication network 2 and displayed on the display 205 of the second terminal device T2.

[0087] Figure 12 is a block diagram of the main functions provided by the information processing device.

[0088] As shown in Figure 12, the information processing device 10 of this embodiment further includes the functions of an image acquisition unit 10F and an image output unit 10G. The other functions are the same as those of the information processing device 10 of the first embodiment described above. Therefore, the functions of the image acquisition unit 10F and the image output unit 10G will be described here.

[0089] The image acquisition unit 10F acquires images transmitted from the photographer P1's first terminal device T1. As described above, the images transmitted from the first terminal device T1 are images displayed on the display (including the electronic viewfinder) Cd of the equipment C. If live view is displayed on the display Cd of equipment C, the live view image is transmitted. The images are transmitted sequentially. In this embodiment, the live view image transmitted from equipment C via the first terminal device T1 is an example of images taken in chronological order by equipment C.

[0090] The method of communication between the first terminal device T1 and equipment C is not particularly limited. For example, images may be transmitted from equipment C to the first terminal device T1 using short-range wireless technology such as Bluetooth® or Wi-Fi (Local Area Network). Since this type of technology is publicly known, a detailed explanation will be omitted.

[0091] The image output unit 10G sequentially outputs (transmits) the images acquired by the image acquisition unit 10F to the client P2's second terminal device T2. The client P2's second terminal device T2 sequentially receives the images output from the information processing device 10 and displays them on the display 205.

[0092] Figure 13 shows an example of the display on the second terminal device. This figure shows an example where live view is displayed on display Cd of the photographer's equipment C.

[0093] As shown in Figure 13, the display 205 of the client's second terminal device T2 shows the image displayed on the display Cd of the photographer's equipment C. If live view is displayed on the display Cd of the photographer's equipment C, the live view image is also displayed on the display 205 of the client's second terminal device T2. On the photographer's equipment C, the equipment setting information (shutter speed, aperture value, exposure compensation) is superimposed on the live view image. amount If information such as ISO sensitivity is displayed, that information will also be shown. By displaying this information together, the client can check what settings the photographer is using.

[0094] Thus, according to the information processing system 1 of this embodiment, the client P2 can check the image being captured by the photographer P1 in real time. Therefore, the client P2 can give more detailed shooting instructions. This allows for shooting that better reflects the intentions of the client P2.

[0095] In this embodiment, the system transmits information from the screen of equipment C operated by photographer P1, but it is also possible to transmit only the captured image. Furthermore, the image size may be changed during transmission. For example, the image may be reduced in size to a size smaller than that displayed on the display Cd of equipment C before transmission. Additionally, the frame rate may be changed during transmission.

[0096] [Third Embodiment] In the information processing system 1 of this embodiment, the image taken by photographer P1 is transmitted to the client P2's second terminal device T2. Information regarding the settings of equipment C at the time the image was taken is also transmitted to the information processing device 10. Based on the acquired information, the information processing device 10 derives the equipment settings necessary to take a photograph in accordance with the instructions from client P2.

[0097] Figure 14 is a block diagram of the main functions provided by the information processing device.

[0098] Similar to the information processing device 10 of the second embodiment described above, the information processing device 10 of this embodiment has the functions of an image acquisition unit 10F and an image output unit 10G.

[0099] The image acquisition unit 10F acquires images transmitted from the photographer P1's first terminal device T1. The images transmitted from the first terminal device T1 include not only live view images but also images that have actually been taken. That is, they include images taken by the shutter release operation (captured images). Captured images have information about the settings used when the image was taken (so-called metadata) attached to them. For example, Exif (Exchangeable image file format) data is attached to the image. Therefore, by referring to the information (metadata) attached to the image, information about the settings used when the image was taken can be obtained. Exif data includes information such as the overall resolution of the image, the horizontal and vertical unit resolution, shutter speed, shutter speed, aperture value, ISO sensitivity, metering mode, whether or not flash was used, exposure compensation step value, focal length, and color space.

[0100] The image output unit 10G outputs (transmits) the image acquired by the image acquisition unit 10F to the client P2's second terminal device T2. Therefore, in addition to the live view image, the captured image is output to the client P2's second terminal device T2. The client P2's second terminal device T2 receives the image output from the information processing device 10 and displays it on the display 205. Therefore, in addition to the live view image, the actually captured image is displayed on the display 205. The client P2 checks the actually captured image and gives instructions to take a picture.

[0101] The captured images acquired by the image acquisition unit 10F are further input to the instruction information analysis unit 10C. Based on the instruction information and metadata of the captured images, the instruction information analysis unit 10C derives the equipment settings necessary to perform shooting according to the instructions.

[0102] Figure 15 is a block diagram of the main functions of the instruction information analysis unit.

[0103] As shown in Figure 15, the instruction information analysis unit 10C of this embodiment further includes a metadata analysis unit 10C3.

[0104] The metadata analysis unit 10C3 analyzes the metadata of the captured image and obtains information about the settings used when the image was taken. The obtained information is added to the equipment setting derivation unit 10C2.

[0105] The equipment setting derivation unit 10C2 derives equipment settings corresponding to the topics extracted by the topic extraction unit 10C1. In doing so, the equipment setting derivation unit 10C2 derives equipment settings corresponding to the topic by taking into consideration the information obtained by the metadata analysis unit 10C3 (information regarding the settings used when the captured image was taken). Similar to the first embodiment described above, the equipment setting derivation unit 10C2 derives equipment settings corresponding to the topic by referring to the equipment setting database 14A. The equipment setting database 14A records multiple terms related to photography, and equipment setting information is associated with each recorded term. The equipment setting information also includes information on preferred setting ranges. For example, for the term "soften," the equipment setting information recorded is "aperture value: small (F8~11), exposure compensation: positive (+1.0~1.5)."

[0106] The equipment setting derivation unit 10C2 obtains equipment setting information corresponding to the topic extracted by the topic extraction unit 10C1 by referring to the equipment setting database 14A. Then, taking into account the information obtained by the metadata analysis unit 10C3 (information regarding the settings when the captured image was taken), it derives the equipment settings corresponding to the topic. For example, for the term "soften," if the aperture value setting when the captured image was taken was F5.6 and there was no exposure compensation, the setting information "Aperture value: small, Exposure compensation: positive" is derived. On the other hand, if the aperture value setting when the captured image was taken was F8 and there was no exposure compensation, the setting information "Exposure compensation: positive" is derived.

[0107] The operation method derivation unit 10D derives the operation method for equipment C based on the setting information derived by the instruction information analysis unit 10C.

[0108] Thus, according to the information processing system of this embodiment, it is possible to instruct the photographer P1 to take pictures based on the images they have taken. Furthermore, it is possible to derive equipment settings based on the results of previously taken pictures (equipment settings). This makes it possible to take pictures that reflect the client's intentions.

[0109] Furthermore, in the information processing system of this embodiment, when deriving equipment settings based on the results of previously taken photos, situations may arise where desirable settings cannot be derived. For example, if the previously taken photos were taken within a desirable setting range, no further settings can be suggested. In this case, the system may be configured to send a message to the client P2 prompting them to change the instructions, or a message indicating that the settings cannot be changed.

[0110] [Differentiation] In the above embodiment, the system is configured to derive settings for shooting according to instructions based on information regarding the equipment settings at the time the captured image was taken. However, it is also possible to configure the system to derive settings for shooting according to instructions based on the captured image, or based solely on the captured image. Specifically, the system analyzes the captured image and derives settings for shooting according to instructions. For example, the system analyzes the captured image to determine the brightness, sharpness, etc., and derives settings for shooting according to instructions.

[0111] [Other embodiments and variations] [System Configuration] In the above embodiment, the first terminal device T1 was described as being composed of a computer with communication functions such as a smartphone, but the equipment that constitutes the first terminal device T1 is not limited to this. For example, if the equipment used by photographer P1 for taking pictures (photography equipment) has communication functions and computer functions (processor and memory, etc.), the photography equipment itself can be used as the first terminal device. T1It can be used as such. In this case, direct communication takes place between the information processing device 10 and equipment C such as a camera. Equipment information is transmitted directly from equipment C such as a camera to the information processing device 10, and operation information is transmitted directly from the information processing device 10 to equipment C such as a camera. The transmitted operation information is also displayed directly on the display provided in equipment C such as a camera.

[0112] Furthermore, the second terminal device T2 can be configured with a personal computer or the like, in addition to a mobile computer such as a smartphone.

[0113] Furthermore, although the above embodiment provides an information processing device 10 in addition to the first terminal device T1 and the second terminal device T2, the functions of the information processing device 10 may be provided to either the first terminal device T1 or the second terminal device T2. In other words, the various processes performed by the information processing device 10 may be performed by either the first terminal device T1 or the second terminal device T2.

[0114] [Data related to the manual] In the above embodiment, data related to the manual is pre-recorded in the manual database 14B, but the method of acquiring data related to the manual is not limited to this. For example, the photographer P1 may transmit the data to the information processing device 10 via the first terminal device T1. In this case, the data related to the manual transmitted from photographer P1 is stored in the manual database 14B. to The system may also be configured to record the data. This allows for the collection of data related to the manuals of multiple pieces of equipment. Alternatively, the system may be configured to request the photographer P1 to provide manual data only if the data related to the manual of the equipment used by the photographer P1 is not recorded in the manual database 14B.

[0115] [Deriving the operating method] In the above embodiment, the data from the relevant page of the manual is extracted to derive the equipment's operating instructions. However, the method for deriving the equipment's operating instructions is not limited to this. For example, instead of extracting the data from the entire page, the configuration could be such that only the area on the relevant page containing the operating instructions is extracted to derive the operating instructions.

[0116] Alternatively, the system may be configured to search the internet for web pages containing the desired operating instructions and output the relevant web pages as operating information. For example, the system could search the website of the manufacturer of the equipment used by photographer P1 for web pages containing the desired operating instructions and output the relevant web pages as operating information. In this case, a publicly known search engine or similar tool could be used to search for web pages containing the desired operating instructions.

[0117] Furthermore, while the above embodiment uses index data to search for the relevant page, it is also possible to use a configuration that analyzes the main text data to search for the relevant page.

[0118] Furthermore, the data related to the manual can also be presented as video data. In other words, the operation methods corresponding to each term are recorded as videos.

[0119] [Output of operation information, etc.] In the above embodiment, the system is configured to output instruction information and setting information along with operation information to the photographer P1's first terminal device T1. However, the information output to the photographer P1's first terminal device T1 may consist only of operation information. In other words, instruction information and setting information may be notified to the photographer P1 by other means (for example, telephone, email, etc.). Alternatively, for example, the information processing device 10 may be equipped with a so-called chat function, allowing messages to be sent and received between the requester P2 and the photographer P1.

[0120] [Derivation of configuration information] The equipment settings (setting information) necessary for taking photos according to the instructions may be directly derived from the instruction information using, for example, a pre-trained model.

[0121] Furthermore, when configuring multiple items, the order in which they are configured can also be specified. In this case, the operation instructions will be displayed in the specified order.

[0122] [Equipment used for filming] As mentioned above, the equipment used for filming includes not only cameras but also devices with camera functions, such as smartphones with cameras. Furthermore, cameras include not only digital cameras but also video cameras, television cameras, cinema cameras, etc. Film cameras are also included.

[0123] Furthermore, shooting instructions include not only instructions for still photography but also instructions for video recording.

[0124] [Client and photographer] The client and the photographer may be the same person. In this case, the client can learn the specific operating procedures for their equipment when performing a particular type of photography.

[0125] [Hardware configuration of information processing equipment] Each function of an information processing device can be comprised of various types of processors. These processors include CPUs (Central Processing Units), which are general-purpose processors that execute programs and function as various processing units; Programmable Logic Devices (PLDs), such as FPGAs (Field Programmable Gate Arrays), whose circuit configurations can be changed after manufacturing; and Dedicated Electrical Circuits, such as ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform particular processing. Information processing deviceA single processing unit constituting the above may be composed of one of the above-mentioned various processors, or it may be composed of two or more processors of the same or different type. For example, a single processing unit may be composed of multiple FPGAs, or a combination of a CPU and an FPGA. Alternatively, multiple processing units may be composed of one processor. Examples of composing multiple processing units with one processor include, firstly, a configuration in which one processor is composed of a combination of one or more CPUs and software, as is typical of computers such as clients and servers, and this processor functions as multiple processing units. Secondly, a configuration using a processor that realizes the functions of the entire system, including multiple processing units, on a single IC (Integrated Circuit) chip, as is typical of System-on-a-Chip (SoC) systems. Thus, various processing units are configured as hardware structures using one or more of the above-mentioned various processors. Furthermore, the hardware structure of these various processors is more specifically an electrical circuit (circuitry) that combines circuit elements such as semiconductor elements. [Explanation of Symbols]

[0126] 1. Information Processing System 2. Communication Network 2a base station 10 Information Processing Devices 10A Equipment Information Acquisition Unit 10B Instruction information acquisition section 10C Instruction information analysis section 10C1 Topic Extraction Unit 10C2 Equipment setting output section 10C3 Metadata Analysis Unit 10D Operation method derivation part 10E Operation Information Output Unit 10F Image acquisition section 10G Image Output Unit 11 CPU 12 ROM 13 RAM 14 Auxiliary storage 14A Equipment Configuration Database 14B Manual Database 15 displays 16 Network Interfaces 17-key keyboard 18 mice 19 Optical drive 101 CPU 102 ROM 103 RAM 104 Flash Memory 105 displays 106 Touch Panel 107 GPS receiver 108 Camera Section 109 Microphone section 110 Speaker section 111 Communications Department 111A Antenna 112 Near Field Wireless Communication Department 112A antenna 113 Sensor section 114 Media Drive 115 memory card 201 CPU 202 ROM 203 RAM 204 Flash Memory 205 displays 206 Touch Panel 207 GPS receiver 208 Camera Department 209 Microphone section 210 Speaker section 211 Communications Department 211A Antenna 212 Near Field Wireless Communication Department 212A Antenna 213 Sensor section 214 Media Drive 215 Memory Card B1 Switch button C Equipment CD player display P1 Photographer P2 Client R1 First area on the display screen of the first terminal device R2 Second area on the display screen of the first terminal device R3 Third area on the display screen of the first terminal device R4 The fourth area on the display screen of the first terminal device T1 First Terminal Device T2 Second Terminal Device S1-S11 Procedures for processing performed in the information processing system

Claims

1. Equipped with a processor, The aforementioned processor, First information regarding the equipment used for shooting is obtained from the first terminal. Second information is obtained from the second terminal regarding the content of the instructions for taking the picture. Based on the first and second pieces of information, the settings of the equipment necessary for taking photographs in accordance with the instructions and the operating methods of the equipment necessary for those settings are derived. Third information relating to the aforementioned operation method is output to the first terminal. Information processing device.

2. The processor receives images captured in chronological order by the equipment and transmits them to the second terminal. The information processing apparatus according to claim 1.

3. The processor further outputs the second information to the first terminal. The information processing apparatus according to claim 1 or 2.

4. The second piece of information consists of text information, The processor extracts topics related to photography from the text information, The above settings corresponding to the above topic are derived. The information processing apparatus according to claim 1 or 2.

5. The processor derives the setting corresponding to the topic by referring to a first database which records information about the setting. The information processing apparatus according to claim 4.

6. The processor derives the setting corresponding to the topic by referring to the first database which records information relating the topic and the setting. The information processing apparatus according to claim 5.

7. The aforementioned processor, Information regarding the manual for the equipment is obtained from a second database that records information regarding the manual for the equipment. Based on the information in the manual, the operation method is derived. The information processing apparatus according to claim 1 or 2.

8. The first information includes information relating to the manual for the equipment, The processor acquires the input of the first information and records the information relating to the manual of the equipment included in the first information in the second database. The information processing apparatus according to claim 7.

9. The processor extracts from the manual for the equipment the section describing the operation method of the equipment necessary for the setting. The information processing apparatus according to claim 7.

10. The aforementioned processor, The system receives information regarding the settings of the equipment used when the image was taken. Based on the first information, the second information, and the information regarding the settings of the equipment when the image was taken, the necessary equipment settings and the operation method of the equipment required for taking a photograph in accordance with the instructions are derived. The information processing apparatus according to claim 1 or 2.

11. The first terminal owned by the first user who undertakes the photography, The second device owned by the second user requesting the photo shoot, The information processing apparatus according to claim 1 or 2, Equipped with, The information processing device acquires input of the first information from the first terminal, acquires input of the second information from the second terminal, and outputs the third information to the first terminal. Information processing system.

12. A computer-based information processing method, The aforementioned computer, First information regarding the equipment used for shooting is obtained from the first terminal. Second information is obtained from the second terminal regarding the content of the instructions for taking the picture. Based on the first and second pieces of information, the settings of the equipment necessary for taking photographs in accordance with the instructions and the operating methods of the equipment necessary for those settings are derived. Third information relating to the aforementioned operation method is output to the first terminal. Information processing methods.

13. A function to obtain input of first information relating to the equipment used for shooting from a first terminal, A function to obtain input of second information regarding the content of instructions for shooting from the second terminal, Based on the first and second pieces of information, a function is provided to derive the settings for the equipment necessary to perform photography in accordance with the instructions, and the operating method of the equipment necessary for those settings. A function to output third information relating to the aforementioned operation method to the first terminal, An information processing program that enables computers to realize this.

Images