Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, an information processing method, and an information processing program that are capable of imaging according to an imaging condition.SOLUTION: An information processing device includes: an imaging unit; an acquisition unit that obtains an imaging condition including an imaging position and an imaging direction in imaging a subject; a first determination unit that determines whether the position of the imaging unit and the imaging direction to which the imaging unit faces correspond to the imaging position and the imaging direction which are included in the imaging condition obtained by the acquisition unit; and an output control unit that performs control to output, when the first determination unit determines that the position of the imaging unit and the imaging direction to which the imaging unit faces correspond to the imaging condition, information indicating that there is a state appropriate for imaging by the imaging unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, at a construction site, photographs are taken before, during, and after construction work, and are compiled into a construction photo album. When taking such photographs, it is required that the photographs are taken from the same position and the same angle. For this reason, the camera described in Patent Document 1 uses a GPS receiver and a gyro sensor to record the imaging position and azimuth angle, and in subsequent imaging, the camera is moved so that it matches the recorded imaging position and azimuth angle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-253659 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the camera described in Patent Document 1 requires workers to manually move it finely to match the image capturing position and azimuth angle between multiple images, which is cumbersome work and places a heavy burden on workers when capturing images. For this reason, it has been desired for workers to easily know whether the image capturing conditions are met.

[0005] The present disclosure provides an information processing device, an information processing method, and an information processing program capable of capturing an image according to image capturing conditions. [Means for solving the problem]

[0006] An information processing device of one embodiment includes an imaging unit, an acquisition unit that acquires imaging conditions including an imaging position and an imaging direction when imaging a subject, a first determination unit that determines whether the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging position and imaging direction included in the imaging conditions acquired by the acquisition unit, and an output control unit that controls to output an indication that the state is suitable for imaging by the imaging unit when the first determination unit determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions. Effect of the Invention

[0007] The information processing device, the information processing method, and the information processing program disclosed herein can perform imaging according to imaging conditions. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an information processing device according to an embodiment. [Diagram 2] FIG. 1 is a block diagram illustrating an information processing device according to an embodiment. [Diagram 3] 1A is a diagram for explaining the relationship between an information processing device and imaging conditions, in which (A) is a diagram for explaining a case where the position and imaging direction of the information processing device (imaging unit) correspond to the imaging conditions (imaging position and imaging direction), and (B) is a diagram for explaining a case where the information processing device (imaging unit) is made to match the imaging conditions. [Figure 4] 1A is a diagram for explaining an example of information output by an information processing device, in which (A) is a diagram for explaining an example of an image when an imaging unit captures an image according to imaging conditions, and (B) is a diagram for explaining an example of an image in which an imaging position and an imaging direction when the imaging unit captures an image according to the imaging conditions are recorded. [Diagram 5] 1 is a flowchart illustrating an information processing method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An embodiment will be described below.

[0010] [Overview of information processing device 100] First, an overview of an information processing device 100 according to an embodiment will be described. FIG. 1 is a diagram illustrating an information processing device 100 according to an embodiment.

[0011] The information processing device 100 may be configured as a determination device or the like that determines whether imaging according to the imaging conditions 210 is possible. The information processing device 100 may be configured as an instruction device or the like that issues an instruction to the effect that imaging is possible when imaging according to the imaging conditions 210 is possible. The information processing device 100 may be configured as an imaging device or the like that is capable of imaging when imaging according to the imaging conditions 210 is followed. The information processing device 100 may be configured as an imaging device or the like that is capable of imaging at least according to the imaging conditions 210. The information processing device 100 may be configured as an output device or the like that outputs image information when imaging according to the imaging conditions 210 is performed. The information processing device 100 is not limited to the device of the above example, and may constitute various devices or the like. The information processing device 100 may be a computer such as a desktop, a laptop, a tablet, or a smartphone.

[0012] The information processing device 100 acquires imaging conditions 210 including an imaging position 251 and an imaging direction 252 when imaging a subject. The imaging position 251 is, for example, a position at which the subject is imaged, and may be, for example, a position indicated by coordinates. The imaging direction 252 is, for example, a direction in which the subject is imaged from the imaging position 251, and may be, for example, a direction, azimuth, elevation angle, depression angle, etc. based on the imaging position 251.

[0013] The information processing device 100 determines whether the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging conditions 210 (imaging position 251 and imaging direction 252). As an example, the information processing device 100 determines whether the position 151 of the imaging unit 131 matches (or approximately matches, etc.) the imaging position 251 recorded in the imaging conditions 210, or is within a predetermined distance from the imaging position 251 (or a reference position of a subject to be imaged, etc.) recorded in the imaging conditions 210. As another example, the information processing device 100 determines whether the imaging direction 152 in which the imaging unit 131 faces matches (or approximately matches, etc.) the imaging direction 252 recorded in the imaging conditions 210, or is within a predetermined range based on the imaging direction 252 recorded in the imaging conditions 210.

[0014] When the information processing device 100 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging conditions 210, it outputs that the state is suitable for imaging by the imaging unit 131. As an output in this case, the information processing device 100 may output (e.g., display and sound output, etc.) the fact that the conditions are suitable for photographing by at least one of the group of characters, symbols, images, sounds, and voices, etc. Furthermore, as an output in this case, the information processing device 100 may, for example, control the imaging unit 131 so that imaging is possible when a state is suitable for imaging by the imaging unit 131. As a specific example, the information processing device 100 may accept an input of an operation of a shutter button for imaging when a state is suitable for imaging by the imaging unit 131.

[0015] [Details of the information processing device 100] Next, the information processing device 100 according to an embodiment will be described in detail. FIG. 2 is a block diagram illustrating the information processing device 100 according to an embodiment. Fig. 3 is a diagram for explaining the relationship between the information processing device 100 and the imaging conditions 210. Fig. 3(A) is a diagram for explaining a case where the position 151 and imaging direction 152 of the information processing device 100 (imaging unit 131) correspond to the imaging conditions 210 (imaging position 251 and imaging direction 252), and Fig. 3(B) is a diagram for explaining a case where the information processing device 100 (imaging unit 131) is matched to the imaging conditions 210.

[0016] As illustrated in FIG. 2, the information processing device 100 includes, for example, a communication unit 121, a storage unit 122, a display unit 123, an imaging unit 131, and a control unit 110. The communication unit 121, the storage unit 122, and the display unit 123 may be an embodiment of an output unit. The control unit 110 includes, for example, an acquisition unit 111, a first determination unit 112, a second determination unit 113, a recording unit 114, and an output control unit 115. The control unit 110 may be configured, for example, by an arithmetic processing device of the information processing device 100. The control unit 110 (for example, an arithmetic processing device) may realize the functions of each unit (the acquisition unit 111, the first determination unit 112, the second determination unit 113, the recording unit 114, the output control unit 115, etc.) by, for example, appropriately reading and executing various programs stored in the storage unit 122, etc.

[0017] The communication unit 121 is, for example, a communication interface capable of transmitting and receiving various information to and from a device (external device) outside the information processing device 100. The external device may be, for example, a server 201 (see FIG. 1) and a company terminal (not shown). The company terminal is a terminal used by an employee of the company 200 (see FIG. 1), and may be, for example, a desktop, a laptop, a tablet, or the like.

[0018] The storage unit 122 may store, for example, various information and programs. Examples of the storage unit 122 may be a memory, a solid state drive, a hard disk drive, etc. Note that the storage unit 122 may be, for example, a storage area and a server on a cloud. The storage unit 122 may store map information relating to road maps.

[0019] The display unit 123 is, for example, a display capable of displaying various characters, symbols, images, and the like.

[0020] The imaging unit 131 may be a camera capable of capturing an image of a subject.

[0021] The acquisition unit 111 acquires the imaging conditions 210 including the imaging position 251 and the imaging direction 252 when imaging the subject. The imaging position 251 and the imaging direction 252 may be the position of a place where a field survey is required and the direction (direction or azimuth) in which the subject at that place is imaged. An example of the field survey may be a survey of roads such as intersections, traffic signals, traffic signs, parking lots, buildings, facilities, and features. As a more specific example, the field survey may be various surveys when creating and updating a road map. The imaging conditions 210 may be set by an employee of a company 200 (e.g., a map creation company) that requires a field survey, and stored in the server 201, etc. (see FIG. 1). The employee may also give instructions to an investigator who performs the field survey and urge the investigator to acquire the imaging conditions 210 based on the instructions. Therefore, the acquisition unit 111 may acquire the imaging conditions 210 from the server 201, etc., via the communication unit 121, for example. The imaging position 251 and the imaging direction 252 included in the imaging condition 210 may be referred to as a condition imaging position 251 and a condition imaging direction 252, respectively.

[0022] The first determination unit 112 determines whether the position 151 of the imaging unit 131 (information processing device 100) and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging position 251 and the imaging direction 252 included in the imaging condition 210 acquired by the acquisition unit 111 (see FIG. 3(A)). The information processing device 100 may include, for example, a receiver for a GNSS signal or the like, a geomagnetic sensor (compass), an acceleration sensor, a gyro sensor, and the like (not shown). The first determination unit 112 acquires position information (device imaging position) of the position 151 where the information processing device 100 is located by using the GNSS signal received by the receiver, and acquires the attitude and orientation of the information processing device 100, i.e., the imaging direction (device imaging direction) 152 of the imaging unit 131 arranged in the information processing device 100 based on the detection results of the physical quantities detected by the geomagnetic sensor (compass), the acceleration sensor, and the gyro sensor.

[0023] The first determination unit 112 determines whether the device imaging position 151 corresponds to the condition imaging position 251. Here, "corresponds" may include concepts such as a case where the position information of the device imaging position 151 and the condition imaging position 251 match, and a case where they approximately match. An approximately match may be a case where the position information of the device imaging position 151 is within a predetermined distance from the position information of the condition imaging position 251, that is, a case where the condition imaging position 251 and the device imaging position 151 are within a predetermined distance, etc. In addition, the first judgment unit 112 may judge that the device imaging position 151 and the condition imaging position 251 correspond to each other when various technical concepts, etc. that are estimated to be the same (approximately the same) between the device imaging position 151 and the condition imaging position 251 are included, without being limited to the above-mentioned example.

[0024] The first determination unit 112 also determines whether the device imaging direction 152 corresponds to the condition imaging direction 252. As an example, the first determination unit 112 may determine whether the optical axis of the optical system of the imaging unit 131 and the condition imaging direction 252 match (approximately match). The approximate match may be a case where the optical axis of the optical system of the imaging unit 131 is included within a predetermined range (for example, an angle range, etc.) based on the condition imaging direction 252. Alternatively, as an example, the first determination unit 112 may determine whether the imaging range (angle of view) of the imaging unit 131 includes the condition imaging direction 252 (for example, the central axis of the condition imaging direction 252 and the imaging range (angle of view) as a condition, etc.). The imaging range of the imaging unit 131 is determined by, for example, the planar size of an imaging element arranged in the imaging unit 131 and the focal length of the optical system, etc. In addition, the first judgment unit 112 may determine that the device imaging direction 152 and the condition imaging direction 252 correspond to each other when various technical concepts, etc. are included that are estimated to be consistent (approximately consistent) between the device imaging direction 152 and the condition imaging direction 252, without being limited to the above-mentioned example.

[0025] The second determination unit 113 determines whether imaging has been performed by the imaging unit 131 after being controlled to output by the output control unit 115 described later. That is, when the first determination unit 112 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging condition 210, the second determination unit 113 may determine whether imaging has been performed by the imaging unit 131. As an example, the second determination unit 113 may determine whether an operation of a shutter button (not shown) for imaging using the imaging unit 131 has been accepted as the determination of whether imaging has been performed by the imaging unit 131. Alternatively, as an example, the second determination unit 113 may determine whether imaging has been performed by the imaging unit 131 by determining whether the imaging unit 131 has operated, whether image information has been generated by the imaging, or whether the image information has been stored in the storage unit 122, or the like.

[0026] When the first determination unit 112 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging condition 210, the output control unit 115 controls to output that the state is suitable for imaging by the imaging unit 131. That is, when the first determination unit 112 determines that the device imaging position 151 corresponds to the condition imaging position 251 and that the device imaging direction 152 corresponds to the condition imaging direction 252, the output control unit 115 controls to output that the state is suitable for imaging by the imaging unit 131.

[0027] In this case, the output control unit 115 may control the imaging unit 131 so that the imaging unit 131 can capture an image of the subject when the imaging unit 131 is in a suitable state for capturing an image. That is, in this case, as an example, the output control unit 115 may control a control function (imaging control unit) (not shown) of the imaging unit 131 in the control unit 110 so that the operation of the shutter button when capturing an image using the imaging unit 131 can be accepted. Or, as an example, when the first determination unit 112 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging condition 210, the output control unit 115 may control the imaging unit 131 (imaging control unit) so that the imaging unit 131 captures an image of the subject even if the shutter button is not operated. That is, in this case, the output control unit 115 may control the imaging unit 131 so that the imaging unit 131 automatically captures an image when the imaging unit 131 matches the imaging condition 210.

[0028] Alternatively, when the state is suitable for imaging by the imaging unit 131, the output control unit 115 may control the display unit 123 to display characters, symbols, and images indicating that the state is suitable for imaging. In this case, the output control unit 115 may control a speaker (not shown) to output sounds and voices indicating that the state is suitable for imaging.

[0029] The output control unit 115 may control the storage unit 122 to store an imaging history (log information) when the imaging unit 131 is in a suitable state for imaging, and when imaging is performed using the imaging unit 131 in that state. In this case, the output control unit 115 may include information on the device imaging position 151 (e.g., position information such as coordinates) and the device imaging direction 152 in the log information. The device imaging direction 152 may include a direction (and an azimuth angle, etc.) such as east, west, north, south, etc., and a height direction (e.g., an elevation angle and a depression angle, etc.) in which the imaging unit 131 (e.g., an optical axis, etc.) faces.

[0030] Furthermore, since multiple imaging conditions 210 of imaging positions 251 and imaging directions 252 may be set for one subject (imaging target), the output control unit 115 controls to output that the state is suitable for imaging by the imaging unit 131 every time the first determination unit 112 determines that the imaging conditions 210 are met. That is, the information processing device 100 may repeat sequentially selecting multiple imaging conditions 210 for one subject (imaging target) and performing imaging when the imaging conditions 210 are met.

[0031] In addition, when the first judgment unit 112 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces do not correspond to the imaging position 251 and the imaging direction 252 included in the imaging conditions 210 acquired by the acquisition unit 111, the output control unit 115 may compare the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces with the imaging position 251 and the imaging direction 252 included in the imaging conditions 210, and may control to indicate (output) the imaging position 251 and the imaging direction 252 included in the imaging conditions 210. As a specific example, the output control unit 115 compares the position 151 of the imaging unit 131 (information processing device 100) with the imaging position 251 included in the imaging condition 210, and if moving the position 151 of the imaging unit 131 (information processing device 100) to the right corresponds to the imaging position 251 included in the imaging condition 210, the output control unit 115 may output "to move the position 151 of the imaging unit 131 to the right" by characters, symbols, images, voice, etc. (see FIG. 3(B)). Note that the above is also true when moving the imaging unit 131 (information processing device 100) in other directions (for example, left, front, back, etc.). Similarly, as a specific example, the output control unit 115 compares the imaging direction 152 in which the imaging unit 131 faces with the imaging direction 252 included in the imaging conditions 210, and if moving the imaging direction 152 in which the imaging unit 131 faces to the right corresponds to the imaging direction 252 included in the imaging conditions 210, the output control unit 115 may output "to turn the imaging direction 152 of the imaging unit 131 to the right" by characters, symbols, images, voice, etc. Note that the same applies to the case where the imaging direction 152 is turned to another direction (left, up, down, etc.). Even in this case, when multiple imaging conditions 210 of imaging positions 251 and imaging directions 252 are set for one subject (imaging target), if the first judgment unit 112 judges that one of the multiple imaging conditions 210 (imaging position 251 and imaging direction 252) does not correspond to the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces, the output control unit 115 may give instructions (output) as described above so that the two correspond to each other, and then, when imaging is performed, may repeat the instruction (output) so that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the other one of the multiple imaging conditions 210 (imaging position 251 and imaging direction 252).

[0032] Note that a time element may be included in the above-described imaging condition 210. That is, the imaging condition 210 may include a time element that enables imaging by the imaging unit 131 within a predetermined time after the position 151 of the imaging unit 131 and the direction 152 in which the imaging unit 131 faces correspond to the imaging condition 210. In other words, the information processing device 100 may be controlled to output that the state is suitable for imaging by the imaging unit 131 (imaging possible state) within a predetermined time based on the case where the first judgment unit 112 judges that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging position 251 and the imaging direction 252 included in the imaging condition 210.

[0033] When the second determination unit 113 determines that imaging has been performed, the output control unit 115 controls to output that imaging is possible by the imaging unit 131 regardless of the imaging conditions 210 acquired by the acquisition unit 111. That is, when the first determination unit 112 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging conditions 210, and then the second determination unit 113 further determines that imaging has been performed by the imaging unit 131, the output control unit 115 may thereafter control so that imaging of the subject is possible by the imaging unit 131 regardless of the imaging conditions 210. In this case, even if imaging is performed according to the imaging conditions 210, there may be cases where it is better to further image the subject in various patterns at the site where the field survey is performed. Therefore, after imaging is performed according to the imaging conditions 210, the output control unit 115 may control each unit of the information processing device 100 so that imaging of the subject can be performed in various patterns.

[0034] As an example, the output control unit 115 may control a control function (imaging control unit) (not shown) of the imaging unit 131 in the control unit 110 so as to be able to accept the operation of the shutter button when capturing an image using the imaging unit 131. Alternatively, the output control unit 115 may control the display unit 123 to display characters, symbols, and images indicating that the subject can be imaged in various patterns. In this case, the output control unit 115 may control a speaker (not shown) to output sounds and voices indicating that the subject can be imaged in various patterns. That is, the output control unit 115 may output a message indicating that imaging is possible by voice or image as an output indicating that imaging is possible by the imaging unit 131 when it is determined by the second determination unit 113 that imaging has been performed. As an example of this case, the output control unit 115 may control the output unit to output a message indicating that imaging according to the imaging conditions 210 has been completed or that imaging is possible in various patterns regardless of the imaging conditions 210 by voice or image.

[0035] Fig. 4 is a diagram for explaining an example of information output by the information processing device 100. Fig. 4(A) is a diagram for explaining an example of an image when the imaging unit 131 performs imaging according to the imaging conditions 210, and Fig. 4(B) is a diagram for explaining an example of an image in which the imaging position 151 and the imaging direction 152 when the imaging unit 131 performs imaging according to the imaging conditions 210 are recorded.

[0036] The output control unit 115 may output to an external device an image (image information) (see FIG. 4(A)) generated by imaging a subject by the imaging unit 131 in response to an output that the state is suitable for imaging by the imaging unit 131, in association with an image (map image) (image information) (see FIG. 4(B)) in which the position 151 of the imaging unit 131 at the time of imaging and the direction 152 in which the imaging unit 131 faces are recorded. That is, the output control unit may control output units such as the communication unit 121, the storage unit 122, and the display unit 123. As described above, when the first determination unit 112 determines that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging condition 210, the output control unit 115 performs control to output that the state is suitable for imaging by the imaging unit 131. When the imaging unit 131 accordingly captures an image of the subject, the imaging unit 131 outputs image information in which the subject is recorded. Furthermore, as described above, the information processing device 100 may include, for example, a receiver for GNSS signals or the like, a geomagnetic sensor (compass), an acceleration sensor, a gyro sensor, and the like (not shown). The output control unit 115 can acquire the position (imaging position) 151 and the imaging direction 152 of the imaging unit 131 according to the output of the receiver and the sensor. In this case, the output control unit 115 may acquire the above-mentioned log information, etc. Based on the map information stored in the storage unit 122, the output control unit 115 records the acquired imaging position 151 and imaging direction 152 on a road map to generate a map image (image information). The output control unit 115 may control the communication unit 121 to transmit a set of image information generated by imaging and a map image (image information) to an external device. The external device may be a server 201 and a company terminal (not shown) used by the company 200 that issues an instruction to carry out a field survey. The output control unit 115 may control the storage unit 122 to store, for example, image information and a map image (image information) as a set. Furthermore, the output control unit 115 may control the display unit 123 to display, for example, image information and a map image (image information) as a set.

[0037] Furthermore, the recording unit 114 records the image (captured image) captured by the imaging unit 131, the position (device imaging position) 151 of the imaging unit 131, and the imaging direction (device imaging direction) 152 in which the imaging unit 131 faces, in a road map based on the map information, in correspondence with the position (device imaging position) 151 of the imaging unit 131. That is, the recording unit 114 may record the image captured at the device imaging position 151 and the imaging direction (device imaging direction) 152 of the image in the map information (road map) by associating the device imaging position 151 with the road map. As a specific example, the recording unit 114 may indicate the device imaging position 151 on the road map with a so-called "marker pin," indicate the device imaging direction 152 extending from the device imaging position 151 (marker pin) on the road map, and display the captured image adjacent to the device imaging position 151 and the device imaging direction 152, or when the marker pin is selected (e.g., clicked, etc.). Alternatively, the recording unit 114 may record the device imaging position 151, the device imaging direction 152, and the captured image on the road map in various ways, not limited to the example described above, so that the device imaging position 151 and the device imaging direction 152 can be seen on the road map.

[0038] The output control unit 115 described above controls so as to output the map information after it has been recorded by the recording unit 114 to an external device. In this case, the output control unit 115 may control output units such as the communication unit 121, the storage unit 122, and the display unit 123. That is, the output control unit 115 may control the communication unit 121 so as to transmit the map information (road map) after various information has been recorded by the above-mentioned recording unit 114 to an external device. Here, the external device may be a server 201 and a company terminal (not shown) used by the company 200 that issues an instruction to carry out a field survey, etc. The output control unit 115 may control the storage unit 122 to store map information (road map) after various information has been recorded by the recording unit 114 described above, for example. Furthermore, the output control unit 115 may control the display unit 123 to display map information (road map) after various pieces of information have been recorded by the recording unit 114 described above, for example.

[0039] [Information processing method] Next, the information processing method will be described.

[0040] The outline of the processing procedure (information processing method) of the information processing device 100 is as follows. (1) An object to be photographed is selected from a list of points for on-site investigation designated by the company 200. As an example, the information processing device 100 may register the selected object to be photographed in a list (for example, My List, etc.). (2) When the information processing device 100 determines that the imaging unit 131 satisfies the imaging conditions 210 (imaging position 251 and imaging direction 252 (e.g., direction, etc.)) specified by the company 200, the information processing device 100 puts the imaging unit 131 into a state in which imaging is possible (imaging possible state) and captures an image of the imaging target (subject). (3) When imaging is performed in (2) above (when imaging has already been performed), the information processing device 100 places the imaging unit 131 in a state in which imaging is possible (imaging possible state) regardless of the specified imaging conditions 210 for subsequent imaging (for example, the second or subsequent imaging). (4) The information processing device 100 generates a map image indicating the positions 151 and directions 152 (for example, directions) captured in the above (2) and (3). (5) The information processing device 100 combines the captured image with the map image generated in (4) above, and uploads the combined image to the server 201 of the company 200. The information processing device 100 also updates the points selected and surveyed in (1) above to "surveyed." That is, the information processing device 100 updates the list of points to be surveyed.

[0041] Next, the information processing method will be described with reference to FIG. FIG. 5 is a flowchart illustrating an information processing method according to an embodiment.

[0042] In step ST101, the acquisition unit 111 acquires imaging conditions 210 including an imaging position 251 and an imaging direction 252 when imaging an object.

[0043] In step ST102, the first determination unit 112 determines whether the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging position 251 and the imaging direction 252 included in the imaging conditions 210 acquired in step ST101.

[0044] In step ST103, if it is determined in step ST102 that the position 151 of the imaging unit 131 and the imaging direction 152 in which the imaging unit 131 faces correspond to the imaging conditions 210, the output control unit 115 controls to output that the state is suitable for imaging by the imaging unit 131. After this output control, imaging is performed by the imaging unit 131 according to the imaging conditions 210.

[0045] In step ST104, the second determination unit 113 determines whether or not imaging has been performed by the imaging unit 131 after the output control unit 115 has controlled the image to be output in step ST103.

[0046] In step ST105, if it is determined in step ST104 that imaging has been performed, the output control unit 115 controls the imaging unit 131 to output that imaging is possible regardless of the imaging conditions 210 acquired in step ST101.

[0047] In step ST106, the recording unit 114 records the image (captured image) captured by the imaging unit 131, the position (device imaging position) 151 of the imaging unit 131, and the imaging direction (device imaging direction) 152 in which the imaging unit 131 faces, corresponding to the position (device imaging position) 151 of the imaging unit 131, on a road map based on the map information.

[0048] In step ST107, the output control unit 115 controls the output unit to output an image (image information) generated by imaging the subject by the imaging unit 131 in response to the output in step ST103 that the state is suitable for imaging by the imaging unit 131 (and including an image (image information) generated by imaging the subject by the imaging unit 131 in response to step ST105) in association with an image (map image) (image information) in which the position 151 of the imaging unit 131 at the time of imaging and the direction 152 in which the imaging unit 131 was facing are recorded. Alternatively, the output control section 115 controls the output section to output the map information after it is recorded in step ST106. The output unit may be, for example, a communication unit 121, a storage unit 122, a display unit 123, and the like.

[0049] [Functions and circuits] Next, the functions and circuits of the above-mentioned information processing device 100 will be described. Each unit of the information processing device 100 may be realized as a function of a processing unit of a computer, etc. That is, the acquisition unit 111, the first determination unit 112, the second determination unit 113, the recording unit 114, and the output control unit 115 (control unit 110) of the information processing device 100 may be realized as an acquisition function, a first determination function, a second determination function, a recording function, and an output control function (control function) by the processing unit of a computer, etc. The information processing program can cause a computer to realize each of the above-mentioned functions. The information processing program may be recorded in a non-transitory computer-readable recording medium, such as a memory, a solid-state drive, a hard disk drive, or an optical disk. The recording medium may be referred to as a non-transitory computer-readable medium, for example. As described above, each unit of the information processing device 100 may be realized by an arithmetic processing device of a computer or the like. The arithmetic processing device or the like is constituted by, for example, an integrated circuit or the like. Therefore, each unit of the information processing device 100 may be realized as a circuit constituting the arithmetic processing device or the like. That is, the acquisition unit 111, the first judgment unit 112, the second judgment unit 113, the recording unit 114, and the output control unit 115 (control unit 110) of the information processing device 100 may be realized as an acquisition circuit, a first judgment circuit, a second judgment circuit, a recording circuit, and an output control circuit (control circuit) constituting the arithmetic processing device of a computer or the like. The communication unit 121, the storage unit 122, and the display unit 123 (output unit) of the information processing device 100, and the imaging unit 131 may be realized as, for example, a communication function, a storage function, and a display function (output function) including the functions of an arithmetic processing device, and an imaging function. The communication unit 121, the storage unit 122, and the display unit 123 (output unit) of the information processing device 100, and the imaging unit 131 may be realized as, for example, a communication circuit, a storage circuit, and a display circuit (output circuit), and an imaging circuit by being configured by an integrated circuit, etc. The communication unit 121, the storage unit 122, and the display unit 123 (output unit) of the information processing device 100, and the imaging unit 131 may be realized as, for example, a communication device, a storage device, and a display device (output device), and an imaging device by being configured by a plurality of devices.

[0050] The information processing device 100 can combine one or any two or more of the above-mentioned units. In this disclosure, the term "information" is used, but the term "information" can be replaced with "data" and the term "data" can be replaced with "information."

[0051] [Aspects and Effects of the Present Embodiment] Next, one aspect of this embodiment and the effects of each aspect will be described. Note that each aspect described below is an example at the time of filing, and this embodiment is not limited to the aspects described below. In other words, this embodiment is not limited to each aspect described below, and may be realized by appropriately combining each of the above-mentioned parts. In addition, a lower aspect may be able to cite any of the higher aspects. The effects described below are merely examples, and the effects of each aspect are not limited to those described below. Each aspect may, for example, have at least one of the effects described below.

[0052] (Aspect 1) An information processing device of one embodiment includes an imaging unit, an acquisition unit that acquires imaging conditions including an imaging position and an imaging direction when imaging a subject, a first determination unit that determines whether the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging position and imaging direction included in the imaging conditions acquired by the acquisition unit, and an output control unit that controls to output an indication that the state is suitable for imaging by the imaging unit when the first determination unit determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions. This allows the information processing device to perform imaging that is suited to the imaging conditions. In particular, since imaging that is suited to imaging conditions may be required in a field survey, the information processing device outputs that the imaging conditions are suited, and the surveyor performing the field survey can perform imaging that is suited to the imaging conditions according to the output. In other words, when multiple images are taken in a field survey, it is difficult for the surveyor to tell on-site whether the imaging conditions are suited, so the output from the information processing device allows the surveyor to easily understand that the imaging conditions are suited, reducing the burden on the surveyor when taking images and shortening the time required for taking images. In other words, the information processing device makes it easy to perform a field survey, so that changes in the field can be collected inexpensively and quickly.

[0053] In addition, in the on-site survey of the survey subject specified by the company, it is necessary to capture the subject in a pre-specified position and direction (bearing). For example, when it is necessary to capture multiple images of one imaging subject (for example, an intersection, a facility, etc.), it is cumbersome to adjust the position and direction (bearing) as specified each time an image is captured, which is a significant burden when capturing images. Therefore, when the information processing device of the present embodiment determines that the imaging unit satisfies the imaging conditions designated in advance, it sets the imaging interface (imaging unit and various interfaces related to imaging) to an imaging permission state. The imaging permission state may be, for example, a state in which imaging by the imaging unit is enabled or imaging operation is enabled. Furthermore, when imaging that satisfies the imaging conditions has been completed for the same imaging target, the information processing device may always be in an imaging permitted state (an imaging possible state, described later) regardless of whether the imaging conditions are appropriate.

[0054] (Aspect 2) In one embodiment of the information processing device, the output control unit may be configured to control the imaging unit to capture an image of the subject even if the shutter button is not operated when the first determination unit determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions. In this way, the information processing device can automatically capture an image of a subject when the imaging unit meets the imaging conditions. Also, the information processing device can reduce the workload of an investigator conducting a field survey by automatically capturing an image of the subject when the imaging unit complies with the imaging conditions.

[0055] (Aspect 3) An information processing device of one embodiment includes a second judgment unit that judges whether imaging has been performed by the imaging unit after being controlled to output by the output control unit, and when the second judgment unit judges that imaging has been performed, the output control unit may be controlled to output that imaging is possible by the imaging unit regardless of the imaging conditions acquired by the acquisition unit. In a field survey, since it may be considered better to take images in various patterns depending on the field conditions, etc., the information processing device can make it possible to take images in various patterns at the discretion of the surveyor after taking images that match the imaging conditions. In other words, the information processing device can perform a better field survey, and as an example, can create and update a better road map. Furthermore, the information processing device can improve the convenience of map users who use the better road map.

[0056] (Aspect 4) In one embodiment of the information processing device, the output control unit may output an audio or image indicating that imaging is possible when the second determination unit determines that imaging has been performed, as an output indicating that imaging is possible by the imaging unit. As a result, the information processing device can take images based on the message that imaging in various patterns is possible, so that the investigator can carry out a better on-site investigation according to, for example, the local conditions.

[0057] (Aspect 5) In one embodiment of an information processing device, the output control unit may correspond image information generated by the imaging unit capturing an image of a subject in response to an output indicating that the state is suitable for imaging by the imaging unit to image information that records the position of the imaging unit and the direction in which the imaging unit was facing at the time of imaging, and output the image information to an external device. This allows the information processing device to transmit the results of the on-site investigation to the company or the like that instructed the on-site investigation. In this case, the information processing device can transmit to the external device a set of image information obtained when an image was actually captured according to the imaging conditions and image information (e.g., a road map and a map image) that describes the position (imaging position) and direction (imaging direction) at the time of the imaging. This allows the information processing device to generate easy-to-understand results of the on-site investigation.

[0058] (Aspect 6) An information processing device of one embodiment includes a memory unit that stores map information regarding a road map, and a recording unit that records an image captured by the imaging unit, the position of the imaging unit, and the imaging direction in which the imaging unit faces on a road map based on the map information, corresponding to the position of the imaging unit, and an output control unit may control the map information after being recorded by the recording unit to be output to an external device. Thereby, the information processing device can transmit the results of the on-site investigation to the company that instructed the on-site investigation, etc. In this case, the information processing device may, for example, associate a landmark indicating the imaging position with a road map as a result of the on-site investigation, and record the imaging direction and the captured image on the road map in association with the landmark, so that a visually easy-to-understand result of the on-site investigation can be generated.

[0059] (Aspect 7) In one aspect of the information processing method, a computer equipped with an imaging unit executes an acquisition step of acquiring imaging conditions including an imaging position and an imaging direction when imaging a subject, a first determination step of determining whether the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging position and imaging direction included in the imaging conditions acquired by the acquisition step, and an output control step of controlling to output a state suitable for imaging by the imaging unit when it is determined by the first determination step that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions. As a result, the information processing method can achieve the same effects as the information processing device according to the above-described aspect.

[0060] (Aspect 8) An information processing program of one embodiment causes a computer having an imaging unit to realize an acquisition function for acquiring imaging conditions including an imaging position and an imaging direction when imaging a subject, a first determination function for determining whether the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging position and imaging direction included in the imaging conditions acquired by the acquisition function, and an output control function for controlling to output that the state is suitable for imaging by the imaging unit when the first determination function determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions. As a result, the information processing program can achieve the same effects as the information processing device according to the above-described aspect. [Explanation of symbols]

[0061] 100 Information processing device 110 Control section 111 Acquisition Department 112 1st Judgment Department 113 Second Judgment Section 114 Recording Section 115 Output control section 121 Communications Department 122 Storage section 123 Display section 131 Imaging unit 151 Imaging position of imaging unit (information processing device) 152 Imaging direction of the imaging unit 200 companies 201 Server 210 Imaging Conditions 251 Imaging positions recorded in imaging conditions 252 Imaging direction recorded in imaging conditions

Claims

1. An imaging unit; an acquisition unit that acquires imaging conditions including an imaging position and an imaging direction when imaging an object; a first determination unit that determines whether a position of the imaging unit and an imaging direction in which the imaging unit faces correspond to an imaging position and an imaging direction included in the imaging conditions acquired by the acquisition unit; an output control unit that controls, when the first determination unit determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions, to output that the state is suitable for imaging by the imaging unit; and An information processing device comprising:

2. When the first determination unit determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to an imaging condition, the output control unit controls the imaging unit to capture an image of a subject even if a shutter button is not operated. The information processing device according to claim 1 .

3. a second determination unit that determines whether imaging has been performed by the imaging unit after the output control unit has controlled the output, The output control unit controls, when it is determined by the second determination unit that imaging has been performed, to output a signal indicating that imaging is possible by the imaging unit regardless of the imaging conditions acquired by the acquisition unit. The information processing device according to claim 1 .

4. The output control unit outputs a message indicating that imaging is possible by using a sound or an image as an output indicating that imaging is possible by the imaging unit when it is determined by the second determination unit that imaging has been performed. The information processing device according to claim 3 .

5. The output control unit, in response to an output that the state is suitable for imaging by the imaging unit, associates image information generated by imaging the subject with image information in which the position of the imaging unit and the direction in which the imaging unit faces at the time of imaging are recorded, and outputs the image information to an external device. The information processing device according to any one of claims 1 to 4.

6. A storage unit for storing map information relating to a road map; a recording unit that records the image captured by the imaging unit, the position of the imaging unit, and the imaging direction in which the imaging unit faces, in a road map based on map information in correspondence with the position of the imaging unit; The output control unit controls the map information recorded by the recording unit to be output to an external device. The information processing device according to any one of claims 1 to 4.

7. A computer including an imaging unit, An acquisition step of acquiring imaging conditions including an imaging position and an imaging direction when imaging an object; a first determination step of determining whether a position of the imaging unit and an imaging direction in which the imaging unit faces correspond to an imaging position and an imaging direction included in the imaging conditions acquired in the acquisition step; an output control step of controlling to output a state that is suitable for imaging by the imaging unit when it is determined in the first determination step that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions; An information processing method for performing the above.

8. A computer having an imaging unit, An acquisition function for acquiring imaging conditions including an imaging position and an imaging direction when imaging an object; a first determination function that determines whether a position of the imaging unit and an imaging direction in which the imaging unit faces correspond to an imaging position and an imaging direction included in the imaging conditions acquired by the acquisition function; an output control function that controls, when the first determination function determines that the position of the imaging unit and the imaging direction in which the imaging unit faces correspond to the imaging conditions, to output that the state is suitable for imaging by the imaging unit; and An information processing program that realizes this.

Images