Photography management system and photography management method

Abstract

To facilitate a photographing operation of a photographer in the case where a photographer at a site performs photographing of a photographing applicant on a vehicle or near the vehicle from a separated position.SOLUTION: A photographing management system includes a cloud 30 that can control a coordination with a photographer terminal 21 used by a photographer 20 with a user terminal 12 of a photographing applicant 10 who moves by using a user vehicle 11, acquires a photographing image containing bar code 11a or the like applied to a vehicle 11 of the photographing applicant 10 from a camera on a photographer terminal 21 side of the photographer 20, specifies the user vehicle 11 of a photographing object by the bar code 11a in the photographing image, and executes an AR display so that a real time video image of a subject and a display indicating a specific vehicle of a photographing object are overlapped and displayed onto a screen of the photographing terminal 21 to follow a motion in the case where a matching of the vehicle is detected. An irradiation of the vehicle is automatically controlled. The fact that the photographer 20 captures the photographing applicant 10 with the camera is notified to the photographing applicant 10.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention mainly relates to a shooting management system and a shooting management method that can be used when a photographer outside a vehicle shoots a photo or the like of a user using a vehicle.

Background Art

[0002] For example, Patent Document 1 discloses a technique for realizing a service that mediates between a person who wishes to have a photo taken (photo requester) and a person who takes the photo (photographer). Further, as described in paragraph "0033" of Patent Document 1, the server 1 extracts photographers 5 existing around each photo requester 2 using the logged user location information and photographer location information, and can transmit the information of the photographers 5 as surrounding photographer information to the user device 3, and the user device 3 can display the information of the photographers 5 existing around. Also, the photo requester 2 can know whether there is a possibility that a photo will be taken at this location.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, people such as tourists who visit various tourist spots during a trip often hope to create a diary including photos at the tourist spots where they are shown in order to leave memories of the trip. Also, since traffic is often inconvenient at tourist spots, each tourist often rents a vehicle of a rental car at the local area and has many opportunities to tour the tourist spots while driving the vehicle by himself / herself.

[0005] Therefore, when each tourist takes a photo of themselves at various locations, it is assumed that there will be many scenes such as the tourist driving and traveling in a vehicle, the tourist getting in and out of a vehicle, or the tourist sightseeing near the rental car they have rented.

[0006] However, for example, when a tourist is driving a vehicle, they cannot take a photo of themselves. Therefore, it is conceivable to use a service such as the technology of Patent Document 1 and have a local photographer take a photo for the tourist who wishes to take a photo.

[0007] However, assuming a situation where an unknown local photographer identifies and takes a photo with a camera of a person who wishes to take a photo (tourist) driving a moving vehicle or a person who wishes to take a photo standing next to a parked vehicle, there are, for example, the following problems.

[0008] (1) In a state where multiple vehicles are lined up on the same road and traveling in the same direction, it is difficult for the photographer to distinguish which of the multiple vehicles is the target vehicle in which the person who wishes to take a photo is riding. (2) When a photographer outside the vehicle takes a photo of a person who wishes to take a photo inside the vehicle while the person who wishes to take a photo is driving the vehicle, the photographer will feel uneasy because they cannot confirm whether the subject vehicle belongs to the person who wishes to take a photo. Also, since the photographer cannot confirm whether the person who wishes to take a photo is aware of the photography, they will be confused about determining the appropriate timing to press the shutter. (3) In a situation where multiple vehicles are parked together with multiple people in a parking lot at a tourist destination, a photographer who is at a distance and does not know the face of the person who wishes to take a photo cannot easily identify which of the multiple vehicles is the vehicle of the person who wishes to take a photo and which of the people is the person who wishes to take a photo. (4) When a photographer outside the vehicle takes a photo of a person who wishes to take a photo inside the vehicle while the person who wishes to take a photo is driving or parked, the interior of the vehicle is darker than the outside, so it is difficult to clearly photograph the person who wishes to take a photo inside the vehicle as a photo. Therefore, the quality of the photo taken deteriorates. (5) When a photographer outside the vehicle takes a picture while the person who wishes to be photographed is driving the vehicle, if the person who wishes to be photographed does not recognize in advance the location of the photographer or the shooting position, etc., there is a high possibility that the picture will be taken with the face direction of the person who wishes to be photographed not being in a suitable state for shooting. As a result, the value of the photographed picture decreases. (6) When a photographer outside the vehicle takes a picture while the person who wishes to be photographed is driving the vehicle, the person who wishes to be photographed is likely to look around while driving to search for the photographer, making it difficult to maintain a safe driving state due to distracted driving.

[0009] The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a shooting management system and a shooting management method that are useful for facilitating the shooting operation of a photographer when the photographer at the site takes a picture with a camera from a position away from a person who wishes to be photographed on the vehicle or a person who wishes to be photographed near the vehicle.

Means for Solving the Problems

[0010] The above object according to the present invention is achieved by the following configuration. (1) A communication control unit capable of controlling the cooperation between a first communication terminal used by a specific person who wishes to be photographed and who can move using a vehicle, and a second communication terminal used by a photographer who can photograph the person who wishes to be photographed with a camera, The communication control unit, An image acquisition function for acquiring an image including unique pattern information previously assigned to a specific vehicle associated with the person who wishes to be photographed from a camera on the second communication terminal side, An object recognition function for identifying whether there is a match between the photographed image and the specific vehicle based on the photographed image and the information acquired from the first communication terminal, When a match between the photographed image and the specific vehicle is recognized, a shooting target instruction function for instructing the second communication terminal to output at least one of a display indicating that the vehicle in the photographed image is the specific vehicle on which the person who wishes to be photographed is riding or an audio indicating that it is the specific vehicle, A shooting management system comprising the above.

[0011] Secure a communication path so that communication can be established between a first communication terminal used by a specific person who wishes to take a photo and can move using a vehicle, and a second communication terminal used by a photographer who can photograph the person who wishes to be photographed with a camera. Obtain a photographed image including unique pattern information previously assigned to a specific vehicle associated with the person who wishes to be photographed from a camera on the second communication terminal side. Based on the photographed image and the information obtained from the first communication terminal, identify whether there is a match between the photographed image and the specific vehicle. When recognizing a match between the photographed image and the specific vehicle, instruct the second communication terminal to output at least one of a display indicating that the vehicle in the photographed image is the specific vehicle on which the person who wishes to be photographed is riding or an audio indicating that it is the specific vehicle. Photographing management method.

Effect of the Invention

[0012] According to the photographing management system and method of the present invention, when a person who wishes to be photographed on a vehicle or a person who wishes to be photographed near a vehicle is photographed with a camera by a local photographer from a remote location, the photographing operation of the photographer becomes easier.

[0013] The present invention has been briefly described above. Further, the details of the present invention will be further clarified by reading through the embodiments for carrying out the invention described below (hereinafter referred to as "embodiments") with reference to the accompanying drawings.

Brief Description of the Drawings

[0014]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0015] Specific embodiments of the present invention will be described below with reference to the respective figures.

[0016] The outline of the configuration of the shooting management system 100 in the embodiment of the present invention is shown in FIG. 1. The shooting management system 100 shown in FIG. 1 includes a user terminal 12 used by a service user 10, a photographer terminal 21 used by a photographer 20, and a cloud 30 that provides the main functions of the management service.

[0017] In the example shown in FIG. 1, the service user 10 is a tourist who tours at a tourist destination and uses a user vehicle 11 as a means of moving around the various places of the tourist destination. This user vehicle 11 is, for example, a rental car, and a barcode 11a that can distinguish each vehicle is attached to the outer surface of the vehicle body. The information of this barcode 11a can be optically read using a camera or the like.

[0018] In addition, instead of the general barcode 11a with a one-dimensional pattern, it is also possible to use a two-dimensional pattern or other unique patterns to distinguish a specific user vehicle 11. The photographer 20 is an ordinary local resident living in various parts of the tourist destination or a professional cameraman who happens to be present at the location.

[0019] The user terminal 12 is, for example, a smartphone and is equipped with various communication functions, a camera, a display, various input devices, a GPS (Global Positioning System) receiver, a control unit (CPU), a storage device, etc., similar to a general smartphone.

[0020] Also, a service-specific app 13 for using the functions of the cloud 30 is pre-installed in the user terminal 12. This service-specific app 13 has functions such as position information transmission, photo upload, shooting request, photo viewing / evaluation, and album request.

[0021] For example, when the service user 10 is moving using the user vehicle 11, a service request for having their own photo taken by an arbitrary photographer 20 can be sent to the cloud 30 using the user terminal 12 and the service-specific app 13.

[0022] The photographer terminal 21 used by the photographer 20 is, for example, a smartphone and is equipped with various communication functions, a camera, a display, various input devices, a GPS receiver, a control unit, a storage device, etc., similar to a general smartphone.

[0023] Also, a photography-specific app 22 for the photographer 20 to use the functions of the cloud 30 is pre-installed in the photographer terminal 21. This photography-specific app 22 has functions such as a position information transmission function, a photo shooting function, a cloud storage function for the taken photos, a barcode recognition function, a marking / AR (augmented reality) display function, etc.

[0024] On one hand, the cloud 30 is constituted by, for example, application software (app) incorporated on a server device installed in a predetermined data center. Further, this server device has a function for communicating with the user terminal 12 and the photographer terminal 21 via the public communication line 40, respectively. Further, the cloud 30 of the present embodiment includes a matching processing unit 31, a photo data storage unit 32, and an album creation processing unit 33.

[0025] The matching processing unit 31 has a processing function necessary to realize smooth matching for photo shooting between the service user 10 who wishes to have a photo taken and the photographers 20 registered in advance in various places. The photo data storage unit 32 can store data such as photos taken by the photographer 20. The album creation processing unit 33 performs processing for creating a photo album.

[0026] <Position relationship between service user and photographer> An example of the position relationship between the service user 10 and the photographer 20 is shown in FIG. 2. The service user 10 uses a user vehicle 11 such as a rental car as shown in FIG. 2, for example, and moves while sightseeing from point A to point Z on the road 50. At each point on the road 50 during the movement, the service user 10 may request to take a memorable photo.

[0027] In addition, in tourist destinations and the like, local residents and the like may exist as photographers 20 in various places. Further, each photographer terminal 21 possessed by each photographer 20 has functions such as a camera function for taking photos like a smartphone, a function for grasping the current position of the photographer by GPS, and a function for communicating with the cloud 30.

[0028] When the service user 10 wishes to take a photo, by operating the service - dedicated app 13 of the user terminal 12, the service user 10 can transmit a photo - shooting request together with the position information of the vehicle to the cloud 30.

[0029] Since the matching processing unit 31 of the cloud 30 grasps the current positions of the photographers 20 existing at each location, it can match each service user 10 with a specific photographer 20 by using the current position of the user vehicle 11 of the service user 10 who sent the photo shooting request, the current positions of the photographers 20, the information of the road map, and the like.

[0030] For example, by the matching processing unit 31 of the cloud 30 automatically controlling the lighting of indoor lighting, headlights, etc. for the user vehicle 11 of a specific service user 10, the photographer 20 can easily visually confirm the user vehicle 11 to be photographed.

[0031] Also, as shown in FIG. 1, the photographer 20 can read the barcode 11a on the user vehicle 11 with the camera of the photographer terminal 21 and transmit the information of the barcode 11a from the photographer terminal 21 to the cloud 30.

[0032] Since the matching processing unit 31 of the cloud 30 has grasped the information of the barcode 11a of the user vehicle 11 in advance, by comparing this information with the information of the barcode 11a transmitted by the photographer 20, it can be identified whether the vehicle of the subject that the photographer 20 is aiming the camera at matches the user vehicle 11 of the service user 10.

[0033] Based on the information transmitted from the matching processing unit 31, the dedicated shooting application 22 on the photographer terminal 21 adds marking information to the user vehicle 11 to be photographed within the display of the photographer terminal 21, and executes AR display in a state where the video of the user vehicle 11 of the subject and the marking information are superimposed. With this AR display, the photographer 20 can easily photograph the service user 10 without misidentifying the user vehicle 11 to be photographed.

[0034] Note that the user terminal 12 and the photographer terminal 21 usually access the cloud 30 using the public communication line 40 respectively and communicate via the cloud 30. On the other hand, when the distance between the user terminal 12 and the photographer terminal 21 is close, direct communication 42 can also be performed without relaying through the cloud 30.

[0035] On the other hand, when the photographer 20 actually photographs the user vehicle 11 in motion and the service user 10, there may be cases where a beautiful photo cannot be taken due to various factors. For example, when photographing at a state where the traveling speed of the user vehicle 11 is too fast, failures such as the timing of shooting, alignment, focusing, and light quantity adjustment are likely to occur. Furthermore, when another preceding vehicle is traveling in front of the user vehicle 11 which is the object to be photographed, if the distance between the user vehicle 11 and the preceding vehicle is close, it is highly possible that the preceding vehicle covers the user vehicle 11 and they are photographed simultaneously, resulting in a deterioration in the quality of the photographed photo.

[0036] Therefore, the shooting management system 100 is also equipped with a vehicle control system for realizing an appropriate shooting environment in cooperation with the cloud 30 and the user vehicle 11. For example, when the user vehicle 11 approaches the shooting location, the accelerator operation is restricted or an automatic braking operation is performed so that the traveling speed of the user vehicle 11 does not increase. Alternatively, guidance is provided by display, voice, etc. so that the driver of the user vehicle 11 performs such driving. Also, when the distance between the user vehicle 11 and the preceding vehicle is close, control is performed to increase the distance between the vehicles.

[0037] <Operation of the system according to different situations> An overview of the respective operating states of the shooting management system 100 in the three types of situations shown in FIG. 1 is shown in FIGS. 3 to 5.

[0038] <When the distance between the user vehicle 11 and the photographer 20 is far apart> As shown in FIG. 3, the service user 10 on the user vehicle 11 can communicate with the cloud 30 via the user terminal 12 and the public communication line 40, and can send a request for taking a photo to the service of the cloud 30 together with the information on the current position of the user vehicle 11. The current position of the user vehicle 11 is updated, for example, periodically by positioning using GPS, and is periodically transmitted to the cloud 30.

[0039] Also, when the photographers 20 existing in various places start the dedicated photography app 22 on the photographer terminals 21, the position information of the photographers 20 is transmitted to the cloud 30 using the public communication line 40. The cloud 30 grasps the mutual distance based on the position information on the service user 10 side and the position information on the photographer 20 side, and executes matching according to the distance.

[0040] <When the user vehicle 11 approaches the position of the photographer 20> When the user vehicle 11 approaches the position of the photographer 20, since the user vehicle 11 can be visually recognized from the position of the photographer 20, as shown in FIG. 4, the photographer 20 can take a photo of the user vehicle 11 with the camera of the photographer terminal 21 and read the barcode 11a of the user vehicle 11.

[0041] The dedicated photography app 22 of the photographer terminal 21 transmits the information on the barcode 11a read from the user vehicle 11 to the cloud 30 via the public communication line 40. Since the cloud 30 has previously grasped the content of the barcode 11a of the user vehicle 11 associated with the service user 10, it can identify whether the information on the barcode 11a transmitted from the photographer 20 matches the user vehicle 11 of the service user 10.

[0042] When the information of barcode 11a matches the user vehicle 11 of service user 10, under the control of cloud 30 and dedicated shooting app 22, an AR display of the target vehicle is executed on the display of shooter terminal 21. That is, it is displayed in a state where the real-time video of the subject being shot by the camera of shooter terminal 21 is superimposed with a mark indicating that user vehicle 11 recognized by barcode 11a is the vehicle to be shot. Thereby, shooter 20 can easily recognize user vehicle 11 to be shot.

[0043] <When service user 10 gets out of user vehicle 11> When shooter 20 approaches service user 10 for the purpose of shooting, as shown in Fig. 5, it becomes possible to perform short-distance wireless communication between shooter terminal 21 and user terminal 12. As a specific example of short-distance wireless communication, UWB (Ultra Wide Band), Wi-Fi (registered trademark), etc. can be used.

[0044] Therefore, shooting management system 100 can execute the processing of the shooting service by using both direct communication between shooter terminal 21 and user terminal 12 and communication using cloud 30. The dedicated shooting app 22 of shooter terminal 21 executes an AR display of service user 10 on the display of shooter terminal 21. For example, on the real-time video of the subject shot by the camera of shooter terminal 21, a target person mark such as a rectangular frame indicating that the person to be shot is service user 10 who wishes to shoot is superimposed on the area surrounding service user 10 in the video.

[0045] <Main functions and communication paths> An example of the main functions and communication paths in shooting management system 100 is shown in Fig. 6. As shown in FIG. 6, the photographer 20 and the cloud 30 can be connected via the respective paths of communications C01, C02, and C03. That is, the photographer terminal 21 or the dedicated photographing application 22 can transmit the position information of the photographer 20, the camera video of the photographer terminal 21, various request information, etc. to the matching processing unit 31 of the cloud 30 via the path of C03. Also, the photographer terminal 21 or the dedicated photographing application 22 can transmit the data of the photo taken by the photographer 20 with his / her camera to the photo data storage unit 32 of the cloud 30 via the path of communication C01.

[0046] In addition, the matching processing unit 31 of the cloud 30 can transmit service registration information, matching result information, AR processing results, incentive information, etc. to the photographer terminal 21 or the dedicated photographing application 22.

[0047] Also, when the distance between the photographer 20 and the service user 10 is short, email messages, various requests, and guidance information can be mutually transmitted and received between the dedicated photographing application 22 and the dedicated service application 13 via the path of communication C04 using direct communication 42. Further, the dedicated photographing application 22 can read the barcode 11a of the user vehicle 11 used by the service user 10 based on the camera video CP taken by the camera of the photographer terminal 21.

[0048] In addition, between the user terminal 12, the dedicated service application 13, or the user vehicle 11 of the service user 10 and the cloud 30, they can be connected via the respective paths of communications C05 to C10 using the public communication line 40.

[0049] The matching processing unit 31 of the cloud 30 can transmit on / off instructions for the headlight and room lamp of the user vehicle 11 via the path of communication C05. Also, the user vehicle 11 can transmit vehicle information, information on the current position of the vehicle, driving history information, etc. to the matching processing unit 31 via the path of communication C06. Note that for the communication between the user vehicle 11 and the cloud 30, it may be relayed by the user terminal 12 and the dedicated service application 13.

[0050] The user terminal 12 or the service dedicated application 13 can transmit service registration information, location information, album requests, photo evaluations, service termination requests, etc. to the matching processing unit 31 of the cloud 30 via the communication path C07.

[0051] Also, the matching processing unit 31 can transmit the matching processing result to the user terminal 12 or the service dedicated application 13 via the communication path C08. The album creation processing unit 33 of the cloud 30 can provide album data and photo data on the cloud 30 to the service dedicated application 13 via the communication path C09. Also, the service dedicated application 13 can transmit the photo data captured by the user terminal 12 to the photo data storage unit 32 of the cloud 30 via the communication path C10.

[0052] Also, the matching processing unit 31 of the cloud 30 can send an album creation instruction to the album creation processing unit 33 via the communication path C11 according to the album request from the service dedicated application 13. The album creation processing unit 33 can create an album of the photos held by the photo data storage unit 32 according to the album creation instruction from the matching processing unit 31. The created album can be stored in the photo data storage unit 32.

[0053] <Processing procedure of the shooting management system> Examples of the processing procedures of the shooting management system 100 in three types of states are shown in FIGS. 7 to 9 respectively. The processing procedures shown in FIGS. 7 to 9 will be described below.

[0054] <When the distance between the user vehicle 11 and the photographer 20 is large> As shown in FIG. 7, the dedicated shooting application 22 on the photographer terminal 21 of the photographer 20 transmits information on the current position of the photographer terminal 21 to the cloud 30, for example, periodically (S11).

[0055] The service dedicated application 13 on the user terminal 12 held by the service user 10 transmits information on the current position of the user terminal 12 or the current position of the user vehicle 11 to the cloud 30, for example, periodically (S12).

[0056] The matching processing unit 31 of the cloud 30 notifies the photographer terminal 21 of the photographer 20 in real time of the current position of the service user 10, and also notifies the user terminal 12 of the service user 10 in real time of the current position of the photographer 20 (S13).

[0057] The matching processing unit 31, the service dedicated application 13, or the photography dedicated application 22 grasps the distance between the position of the service user 10 and the position of the photographer 20, and compares this distance with a specified value (for example, 500 m) in S14. If the distance is less than or equal to the specified value, the process proceeds to S15. If the distance exceeds the specified value, the process returns to the process of S11.

[0058] The photography management system 100 notifies both the service user 10 and the photographer 20 that the user vehicle 11 of the service user 10 is approaching the photography point (S15). This process is executed by at least one of the matching processing unit 31, the service dedicated application 13, and the photography dedicated application 22.

[0059] The matching processing unit 31 identifies in S16 whether there is a photography service request from the service dedicated application 13 of the service user 10. If the service user 10 requests a photography service, the process proceeds from S16 to the process of S17. If there is no request, the process proceeds to the process of S18.

[0060] The matching processing unit 31 or the service dedicated application 13 gives an instruction to the lighting system of the user vehicle 11 in S17, and automatically turns on both the headlight and the room lamp of the user vehicle 11. By the illumination of the headlight of the user vehicle 11, the photographer 20 can easily visually recognize the user vehicle 11 in which the service user 10 to be photographed is riding. Also, by turning on the room lamp, it becomes easy to take a clear photo with a bright interior. The matching processing unit 31 or the photography dedicated application 22 notifies the photographer 20 that the service user 10 has rejected the photography service (S18).

[0061] <When the user vehicle 11 approaches the photographer 20> As shown in FIG. 8, the dedicated shooting application 22 on the shooter terminal 21 of the shooter 20 transmits information on the current position of the shooter terminal 21 to the cloud 30, for example, periodically (S21).

[0062] The dedicated service application 13 on the user terminal 12 held by the service user 10 transmits information on the current position of the user terminal 12 or the current position of the user vehicle 11 to the cloud 30, for example, periodically (S22).

[0063] The matching processing unit 31 of the cloud 30 notifies the shooter terminal 21 of the shooter 20 of the current position of the service user 10 in real time, and notifies the user terminal 12 of the service user 10 of the current position of the shooter 20 in real time (S23).

[0064] The dedicated shooting application 22 is launched on the shooter terminal 21 of the shooter 20 (S24). Here, the shooter 20 operates to direct the camera of the shooter terminal 21 at the target user vehicle 11 to which the barcode 11a is attached and the headlights and room lamp are lit. A real-time video captured by the camera is displayed on the display of the shooter terminal 21. The dedicated shooting application 22 transmits the captured video including the barcode 11a to the cloud 30 in real time.

[0065] The matching processing unit 31 of the cloud 30 recognizes the barcode 11a in the real-time video input from the dedicated shooting application 22 of the shooter 20, and compares the recognition result of the barcode with the information of the barcode of the user vehicle 11 used by the service user 10 (S25). If the two match, the process proceeds from S25 to S26; if they do not match, the process of S24 is repeated.

[0066] The matching processing unit 31 of the cloud 30 processes so that the position of the user vehicle 11 where the barcode information matches and the position of the photographer 20 are matched, and notifies the dedicated shooting app 22 and the dedicated service app 13 of the position information of the other party in real time (S26). Based on the position information transmitted from the matching processing unit 31, the dedicated shooting app 22 specifies the area of the user vehicle 11 to be photographed in the image frame being photographed by the camera of the photographer terminal 21, and executes AR display so as to follow the movement of the user vehicle 11 in the image frame in real time. For example, it is displayed in a state where a mark such as a rectangular pattern is superimposed on a position surrounding the video of the user vehicle 11 in the image frame (see FIG. 4).

[0067] The dedicated shooting app 22 on the photographer terminal 21 of the photographer 20 uses the public communication line 40 or the direct communication 42 to notify the dedicated service app 13 of the service user 10 of the necessary information (S27). The content of the information to be notified is configured so that the service user 10 can understand "the fact that the photographer 20 is capturing the user vehicle 11 with the camera while confirming the AR display", the location of the photographer 20, and "the request for the service user 10 to face the direction of the photographer 20".

[0068] Therefore, the photographer 20 can easily grasp that the shooting target he / she is aiming the camera at is the user vehicle 11 in which the target service user 10 is riding by the AR display on the display screen of the photographer terminal 21, and can take a photo. In addition, since the room lamp of the user vehicle 11 to be photographed is lit, the photographer 20 can take a clear photo with the interior of the user vehicle 11 being bright.

[0069] Also, before the photographer 20 takes a photo and plans to take a photo of the service user 10 from now on, and notifies the service user 10 of the location of the photographer 20 (S27), the service user 10 can take actions suitable for photo shooting. For example, the driving speed of the user vehicle 11 can be reduced to ensure safety, and the orientation of the face and line of sight of the service user 10 can be directed towards the direction of the camera of the photographer 20 at an appropriate timing.

[0070] <When the distance between the service user 10 and the photographer 20 approaches after the service user 10 gets off the vehicle> As shown in FIG. 9, the dedicated shooting app 22 on the photographer terminal 21 of the photographer 20 transmits information on the current position of the photographer terminal 21 to the cloud 30, for example, periodically (S31).

[0071] The dedicated service app 13 on the user terminal 12 held by the service user 10 transmits information on the current position of the user terminal 12 to the cloud 30, for example, periodically (S32). The matching processing unit 31 of the cloud 30 notifies the current position of the service user 10 to the photographer terminal 21 of the photographer 20 in real time, and notifies the current position of the photographer 20 to the user terminal 12 of the service user 10 in real time (S33).

[0072] The dedicated shooting app 22 is launched on the photographer terminal 21 of the photographer 20 (S34). Here, since the photographer 20 grasps the positional relationship between the current position of the service user 10 and his own position based on the information notified from the cloud 30, the photographer 20 can operate to direct the camera of the photographer terminal 21 towards the target service user 10.

[0073] Therefore, a real-time video including the service user 10 captured by the camera is displayed on the display of the photographer terminal 21. Also, the dedicated shooting app 22 transmits the captured video to the cloud 30 in real time (S34).

[0074] The matching processing unit 31 of the cloud 30 analyzes the real-time video input from the dedicated shooting app 22 of the photographer 20 to recognize people. Furthermore, based on the current position of the service user 10 input from the dedicated service app 13, the position of the photographer 20 input from the dedicated shooting app 22, the orientation of the camera, etc., it compares whether the person in the real-time video matches the service user 10 who is the shooting target (S35).

[0075] If the person in the real-time video matches the service user 10 who is the shooting target, the process proceeds from S35 to S36; if not, the process of S34 is repeated. The matching processing unit 31 of the cloud 30 associates the person who has matched the service user 10 who is the shooting target with the position of the person in the real-time video so as to match, and notifies the dedicated shooting app 22 of the position information in real time (S36).

[0076] Based on the position information sent from the matching processing unit 31, the dedicated shooting app 22 identifies the area of the service user 10 who is the shooting target within the image frame captured by the camera of the photographer terminal 21, and performs AR display so as to follow the movement of the service user 10 in the image frame in real time. For example, it is displayed in a state where a mark such as a rectangular pattern is superimposed on the position surrounding the video of the service user 10 in the image frame (see FIG. 5).

[0077] The dedicated shooting app 22 on the photographer terminal 21 of the photographer 20 uses the public communication line 40 or the direct communication 42 to notify the dedicated service app 13 of the service user 10 of the necessary information (S37). The content of the information to be notified is configured so that the service user 10 can understand "the fact that the photographer 20 is capturing the service user 10 with the camera while confirming the AR display", the location of the photographer 20, and "the request for the service user 10 to face the direction of the photographer 20".

[0078] Note that the present invention is not limited to the above-described embodiments, and can be appropriately modified, improved, etc. In addition, the material, shape, dimensions, number, arrangement location, etc. of each component in the above-described embodiments are arbitrary as long as the present invention can be achieved, and are not limited.

[0079] For example, in the above-described shooting management system 100, the photographer 20 uses the barcode 11a attached to the body surface of the target user vehicle 11 to recognize the user vehicle 11. However, a unique pattern other than the barcode optically readable by the camera may be used instead of the barcode 11a. Further, for example, a function of recognizing the body shape and the difference in vehicle type of the user vehicle 11 from the appearance in the video captured by the camera may be used in combination with the reading of the barcode 11a.

[0080] In the above-described shooting management system 100, the real-time video of the subject captured by the camera of the photographer terminal 21 and the mark indicating that the user vehicle 11 recognized by the barcode 11a is the vehicle to be photographed are displayed in a superimposed state. However, the number, color, vehicle type, position such as "the vehicle in front" and "the vehicle on the right side" of the user vehicle 11 may be notified to the photographer terminal 21 by characters or voice. Alternatively, the photographer terminal 21 may be notified that the superimposed vehicle matches the target user vehicle 11 by characters such as "correct", symbols such as "〇" and "×", voices or chimes indicating correct or incorrect.

[0081] As described above, according to the imaging management system 100 of the present embodiment, since the photographer 20 can identify the user vehicle 11 to be imaged based on the barcode 11a or the like, even when a plurality of vehicles are running side by side on the road, the photographer 20 can easily perform imaging without misidentifying the imaging target. In particular, since a mark or the like representing the user vehicle 11 to be imaged is AR-displayed together with the subject image on the display screen of the photographer terminal 21, or a voice indicating that it is the user vehicle 11 to be imaged is output to the photographer terminal 21, even when another vehicle appears near the user vehicle 11 or when the photographer 20 changes the direction of the camera, the photographer 20 can be prevented from losing sight of the user vehicle 11 to be imaged.

[0082] In addition, since the headlight and the room lamp of the user vehicle 11 to be imaged are turned on before approaching the photographer 20 (S17), the photographer 20 can easily distinguish the user vehicle 11 to be imaged from other vehicles even when the distance is relatively far. In addition, since the user vehicle 11 to be imaged turns on the room lamp, the photographer 20 can image the service user 10 with the interior of the vehicle being bright. As a result, an improvement in the quality of the photographed picture can be expected.

[0083] In addition, since the imaging management system 100 notifies the service user 10 of the necessary information before the photographer 20 performs imaging (S27), the service user 10 can take actions suitable for photographing while driving. For example, the service user 10 can accurately grasp the relative position of the photographer 20 with respect to his own position and direct the face and the direction of the line of sight toward the camera. In addition, the service user 10 can grasp the timing of imaging and reduce the running speed of the user vehicle 11 or take actions necessary for ensuring safety.

[0084] Here, the features of the imaging management system and the imaging management method according to the above-described embodiment of the present invention are briefly summarized and listed in [1] to [6] below, respectively. [1] A communication control unit (cloud 30) that can control the cooperation between a first communication terminal (user terminal 12) used by a specific photography requester (service user 10) who can move using a vehicle (user vehicle 11) and a second communication terminal (photographer terminal 21) used by a photographer (20) who can photograph the photography requester with a camera. The communication control unit An image acquisition function (S24) that acquires a photographed image including unique pattern information (barcode 11a) previously assigned to a specific vehicle associated with the photography requester from the camera on the second communication terminal side. An object recognition function (S25) that identifies whether there is a match between the photographed image and the specific vehicle based on the photographed image and the information acquired from the first communication terminal. When it is recognized that the photographed image and the specific vehicle match, a photographing target instruction function (S26) that instructs the second communication terminal to output at least one of a display indicating that the vehicle in the photographed image is the specific vehicle on which the photography requester is riding or a voice indicating that it is the specific vehicle. A photographing management system (100) comprising the above.

[0085] According to the photographing management system having the configuration of [1] above, by recognizing the unique pattern information, the vehicle to be photographed by the photographer can be surely identified. In addition, since a mark indicating the specific vehicle to be photographed is displayed on the photographer's screen or notified by voice, even when a plurality of vehicles are traveling on the same road at the same time, the photographer can easily identify the specific vehicle to be photographed.

[0086] [2] The photographing target instruction function instructs the second communication terminal to superimpose a display indicating that it is the specific vehicle on the screen. The photographing management system according to [1] above.

[0087] According to the photographing management system having the configuration of [2] above, since a mark indicating the specific vehicle to be photographed is superimposed on the photographer's screen together with the image of the subject, even when a plurality of vehicles are traveling on the same road at the same time, the photographer can easily identify the specific vehicle to be photographed.

[0088] [3] After receiving information indicating that the photographer has confirmed the subject to be photographed, the communication control unit has a photographing illumination control unit (S17) that transmits an instruction to turn on the illumination on the specific vehicle to the first communication terminal. The photographing management system according to [1] above.

[0089] According to the photographing management system having the configuration of [3] above, at least during photographing, the illumination in the specific vehicle that is the subject to be photographed automatically turns on, so that the photographer can always perform photographing with the interior of the vehicle being bright. Therefore, a person to be photographed inside the vehicle can be photographed as a clear picture.

[0090] [4] After receiving information indicating that the photographer has confirmed the subject to be photographed, the communication control unit has a photographing preparation notification unit (S27) that transmits a notification indicating that the photographer's camera has captured the person who wishes to be photographed to the first communication terminal. The photographing management system according to [1] above.

[0091] According to the photographing management system having the configuration of [4] above, it becomes easier for the person who wishes to be photographed to take actions suitable for photographing before photographing. For example, the person who wishes to be photographed can accurately grasp the relative position of the photographer with respect to their own position and direct their face and line of sight towards the camera. Also, the person who wishes to be photographed can grasp the timing of photographing and reduce the running speed of their own vehicle or take actions necessary for ensuring safety.

[0092] [5] When the communication control unit detects that the specific vehicle has entered an area where it can be photographed based on the position information of the specific vehicle and the position information of the camera on the second communication terminal side, the communication control unit has a notification illumination control unit (S17) that controls the illumination on the specific vehicle to notify the photographer that it is the vehicle to be photographed. The photographing management system according to [1] above.

[0093] According to the shooting management system configured as described in [5] above, even when the vehicle to be photographed is located at a position relatively far from the position of the photographer, the photographer can easily distinguish the corresponding vehicle from other vehicles based on the difference in lighting.

[0094] [6] Ensure a communication path (public communication line 40, direct communication 42) so that a first communication terminal (user terminal 12) used by a specific shooting applicant (service user 10) who can move using a vehicle (user vehicle 11) can cooperate with a second communication terminal (photographer terminal 21) used by a photographer (20) who can photograph the shooting applicant with a camera. Acquire a photographed image including unique pattern information (barcode 11a) previously assigned to a specific vehicle associated with the shooting applicant from the camera on the second communication terminal side (S24). Based on the photographed image and the information obtained from the first communication terminal, identify whether there is a match between the photographed image and the specific vehicle (S25). When recognizing a match between the photographed image and the specific vehicle, instruct at least one of a display indicating that the vehicle in the photographed image is the specific vehicle on which the shooting applicant is riding or an output of a voice indicating that it is the specific vehicle to the second communication terminal (S26). Shooting management method.

[0095] According to the shooting management method of the procedure described in [6] above, by recognizing unique pattern information, the photographer can surely identify the vehicle to be photographed. In addition, since a mark representing the specific vehicle to be photographed is superimposed and displayed on the screen on the photographer's side together with the image of the subject or notified by voice, even when a plurality of vehicles are running on the same road at the same time, the photographer can easily identify the specific vehicle to be photographed.

Explanation of symbols

[0096] 10 Service user 11 User vehicle 11a Barcode 12 User terminal 13 Service dedicated application 20 Photographer 21 Photographer's terminal 22 Dedicated photography app 30 Cloud 31 Matching processing unit 32 Photo data storage unit 33 Album creation processing unit 40 Public communication line 42 Direct communication 100 Photography management system CP Camera video

Claims

1. A communication control unit capable of controlling the cooperation between a first communication terminal used by a specific person who wishes to be photographed and can move using a vehicle, and a second communication terminal used by a photographer who can photograph the person who wishes to be photographed with a camera, The communication control unit, An imaging image acquisition function of acquiring an imaging image including unique pattern information previously assigned to a specific vehicle associated with the person who wishes to be photographed from a camera on the second communication terminal side, An object recognition function of identifying whether there is a match between the imaging image and the specific vehicle based on the imaging image and information acquired from the first communication terminal, When recognizing a match between the imaging image and the specific vehicle, a photographing target instruction function of instructing the second communication terminal to output at least one of a display indicating that the vehicle in the imaging image is the specific vehicle on which the person who wishes to be photographed is riding or a voice indicating that it is the specific vehicle, A photographing management system comprising the above.

2. The photographing target instruction function instructs the second communication terminal to perform a superimposed display on a screen of a display indicating that it is the specific vehicle. The photographing management system according to Claim 1.

3. The communication control unit has a photographing illumination control unit that transmits an instruction to turn on the illumination on the specific vehicle to the first communication terminal after receiving information indicating that the photographer has confirmed the photographing target. The photographing management system according to Claim 1.

4. The communication control unit has a photographing preparation notification unit that transmits a notification indicating that the camera of the photographer has captured the person who wishes to be photographed to the first communication terminal after receiving information indicating that the photographer has confirmed the photographing target. The photographing management system according to Claim 1.

5. When the communication control unit detects that the specific vehicle has entered an area where it can be photographed based on the position information of the specific vehicle and the position information of the camera on the second communication terminal side, it controls the lighting on the specific vehicle to notify the photographer that the vehicle is the subject to be photographed, and has a notification lighting control unit. The photographing management system according to claim 1.

6. A communication path is secured so as to enable cooperation between a first communication terminal used by a specific photographer who can move using a vehicle and a second communication terminal used by a photographer who can photograph the photographer with a camera. An image of a photograph including unique pattern information previously assigned to a specific vehicle associated with the photographer is acquired from a camera on the second communication terminal side. Based on the photographed image and the information acquired from the first communication terminal, it is determined whether there is a match between the photographed image and the specific vehicle. When the match between the photographed image and the specific vehicle is recognized, at least one of an output of a display indicating that the vehicle in the photographed image is the specific vehicle on which the photographer is riding or an audio indicating that it is the specific vehicle is instructed to the second communication terminal. Photographing management method.

Images