Photographing management system and photographing management method

JP2024157975AActive Publication Date: 2024-11-08YAZAKI CORP
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2023072688
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-26
Publication Date
2024-11-08
Estimated Expiration
2043-04-26

AI Technical Summary

Benefits of technology

【0012】 本発明の撮影管理システム及び撮影管理方法によれば、車両上の撮影希望者、又は車両のそばにいる撮影希望者を離れた位置から現地の撮影者がカメラで撮影する場合に、撮影者の撮影操作が容易になる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024157975000001_ABST
    Figure 2024157975000001_ABST
Patent Text Reader

Abstract

To facilitate a photographing operation of a photographer in the case where a photographer at a site performs photographing of a photographing applicant on a vehicle or near the vehicle from a separated position.SOLUTION: A photographing management system includes a cloud 30 that can control a coordination with a photographer terminal 21 used by a photographer 20 with a user terminal 12 of a photographing applicant 10 who moves by using a user vehicle 11, acquires a photographing image containing bar code 11a or the like applied to a vehicle 11 of the photographing applicant 10 from a camera on a photographer terminal 21 side of the photographer 20, specifies the user vehicle 11 of a photographing object by the bar code 11a in the photographing image, and executes an AR display so that a real time video image of a subject and a display indicating a specific vehicle of a photographing object are overlapped and displayed onto a screen of the photographing terminal 21 to follow a motion in the case where a matching of the vehicle is detected. An irradiation of the vehicle is automatically controlled. The fact that the photographer 20 captures the photographing applicant 10 with the camera is notified to the photographing applicant 10.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a photography management system and a photography management method that can be used mainly when a photographer outside a vehicle takes photographs of a user who uses the vehicle. [Background technology]

[0002] For example, Patent Document 1 discloses a technology for realizing a service that mediates between people who want to have their photos taken (photo seekers) and people who take photos (photographers). As described in paragraph "0033" of Patent Document 1, the server 1 can use logged user location information and photographer location information to extract photographers 5 present in the vicinity of each photo seeker 2, and transmit information on the photographers 5 to the user device 3 as surrounding photographer information, and the user device 3 can display information on the surrounding photographers 5. Also, the photo seeker 2 can know whether there is a possibility that a photo will be taken at this location. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-16100 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, people such as tourists who visit various tourist spots during their travels often wish to create a diary that includes photos of themselves at the tourist spots in order to keep memories of their trip. In addition, since transportation is often inconvenient at tourist spots, it is likely that each tourist will have many opportunities to rent a car locally and drive the car around the tourist spots by themselves.

[0005] Therefore, when tourists take photographs of themselves in various locations, it is expected that many of the scenes will involve the tourists driving the vehicle themselves, getting in and out of the vehicle, or sightseeing near the rental car they have rented.

[0006] However, for example, tourists cannot take their own photos while driving the vehicle. Therefore, it is conceivable that tourists who wish to take photos can use a service such as the technology of Patent Document 1 to have a local photographer take their photos.

[0007] However, assuming that an unknown local photographer identifies and photographs a person (tourist) driving a moving vehicle or a person standing next to a parked vehicle, there are problems, such as the following:

[0008] (1) When multiple vehicles are traveling in the same direction along the same road, it is difficult for a photographer to distinguish which of the multiple vehicles is the intended vehicle in which the person wishing to be photographed is riding. (2) When a person wishing to be photographed is driving a vehicle and a photographer outside the vehicle photographs the person wishing to be photographed inside the vehicle, the photographer cannot be sure that the subject's vehicle is indeed that of the person wishing to be photographed, which makes the photographer feel uneasy. In addition, the photographer cannot be sure that the person wishing to be photographed is aware that he or she is being photographed, which makes the photographer unsure of the appropriate timing to press the shutter. (3) In a parking lot at a tourist spot or the like where multiple vehicles are parked with multiple people, a photographer who is located at a distance and does not know the faces of the people wishing to be photographed cannot easily identify which of the multiple vehicles is the vehicle of the people wishing to be photographed and which people are the people wishing to be photographed. (4) When a person who wishes to be photographed is driving a vehicle or is stopped, and a photographer outside the vehicle photographs the person inside the vehicle, it is difficult to take a clear photograph of the person inside the vehicle because the interior of the vehicle is darker than the exterior of the vehicle. Therefore, the quality of the photograph taken is reduced. (5) When a person wishing to be photographed is driving a vehicle and a photographer outside the vehicle takes a photograph, unless the person wishing to be photographed is aware of the photographer's location and the photographing position in advance, there is a high possibility that the person wishing to be photographed will be photographed with his / her face facing in an unsuitable position, etc. As a result, the value of the photograph taken will decrease. (6) When a person wishing to take a photograph is driving a vehicle and a person outside the vehicle is taking a photograph, the person wishing to take a photograph is likely to look around while driving to find the person taking the photograph, making it difficult to maintain a safe driving state due to inattentive driving.

[0009] The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide a photography management system and photography management method that are useful for facilitating a photographer's photography operations when a local photographer takes pictures of a person wishing to take a photograph on a vehicle or near a vehicle from a remote position with a camera. [Means for solving the problem]

[0010] The above object of the present invention can be achieved by the following configuration. (1) A communication control unit capable of controlling cooperation between a first communication terminal used by a specific person who wishes to be photographed and who can move around by vehicle and a second communication terminal used by a photographer who can photograph the person who wishes to be photographed with a camera, The communication control unit an image acquisition function for acquiring an image including unique pattern information previously assigned to a specific vehicle associated with the person wishing to take a photograph from a camera of the second communication terminal; an object recognition function for identifying whether or not the captured image matches the specific vehicle based on the captured image and information acquired from the first communication terminal; a photographing subject designation function that, when it is recognized that the photographed image matches the specific vehicle, instructs the second communication terminal to at least one of displaying a message indicating that the vehicle in the photographed image is the specific vehicle in which the person wishing to take a photograph is riding or outputting a sound indicating that the vehicle is the specific vehicle; A photography management system comprising:

[0011] (2) A communication path is secured so that a first communication terminal used by a specific person who wishes to take a photograph and who can move around by vehicle can cooperate with a second communication terminal used by a photographer who can photograph the person who wishes to take a photograph with a camera; Acquire a photographed image including unique pattern information previously assigned to a specific vehicle associated with the person wishing to photograph from a camera on the second communication terminal side; Identifying whether or not the photographed image matches the specific vehicle based on the photographed image and the information acquired from the first communication terminal; When a match between the photographed image and the specific vehicle is recognized, instruct the second communication terminal to at least one of displaying a message indicating that the vehicle in the photographed image is the specific vehicle in which the person wishing to take a photograph is riding or outputting a sound indicating that the vehicle is the specific vehicle. How to manage photography. Effect of the Invention

[0012] According to the photography management system and photography management method of the present invention, when a local photographer takes a photograph of a person wishing to be photographed on a vehicle or near a vehicle from a remote position, the photographer's photography operation becomes easier.

[0013] The present invention has been briefly described above. Furthermore, the details of the present invention will be further clarified by reading the following description of the preferred embodiment of the present invention (hereinafter, referred to as "embodiment") with reference to the accompanying drawings. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram showing an outline of the configuration of a photography management system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a plan view showing an example of the positional relationship between a service user and a photographer. [Diagram 3] FIG. 3 is a schematic diagram showing an operation state-1 in the photography management system. [Figure 4] FIG. 4 is a schematic diagram showing an operating state-2 in the photography management system. [Diagram 5] FIG. 5 is a schematic diagram showing an operation state-3 in the photography management system. [Figure 6] FIG. 6 is a block diagram showing an example of main functions and communication paths in the picture taking management system. [Figure 7] FIG. 7 is a flowchart showing the processing procedure of the picture taking management system in the first state. [Figure 8] FIG. 8 is a flowchart showing the processing steps of the imaging management system in the second state. [Figure 9] FIG. 9 is a flowchart showing the processing procedure of the imaging management system in the third state. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Specific embodiments of the present invention will be described below with reference to the accompanying drawings.

[0016] FIG. 1 shows an outline of the configuration of a photography management system 100 according to an embodiment of the present invention. The photography management system 100 shown in FIG. 1 includes a user terminal 12 used by a service user 10, a photographer terminal 21 used by a photographer 20, and a cloud 30 that provides the main functions of a management service.

[0017] In the example shown in Fig. 1, the service user 10 is a tourist visiting a tourist spot, and uses a user vehicle 11 as a means of moving around the various parts of the tourist spot. The user vehicle 11 is, for example, a rental car, and a barcode 11a that can distinguish each vehicle is attached to the outer surface of the vehicle body. The information in the barcode 11a can be optically read using a camera or the like.

[0018] It is also possible to use a two-dimensional pattern or other unique pattern instead of the general one-dimensional barcode 11a to distinguish a specific user vehicle 11. The photographer 20 may be an ordinary local resident living in each tourist spot, or a professional photographer who happens to be at the location.

[0019] The user terminal 12 is, for example, a smartphone, and like a typical smartphone, is equipped with various communication functions, a camera, a display, various input devices, a GPS (Global Positioning System) receiver, a control unit (CPU), a storage device, and the like.

[0020] In addition, a service-specific application 13 for utilizing the functions of the cloud 30 is preinstalled in the user terminal 12. This service-specific application 13 has functions such as location information transmission, photo uploading, photo shooting request, photo viewing / rating, and album request.

[0021] For example, while a service user 10 is traveling using a user vehicle 11, the service user 10 can send a service request to have a photograph of himself / herself taken by any photographer 20 to the cloud 30 using the user terminal 12 and the service-specific application 13.

[0022] The photographer terminal 21 used by the photographer 20 is, for example, a smartphone, and like a typical smartphone, is equipped with various communication functions, a camera, a display, various input devices, a GPS receiver, a control unit, a storage device, etc.

[0023] In addition, a dedicated photography application 22 for the photographer 20 to use the functions of the cloud 30 is preinstalled in the photographer terminal 21. This dedicated photography application 22 has a location information transmission function, a photo shooting function, a cloud storage function for the captured photos, a barcode recognition function, a marking / AR (augmented reality) display function, and the like.

[0024] On the other hand, the cloud 30 is configured by application software (app) installed on a server device installed in a specific data center, for example. This server device has a function for communicating with the user terminal 12 and the photographer terminal 21 via a public communication line 40. The cloud 30 of this embodiment also includes a matching processing unit 31, a photo data storage unit 32, and an album creation processing unit 33.

[0025] The matching processing unit 31 has processing functions necessary to realize smooth matching for photography between the service user 10 who wishes to have his / her photo taken and the photographers 20 in various locations who have been registered in advance. The photo data storage unit 32 can store data such as photos taken by the photographers 20. The album creation processing unit 33 executes processing for creating a photo album.

[0026] <Positional relationship between the service user and the photographer> An example of the positional relationship between the service user 10 and the photographer 20 is shown in FIG. A service user 10 travels on a road 50 from point A to point Z while sightseeing using a user vehicle 11 such as a rental car as shown in Fig. 2. At each point on the road 50 during the travel, the service user 10 may wish to take a photograph to become a memory.

[0027] Additionally, in tourist spots, there may be local residents in various locations who act as photographers 20. Furthermore, the photographer terminal 21 carried by each photographer 20 has a camera function for taking pictures like a smartphone, a function for determining the photographer's current location by GPS, a function for communicating with the cloud 30, and the like.

[0028] When the service user 10 wishes to take a photograph, the service user 10 operates the service-specific application 13 of the user terminal 12 to transmit a request to take a photograph to the cloud 30 together with the position information of the service user's own vehicle.

[0029] The matching processing unit 31 of the cloud 30 grasps the current positions of the photographers 20 at each location, and can match each service user 10 with a specific photographer 20 by using the current position of the user vehicle 11 of the service user 10 who sent the photo taking request, the current position of each photographer 20, road map information, etc.

[0030] For example, the matching processing unit 31 of the cloud 30 automatically controls the interior lighting, headlights, etc. of the user vehicle 11 of a particular service user 10, making it easier for the photographer 20 to visually confirm the user vehicle 11 to be photographed.

[0031] As shown in FIG. 1, a photographer 20 can read a barcode 11 a on the user vehicle 11 with a camera of a photographer terminal 21 and transmit the information of the barcode 11 a from the photographer terminal 21 to the cloud 30 .

[0032] The matching processing unit 31 of the cloud 30 knows the information of the barcode 11a of the user vehicle 11 in advance, and by comparing this information with the information of the barcode 11a sent by the photographer 20, it can identify whether the vehicle at which the photographer 20 is pointing the camera matches the user vehicle 11 of the service user 10.

[0033] The dedicated photography application 22 on the photographer terminal 21 adds marking information to the user vehicle 11 to be photographed on the display of the photographer terminal 21 based on the information transmitted from the matching processing unit 31, and executes AR display with the marking information superimposed on the image of the subject user vehicle 11. This AR display allows the photographer 20 to easily photograph the service user 10 without mistaking the user vehicle 11 to be photographed.

[0034] Normally, the user terminal 12 and the photographer terminal 21 each access the cloud 30 using a public communication line 40, and communicate via the cloud 30. On the other hand, when the user terminal 12 and the photographer terminal 21 are close to each other, they can also perform direct communication 42 without relaying through the cloud 30.

[0035] On the other hand, when the photographer 20 actually photographs the user vehicle 11 and the service user 10 while they are traveling, various factors may prevent the photographer 20 from taking a good picture. For example, if the photographer 20 photographs the user vehicle 11 when the traveling speed is too fast, the photographer is likely to fail in the timing, positioning, focusing, light adjustment, etc. of the photograph. Furthermore, if another preceding vehicle is traveling ahead of the user vehicle 11 to be photographed, and the distance between the user vehicle 11 and the preceding vehicle is short, the preceding vehicle is likely to be photographed at the same time as the user vehicle 11 overlapping each other, which reduces the quality of the photograph.

[0036] Therefore, the photography management system 100 also includes a vehicle control system for realizing an appropriate photography environment in cooperation with the cloud 30 and the user vehicle 11. For example, when the user vehicle 11 approaches a photography location, the accelerator operation is limited or an automatic brake operation is performed so that the driving speed of the user vehicle 11 does not increase. Alternatively, guidance is provided by display or voice to encourage the driver of the user vehicle 11 to drive in such a manner. Also, when the distance between the user vehicle 11 and the preceding vehicle is short, the distance is controlled to be increased.

[0037] <System behavior depending on different situations> 3 to 5 show an overview of the operation states of the photography management system 100 in FIG. 1 in three different situations.

[0038] <When the distance between the user vehicle 11 and the photographer 20 is large> 3, a service user 10 on a user vehicle 11 communicates with the cloud 30 via a user terminal 12 and a public communication line 40, and can transmit a request for taking a photo to the service of the cloud 30 together with information on the current position of the user vehicle 11. The current position of the user vehicle 11 is updated periodically, for example, by positioning using GPS, and is transmitted to the cloud 30 periodically.

[0039] Furthermore, when a photographer 20 in various locations activates a dedicated photography application 22 on the photographer terminal 21, the location information of the photographer 20 is transmitted to the cloud 30 using a public communication line 40. The cloud 30 grasps the mutual distance based on the location information of the service user 10 and the location information of the photographer 20, and performs matching according to the distance.

[0040] <When the user vehicle 11 approaches the position of the photographer 20> When the user vehicle 11 approaches the position of the photographer 20, the user vehicle 11 can be seen from the position of the photographer 20, so as shown in Figure 4, the photographer 20 can photograph the user vehicle 11 with the camera of the photographer terminal 21 and read the barcode 11a of the user vehicle 11.

[0041] The photography-specific application 22 of the photographer terminal 21 transmits the information of the barcode 11a read from the user vehicle 11 to the cloud 30 via the public communication line 40. The cloud 30 knows in advance the contents of the barcode 11a of the user vehicle 11 associated with the service user 10, and can therefore identify whether the information of the barcode 11a sent from the photographer 20 matches the user vehicle 11 of the service user 10.

[0042] When the information in the barcode 11a matches the user vehicle 11 of the service user 10, AR display of the target vehicle is executed on the display of the photographer terminal 21 under the control of the cloud 30 and the dedicated photography application 22. That is, a real-time image of the subject photographed by the camera of the photographer terminal 21 is displayed superimposed on a mark indicating that the user vehicle 11 recognized by the barcode 11a is the vehicle to be photographed. This allows the photographer 20 to easily recognize the user vehicle 11 to be photographed.

[0043] <When the service user 10 gets off the user vehicle 11> When a photographer 20 approaches a service user 10 for the purpose of taking a picture, short-distance wireless communication can be performed between the photographer terminal 21 and the user terminal 12 as shown in Fig. 5. Specific examples of short-distance wireless communication that can be used include UWB (Ultra Wide Band) and Wi-Fi (registered trademark).

[0044] Therefore, the photography management system 100 can execute photography service processing by using both direct communication between the photographer terminal 21 and the user terminal 12 and communication using the cloud 30. The photography dedicated app 22 of the photographer terminal 21 executes AR display of the service user 10 on the display of the photographer terminal 21. For example, on a real-time image of a subject photographed by the camera of the photographer terminal 21, a target person mark such as a rectangular frame indicating that the person being photographed is the service user 10 who wishes to be photographed is displayed in a state superimposed on an area surrounding the service user 10 in the image.

[0045] <Major functions and communication paths> FIG. 6 shows an example of main functions and communication paths in the photography management system 100. 6, the photographer 20 and the cloud 30 can be connected via each of the communication paths C01, C02, and C03. That is, the photographer terminal 21 or the dedicated photography application 22 can transmit the location information of the photographer 20, the camera image of the photographer terminal 21, various request information, and the like to the matching processing unit 31 of the cloud 30 via the path C03. In addition, the photographer terminal 21 or the dedicated photography application 22 can transmit data of a photo taken by the photographer 20 with his / her own camera to the photo data storage unit 32 of the cloud 30 via the communication path C01.

[0046] Furthermore, the matching processing unit 31 of the cloud 30 can transmit service registration information, matching result information, AR processing results, incentive information, and the like to the photographer terminal 21 or the photography-dedicated application 22.

[0047] Furthermore, when the photographer 20 and the service user 10 are close to each other, email messages, various requests, and guide information can be transmitted and received between the photography-dedicated application 22 and the service-dedicated application 13 via a route of communication C04 using direct communication 42. Furthermore, the photography-dedicated application 22 can read the barcode 11a of the user vehicle 11 used by the service user 10 from the camera image CP captured by the camera of the photographer terminal 21.

[0048] Furthermore, the user terminal 12 of the service user 10, the service-specific application 13, or the user vehicle 11 can be connected to the cloud 30 via the public communication line 40 via each of the communication paths C05 to C10.

[0049] The matching processing unit 31 of the cloud 30 can transmit on / off instructions for the headlights and room lamps to the user vehicle 11 via a communication path C05. In addition, the user vehicle 11 can transmit vehicle information, information on the current position of the vehicle, driving history information, and the like to the matching processing unit 31 via a communication path C06. Note that the communication between the user vehicle 11 and the cloud 30 may be relayed by the user terminal 12 and the service-specific application 13.

[0050] The user terminal 12 or the service-specific application 13 can transmit service registration information, location information, album requests, photo ratings, service termination requests, and the like to the matching processing unit 31 of the cloud 30 via the communication C07 route.

[0051] Furthermore, the matching processing unit 31 can transmit the matching processing result to the user terminal 12 or the service-dedicated application 13 via a route of communication C08. The album creation processing unit 33 of the cloud 30 can provide the album data and photo data on the cloud 30 to the service-dedicated application 13 via a route of communication C09. Furthermore, the service-dedicated application 13 can transmit photo data taken by the user terminal 12 to the photo data storage unit 32 of the cloud 30 via a route of communication C10.

[0052] Furthermore, the matching processing unit 31 of the cloud 30 can send an album creation instruction to the album creation processing unit 33 via the communication C11 path in response to an album request from the service-specific application 13. The album creation processing unit 33 can create an album of photos held in the photo data storage unit 32 in response to the album creation instruction from the matching processing unit 31. The created album can be stored in the photo data storage unit 32.

[0053] <Processing procedure for the photography management system> Examples of the processing procedures of the imaging management system 100 in three different states are shown in Fig. 7 to Fig. 9. The processing procedures shown in Fig. 7 to Fig. 9 will be described below.

[0054] <When the distance between the user vehicle 11 and the photographer 20 is large> As shown in FIG. 7, the photography-specific application 22 on the photographer terminal 21 of the photographer 20 transmits information on the current location of the photographer terminal 21 to the cloud 30, for example, periodically (S11).

[0055] The service-specific application 13 on the user terminal 12 carried by the service user 10 transmits information on the current location of the user terminal 12 or the current location of the user vehicle 11 to the cloud 30, for example, periodically (S12).

[0056] The matching processing unit 31 of the cloud 30 notifies the photographer terminal 21 of the photographer 20 of the current location of the service user 10 in real time, and also notifies the user terminal 12 of the service user 10 of the current location of the photographer 20 in real time (S13).

[0057] The matching processing unit 31, the service dedicated application 13, or the photography dedicated application 22 grasps the distance between the position of the service user 10 and the position of the photographer 20, and compares this distance with a specified value (e.g., 500 m) in S14. If the distance is equal to or less than the specified value, the process proceeds to S15, and if the distance exceeds the specified value, the process returns to S11.

[0058] The photography management system 100 notifies both the service user 10 and the photographer 20 that the user vehicle 11 of the service user 10 is approaching the photography point (S15). This process is executed by at least one of the matching processing unit 31, the service-specific application 13, and the photography-specific application 22.

[0059] The matching processing unit 31 determines in S16 whether or not there is a request for a photographing service from the service-specific application 13 of the service user 10. If the service user 10 has requested a photographing service, the process proceeds from S16 to S17, and if not, the process proceeds to S18.

[0060] In S17, the matching processing unit 31 or the service-specific application 13 issues an instruction to the lighting system of the user vehicle 11 to automatically turn on both the headlights and the room lamp of the user vehicle 11. The illumination of the headlights of the user vehicle 11 allows the photographer 20 to easily visually recognize the user vehicle 11 in which the service user 10 to be photographed is riding. In addition, the illumination of the room lamp makes it easy to take a clear photo in a bright interior state. The matching processing unit 31 or the photography dedicated application 22 notifies the photographer 20 that the service user 10 has refused the photography service (S18).

[0061] <When the user vehicle 11 approaches the photographer 20> As shown in FIG. 8, the photography-specific application 22 on the photographer terminal 21 of the photographer 20 transmits information on the current location of the photographer terminal 21 to the cloud 30, for example, periodically (S21).

[0062] The service-specific application 13 on the user terminal 12 carried by the service user 10 transmits information on the current location of the user terminal 12 or the current location of the user vehicle 11 to the cloud 30, for example, periodically (S22).

[0063] The matching processing unit 31 of the cloud 30 notifies the photographer terminal 21 of the photographer 20 of the current location of the service user 10 in real time, and also notifies the user terminal 12 of the service user 10 of the current location of the photographer 20 in real time (S23).

[0064] The dedicated photography application 22 is started on the photographer terminal 21 of the photographer 20 (S24). Here, the photographer 20 operates to point the camera of the photographer terminal 21 at the target user vehicle 11 to which the barcode 11a is attached and whose headlights and interior lamps are on. A real-time image captured by the camera is displayed on the display of the photographer terminal 21. The dedicated photography application 22 transmits the captured image including the barcode 11a to the cloud 30 in real time.

[0065] The matching processing unit 31 of the cloud 30 recognizes the barcode 11a in the real-time video input from the dedicated photography application 22 of the photographer 20, and compares the barcode recognition result with the barcode information of the user vehicle 11 used by the service user 10 (S25). If the two match, the process proceeds from S25 to S26, and if they do not match, the process of S24 is repeated.

[0066] The matching processing unit 31 of the cloud 30 performs processing to match the position of the user vehicle 11 with the matching barcode information with the position of the photographer 20, and notifies the photography-dedicated application 22 and the service-dedicated application 13 of the other party's position information in real time (S26). The photography-dedicated application 22 identifies the area of ​​the user vehicle 11 to be photographed in the image frame photographed by the camera of the photographer terminal 21 based on the position information transmitted from the matching processing unit 31, and executes AR display so as to follow the movement of the user vehicle 11 in the image frame in real time. For example, a mark such as a rectangular pattern is displayed superimposed at a position surrounding the image of the user vehicle 11 in the image frame (see FIG. 4).

[0067] The photography-dedicated application 22 on the photographer terminal 21 of the photographer 20 notifies the service-dedicated application 13 of the service user 10 of necessary information by using the public communication line 40 or direct communication 42 (S27). The content of the notified information is configured so that the service user 10 can understand that "the photographer 20 is capturing the user vehicle 11 with the camera while checking the AR display", the location of the photographer 20, and "a request for the service user 10 to face the photographer 20".

[0068] Therefore, the photographer 20 can take a photograph while easily understanding from the AR display on the display screen of the photographer terminal 21 that the subject he or she is pointing the camera at is the user vehicle 11 in which the desired service user 10 is riding. In addition, since the interior lamp of the user vehicle 11 that is the subject of the photograph is turned on, the photographer 20 can take a clear photograph with the interior of the user vehicle 11 bright.

[0069] Furthermore, before the photographer 20 takes a photograph, the service user 10 is notified that he or she is about to take a photograph of the service user 10 and of the location of the photographer 20 (S27), so that the service user 10 can take appropriate action for taking a photograph. For example, the travel speed of the user vehicle 11 can be reduced to ensure safety, and the face and gaze of the service user 10 can be directed toward the camera of the photographer 20 at an appropriate timing.

[0070] <When the service user 10 gets off the bus and approaches the photographer 20> As shown in FIG. 9, the photography-specific application 22 on the photographer terminal 21 of the photographer 20 transmits information on the current location of the photographer terminal 21 to the cloud 30, for example, periodically (S31).

[0071] The service-specific application 13 on the user terminal 12 carried by the service user 10 transmits information on the current location of the user terminal 12 to the cloud 30, for example, periodically (S32). The matching processing unit 31 of the cloud 30 notifies the photographer terminal 21 of the photographer 20 of the current location of the service user 10 in real time, and also notifies the user terminal 12 of the service user 10 of the current location of the photographer 20 in real time (S33).

[0072] The photography application 22 is started on the photographer terminal 21 of the photographer 20 (S34). At this point, the photographer 20 knows the positional relationship between the current location of the service user 10 and his / her own location from the information notified from the cloud 30, so can operate the photographer terminal 21 to point the camera at the target service user 10.

[0073] Therefore, a real-time image including the service user 10 captured by the camera is displayed on the display of the photographer terminal 21. In addition, the photography application 22 transmits the captured image to the cloud 30 in real time (S34).

[0074] The matching processing unit 31 of the cloud 30 analyzes the real-time video input from the dedicated photography application 22 of the photographer 20 to recognize the person. Furthermore, based on the current position of the service user 10 input from the service dedicated application 13 and the position and camera direction of the photographer 20 input from the dedicated photography application 22, it compares whether the person in the real-time video matches the service user 10 who is the subject of the photography (S35).

[0075] If the person in the real-time video matches the service user 10 who is the subject of the image capture, the process proceeds from S35 to S36, and if they do not match, the process of S34 is repeated. The matching processing unit 31 of the cloud 30 matches the person who matches the service user 10 to be photographed with the position of the person in the real-time video, and notifies the photography-dedicated application 22 of the position information in real time (S36).

[0076] The photography application 22 identifies the area of ​​the service user 10 being photographed within the image frame photographed by the camera of the photographer terminal 21 based on the position information transmitted from the matching processing unit 31, and executes AR display so as to follow the movement of the service user 10 within the image frame in real time. For example, a mark such as a rectangular pattern is displayed superimposed at a position surrounding the image of the service user 10 within the image frame (see FIG. 5).

[0077] The photography-dedicated application 22 on the photographer terminal 21 of the photographer 20 notifies the service-dedicated application 13 of the service user 10 of necessary information by using the public communication line 40 or direct communication 42 (S37). The content of the notified information is configured so that the service user 10 can understand that "the photographer 20 is capturing the service user 10 with the camera while checking the AR display", the location of the photographer 20, and "a request for the service user 10 to face the photographer 20".

[0078] The present invention is not limited to the above-described embodiment, and can be appropriately modified, improved, etc. In addition, the material, shape, size, number, arrangement location, etc. of each component in the above-described embodiment are arbitrary as long as the present invention can be achieved, and are not limited.

[0079] For example, in the above-described photography management system 100, the barcode 11a affixed to the surface of the user vehicle 11 is used so that the photographer 20 can recognize the target user vehicle 11, but a unique pattern other than a barcode that can be optically read by a camera may be used instead of the barcode 11a. Also, for example, a function for recognizing the vehicle shape and model of the user vehicle 11 from the appearance in the image captured by the camera may be used in combination with reading the barcode 11a.

[0080] In the above-mentioned photography management system 100, the real-time image of the subject photographed by the camera of the photographer terminal 21 is displayed in a superimposed state with a mark indicating that the user vehicle 11 recognized by the barcode 11a is the vehicle to be photographed, but the license plate number, color, model, and position of the user vehicle 11, such as "the car in front" or "the car on the right", may be notified to the photographer terminal 21 by text or voice. Alternatively, the photographer terminal 21 may be notified that the superimposed vehicle is the user vehicle 11 to be photographed by text such as "correct", symbols such as "o" or "x", or voice or chime indicating correct or incorrect.

[0081] As described above, according to the photography management system 100 of this embodiment, the photographer 20 can identify the user vehicle 11 to be photographed based on the barcode 11a, etc., so that the photographer 20 can easily photograph the subject without making a mistake, even when multiple vehicles are running side by side on the road. In particular, a mark or the like representing the user vehicle 11 to be photographed is displayed in AR on the display screen of the photographer terminal 21 together with the subject image, and a sound indicating that it is the user vehicle 11 to be photographed is output to the photographer terminal 21, so that the photographer 20 can be prevented from losing sight of the user vehicle 11 to be photographed even when another vehicle appears near the user vehicle 11 or when the photographer 20 changes the direction of the camera.

[0082] In addition, the user vehicle 11 to be photographed turns on its headlights and interior lights before approaching the photographer 20 (S17), so the photographer 20 can easily distinguish the user vehicle 11 to be photographed from other vehicles even when the photographer 20 is relatively far away. In addition, the user vehicle 11 to be photographed turns on its interior lights, so the photographer 20 can photograph the service user 10 with the interior of the vehicle bright. This is expected to improve the quality of the photographs taken.

[0083] Furthermore, since the photography management system 100 notifies the service user 10 of necessary information before the photographer 20 takes a photograph (S27), the service user 10 can take appropriate action for taking a photograph while driving. For example, the service user 10 can accurately grasp the relative position of the photographer 20 to his / her own position and direct the direction of the face and line of sight toward the camera. Furthermore, the service user 10 can grasp the timing of photography and reduce the driving speed of the user vehicle 11 or take necessary action to ensure safety.

[0084] Here, the features of the photography management system and photography management method according to the above-described embodiment of the present invention will be briefly summarized and listed in the following [1] to [6]. [1] A communication control unit (cloud 30) capable of controlling cooperation between a first communication terminal (user terminal 12) used by a specific person wishing to take a photograph (service user 10) who is able to move around using a vehicle (user vehicle 11) and a second communication terminal (photographer terminal 21) used by a photographer (20) who is able to photograph the person wishing to take a photograph with a camera, The communication control unit an image acquisition function (S24) for acquiring an image including unique pattern information (barcode 11a) previously assigned to a specific vehicle associated with the person requesting to be photographed, from a camera of the second communication terminal; an object recognition function (S25) for identifying whether or not the photographed image matches the specific vehicle based on the photographed image and information acquired from the first communication terminal; a photographing subject designation function (S26) for instructing the second communication terminal to at least one of display indicating that the vehicle in the photographed image is the specific vehicle in which the person wishing to photograph is riding or outputting a sound indicating that the vehicle is the specific vehicle when a match between the photographed image and the specific vehicle is recognized; A photography management system (100) comprising:

[0085] According to the photography management system configured as above in [1], the photographer can reliably identify the vehicle to be photographed by recognizing the unique pattern information. In addition, since a mark representing the specific vehicle to be photographed is displayed on the photographer's screen or notified by voice, the photographer can easily identify the specific vehicle to be photographed even when multiple vehicles are traveling on the same road at the same time.

[0086] [2] The photographing target indication function instructs the second communication terminal to superimpose on a screen an indication indicating that the vehicle is the specific vehicle. The photography management system according to [1] above.

[0087] According to the photography management system having the configuration described above in [2], a mark representing the specific vehicle to be photographed is superimposed on the image of the subject on the photographer's screen, so that the photographer can easily identify the specific vehicle to be photographed even when multiple vehicles are traveling on the same road at the same time.

[0088] [3] The communication control unit has a photography and lighting control unit (S17) that transmits an instruction to turn on the lights on the specific vehicle to the first communication terminal after receiving information indicating that the photographer has confirmed the subject to be photographed. The photography management system according to [1] above.

[0089] According to the photography management system configured as in [3] above, the lights in the specific vehicle being photographed are automatically turned on at least when photography is being performed, so the photographer can always take photographs in a brightly lit interior of the vehicle. This allows the photographer to take clear photographs of the subject in the vehicle.

[0090] [4] The communication control unit has a photography preparation notification unit (S27) that transmits a notification to the first communication terminal indicating that the camera of the photographer has captured the person wishing to be photographed after receiving information indicating that the photographer has confirmed the subject of photography. The photography management system according to [1] above.

[0091] According to the photography management system configured as in [4] above, it becomes easy for a person who wishes to take a photograph to take an appropriate action before taking a photograph. For example, the person who wishes to take a photograph can accurately grasp the relative position of the photographer to his / her own position and direct the direction of the face and the line of sight toward the camera. In addition, the person who wishes to take a photograph can grasp the timing of the photograph and reduce the traveling speed of the vehicle or take the action required to ensure safety.

[0092] [5] The communication control unit has a notification lighting control unit (S17) that, when it detects that the specific vehicle has entered an area where the specific vehicle can be photographed based on the position information of the specific vehicle and the position information of the camera on the second communication terminal side, controls lighting on the specific vehicle to notify the photographer that the vehicle is a subject of photography. The photography management system according to [1] above.

[0093] According to the photography management system having the configuration described above in [5], even if the vehicle being photographed is located relatively far from the photographer's position, the photographer can easily distinguish the vehicle in question from other vehicles due to differences in lighting.

[0094] [6] A communication path (public communication line 40, direct communication 42) is secured so that a first communication terminal (user terminal 12) used by a specific person wishing to take a photograph (service user 10) who can move around using a vehicle (user vehicle 11) can cooperate with a second communication terminal (photographer terminal 21) used by a photographer (20) who can photograph the person wishing to take a photograph with a camera. A photographed image including unique pattern information (barcode 11a) previously assigned to a specific vehicle associated with the person requesting to be photographed is acquired from a camera on the second communication terminal side (S24); Based on the captured image and the information acquired from the first communication terminal, it is determined whether or not the captured image matches the specific vehicle (S25); When it is recognized that the photographed image matches the specific vehicle, the second communication terminal is instructed to at least one of displaying a message indicating that the vehicle in the photographed image is the specific vehicle in which the person wishing to take a photograph is riding or outputting a sound indicating that the vehicle is the specific vehicle (S26). How to manage photography.

[0095] According to the photography management method of the above procedure [6], the photographer can reliably identify the vehicle to be photographed by recognizing the unique pattern information. In addition, since a mark representing the specific vehicle to be photographed is superimposed on the image of the subject on the photographer's screen or is notified by voice, the photographer can easily identify the specific vehicle to be photographed even when multiple vehicles are traveling on the same road at the same time. [Explanation of symbols]

[0096] 10 Service Users 11 User vehicle 11a Barcode 12 User terminal 13 Service-specific apps 20 Photographer 21 Photographer's terminal 22 Photo-taking app 30. Cloud 31 Matching processing section 32 Photo data storage section 33 Album creation processing section 40 Public communication lines 42 Direct Communication 100 Shooting Management System CP camera footage

Claims

1. a communication control unit capable of controlling cooperation between a first communication terminal used by a specific person who wishes to be photographed and who can move around by vehicle, and a second communication terminal used by a photographer who can photograph the person who wishes to be photographed with a camera; The communication control unit an image acquisition function for acquiring an image including unique pattern information previously assigned to a specific vehicle associated with the person wishing to take a photograph, from a camera of the second communication terminal; an object recognition function for identifying whether or not the photographed image matches the specific vehicle based on the photographed image and information acquired from the first communication terminal; a photographing subject designation function that, when a match between the photographed image and the specific vehicle is recognized, instructs the second communication terminal to at least one of displaying a message indicating that the vehicle in the photographed image is the specific vehicle in which the person wishing to take a photograph is riding or outputting a sound indicating that the vehicle is the specific vehicle; A photography management system comprising:

2. The photographing target instruction function instructs the second communication terminal to superimpose on a screen a display indicating that the vehicle is the specific vehicle. The photography management system according to claim 1 .

3. the communication control unit has an imaging and lighting control unit that transmits an instruction to turn on lights on the specific vehicle to the first communication terminal after receiving information indicating that the photographer has confirmed the subject to be photographed; The photography management system according to claim 1 .

4. the communication control unit has a photographing preparation notification unit that transmits a notification to the first communication terminal indicating that the camera of the photographer has captured the person wishing to be photographed after receiving information indicating that the photographer has confirmed the subject of the photographing. The photography management system according to claim 1 .

5. The communication control unit has a notification lighting control unit that, when detecting that the specific vehicle has entered an area where the specific vehicle can be photographed based on position information of the specific vehicle and position information of a camera on the second communication terminal side, controls lighting on the specific vehicle to notify the photographer that the specific vehicle is a subject of photography. The photography management system according to claim 1 .

6. A communication path is secured so that a first communication terminal used by a specific person who wishes to be photographed and who can move around by vehicle can cooperate with a second communication terminal used by a photographer who can photograph the person who wishes to be photographed by a camera; Acquire a photographed image including unique pattern information previously assigned to a specific vehicle associated with the person wishing to photograph from a camera on the second communication terminal side; Identifying whether or not the photographed image matches the specific vehicle based on the photographed image and the information acquired from the first communication terminal; When a match between the photographed image and the specific vehicle is recognized, the second communication terminal is instructed to at least one of displaying a message indicating that the vehicle in the photographed image is the specific vehicle in which the person wishing to take a photograph is riding or outputting a sound indicating that the vehicle is the specific vehicle. How to manage photography.

Citation Information

Patent Citations

  • Method and system for mediating digital data, and program for digital data mediation service

    JP2008217831A

  • Rescue system, rescue instruction device, rescue device, object device, computer program and rescue instruction method

    JP2012230523A

  • Imaging apparatus, imaging method, and imaging program

    JP2016139957A

  • Vehicle number information recognition / correspondence system and correspondence method

    JP2017004527A

  • Data system, server, and program

    JP2019016100A