Information processing device, information processing method, and program
The information processing system addresses the challenge of recognizing designated locations in real space by superimposing reservation data onto images, improving location identification and reservation management.
Patent Information
- Application Number
- JP2023079563
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-12
- Publication Date
- 2024-11-22
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing techniques struggle to accurately identify and recognize designated locations in real space due to obstacles and limitations in displaying reservation status, making it difficult to locate specified areas outdoors.
An information processing system that acquires specified place information and real space position information, superimposing designated area information onto a photographed image using a user terminal, enabling precise location recognition through GPS and AR markers.
Facilitates easy recognition of designated locations in real space by overlaying reservation information onto captured images, enhancing user navigation and reservation management.
Smart Images

Figure 2024163717000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]
[0002] When people are meeting up or watching an outdoor event, it may be necessary to identify a meeting place or a viewing place even in a space where it is difficult to divide it into specific areas. A technology for identifying such a place is disclosed in Patent Document 1. Specifically, Patent Document 1 describes displaying a layout of the viewing area in a parade on a signage or a mobile terminal, and displaying the reservation status. Patent Document 1 also describes displaying the reservation status with a projector on the ground of the viewing area. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-088045 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the technology described in the above-mentioned Patent Document 1 only displays a layout diagram on a signage or a mobile terminal, making it difficult to recognize the designated location in real space. Also, when the reservation status is displayed on the ground in the real space using a projector, it may be difficult to recognize the display due to obstacles that exist in the real space. This causes the problem that it is difficult to recognize the designated location in real space.
[0005] Therefore, an object of the present disclosure is to provide an information processing device that can solve the above-mentioned problem of the difficulty in recognizing a designated location in real space. [Means for solving the problem]
[0006] An information processing device according to an embodiment of the present disclosure includes: an acquisition unit that acquires designated location information that identifies a location of a designated location and a captured image of a real space associated with real space location information that indicates a location in the real space including the designated location; a display unit that displays designated area information at a position on the captured image that corresponds to the designated location information based on the designated location information and the real space position information; Equipped with The structure is as follows.
[0007] In addition, an information processing method according to an embodiment of the present disclosure includes: Acquire designated location information that identifies a location of the designated location, and a captured image of the real space associated with real space location information that indicates a location in the real space that includes the designated location; displaying designated area information at a position on the photographed image corresponding to the designated location information based on the designated location information and the real space position information; The structure is as follows.
[0008] In addition, a program according to an embodiment of the present disclosure includes: Acquire designated location information that identifies a location of the designated location, and a captured image of the real space associated with real space location information that indicates a location in the real space that includes the designated location; displaying designated area information at a position on the photographed image corresponding to the designated location information based on the designated location information and the real space position information; Have a computer carry out the process, The structure is as follows. Effect of the Invention
[0009] By being configured as described above, the present disclosure makes it easy to recognize a designated location in real space. [Brief description of the drawings]
[0010] [Figure 1]FIG. 1 is a diagram illustrating a usage scene of an information processing system according to a first embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing a configuration of an information processing system according to a first embodiment of the present disclosure. [Diagram 3] 3 is a diagram showing a state of processing by the information processing system disclosed in FIG. 2. [Figure 4] 3 is a diagram showing a state of processing by the information processing system disclosed in FIG. 2. [Diagram 5] 3 is a flowchart showing the operation of the information processing system disclosed in FIG. 2. [Figure 6] FIG. 11 is a diagram illustrating a usage scene of an information processing system according to a second embodiment of the present disclosure. [Figure 7] FIG. 11 is a block diagram showing a configuration of an information processing system according to a second embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram showing a state of processing by the information processing system disclosed in FIG. 7. [Figure 9] FIG. 8 is a diagram showing a state of processing by the information processing system disclosed in FIG. 7. [Figure 10] FIG. 8 is a diagram showing a state of processing by the information processing system disclosed in FIG. 7. [Figure 11] 8 is a flowchart showing the operation of the information processing system disclosed in FIG. 7. [Figure 12] FIG. 11 is a block diagram showing a hardware configuration of an information processing device according to a third embodiment of the present disclosure. [Figure 13] FIG. 11 is a block diagram showing a configuration of an information processing device according to a third embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] <Embodiment 1> A first embodiment of the present disclosure will be described with reference to Fig. 1 to Fig. 5. Fig. 1 is a diagram for explaining a usage scene of an information processing system, Fig. 2 is a diagram for explaining a configuration of the information processing system, Fig. 3 to Fig. 5 are diagrams for explaining a processing operation of the information processing system.
[0012] [composition] The information processing system in this embodiment is used for a user to make a reservation for use of a designated place in a real space and for the user to recognize the reserved designated place in the real space. For example, in a real space A as shown in FIG. 1, the information processing system accepts a reservation for use of a designated place such as a meeting place for a user U or a place to watch an event, and for the user U to recognize the designated place in the real space A. In this embodiment, a case where a designated place in the real space A that has already been reserved is particularly described. As an example, when a "tree" in the real space A is designated as a meeting place, multiple places near the "tree" can be considered as the designated place, as shown by symbols P1, P2, and P3 in FIG. 1. In this case, when a place P1 is reserved as a designated place for the user U, a designated area R1 can be superimposed on a photographed image G of the real space A on the user terminal 10 of the user U, as shown in FIG. 4 described later, to allow the user U to recognize the designated place corresponding to the designated area R1.
[0013] In this embodiment, a case will be described in which a user U captures an image of real space A with a user terminal 10 at the actual site of real space A, and a designated area R1 is superimposed on the captured image G. However, the information processing system disclosed herein is not necessarily limited to displaying the designated area R1 on a captured image G captured by the user terminal 10 at the actual site of real space A, but may display a captured image G of real space A captured in advance at a location other than the actual site, and may superimpose the designated area R1 on the captured image G. In addition, the user terminal 10 does not necessarily have to be a mobile terminal owned by the user U, and may be any information processing device.
[0014] 2, the information processing system includes a user terminal 10 and an information processing device 20, which are connected via a network. Each device will be described in detail below.
[0015] The information processing device 20 is composed of one or more information processing devices each including a calculation device and a storage device. The information processing device 20 is, for example, an information processing device managed by a business that provides a service for registering and managing reservations for use of a specified place in real space to provide a user with use of the specified place, and for allowing the user to recognize the specified place. As shown in FIG. 2, the information processing device 20 includes a registration unit 21 and a provision unit 22. The functions of the registration unit 21 and the provision unit 22 can be realized by the calculation device executing a program for realizing each function stored in the storage device. The information processing device 20 also includes a reservation information storage unit 23. The reservation information storage unit 23 is composed of a storage device. Each configuration will be described in detail below.
[0016] The registration unit 21 receives a notification of a reservation for use of the designated place P1 in the real space A from the user terminal 10, and registers and manages the reservation for use of the designated place P1. For example, the registration unit 21 receives a notification from the user terminal 10 of a user ID, which is identification information for identifying the user U, and designated place information that specifies the position of the designated place P1 in the real space A, and stores the user ID and the designated place information in the reservation information storage unit 23 as reservation information in association with each other. As a result, the user U of the user ID is in a reserved state for use of the designated place P1 specified by the designated place information. At this time, the user ID associated with the designated place information as reservation information includes not only the user ID of the user U who notified the reservation for use, but also the user ID of another user U. For example, when multiple users U use the designated place P1, such as when the users U are meeting each other, the user ID of the first user U who makes the reservation and the user ID of the second user U who is to meet the first user U are associated with the designated place information and registered as reservation information.
[0017] Here, the designated place information included in the reservation information stored in the reservation information storage unit 23 is position information of the designated place P1 in the real space A, and is represented by, for example, coordinates based on latitude and longitude. When the designated place information notified from the user terminal 10 is position information of the designated place P1 in the real space A based on latitude, longitude, etc., the registration unit 21 stores it as the designated place information. On the other hand, when the designated place information notified from the user terminal 10 is position information (designated area information) on a captured image G in which the real space A is captured by the user terminal 10 from the user terminal 10 as described later, the registration unit 21 converts the position information on the captured image G into position information of the designated place P1 in the real space A, such as latitude and longitude, and stores it as the designated place information. At this time, the registration unit 21 receives a notification of position information (real space position information) indicating the position of the real space A shown in the captured image G from the user terminal 10 together with the captured image G, and converts the position information on the captured image G into position information in the real space A using the position information.
[0018] Furthermore, the designated location information included in the reservation information may be associated with time information indicating the time for using the designated location P1 notified from the user terminal 10. As an example, the time information is information including the start time and end time of the time for use, such as 10 minutes from 11:20 to 11:30. However, the time information is not limited to the time notified from the user terminal 10, and may be a time specified by the user terminal 10 from a pre-divided time, or may be a pre-set time from the time of notification of the reservation for use.
[0019] The providing unit 22 transmits the reservation information stored in the reservation information storage unit 23 to the user terminal 10 as described above, and provides the reservation information. For example, when the providing unit 22 receives a request for reservation information from the user terminal 10 together with the current location information of the user terminal 10, the providing unit 22 extracts reservation information corresponding to the vicinity of the location information from the reservation information storage unit 23 and transmits it to the user terminal 10. As an example, the providing unit 22 extracts reservation information including designated place information located within a predetermined range of the location information transmitted from the user terminal 10, and transmits it to the user terminal 10. Note that the reservation information may be registered in the reservation information storage unit 23 for each partitioned area obtained by partitioning the real space A. In this case, the providing unit 22 may extract the reservation information included in the partitioned area corresponding to the location information transmitted from the user terminal 10, and transmit it to the user terminal 10.
[0020] The user terminal 10 is composed of one or more information processing devices including a computing device and a storage device. In particular, in this embodiment, the user terminal 10 is a portable information processing terminal such as a smartphone owned by the user U, and has a general configuration that a portable information processing terminal has. For example, as shown in FIG. 2, the user terminal 10 has a general configuration including a camera 15 that is a photographing device that photographs images, a GPS (Global Positioning System) 16 that is a position information acquisition device that acquires position information, and a display 17 that is a display device that displays various data such as images. The display 17 is composed of a touch panel and also functions as an input device that allows touch input operations. The user terminal 10 may have a device that acquires position information by any technology other than the GPS 16 (for example, a self-position estimation technology using a VPS (Visual Positioning System) or SLAM (Simultaneous Localization and Mapping)), and may have a configuration other than the above-mentioned configuration.
[0021] 2, the user terminal 10 includes an acquisition unit 11, an identification unit 12, and a display unit 13. The functions of the acquisition unit 11, the identification unit 12, and the display unit 13 can be realized by a computing device executing a program for realizing each function stored in a storage device. For example, such a program is an application for using a service provided by a business operator that manages the above-mentioned information processing device 20, for reserving use of a specified place in real space and recognizing the specified place. Each component of the user terminal 10 will be described in detail below.
[0022] In this embodiment, it is assumed that a reservation for a specified place in real space A has already been registered, and a case will be mainly described in which a user U recognizes the specified place by displaying the specified area information based on the reservation information, that is, the user terminal 10 of a second user U who will meet up with a first user U who made a reservation. Specifically, as shown in FIG. 1, the function of the user terminal 10 of the second user U who goes to the general meeting place notified by the first user U who made the reservation will be described. In the following, the second user U will be simply referred to as user U.
[0023] The acquisition unit 11 operates on the above-mentioned application, and acquires a photographed image G of the real space A taken by the user U located near the meeting place as shown in FIG. 1, using the camera 15. At this time, the photographed image G acquired by the acquisition unit 11 is a preview image displayed on the display 17 with the user U pointing the camera 15 toward the real space A, but may be an image that is photographed, stored in a storage device, and then reproduced on the display 17. For example, the photographed image G is an image as shown in FIG. 3. Furthermore, when the photographed image G is photographed, the acquisition unit 11 acquires real space position information representing the position of the real space A using the GPS 16, and associates the real space position information with the photographed image G. The real space position information is the position of the user terminal 10 where the user U photographed the real space A with the user terminal 10, and is represented by, for example, coordinates based on latitude and longitude.
[0024] In addition, the acquisition unit 11 requests reservation information from the information processing device 20 in response to an operation from the user U on the above-mentioned application. For example, the acquisition unit 11 displays an operation unit for inputting a command to request reservation information on the display 17 displaying the captured image G, and requests reservation information from the information processing device 20 by operating the operation unit by the user U. At this time, the acquisition unit 11 further notifies the information processing device 20 of the position of the user terminal 10 at the time of shooting, that is, real space position information representing the position of the real space A, and requests reservation information. In response to this, the information processing device 20 transmits reservation information corresponding to the vicinity of the position specified by the notified real space position information to the user terminal 10. As a result, the acquisition unit 11 acquires reservation information corresponding to the vicinity of the position of the user U. Note that the reservation information includes designated place information, which is the position information of the designated place reserved for use, as described above, and further includes the user ID of the user U who uses the designated place, which is associated with the designated place information, and time information for use. In this example, the acquisition unit 11 acquires reservation information including designated place information corresponding to the positions of the designated places P1, P2, and P3 shown in FIG.
[0025] The identification unit 12 (display unit) identifies a position on the photographed image G corresponding to the designated place based on the photographed image G and real space position information acquired as described above, and the designated place information included in the reservation information. For example, the identification unit 12 calculates coordinates (e.g., latitude and longitude) that are positions in the real space A of each position on the photographed image G from the real space position information that is the photographing position of the user U, and identifies the position on the photographed image G corresponding to the designated place by associating the calculated coordinates on the photographed image G with the coordinates that are the designated place information. Note that the method of identifying the position corresponding to the designated place is not limited to this, and various methods can be adopted. For example, the position corresponding to the designated place on the photographed image G may be identified based on the photographed image G and the designated place information included in the reservation information. More specifically, an object is identified from the photographed image G, and the position corresponding to the designated place on the photographed image G is identified based on the designated place information linked to the identified object. Here, the "object" is a building, a signboard, a monument, or the like. It may also be an AR marker, or the like.
[0026] The display unit 13 displays the designated area information R1, R2, and R3 indicating that the designated areas are designated areas at positions corresponding to the designated areas P1, P2, and P3 specified as described above on the photographed image G displayed on the display 17. For example, the display unit 13 displays the designated area information R1, R2, and R3 corresponding to the designated areas P1, P2, and P3 shown in FIG. 1, respectively, superimposed on the photographed image G as shown in FIG. 4. At this time, the display unit 13 specifies the designated area information corresponding to the designated area information associated with the user ID of the user U, and displays the designated area information in a manner distinguished from others. In the examples of FIG. 1 and FIG. 4, since the designated area information of the designated area P1 includes the user ID of the user U, the designated area information R1 corresponding to the designated area P1 is displayed in black, and the other designated area information R2 and R3 are displayed in gray. At this time, the display unit 13 may display the route information from the user U to the designated area information R1 superimposed on the photographed image G displayed on the display 17. For example, the display unit 13 calculates a route from the real space position information of the user U in the real space A to the specified location P1, converts the route into route information on the captured image G, and displays the route information on the captured image G.
[0027] [Operation] Next, the operation of the above-mentioned information processing system, in particular the operation of the user terminal 10, will be described mainly with reference to the flowchart in Fig. 5. Here, as shown in Fig. 1, it is assumed that designated places P1, P2, and P3 are registered as reservation information in the information processing device 20, and among these, the designated place P1 is reserved as a meeting place for a user U.
[0028] First, in response to an operation by a user U located near the meeting place, the user terminal 10 captures and acquires a captured image G, which is an image of the real space A, with the camera 15, and acquires real space position information indicating the position of the real space A at the time of capturing the image with the GPS 16 (step S1). Then, in response to an operation by the user U, the user terminal 10 notifies the information processing device 20 of the position information of the real space A and requests reservation information. As a result, the user terminal 10 acquires reservation information corresponding to the vicinity of the position of the user U (step S1). Note that the user terminal 10 may first acquire the reservation information from the information processing device 20, and then capture and acquire the captured image G.
[0029] Next, the user terminal 10 identifies a position on the captured image G corresponding to the designated place based on the acquired captured image G and real space position information, and the designated place information included in the acquired reservation information (step S2). For example, the user terminal 10 calculates coordinates of positions on the captured image G in real space A from real space position information that is the shooting position of the user U, and identifies a position on the captured image G corresponding to the designated place by associating the calculated coordinates on the captured image G with the coordinates that are the designated place information.
[0030] Next, the user terminal 10 displays the designated area information R1, R2, R3 indicating that the designated areas are designated areas at positions corresponding to the designated areas P1, P2, P3 identified as described above on the photographed image G displayed on the display 17 (step S3). At this time, the user terminal 10 identifies the designated area information corresponding to the designated area information associated with the user ID of the user U, and displays the designated area information in a manner distinguished from others. In the example of Fig. 4, the designated area information R1 associated with the user ID of the user U is displayed in black, and the other designated area information R2, R3 not associated with the user ID of the user U is displayed in gray.
[0031] As described above, according to the information processing system of this embodiment, the designated area information R1, R2, R3 corresponding to the reserved designated places P1, P2, P3 is displayed on the photographed image G of the real space A displayed on the display 17 of the user terminal 10. Therefore, the user U can easily recognize the designated places reserved for use on the photographed image G of the real space A. In addition, the designated area information R1, R2, R3 corresponding to the designated places P1, P2, P3 associated with each user U is displayed in a distinguished manner, so the user U can easily recognize the area location that he or she will use for a meeting or the like on the photographed image G.
[0032] In the above example, the case was described where the user U points the camera 15 at the real space A and the designated area information R1, R2, R3 is superimposed on a preview image that shows the captured image of the real space A on the display 17. However, the designated area information R1, R2, R3 may also be superimposed on a captured image G that has been captured in advance, saved in a storage device, and then played back on the display 17.
[0033] 4, both the designated area information R1 associated with the user U and the designated area information R2, R3 not associated with the user U are displayed, but only one of the designated area information may be displayed. For example, the user terminal 10 may acquire only the reservation information associated with the user ID of the user U from the information processing device 20, or may identify the reservation information associated with the user ID of the user U from the acquired reservation information, and display only the designated area information corresponding to the user U. For example, even if there is no reservation information corresponding to the user terminal 10, the user terminal 10 may acquire the reservation information and display only the designated area information of others.
[0034] The real space position information and the designated place information in the real space A described above may be position information consisting of three-dimensional coordinates including latitude, longitude and altitude, and the captured image G may be an image including three-dimensional coordinates accordingly. In this case, the user terminal 10 may specify a position on the captured image G corresponding to the designated place by three-dimensional coordinates, and may display the designated area information in a three-dimensional superimposed manner at such a position.
[0035] <Embodiment 2> Next, a second embodiment of the present disclosure will be described with reference to Fig. 6 to Fig. 11. Fig. 6 is a diagram for explaining a usage scene of the information processing system, Fig. 7 is a diagram for explaining a configuration of the information processing system, Fig. 8 to Fig. 11 are diagrams for explaining a processing operation of the information processing system.
[0036] [composition] The information processing system in this embodiment includes a configuration for a user to make a reservation for use of a designated place in real space, in addition to the configuration of the information processing system in the above-mentioned embodiment 1. Here, in this embodiment, as shown in the designated area information R1, R2, and R3 on the captured image G in Fig. 6, reservation information by another user has already been registered in the information processing device 20, and a case will be described in which a user U makes a new reservation for a designated place to be used by himself / herself in such a situation.
[0037] In addition to the components described in the first embodiment, the user terminal 10 in this embodiment further includes a notification unit 14 as shown in Fig. 7. The function of the notification unit 14 can be realized by the arithmetic unit of the user terminal 10 executing a program stored in a storage device. In addition, the user terminal 10 in this embodiment is connected to an external server 30 as shown in Fig. 7. Each component in this embodiment will be described in detail below.
[0038] First, the display unit 13 in this embodiment displays candidate area information indicating an area that can be newly reserved for use and that can be designated by the user U, on the photographed image G displayed on the display 17. At this time, the display unit 13 sets candidate area information corresponding to a location different from the designated location corresponding to the designated area information based on the designated area information identified from the already registered reservation information, and displays it on the photographed image G. As an example, as shown in Fig. 8, the display unit 13 sets areas on the photographed image G that are different from the already registered designated area information R1, R2, R3 as candidate area information r1, r2, r3, and displays them on the photographed image G.
[0039] Here, the display unit 13 may set and display the candidate area information based on the designated area information identified from the already registered reservation information and the real space situation information indicating the situation of the real space A acquired from the external server 30. For example, the display unit 13 first acquires the real space situation information indicating the situation at the position of the real space A by using the real space position information which is the position information of the real space A where the photographed image G was captured. The real space situation information includes a surveillance image by a surveillance camera installed near the real space A, crowd information indicating the degree of congestion measured by a human presence sensor installed near the real space A, and meteorological information such as the weather near the real space A. Then, the display unit 13 checks the congestion situation at each position in the real space A from, for example, the surveillance image or the human presence sensor, identifies a position that is not crowded according to a preset criterion, and calculates the position on the photographed image G corresponding to the identified position to set the candidate area information. In addition, the display unit 13 checks the weather, for example, from meteorological information in the vicinity of the real space A, and if it is raining, for example, identifies positions around the location where structures such as buildings and trees exist from the analysis results of the captured image G and map information, and calculates the position on the captured image G that corresponds to such identified position, and sets the candidate area information.
[0040] The display unit 13 may set and display candidate area information based on time information included in already registered reservation information. For example, the display unit 13 checks time information associated with each designated place information identified from already registered reservation information, and sets designated area information corresponding to the designated place information whose reserved time is about to end as candidate area information. Note that the above-mentioned method of setting candidate area information is one example, and other methods may be used.
[0041] Furthermore, the acquisition unit 11 (reception unit) in this embodiment accepts candidate area information designated by the user U from among the candidate area information r1, r2, and r3 on the captured image G displayed on the display 17 as described above, as position information (second designated area information) on the captured image G of the designated location that the user U reserves to use. For example, the acquisition unit 11 accepts designation by a touch operation of the user U's finger on the position of any of the candidate area information r1, r2, and r3 on the display 17, which is a touch panel. Here, it is assumed that the candidate area information r2 is designated, as shown by the diagonal lines in FIG. 9.
[0042] Then, the display unit 13 in this embodiment displays designated area information R4 (second designated area information) indicating the designated place reserved for use by the user U at the position of the candidate area information r2 designated as described above on the captured image G displayed on the display 17. At this time, the display unit 13 displays the designated area information R4 designated by the user U in a manner distinguished from the others. In the example of Fig. 10, the designated area information R4 designated by the user U is displayed in black, and the designated area information R1, R2, and R3 by the other users U are displayed in gray.
[0043] The notification unit 14 identifies a position in the real space A corresponding to the position of the designated area information R4 on the photographed image G designated by the user U. At this time, the notification unit 14 converts the position information of the designated area information R4 on the photographed image G into position information consisting of coordinates such as latitude and longitude in the real space A, for example, based on the photographed image G and the position information of the real space A where the photographed image G was photographed. Then, the notification unit 14 notifies the information processing device 20 set as the notification destination of the position information in the real space A converted from the designated area information R4 on the photographed image G, together with the user ID of the user U, as designated location information (second designated location information) reserved for use by the user U. As a result, the notified designated location information is registered as reservation information of the user U in the information processing device 20.
[0044] [Operation] Next, the operation of the above-mentioned information processing system, particularly the operation of the user terminal 10, will be described mainly with reference to the flowchart in Fig. 11. Here, as shown in Fig. 6, the designated area information R1, R2, and R3 are registered as reservation information in the information processing device 20, and a case will be described in which a user U makes a new reservation for a meeting place in such a situation.
[0045] First, in response to an operation by a user U located near the meeting place, the user terminal 10 captures and acquires a captured image G, which is an image of the real space A, with the camera 15, and acquires real space position information indicating the position of the real space A at the time of capturing the image with the GPS 16 (step S1). Then, in response to an operation by the user U, the user terminal 10 notifies the information processing device 20 of the position information of the real space A and requests reservation information. As a result, the user terminal 10 acquires reservation information corresponding to the vicinity of the position of the user U (step S1).
[0046] Next, the user terminal 10 identifies a position on the photographed image G corresponding to the designated place based on the acquired photographed image G and real space position information, and the designated place information included in the acquired reservation information (step S2). Then, the user terminal 10 displays designated area information R1, R2, R3 indicating the designated place at a position corresponding to the designated place identified as described above on the photographed image G displayed on the display 17 (step S3). At this time, the displayed designated area information R1, R2, R3 is not related to the user U, and is therefore displayed in gray as shown in FIG.
[0047] Next, when the user U makes a reservation for a new meeting place, the user inputs a reservation to the user terminal 10. Then, the user terminal 10 displays candidate area information r1, r2, r3 representing an area that can be newly reserved and designated for use on the photographed image G displayed on the display 17 as shown in FIG. 8 (step S4). At this time, the user terminal 10 sets areas different from the designated area information R1, R2, R3 specified from the reservation information already registered as the candidate area information r1, r2, r3 and displays them on the photographed image G. The user terminal 10 may set the candidate area information r1, r2, r3 in consideration of a monitoring image showing the situation of the real space A, an environment such as the weather, and the like, and may set the candidate area information r1, r2, r3 in consideration of the time set in the designated area information R1, R2, R3.
[0048] Then, the user terminal 10 accepts the candidate area information designated by the user U from among the candidate area information r1, r2, and r3 on the captured image G displayed on the display 17 as position information (second designated area information) on the captured image G of the designated place that the user U reserves to use (step S5). For example, the user terminal 10 accepts designation by a touch operation of the user U's finger on the display 17, which is a touch panel, of the position of any of the candidate area information r1, r2, and r3.
[0049] Then, the user terminal 10 displays designated area information R4 (second designated area information) indicating the designated location reserved for use by the user U at the position of the candidate area information r2 designated as described above on the photographed image G displayed on the display 17 (step S6). For example, as shown in Fig. 10, the user terminal 10 displays the designated area information R4 designated by the user U in black and the designated area information R1, R2, and R3 by other users in gray, distinguishing between related users.
[0050] Thereafter, the user terminal 10 identifies a position in the real space A corresponding to the position of the designated area information R4 on the captured image G designated by the user U, and notifies the information processing device 20 of the position information in the real space A as designated location information by the user U (step S7). As a result, the notified designated location information is registered as reservation information of the user U in the information processing device 20.
[0051] As described above, according to the information processing system of this embodiment, the user U can reserve a new designated location while recognizing designated locations reserved by other users. At this time, by displaying candidate area information on the captured image G of the real space A displayed on the display of the user terminal 10, the user U can easily reserve a new designated area.
[0052] In the above, the case where the candidate area information r1 and the like is displayed on the photographed image G of the user terminal 10 in addition to the already reserved designated area information R1 and the like is exemplified, but the candidate area information may not be displayed. In this case, the user U designates a desired position on the photographed image G of the real space A displayed on the display 17 by a touch operation or the like, and an area of a predetermined size including the designated position is accepted as the designated area. At this time, in response to the designation of the position, a display may be made to allow the user to input and designate information regarding the size to be reserved as the designated area. Then, the designated area may be accepted based on the designated position and the information regarding the input size. The user U may also designate the size of the designated area by a touch operation such as pinching in or pinching out, or may designate a change in the size of the designated area. As a result, the designated area of the size designated by the user U is accepted.
[0053] Furthermore, when accepting a reservation of the designated area, information regarding the usage time may be accepted. The information regarding the usage time may simply specify the time of use, such as XX minutes, or may specify a specific date and time, such as XX month, XX day, from 12:00 to 12:30. Then, based on the obtained usage time information, it may be determined whether or not the designated area can be reserved. Furthermore, if the designated area cannot be reserved for the desired usage time, the available time or candidate area information that can be used for the desired time may be displayed.
[0054] In addition, when a usage time is set for the above-mentioned candidate area or the specified area, the usage time set may be superimposed on the captured image G along with the display of each area on the display of the user terminal 10. In addition, if the user U wishes to use the candidate area within the usage time set for the candidate area, the user U may wait for a cancellation for the candidate area. For example, the user U selects the candidate area information displayed on the user terminal 10 and inputs a cancellation waiting request, whereby the information processing device 20 accepts the cancellation waiting request for the candidate area. Then, when the use of the candidate area for which the cancellation waiting request was accepted is canceled, the information processing device 10 may switch the reservation for the candidate area to the user U who waited for the cancellation and register it, and notify the user U and other related parties of the cancellation waiting request.
[0055] In addition, when accepting a reservation, a usage fee according to the contents of the designated area may be displayed. The contents of the designated area may be, for example, the size of the designated area, the usage time of the designated area, popularity, etc. More specifically, the larger the size of the designated area, the higher the usage fee may be displayed. Similarly, the longer the usage time of the designated area, the higher the usage fee may be displayed. The popularity may be determined according to the frequency of reservations as the designated area. For example, if the usage frequency of a certain candidate area is higher than the usage frequency of other candidate areas in a specific period, the popularity of the candidate area with the higher usage frequency is determined to be high. The popularity may be determined by a relative evaluation between the candidate areas, or by an absolute evaluation in which the usage frequency of each candidate area is individually evaluated. In the description of the popularity, the candidate area is used as an example, but this is not limited to this, and the popularity of the designated area including the position may be determined based on the position of the designated area. As a result, the more popular the designated area, the higher the usage fee is displayed. The information of the designated area may be calculated taking into consideration information other than the exemplified information, or may be calculated by combining the exemplified size of the designated area, the usage time of the designated area, popularity, etc.
[0056] In addition, the reservation status may be distributed through various media so that other users U can check the reserved designated area. Examples of the various media include a website and signage installed in the facility. In addition, the reservation status may be distributed through an application installed on a smartphone.
[0057] The real space position information and the designated place information in the real space A described above may be position information consisting of three-dimensional coordinates in which altitude is added to latitude and longitude, and the photographed image G may be an image including three-dimensional coordinates accordingly. In this case, the user terminal 10 may specify a position corresponding to the designated place on the photographed image G by three-dimensional coordinates, and may superimpose and display the candidate area information and the designated area information on the position in three dimensions. Furthermore, when receiving an input of a designated area on the photographed image G from the user U, the user terminal 10 may receive a designated area consisting of three-dimensional coordinates. At this time, the user terminal 10 may receive a designation of a height together with a designation of an area of a predetermined width on the photographed image G from the user U. Furthermore, the user terminal 10 may display a three-dimensional model of a predetermined shape at a designated position on the photographed image G, and may receive a change in the shape of the three-dimensional model from the user U, thereby receiving a designation of a designated area consisting of three-dimensional coordinates. Furthermore, the shape of the designated area by the three-dimensional coordinates may be any shape, such as a cube, a rectangular parallelepiped, a cylinder, a sphere, or a cone.
[0058] In the above-described embodiments, the user has reserved a meeting place and recognized the place, but the system disclosed herein can be applied to reserving and recognizing any place. For example, the system can be applied to reserving a parking space, reserving a place to use such as a beach or a ground, reserving a seat in a movie theater, etc.
[0059] <Embodiment 3> Next, a third embodiment of the present disclosure will be described with reference to Fig. 12 to Fig. 13. Fig. 12 to Fig. 13 are block diagrams showing the configuration of an information processing device in the third embodiment. Note that this embodiment shows an outline of the configuration of the user terminal 10 described in the above-mentioned embodiment.
[0060] First, a hardware configuration of the information processing device 100 in this embodiment will be described with reference to Fig. 12. The information processing device 100 is configured as a general information processing device, and is equipped with the following hardware configuration, as an example. ·CPU(Central Processing Unit)101(Arithmetic unit) ROM (Read Only Memory) 102 (storage device) RAM (Random Access Memory) 103 (storage device) · Programs 104 loaded into RAM 103 A storage device 105 for storing a program group 104 A drive device 106 that reads and writes data from a storage medium 110 external to the information processing device A communication interface 107 for connecting to a communication network 111 outside the information processing device Input / output interface 108 for inputting and outputting data Bus 109 connecting each component
[0061] 12 shows an example of the hardware configuration of the information processing device which is the information processing device 100, and the hardware configuration of the information processing device is not limited to the above-mentioned case. For example, the information processing device may be configured with a part of the above-mentioned configuration, such as not having the drive device 106. Furthermore, the information processing device may use a GPU (Graphic Processing Unit), a DSP (Digital Signal Processor), an MPU (Micro Processing Unit), an FPU (Floating point number Processing Unit), a PPU (Physics Processing Unit), a TPU (Tensor Processing Unit), a quantum processor, a microcontroller, or a combination thereof, instead of the above-mentioned CPU.
[0062] The information processing device 100 can be equipped with an acquisition unit 121 and a display unit 122 shown in Fig. 13 by the CPU 101 acquiring the program group 104 and executing it. The program group 104 is stored in the storage device 105 or the ROM 102 in advance, for example, and the CPU 101 loads the program group 104 into the RAM 103 and executes it as necessary. The program group 104 may be supplied to the CPU 101 via the communication network 111, or may be stored in the storage medium 110 in advance, and the drive device 106 reads out the program and supplies it to the CPU 101. However, the acquisition unit 121 and the display unit 122 described above may be constructed of dedicated electronic circuits for realizing such means.
[0063] The acquiring unit 121 acquires designated location information that specifies the location of a designated location, and a captured image of a real space associated with real space location information that indicates a position in the real space that includes the designated location.
[0064] The display unit 122 displays designated area information at a position on the captured image that corresponds to the designated place information, based on the designated place information and the real space position information.
[0065] With the present disclosure configured as described above, the information processing device 100 displays designated area information corresponding to a designated location on a captured image of a real space. This allows a user to easily recognize the designated location on the captured image of the real space.
[0066] The above-mentioned program can be stored and supplied to a computer using various types of non-transitory computer readable media. The non-transitory computer readable medium includes various types of tangible storage media. Examples of the non-transitory computer readable medium include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include electric signals, optical signals, and electromagnetic waves. The transitory computer readable medium can supply the program to a computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.
[0067] Although the present disclosure has been described above with reference to the above-mentioned embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. In addition, the configurations described in the above-mentioned embodiments can be combined or substituted. In addition, at least one or more functions of the above-mentioned acquisition unit 121 and display unit 122 may be executed by an information processing device installed and connected anywhere on a network, that is, they may be executed by so-called cloud computing.
[0068] <Additional Notes> A part or all of the above-described embodiments may be described as follows: Below, an overview of the configurations of an information processing device, an information processing method, and a program according to the present disclosure will be described. However, the present disclosure is not limited to the following configurations. (Appendix 1) an acquisition unit that acquires designated location information that identifies a location of a designated location and a captured image of a real space associated with real space location information that indicates a location in the real space including the designated location; a display unit that displays designated area information at a position on the captured image that corresponds to the designated location information based on the designated location information and the real space position information; An information processing device comprising: (Appendix 2) 2. The information processing device according to claim 1, a receiving unit that receives second designated area information representing a position designated on the photographed image where the designated area information can be displayed; Information processing device. (Appendix 3) The information processing device according to claim 2, the display unit displays the second designated area information at a position on the captured image corresponding to the second designated area information. Information processing device. (Appendix 4) The information processing device according to claim 2, the display unit displays candidate area information that can be designated as the second designated area information at a position on the captured image that is set based on the designated area information. Information processing device. (Appendix 5) The information processing device according to claim 4, the display unit displays the candidate area information at a position on the captured image that is set based on the designated area information and real space situation information that represents a situation of the real space. Information processing device. (Appendix 6) The information processing device according to claim 4, time information is associated with the specified location information; the display unit displays the candidate area information at a position on the captured image that is set based on the designated area information corresponding to the designated location information and the time information associated with the designated location information. Information processing device. (Appendix 7) The information processing device according to claim 2, a notification unit that notifies a preset notification destination of second designated location information that indicates a position in real space corresponding to the second designated area information identified based on the second designated area information on the captured image and the real space position information, Information processing device. (Appendix 8) Acquire designated location information that identifies a location of the designated location, and a captured image of the real space associated with real space location information that indicates a location in the real space that includes the designated location; displaying designated area information at a position on the photographed image corresponding to the designated location information based on the designated location information and the real space position information; Information processing methods. (Appendix 9) 9. The information processing method according to claim 8, receiving second designated area information representing a position designated on the captured image where the designated area information can be displayed; Information processing methods. (Appendix 9.1) 10. The information processing method according to claim 9, further comprising: displaying the second designated area information at a position on the photographed image corresponding to the second designated area information; Information processing device. (Appendix 9.2) 1. An information processing method according to claim 9 or 9.1, comprising: displaying candidate area information that can be designated as the second designated area information at a position on the captured image that is set based on the designated area information; Information processing methods. (Appendix 9.3) 9.2, comprising the steps of: displaying the candidate area information at a position on the captured image that is set based on the designated area information and real space situation information that represents a situation of the real space; Information processing device. (Appendix 9.4) 9.2 or 9.3, comprising: time information is associated with the specified location information; displaying the candidate area information at a position on the captured image that is set based on the designated area information corresponding to the designated location information and the time information associated with the designated location information; Information processing methods. (Appendix 9.5) 9. An information processing method according to any one of Supplementary Notes 9 to 9.4, notifying a preset notification destination of second designated location information indicating a position in real space corresponding to the second designated area information identified based on the second designated area information on the captured image and the real space position information; Information processing methods. (Appendix 10) Acquire designated location information that identifies a location of the designated location, and a captured image of the real space associated with real space location information that indicates a location in the real space that includes the designated location; displaying designated area information at a position on the photographed image corresponding to the designated location information based on the designated location information and the real space position information; A program that causes a computer to execute a process. [Explanation of symbols]
[0069] 10 User terminal 11 Acquisition Department 12 Specific part 13 Display section 14 Notification Department 15 Camera 16 GPS 17 Display 20 Information processing device 21 Registration Department 22 Providing Department 23 Reservation information storage unit 30 External Servers 100 Information processing device 101 CPU 102 ROM 103 RAM 104 Programs 105 Storage device 106 Drive device 107 Communication Interface 108 Input / Output Interface 109 Bus 110 Storage medium 111 Communication Network 121 Acquisition Department 122 Display section
Claims
1. an acquisition unit that acquires designated location information that identifies a location of a designated location and a captured image of a real space associated with real space location information that indicates a location in the real space including the designated location; a display unit that displays designated area information at a position on the captured image that corresponds to the designated location information based on the designated location information and the real space position information; An information processing device comprising:
2. 2. The information processing device according to claim 1, a receiving unit that receives second designated area information representing a position designated on the photographed image where the designated area information can be displayed; Information processing device.
3. 3. The information processing device according to claim 2, the display unit displays the second designated area information at a position on the captured image corresponding to the second designated area information. Information processing device.
4. 3. The information processing device according to claim 2, the display unit displays candidate area information that can be designated as the second designated area information at a position on the captured image that is set based on the designated area information. Information processing device.
5. 5. The information processing device according to claim 4, the display unit displays the candidate area information at a position on the captured image that is set based on the designated area information and real space situation information that represents a situation of the real space. Information processing device.
6. 5. The information processing device according to claim 4, time information is associated with the specified location information; the display unit displays the candidate area information at a position on the captured image that is set based on the designated area information corresponding to the designated location information and the time information associated with the designated location information. Information processing device.
7. 3. The information processing device according to claim 2, a notification unit that notifies a preset notification destination of second designated location information that indicates a position in real space corresponding to the second designated area information identified based on the second designated area information on the captured image and the real space position information, Information processing device.
8. Acquire designated location information that identifies a location of the designated location, and a captured image of the real space associated with real space location information that indicates a location in the real space that includes the designated location; displaying designated area information at a position on the photographed image corresponding to the designated location information based on the designated location information and the real space position information; Information processing methods.
9. 9. The information processing method according to claim 8, receiving second designated area information representing a position designated on the captured image where the designated area information can be displayed; Information processing methods.
10. Acquire designated location information that identifies a location of the designated location, and a captured image of the real space associated with real space location information that indicates a location in the real space that includes the designated location; displaying designated area information at a position on the photographed image corresponding to the designated location information based on the designated location information and the real space position information; A program that causes a computer to execute a process.
Citation Information
Patent Citations
Viewing area reservation system, portable terminal device and program
JP2018088045A
