Information processing device, program, information processing method, and information processing system

Abstract

To reduce a burden on shop staff at a shop in an open space.SOLUTION: An information processing device of the present invention includes: ground surface image obtaining means for obtaining a ground surface image of an open space including a shop from an unmanned aircraft that picks up the image of the ground surface; ground surface image displaying means for displaying the ground surface image; display site obtaining means for obtaining an instruction for the display site of an aligned image in the displayed ground surface image; display image creating means for creating a display image for causing a projector to display the aligned image using the aligned image and the instruction for the display site; and display image outputting means for causing the projector to output the display image.SELECTED DRAWING: Figure 1

Description

【Technical Field】 【0001】 The present invention relates to the alignment of customers who purchase products at a store. 【Background Art】 【0002】 The mobile service system described in Patent Document 1 enters a parking lot by vehicle, stops the vehicle, and sets an identifier for purchase for the vehicle that has come to the store in order to improve the safety of users who are about to join the queue to purchase products. 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Patent Application Laid-Open No. 2001-229424 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 When a store that sells products is installed in an open space such as an empty lot or a park, customers who purchase products may not know where to form a queue to purchase products. Therefore, store employees at stores that sell products in open spaces have a load other than selling products, such as queue arrangement. Therefore, it is desired to reduce the load on store employees. 【0005】 An object of the present invention is to provide an information processing device or the like that reduces the load on store employees in a store in an open space. 【Means for Solving the Problems】 【0006】 An information processing device in one embodiment of the present invention includes: a ground image acquisition means for acquiring a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground surface; a ground image display means for displaying the ground image; a display location acquisition means for acquiring an indication of the display location of an aligned image in the displayed ground image; a display image generation means for generating a display image for a projector to display the aligned image using the aligned image and the indication of the display location; and a display image output means for outputting the display image to the projector. 【0007】 A program in one embodiment of the present invention causes a computer to perform the following processes: acquiring a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground surface; displaying the ground image; acquiring instructions for the display location of an aligned image in the displayed ground image; generating a display image for a projector to display the aligned image using the aligned image and the instructions for the display location; and outputting the display image to the projector. 【0008】 The above program may be stored on a non-transitory, computer-readable storage medium. 【0009】 An information processing method in one embodiment of the present invention acquires a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground surface, displays the ground image, obtains instructions for the display location of the aligned image in the displayed ground image, generates a display image for a projector to display the aligned image using the aligned image and the display location instructions, and outputs the display image to the projector. 【0010】 An information processing system in one embodiment of the present invention includes the above-mentioned information processing device, an unmanned aerial vehicle that outputs a ground image to the information processing device, and a projector that displays the displayed image. 【0011】 In one embodiment of the present invention, an information processing device performs the above-described information processing method, an unmanned aerial vehicle outputs a ground image to the information processing device, and a projector displays the image. [Effects of the Invention] 【0012】 According to the present invention, it is possible to reduce the workload on store employees in open spaces. [Brief explanation of the drawing] 【0013】 [Figure 1] This is a block diagram showing an example of the configuration of an information processing device. [Figure 2] This diagram shows an overview of an information processing system, including an information processing device. [Figure 3] This figure shows an example of a ground surface image taken by a drone. [Figure 4] This figure shows an example of instructions for indicating the display location of aligned images. [Figure 5] This figure shows an example of a projector display. [Figure 6] This figure shows an example of how customers can align themselves by referring to an alignment image. [Figure 7] This is a flowchart illustrating an example of the operation of an information processing device. [Figure 8] This is a block diagram showing an example of the hardware configuration of an information processing device. [Modes for carrying out the invention] 【0014】 Embodiments of the present invention will be described with reference to the drawings. The drawings are for illustrating the information processing apparatus of the embodiments, but are not intended to limit the information processing apparatus of the embodiments. 【0015】 Customers who purchase products at stores in open spaces such as mobile sales do not know where to form a line to purchase products. Therefore, store clerks at stores in open spaces need to organize the lines during product sales. As a measure to avoid line organization during product sales, there is a method of installing partitions such as belt partitions or rope partitions. However, even in this case, the store clerk needs to install the partition before sales and tidy up the partition after sales. Furthermore, if the number of customers exceeds expectations, the store clerk needs to增设 partitions even during product sales. Thus, at stores in open spaces, store clerks are burdened with forming and organizing customer lines. 【0016】 Therefore, as described below, the information processing apparatus of each embodiment outputs a display image for a projector as an image for customers who purchase products at stores in open spaces to form a line in order to reduce the burden on store clerks. An open space is, for example, an open area (the part of the site where no building is constructed) provided in a large building and a condominium, and is a space equipped with pedestrian passages and plantings. Furthermore, in a broad sense including such a space, an open space is also used as a general term for spaces not covered by buildings such as parks, green spaces, streets, riverbanks, and open areas of privately-owned land in a city. Hereinafter, an open space in a broad sense will be used for explanation. 【0017】 <First Embodiment> FIG. 1 is a block diagram showing an example of the configuration of the information processing apparatus 10. The information processing apparatus 10 includes a ground surface image acquisition unit 110, a ground surface image display unit 120, a display location acquisition unit 130, a display image generation unit 140, and a display image output unit 150. 【0018】 The ground surface image acquisition unit 110 acquires a ground surface image of an open space including a store from an unmanned aircraft that photographs the ground surface. Hereinafter, the unmanned aircraft is also referred to as a "drone". For example, the ground surface image acquisition unit 110 acquires, via a wireless connection, a ground surface image of an open space including a store, which is photographed by a drone equipped with a camera from above the store. The ground surface image acquisition unit 110 may acquire a ground surface image obtained by synthesizing a plurality of images. For example, the ground surface image acquisition unit 110 may acquire a ground surface image synthesized using drone mapping. Note that drone mapping is a process of combining a plurality of aerial images taken unmanned using a drone as digital data to create a large and accurate composite image. 【0019】 The ground surface image display unit 120 displays the ground surface image. For example, when the information processing device 10 includes a touch panel, the ground surface image display unit 120 may display the ground surface image on the touch panel. Alternatively, the ground surface image display unit 120 may cause a display device such as a liquid crystal display (not shown) to display the ground surface image. Hereinafter, the ground surface image display unit 120 will be described as displaying the ground surface image, including the case where the ground surface image display unit 120 outputs the ground surface image to another device for display. The ground surface image display unit 120 may display not only a two-dimensional image but also a three-dimensional image. 【0020】 The display location acquisition unit 130 acquires an instruction for the display location of the alignment image in the displayed ground surface image. The alignment image is an image that customers of the store refer to for alignment and is an image included in the display image displayed by a projector in the open space. For example, when the information processing device 10 includes a touch panel, the display location acquisition unit 130 may acquire, as an instruction for the display location of the alignment image, the range touched by a store clerk with a finger or the like in the ground surface image displayed on the touch panel. Alternatively, when the ground surface image display unit 120 outputs the ground surface image to another device, the display location acquisition unit 130 may acquire an instruction for the display location of the alignment image from that device. The display location acquisition unit 130 may acquire not only one but also a plurality of instructions for the display location. Note that the information processing device 10 may store the alignment image in advance or may acquire the alignment image together with the instruction for the display location. 【0021】 The display image generation unit 140 generates a display image for the projector to display the aligned image, using the alignment image and the display location instruction. Hereinafter, the projector will also be referred to as the "projector". For example, based on the projector's specifications, installation location, and installation direction, the display image generation unit 140 generates a display image so that when the projector displays the display screen, the alignment image is displayed at the display location acquired as an instruction by the display location acquisition unit 130. The display image generation unit 140 may enlarge, reduce, and transform the alignment image to match the display location. For example, the display image generation unit 140 may use projection mapping techniques to superimpose images onto three-dimensional objects. Alternatively, a technique may be used to transform the aligned images to match the shape of the open space, thereby generating the display image. 【0022】 The display image generation unit 140 may generate display images to be displayed by multiple projectors. In this case, the display image generation unit 140 may generate display images that show different alignment images in at least some display locations than in other locations. For example, to avoid congestion near the store, the display image generation unit 140 may generate a display image showing footprints to indicate standing positions for projectors installed near the store. The display image generation unit 140 may also generate a display image showing an arrow, rectangle, or ellipse to indicate the area where a queue will form for projectors installed away from the store. Alternatively, the display image generation unit 140 may generate a display image for the queue formed by customers with reservations and a display image for other customers to form a queue. Alternatively, if the store has multiple counters, the display image generation unit 140 may generate a display image for each counter. In addition to the alignment image, the display image generation unit 140 may generate a display image that includes other images. For example, the display image generation unit 140 may include product information such as the name, image, and price of the products to be purchased while queuing. You may generate a display image. 【0023】 The display image output unit 150 outputs the display image to the projector. If the display image generation unit 140 is generating display images for multiple projectors, the display image output unit 150 may output the respective display image to each of the multiple projectors. 【0024】 The projector only needs to display the image acquired from the information processing device 10. As a result, the alignment image is displayed in the designated location. Therefore, customers in the store can simply refer to the alignment image included in the image displayed by the projector and line up to form a queue. 【0025】 As a description of the information processing device 10, the information processing system 80 that uses the information processing device 10 will be described. Figure 2 is a diagram showing an overview of the information processing system 80 including the information processing device 10. The information processing system 80 includes the information processing device 10, a drone 20, and a projector 30. Figure 2 also shows a store 40 and an open space 50 used for the explanation. Furthermore, in Figure 2, trees are shown near the store 40 to make the store 40 easier to see in the ground image. In Figure 2, the projector 30 is shown in a location separate from the store 40, but this is to make the projector 30 easier to see in the diagram and does not limit the location of the projector 30. For example, the projector 30 may be installed on the exterior wall around the entrance or counter of the store 40, or on a building, signboard, or pillar or other structure built in the open space 50. The information processing device 10 is a tablet equipped with a touch panel. However, this is for the convenience of explaining using Figure 2 and does not limit the information processing device 10. 【0026】 Drone 20 is equipped with a camera and, while flying over store 40, uses the camera to take ground images of the open space 50, including store 40. Figure 3 shows the images taken by drone 20. This figure shows an example of a shadowed ground image. As shown in Figure 3, the ground image includes the store 40 and the open space 50 surrounding the store 40. The drone 20 then outputs the ground image to the information processing device 10 via a wireless link or the like. 【0027】 When the ground image acquisition unit 110 acquires a ground image from the drone 20, the ground image display unit 120 displays the ground image on the touch panel. Then, store employees or others can indicate the display location by touching the ground image displayed on the touch panel with their finger or other object to indicate the location where the aligned image should be displayed. Figure 4 shows an example of an employee indicating the display location of the aligned image. In Figure 4, the arrows indicate the locations touched by the employee. For example, the top arrow indicates that the employee touched from left to right. Note that the instruction for the display location of the aligned image may also include the direction of alignment. For example, the instruction for the display location of the top arrow may include information that the customers should line up from left to right. When an employee touches the touch panel as shown in Figure 4, the display location acquisition unit 130 acquires the location touched by the employee as shown in Figure 4 as the instruction for the display location of the aligned image. The display location acquisition unit 130 may acquire a shape indicating a range, such as an ellipse or rectangle, instead of a line like the arrow shown in Figure 4, as an indication of the display location. The display image generation unit 140 then generates a display image 60 so that the projector 30 displays the aligned image at the indicated location. The display image output unit 150 then outputs the display image 60 to the projector 30. If the indication of the display location includes the direction of alignment, the display image generation unit 140 may select an aligned image indicating the direction of alignment and generate the display image. 【0028】 The projector 30 displays a display image 60 acquired from the information processing device 10. Figure 5 shows an example of the display by the projector 30. In Figure 5, the projector 30 displays the display image 60, including the alignment image 70, in the open space. As a result, the alignment image 70 is displayed in the open space corresponding to the instructions in Figure 4. Customers in the store can then line up by referring to the alignment image 70 displayed in the open space. Figure 6 shows an example of when customers line up by referring to the alignment image 70. 【0029】 Figure 7 is a flowchart showing an example of the operation of the information processing device 10. Ground image acquisition unit 110 The system acquires a ground image of the open space, including the store, from an unmanned aerial vehicle that photographs the ground surface (step S201). For example, the ground image acquisition unit 110 acquires a ground image like the one in Figure 3 from a drone 20 flying over the store 40, as shown in Figure 2. The ground image display unit 120 displays the ground image (step S202). For example, the ground image display unit 120 displays the ground image on the touch panel of the information processing device 10, as shown in Figure 3. The display location acquisition unit 130 acquires instructions for the display location of the aligned image in the displayed ground image (step S203). For example, the display location acquisition unit 130 acquires instructions for the display location of the aligned image in the information processing device, as shown in Figure 4. The location touched by the store clerk with their finger on the ground image displayed on the 10 touch panels is acquired as an instruction for the display location of the alignment image. The display image generation unit 140 uses the alignment image and the instruction for the display location to generate a display image for the projector to display the alignment image (step S204). For example, the display image generation unit 140 generates a display image for the projector 30 to display the alignment image based on the projector's specifications, installation location, and installation direction. Then, the display image output unit 150 outputs the display image to the projector (step S205). Then, for example, as shown in Figure 5, the projector 30 displays the display image in the open space. As a result, as shown in Figure 5, the alignment image is displayed in the location instructed by the store clerk. Then, as shown in Figure 6, the store's customers can refer to the alignment image and form a line. 【0030】 Thus, the information processing device 10 includes a ground surface image acquisition unit 110, a ground surface image display unit 120, a display location acquisition unit 130, a display image generation unit 140, and a display image output unit 150. The ground image acquisition unit 110 acquires ground images of open spaces, including shops, from an unmanned aerial vehicle that photographs the ground surface. The ground image display unit 120 displays the ground images. The display location acquisition unit 130 acquires instructions for the display locations of the aligned images in the displayed ground images. The display image generation unit 140 uses the aligned images and the display location instructions to generate a display image for the projector to display the aligned images. The display image output unit 150 outputs the display image to the projector. 【0031】 For example, in the information processing system 80 described with reference to Figures 2 to 6, the ground image acquisition unit 110 acquires a ground image of the open space including the store from the drone 20. The ground image display unit 120 displays the ground image on a tablet. The display location acquisition unit 130 acquires the instruction for the display location of the alignment image, which is indicated in the displayed ground image. The display image generation unit 140 uses the alignment image and the instruction for the display location to generate a display image so that the alignment image is displayed at the display location acquired by the projector 30. Then, the display image output unit 150 outputs the display image to the projector 30. Therefore, when the projector 30 displays the display image, the alignment image that customers refer to to form a line is displayed in the indicated location. In this way, using the information processing device 10, store employees can display an image for customers to line up in the store by touching the location of the alignment image on the ground image displayed by the information processing device 10 with their finger or other object. Touching the location of the alignment image on the displayed ground image with a finger or other object is a less burdensome operation compared to queuing and setting up partitions. In other words, the information processing device 10 reduces the workload on store employees for managing queues. 【0032】 The display location acquisition unit 130 may acquire instructions to modify the display location of the aligned image. For example, the display location acquisition unit 130 may acquire instructions from a store employee to modify the display location of the aligned image in the ground image displayed on the touch panel. In this case, the display image generation unit 140 should generate a display image for displaying the aligned image based on the modification instructions. The display image output unit 150 should then output the display image corresponding to the modification instructions to the projector. For example, if the number of customers purchasing products increases, the store employee may operate the touch panel to instruct the information processing device 10 to modify the display range so that the aligned image is displayed over a wider area. In this case, the information processing device 10 should generate a display image that displays the aligned image over a wider area based on the modification instructions and output it to the projector 30. 【0033】 The display location acquisition unit 130 may acquire instructions to change the alignment image. For example, the display location acquisition unit 130 may acquire instructions from a store employee to change the alignment image in the ground image displayed on the touch panel. In this case, the display image generation unit 140 should generate a display image that shows the changed alignment image. The display image output unit 150 should then output the display image with the changed alignment image to the projector. 【0034】 The ground image acquisition unit 110 may output a movement instruction to the unmanned aerial vehicle to take a ground image and acquire a ground image at the new location. For example, the ground image acquisition unit 110 may use an application installed on the information processing device 10 to control the drone 20 to output a movement instruction to the drone 20 for taking a picture and acquire a ground image from the drone 20 at the new location. Alternatively, the ground image acquisition unit 110 may instruct the control device of the drone 20 to move the drone 20. In this case, for example, a store clerk or someone similar operates the control device of the drone 20 to move the drone 20. The drone 20 then acquires a ground image at the new location and outputs it to the control device. The ground image acquisition unit 110 then acquires the ground image at the new location from the control device of the drone 20. 【0035】 <Hardware Configuration> Next, the hardware configuration of the information processing device in each embodiment will be described. Each component of the information processing device 10 may be composed of a hardware circuit. Alternatively, each component of the information processing device 10 may be composed of multiple devices connected via a network. For example, the information processing device 10 may be configured using cloud computing. Alternatively, multiple components of the information processing device 10 may be composed of a single piece of hardware. For example, if the information processing device 10 is equipped with a touch panel, the information processing device 10 may use the touch panel to realize the functions of the ground image display unit 120 and the display location acquisition unit 130. Alternatively, the information processing device 10 may be implemented as a computer device including a central processing unit (CPU), read-only memory (ROM), random access memory (RAM), and a network interface. For example, the information processing device 10 may be a notebook computer, a tablet, or a smartphone. 【0036】 Figure 8 is a block diagram showing the configuration of a computer device 600, which is an example of the hardware configuration of the information processing device 10. The computer device 600 includes a CPU 610, a ROM 620, a RAM 630, a storage device 640, a network interface 650, and a touch panel 660. 【0037】 The CPU 610 reads a program from at least one of the ROM 620 and the storage device 640. Based on the read program, the CPU 610 controls the RAM 630, the storage device 640, the network interface 650, and the touch panel 660. The computer device 600, including the CPU 610, controls these components to realize the functions of the ground image acquisition unit 110, the ground image display unit 120, the display location acquisition unit 130, the display image generation unit 140, and the display image output unit 150, as shown in Figure 1. Thus, the computer device 600 is a combination of hardware and software. It is acceptable to implement the function as is. 【0038】 Alternatively, the CPU 610 may read a program contained in a recording medium 690, which stores the program in a computer-readable format, using a recording medium reader (not shown). Alternatively, the CPU 610 may receive a program from an external device (not shown) via a network interface 650, store it in RAM 630 or storage device 640, and operate based on the stored program. 【0039】 ROM620 stores programs executed by CPU610 and static data. ROM 620 is, for example, a programmable ROM (P-ROM) or flash ROM. RAM 630 temporarily stores programs and data executed by the CPU 610. RAM 630 is, for example, dynamic RAM (D-RAM). Storage device 640 stores data and programs that the computer device 600 will store long-term. Storage device 640 may also operate as temporary storage for the CPU 610. Storage device 640 is, for example, a hard disk drive, a solid state drive (SSD), or a disk array device. 【0040】 The ROM 620 and the storage device 640 are non-transitory recording media. On the other hand, RAM630 is a transient recording medium. The CPU610 then processes the programs stored in ROM620, storage device640, and RAM630. It is possible to operate based on this. In other words, the CPU 610 can operate using either a non-volatile recording medium or a volatile recording medium. When implementing each function, the CPU 610 may use at least one of the RAM 630 and the storage device 640 as a temporary storage medium for programs and data. 【0041】 The network interface 650 relays data exchange between the drone 20 and devices such as the projector 30 via the network. The network interface 650 is, for example, a local area network (LAN) card. The network interface 650 may be wired or wireless. The touch panel 660 displays a ground image and obtains instructions for the display location of the aligned image. Thus, the touch panel 660 functions as a ground image display unit 120 and a display location acquisition unit 130. 【0042】 The computer device 600 configured in this way executes the operation of each component in the information processing device 10, thereby realizing the functions of the information processing device 10. 【0043】 Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments. Various modifications to the structure and details of the present invention can be made that can be understood by those skilled in the art within the scope of the present invention. [Explanation of symbols] 【0044】 10 Information Processing Devices 20 Drones 30 Projectors 40 stores 50 Open Space 60 displayed images 70 Aligned Images 80 Information Processing Systems 110 Ground surface image acquisition unit 120 Ground surface image display section 130 Display location acquisition unit 140 Display Image Generation Unit 150 Display Image Output Unit 600 Computer devices 610 CPU 620 ROM 630 RAM 640 Storage device 650 Network Interfaces 660 Touch Panel 690 recording media

Claims

[Claim 1] A ground image acquisition method that obtains ground images of open spaces, including shops, from an unmanned aerial vehicle that photographs the ground surface, A ground image display means for displaying the aforementioned ground image, A display location acquisition means for acquiring an indication of the display location of the aligned image in the displayed ground surface image, A display image generation means generates a display image for the projector to display the alignment image, which is obtained by converting the alignment image to match the shape of the open space, using the alignment image and the indication of the display location, the specifications of the projector, the installation location, and the installation direction. Output means for outputting the display image to the projector, thereby causing the projector to project the display image onto the open space, Information processing device including [Claim 2] The display image generation means generates a display image by converting the aligned image to match the shape of the open space using projection mapping technology, which involves pasting an image onto a three-dimensional object. The information processing apparatus according to claim 1. [Claim 3] An information processing system, A ground image acquisition method that obtains ground images of open spaces, including shops, from an unmanned aerial vehicle that photographs the ground surface, A ground image display means for displaying the aforementioned ground image, A display location acquisition means for acquiring an indication of the display location of the aligned image in the displayed ground surface image, A display image generation means generates a display image for the projection means to display the aligned image, which is a display image obtained by converting the aligned image to match the shape of the open space, using the alignment image and the indication of the display location, the specifications of the projection means, the installation location, and the installation direction. A projection means for projecting the aforementioned display image onto the open space, An information processing system that includes this. [Claim 4] The process involves acquiring ground surface images of open spaces, including shops, from an unmanned aerial vehicle that photographs the ground surface, The process of displaying the aforementioned ground surface image, A process to obtain an instruction for the display location of the aligned image in the displayed ground surface image, A process to generate a display image for the projector to display the alignment image, which is obtained by transforming the alignment image to match the shape of the open space, using the alignment image and the instructions for the display location, the specifications of the projector, the installation location, and the installation direction. The process involves outputting the display image to the projector, thereby causing the projector to project the display image onto the open space. A program that causes a computer to execute something. [Claim 5] An information processing method performed by an information processing device, We obtain ground images of open spaces, including shops, from unmanned aerial vehicles that photograph the ground surface. Display the aforementioned ground surface image, The instruction for the display location of the aligned image in the displayed ground surface image is obtained, Using the alignment image and the indication of the display location, along with the projector's specifications, installation location, and installation direction, a display image is generated for the projector to display the alignment image, which is a display image obtained by transforming the alignment image to match the shape of the open space. By outputting the display image to the projector, the projector is made to project the display image onto the open space. Information processing methods. [Claim 6] An information processing method to be performed by an information processing system, We obtain ground images of open spaces, including shops, from unmanned aerial vehicles that photograph the ground surface. Display the aforementioned ground surface image, The instruction for the display location of the aligned image in the displayed ground surface image is obtained, Using the alignment image and the indication of the display location, the specifications of the projection means, the installation location, and the installation direction, the projection means generates a display image for displaying the alignment image, which is a display image obtained by transforming the alignment image to match the shape of the open space. The aforementioned display image is projected onto the open space. Information processing methods.

Images