Information processing device, program, information processing method and information processing system

Abstract

To reduce a burden on shop staff at a shop in an open space.SOLUTION: An information processing device of the present invention includes: ground surface image obtaining means for obtaining a ground surface image of an open space including a shop from an unmanned aircraft that picks up the image of the ground surface; ground surface image displaying means for displaying the ground surface image; display site obtaining means for obtaining an instruction for the display site of an aligned image in the displayed ground surface image; display image creating means for creating a display image for causing a projector to display the aligned image using the aligned image and the instruction for the display site; and display image outputting means for causing the projector to output the display image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to queuing up customers to purchase items in a store. [Background technology]

[0002] The mobile service system described in Patent Document 1 assigns a purchase identifier to vehicles that arrive at the store in order to improve the safety of users who enter a parking lot in a vehicle, park their vehicle, and try to join the queue to purchase goods. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-229424 Summary of the Invention [Problem to be solved by the invention]

[0004] When a store selling products is located in an open space such as a vacant lot or a park, customers who purchase the products may not know where to line up to purchase the products. As a result, store clerks in stores selling products in open spaces are burdened with tasks other than selling products, such as managing lines. Therefore, it is desirable to reduce the burden on store clerks.

[0005] An object of the present invention is to provide an information processing device or the like that reduces the burden on store staff in an open space store. [Means for solving the problem]

[0006] An information processing device in one form of the present invention includes a ground image acquisition means for acquiring a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground surface, a ground image display means for displaying the ground image, a display location acquisition means for acquiring instructions for the display location of an aligned image in the displayed ground image, a display image generation means for generating a display image for a projector to display the aligned image using the aligned image and the display location instructions, and a display image output means for outputting the display image to the projector.

[0007] A program in one form of the present invention causes a computer to perform the following processes: acquiring a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground; displaying the ground image; acquiring instructions for the display location of an aligned image in the displayed ground image; generating a display image for a projector to display the aligned image using the aligned image and the instructions for the display location; and outputting the display image to the projector.

[0008] The program may be stored in a non-transitory computer-readable storage medium.

[0009] An information processing method in one form of the present invention acquires a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground surface, displays the ground image, acquires instructions for the display location of an aligned image in the displayed ground image, generates a display image for a projector to display the aligned image using the aligned image and the instructions for the display location, and outputs the display image to the projector.

[0010] An information processing system according to one aspect of the present invention includes the information processing device described above, an unmanned aerial vehicle that outputs a ground image to the information processing device, and a projector that displays a display image.

[0011] In an information processing method according to one aspect of the present invention, an information processing device executes the above-described information processing method, an unmanned aerial vehicle outputs a ground image to the information processing device, and a projector displays a display image. [Effects of the Invention]

[0012] According to the present invention, it is possible to reduce the workload of store staff in open spaces. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram illustrating an example of a configuration of an information processing device. [Figure 2] FIG. 1 is a diagram illustrating an overview of an information processing system including an information processing device. [Figure 3] FIG. 1 is a diagram illustrating an example of a ground surface image captured by a drone. [Figure 4] FIG. 10 is a diagram showing an example of an instruction for displaying the aligned images. [Figure 5] FIG. 10 is a diagram illustrating an example of a display of the projector. [Figure 6] FIG. 10 is a diagram showing an example in which customers line up with reference to the line-up image. [Figure 7] FIG. 10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 8] FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described with reference to the accompanying drawings, which are provided for the purpose of explaining an information processing apparatus according to the present invention, but are not intended to limit the scope of the present invention.

[0015] Customers who purchase products at open-space stores, such as mobile vendors, do not know where to form a line to purchase the products. Therefore, store staff in open-space stores must organize the lines while the products are being sold. One measure to avoid having to organize lines while the products are being sold is to install partitions such as belt partitions or rope partitions. However, even in this case, the store staff must set up the partitions before the sale and remove them after the sale. Furthermore, if the number of customers increases more than expected, the store staff must set up additional partitions even while the products are being sold. As such, in open-space stores, the burden of forming and organizing customer lines is placed on the store staff.

[0016] Therefore, as will be explained below, the information processing device of each embodiment outputs a display image to be displayed by a projector as an image for customers to line up to purchase products in an open-space store in order to reduce the workload of store staff. An open space is, for example, an open space (a part of the site where no buildings have been erected) provided in a large building or apartment building, and is a space equipped with pedestrian walkways and plants. Furthermore, in a broad sense including such spaces, open space is also used as a general term for spaces not covered by buildings, such as parks, green spaces, streets, riverbeds, and open spaces on private land in cities. Hereinafter, the term "open space" will be used. This will be explained using the meaning of open space.

[0017] First Embodiment 1 is a block diagram showing an example of the configuration of an information processing device 10. The information processing device 10 includes a ground surface image acquisition unit 110, a ground surface image display unit 120, a display location acquisition unit 130, a display image generation unit 140, and a display image output unit 150.

[0018] The ground image acquisition unit 110 acquires ground images of an open space including a store from an unmanned aerial vehicle that photographs the ground. Hereinafter, the unmanned aerial vehicle will also be referred to as a "drone." For example, the ground image acquisition unit 110 acquires ground images of an open space including a store, taken from above the store by a drone equipped with a camera, via a wireless connection. The ground image acquisition unit 110 may acquire a ground image that is a composite of multiple images. For example, the ground image acquisition unit 110 may acquire a composite ground image using drone mapping. Drone mapping is a process of combining multiple aerial images taken unmanned using a drone as digital data to create a large, accurate composite image.

[0019] The ground surface image display unit 120 displays a ground surface image. For example, if the information processing device 10 is equipped with a touch panel, the ground surface image display unit 120 may display the ground surface image on the touch panel. Alternatively, the ground surface image display unit 120 may display the ground surface image on a display device such as a liquid crystal display (not shown). Hereinafter, the ground surface image display unit 120 will be described as displaying a ground surface image, including a case where the ground surface image display unit 120 outputs the ground surface image to another device for display. The ground surface image display unit 120 is not limited to displaying a two-dimensional image, and may also display a three-dimensional image.

[0020] The display location acquisition unit 130 acquires an instruction for the display location of the alignment image in the displayed ground image. The alignment image is an image that customers of a store refer to when lining up, and is an image included in the display image displayed by the projector in the open space. For example, if the information processing device 10 is equipped with a touch panel, the display location acquisition unit 130 may acquire the area touched by a store clerk's finger or the like on the ground image displayed on the touch panel as an instruction for the display location of the alignment image. Alternatively, if the ground image display unit 120 outputs the ground image to another device, the display location acquisition unit 130 may acquire an instruction for the display location of the alignment image from that device. The display location acquisition unit 130 may acquire instructions for multiple display locations, not just one. Note that the information processing device 10 may store the alignment image in advance, or may acquire the alignment image along with an instruction for the display location.

[0021] The display image generation unit 140 uses the alignment image and the display location instruction to generate a display image for the projector to display the alignment image. Hereinafter, the projector will also be referred to as a "projector." For example, the display image generation unit 140 generates a display image based on the specifications, installation location, and installation direction of the projector so that when the projector displays the display screen, the alignment image is displayed at the display location acquired as an instruction by the display location acquisition unit 130. The display image generation unit 140 may enlarge, reduce, and deform the alignment image to fit the display location. For example, the display image generation unit 140 may use a projection mapping technique for pasting an image onto a three-dimensional object. Techniques may be used to transform the aligned image to fit the shape of the open space to generate the displayed image.

[0022] The display image generating unit 140 may generate display images to be displayed by multiple projectors. In this case, the display image generating unit 140 may generate a display image that displays a different lining up image in at least some display locations from that in other locations. For example, the display image generating unit 140 may generate a display image that displays footprints indicating standing positions for a projector installed near the store to avoid congestion near the store. The display image generating unit 140 may generate a display image that displays an arrow, square, or ellipse indicating the area where a line should be formed for a projector installed away from the store. Alternatively, the display image generating unit 140 may generate a display image for a line formed by customers who have made a reservation and a display image for other customers to form lines. Alternatively, if a store has multiple counters, the display image generating unit 140 may generate a display image for each counter. The display image generating unit 140 may generate a display image that includes other images in addition to a lining up image. For example, the display image generating unit 140 may generate a display image that includes product information such as the name, image, and price of the product to be purchased by lining up. A display image may be generated.

[0023] The display image output unit 150 outputs a display image to the projector. When the display image generation unit 140 generates display images for a plurality of projectors, the display image output unit 150 may output a display image for each of the plurality of projectors.

[0024] The projector may simply display the display image acquired from the information processing device 10. As a result, the alignment image is displayed in the designated display location, so that customers in the store can line up by referring to the alignment image included in the display image displayed by the projector.

[0025] To explain the information processing device 10, an information processing system 80 using the information processing device 10 will be described. FIG. 2 is a diagram illustrating an overview of the information processing system 80 including the information processing device 10. The information processing system 80 includes the information processing device 10, a drone 20, and a projector 30. FIG. 2 also illustrates a store 40 and an open space 50 for illustrative purposes. Furthermore, FIG. 2 illustrates trees near the store 40 to make the store 40 easier to understand in the ground image. Note that in FIG. 2, the projector 30 is depicted at a distance from the store 40. This is for the sake of making the projector 30 easier to understand in the drawing and does not limit the installation location of the projector 30. For example, the projector 30 may be installed on an exterior wall around the entrance or counter of the store 40, or on a building, signboard, pillar, or other structure erected in the open space 50. The information processing device 10 is a tablet equipped with a touch panel. However, this is for the convenience of explanation using FIG. 2 and does not limit the information processing device 10.

[0026] The drone 20 is equipped with a camera, and while flying above the store 40, it uses the camera to capture an image of the ground surface of the open space 50 including the store 40. 3 is a diagram showing an example of a projected ground surface image. As shown in Fig. 3, the ground surface image is an image including a store 40 and an open space 50 around the store 40. Then, the drone 20 outputs the ground surface image to the information processing device 10 via a wireless line or the like.

[0027] When the ground image acquisition unit 110 acquires a ground image from the drone 20, the ground image display unit 120 displays the ground image on a touch panel. Then, a store clerk or the like touches the display location of the alignment image on the ground image displayed on the touch panel with a finger or the like as an instruction for the display location. FIG. 4 is a diagram showing an example of an instruction for the display location of the alignment image by a store clerk. In FIG. 4, the arrow indicates the location touched by the store clerk. For example, the top arrow indicates that the store clerk touched from left to right. Note that the instruction for the display location of the alignment image may also include the lining up direction. For example, the instruction for the display location of the top arrow may include information that the line of customers should line up from left to right. When the store clerk touches the touch panel as shown in FIG. 4, the display location acquisition unit 130 acquires the location touched by the store clerk shown in FIG. 4 as an instruction for the display location of the alignment image. The display location acquisition unit 130 may acquire a shape indicating a range, such as an ellipse or a rectangle, instead of a line such as the arrow shown in FIG. 4, as an instruction for the display location. Then, the display image generation unit 140 generates the display image 60 so that the projector 30 displays the alignment image at the instructed location. Then, the display image output unit 150 outputs the display image 60 to the projector 30. If the instruction for the display location includes an alignment direction, the display image generation unit 140 may select an alignment image indicating the alignment direction and generate the display image.

[0028] The projector 30 displays a display image 60 acquired from the information processing device 10. FIG. 5 is a diagram showing an example of a display of the projector 30. In FIG. 5, the projector 30 displays the display image 60 including an alignment image 70 in an open space. As a result, the alignment image 70 is displayed in a location in the open space corresponding to the instruction in FIG. 4. Customers of the store can line up by referring to the alignment image 70 displayed in the open space. FIG. 6 is a diagram showing an example of a case where customers line up by referring to the alignment image 70.

[0029] 7 is a flow diagram showing an example of the operation of the information processing device 10. acquires a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground (step S201). For example, the ground image acquisition unit 110 acquires a ground image as shown in FIG. 3 from a drone 20 flying above a store 40 as shown in FIG. 2. The ground image display unit 120 displays the ground image (step S202). For example, the ground image display unit 120 displays the ground image on the touch panel of the information processing device 10 as shown in FIG. 3. The display location acquisition unit 130 acquires an instruction for the display location of the aligned images in the displayed ground image (step S203). For example, the display location acquisition unit 130 acquires an instruction for the display location of the aligned images in the displayed ground image from the information processing device as shown in FIG. 4. The location on the ground image displayed on the touch panel of the display unit 10 where the store clerk touches with a finger or the like is acquired as an instruction for the display location of the alignment image. The display image generation unit 140 generates a display image for the projector 30 to display the alignment image using the alignment image and the instruction for the display location (step S204). For example, the display image generation unit 140 generates a display image for the projector 30 to display the alignment image based on the specifications, installation location, and installation direction of the projector. Then, the display image output unit 150 outputs the display image to the projector (step S205). Then, for example, as shown in FIG. 5, the projector 30 displays the display image in an open space. As a result, as shown in FIG. 5, the alignment image is displayed at the location instructed by the store clerk. Then, customers in the store can refer to the alignment image and form a line, as shown in FIG. 6.

[0030] Thus, the information processing device 10 includes the ground surface image acquisition unit 110, the ground surface image display unit 120, the display location acquisition unit 130, the display image generation unit 140, and the display image output unit 150. The ground image acquisition unit 110 acquires a ground image of an open space including a store from an unmanned aerial vehicle that photographs the ground. The ground image display unit 120 displays the ground image. The display location acquisition unit 130 acquires an instruction for the display location of the aligned image in the displayed ground image. The display image generation unit 140 uses the aligned image and the instruction for the display location to generate a display image for the projector to display the aligned image. The display image output unit 150 outputs the display image to the projector.

[0031] For example, in the information processing system 80 described with reference to FIGS. 2 to 6 , the ground image acquisition unit 110 acquires a ground image of an open space including a store acquired from the drone 20. The ground image display unit 120 displays the ground image on a tablet. The display location acquisition unit 130 acquires an instruction for the display location of the lining up image, as instructed in the displayed ground image. The display image generation unit 140 generates a display image using the lining up image and the instruction for the display location so that the projector 30 displays the lining up image at the acquired display location. The display image output unit 150 then outputs the display image to the projector 30. Therefore, when the projector 30 displays the display image, the lining up image that customers refer to to form a line is displayed at the instructed location. In this way, using the information processing device 10, a store clerk can display an image for customers to line up in the store by touching the display location of the lining up image on the ground image displayed by the information processing device 10 with a finger or the like. The operation of touching the display location of the lining up image on the displayed ground image with a finger or the like is a less demanding operation than arranging lines and installing partitions. That is, the information processing device 10 reduces the burden on store staff for arranging queues.

[0032] The display location acquisition unit 130 may acquire an instruction to correct the display location of the alignment image. For example, the display location acquisition unit 130 may acquire an instruction from a store clerk to correct the display location of the alignment image on the ground image displayed on the touch panel. In this case, the display image generation unit 140 may generate a display image for displaying the alignment image based on the correction instruction. Then, the display image output unit 150 may output a display image corresponding to the correction instruction to the projector. For example, if the number of customers purchasing products increases, the store clerk may operate the touch panel to instruct the information processing device 10 to correct the display range so that the alignment image is displayed in a wider range. In this case, the information processing device 10 may generate a display image for displaying the alignment image in a wider range based on the correction instruction and output it to the projector 30.

[0033] The display location acquisition unit 130 may acquire an instruction to change the alignment image. For example, the display location acquisition unit 130 may acquire an instruction to change the alignment image from a store clerk in the ground image displayed on the touch panel. In this case, the display image generation unit 140 may generate a display image that displays the changed alignment image. Then, the display image output unit 150 may output the display image with the changed alignment image to a projector.

[0034] The ground image acquisition unit 110 may output a movement instruction to the unmanned aerial vehicle to capture a ground image, and acquire a ground image at a position after the movement. For example, the ground image acquisition unit 110 may use an application installed on the information processing device 10 to control the drone 20 to output a movement instruction for capturing an image to the drone 20, and acquire a ground image at a position after the movement from the drone 20. Alternatively, the ground image acquisition unit 110 may instruct a control device of the drone 20 to move the drone 20. In this case, for example, a store clerk or the like operates the control device of the drone 20 to move the drone 20. Then, the drone 20 may acquire a ground image at a position after the movement and output it to the control device. Then, the ground image acquisition unit 110 may acquire a ground image at a position after the movement from the control device of the drone 20.

[0035] <Hardware configuration> Next, the hardware configuration of the information processing device of each embodiment will be described. Each component of the information processing device 10 may be configured as a hardware circuit. Alternatively, each component of the information processing device 10 may be configured using multiple devices connected via a network. For example, the information processing device 10 may be configured using cloud computing. Alternatively, multiple components of the information processing device 10 may be configured as a single piece of hardware. For example, if the information processing device 10 has a touch panel, the information processing device 10 may use the touch panel to realize the functions of the ground surface image display unit 120 and the display location acquisition unit 130. Alternatively, the information processing device 10 may be realized as a computer device including a central processing unit (CPU), read-only memory (ROM), random access memory (RAM), and a network interface. For example, the information processing device 10 may be a laptop computer, a tablet, or a smartphone.

[0036] 8 is a block diagram showing the configuration of a computer device 600, which is an example of the hardware configuration of information processing device 10. Computer device 600 includes a CPU 610, a ROM 620, a RAM 630, a storage device 640, a network interface 650, and a touch panel 660.

[0037] The CPU 610 reads a program from at least one of the ROM 620 and the storage device 640. Then, the CPU 610 controls the RAM 630, the storage device 640, the network interface 650, and the touch panel 660 based on the read program. The computer device 600 including the CPU 610 controls these components to realize the functions of the ground surface image acquisition unit 110, the ground surface image display unit 120, the display location acquisition unit 130, the display image generation unit 140, and the display image output unit 150 shown in FIG. 1. In this way, the computer device 600 is a combination of hardware and software. The function may be realized as follows.

[0038] Alternatively, the CPU 610 may read a program contained in a computer-readable recording medium 690 using a recording medium reading device (not shown). Alternatively, the CPU 610 may receive a program from an external device (not shown) via the network interface 650, store the program in the RAM 630 or the storage device 640, and operate based on the stored program.

[0039] The ROM 620 stores programs executed by the CPU 610 and fixed data. The ROM 620 is, for example, a programmable ROM (P-ROM) or a flash ROM. The RAM 630 temporarily stores programs and data executed by the CPU 610. The RAM 630 is, for example, a dynamic RAM (D-RAM). The storage device 640 stores data and programs that the computer device 600 stores long-term. The storage device 640 may also operate as a temporary storage device for the CPU 610. The storage device 640 is, for example, a hard disk device, a solid state drive (SSD), or a disk array device.

[0040] The ROM 620 and the storage device 640 are non-volatile (non-transitory) recording media. On the other hand, the RAM 630 is a volatile (transitory) recording medium. The CPU 610 executes the programs stored in the ROM 620, the storage device 640, and the RAM 630. That is, the CPU 610 can operate using either a non-volatile recording medium or a volatile recording medium. When realizing each function, the CPU 610 may use at least one of the RAM 630 and the storage device 640 as a temporary storage medium for programs and data.

[0041] The network interface 650 relays data exchange with devices such as the drone 20 and the projector 30 via a network. The network interface 650 is, for example, a local area network (LAN) card. The network interface 650 is not limited to a wired connection, and may be wireless. The touch panel 660 displays the ground image and receives instructions on where to display the aligned image. In this way, the touch panel 660 realizes the functions of the ground surface image display unit 120 and the display location acquisition unit 130.

[0042] The computer device 600 configured in this manner executes the operations of the components in the information processing device 10 to realize the functions of the information processing device 10.

[0043] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0044] 10. Information processing equipment 20 Drone 30 Projectors 40 stores 50 Open Space 60 display images 70 Aligned Images 80 Information Processing Systems 110 Surface image acquisition unit 120 Surface image display section 130 Display location acquisition unit 140 Display image generation unit 150 Display image output unit 600 Computer equipment 610 CPU 620 ROM 630 RAM 640 Storage device 650 network interface 660 Touch Panel 690 Recording Media

Claims

1. a ground surface image acquisition means for acquiring ground surface images of an open space including a store from an unmanned aerial vehicle that photographs the ground surface; a ground surface image display means for displaying the ground surface image; a display location acquisition means for acquiring an instruction for a display location of the aligned image on the displayed ground image; a display image generating means for generating a display image for a projector to display the alignment image using the alignment image and the indication of the display location; a display image output means for outputting the display image to the projector; An information processing device comprising:

2. the display location acquisition means acquires an instruction to modify the display location of the aligned image; the display image generating means generates the display image for displaying the aligned image based on the correction instruction; the display image output means outputs the display image corresponding to the correction instruction to the projector. The information processing device according to claim 1 .

3. the display location acquisition means acquires an instruction to change the aligned images; the display image generating means generates the display image that displays the modified aligned image; the display image output means outputs the display image obtained by changing the alignment image to the projector.

3. The information processing device according to claim 1 or 2.

4. The ground surface image acquisition means outputs a movement instruction to the unmanned aerial vehicle to capture the ground surface image, and acquires the ground surface image at a position after the movement.

3. The information processing device according to claim 1 or 2.

5. A process of acquiring a ground surface image of an open space including a store from an unmanned aerial vehicle that photographs the ground surface; displaying the ground surface image; A process of obtaining an instruction for a display location of the aligned image on the displayed ground image; generating a display image using the alignment image and the indication of the display location for a projector to display the alignment image; outputting the display image to the projector; A program that causes a computer to execute the following.

6. Obtain ground surface images of open spaces, including stores, from an unmanned aerial vehicle that photographs the ground surface. displaying the ground image; obtaining an indication of a display location of the aligned image on the displayed ground image; generating a display image using the alignment image and the indication of the display location, for a projector to display the alignment image; The display image is output to the projector. Information processing methods.

7. The information processing device according to claim 1 or 2; the unmanned aerial vehicle that outputs the ground surface image to the information processing device; the projector for displaying the display image; An information processing system including:

8. an information processing device that executes the information processing method according to claim 6; the unmanned aerial vehicle outputs the ground surface image to the information processing device; The projector displays the display image. Information processing methods.

Images