Server, control method, and program

Abstract

To provide a server, a control method, and a program that suppress the risk of a decrease in the measurement accuracy of the position of a terminal device.SOLUTION: A server according to the present disclosure includes a terminal device that displays visual information, an acquisition unit that acquires an image including a measurement area surface on which the terminal device is located, and a position determination unit that determines the terminal device and the position of the terminal device on the measurement area surface on the basis of the acquired image.SELECTED DRAWING: Figure 22

Description

Technical Field

[0001] The present disclosure relates to a server, a control method, and a program.

Background Art

[0002] In the position identification system disclosed in Patent Document 1, the position measurement sensor transmits a signal to obtain the position information of the mobile terminal. Further, the position measurement sensor is composed of, for example, an IMES (Indoor Messaging System) transmitter or the like. The IMES transmitter transmits information such as its own position coordinates (latitude, longitude, altitude) and floor number (floor ID), and the position information received on the mobile terminal side serving as the receiver is regarded as the received point position.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The inventors of the present application have discovered the following technical problems. In such a position identification system, the position measurement sensor transmits a signal using radio waves to obtain the position information of the mobile terminal. Therefore, when radio wave reflection or radio wave attenuation occurs, the measurement error of the position of the terminal device increases, and there is a risk that the measurement accuracy decreases.

[0005] An object of the present disclosure is to provide a server, a control method, and a program that suppress the risk of a decrease in the measurement accuracy of the position of a terminal device.

Means for Solving the Problems

[0006] The server according to the present disclosure is An acquisition unit that acquires an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located, and a position specifying unit that specifies the position of the terminal device on the terminal device and the measurement area surface based on the acquired image.

[0007] The control method according to the present disclosure is a computer acquires an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located, and specifies the position of the terminal device on the terminal device and the measurement area surface based on the acquired image.

[0008] The program according to the present disclosure is acquires an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located, and causes a computer to specify the position of the terminal device on the terminal device and the measurement area surface based on the acquired image.

Effect of the Invention

[0009] According to the present disclosure, it is possible to suppress the possibility that the measurement accuracy of the position of the terminal device decreases.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Embodiments for Carrying Out the Invention

[0011] Hereinafter, the present invention will be described through embodiments of the invention. However, the invention according to the claims is not limited to the following embodiments. Also, not all of the configurations described in the embodiments are necessarily essential as means for solving the problems. For the sake of clarity of explanation, the following description and drawings have been appropriately omitted and simplified. In each drawing, the same elements are denoted by the same reference numerals, and redundant explanations are omitted as necessary.

[0012] <Embodiment 1> A configuration example of the server 10 will be described with reference to FIGS. 1 to 9.

[0013] Of course, the right-handed XYZ coordinates shown in FIG. 3 and other drawings are for convenience in explaining the positional relationship of the components. Usually, the positive Z-axis direction is vertically upward, the XY plane is a horizontal plane, and they are common among the drawings.

[0014] As shown in FIG. 1, the server 10 includes an acquisition unit 1, a position identification unit 2, and a target area identification unit 3.

[0015] The acquisition unit 1 acquires an image. The acquired image includes a measurement area surface and a terminal device. The terminal device is located on the measurement area surface. The measurement area surface is provided with a plurality of target areas. The terminal device displays visual information. In the plurality of target areas, a plurality of target objects may be provided respectively. The target object is, for example, a shelf, a load, an area, etc.

[0016] Based on the image acquired by the acquisition unit 1, the position identification unit 2 identifies the terminal device and the position of the terminal device on the measurement area surface.

[0017] The target area specifying unit 3 specifies one target area from the plurality of target areas based on the position of the terminal device on the measurement area plane specified by the position specifying unit 2.

[0018] As shown in FIG. 2, the server 10 can be incorporated and used in the position specifying system 100. The position specifying system 100 includes a server 10, a camera device 20, a terminal device 30, and a database 40. The server 10, the camera device 20, the terminal device 30, and the database 40 may be connected to each other by wire or wirelessly so as to be able to exchange various information.

[0019] The camera device 20 is provided above the measurement area plane so as to be able to image the measurement area plane. The camera device 20 images the measurement area plane and generates an image. An example of the position specifying system 100 uses the measurement area plane SF shown in FIG. 3 as the measurement target. The measurement area plane SF is a floor surface that extends in a substantially rectangular shape. The space SP1 is a substantially rectangular parallelepiped that extends above the measurement area plane SF. An example of the camera device 20 is provided near the center of the ceiling surface SP1a of the space SP1. An example of the camera device 20 may be provided at another part of the ceiling surface SP1a of the space SP1, for example, at an end or between the center and an end. In FIG. 3, the illustration of the plurality of target areas is omitted. The space SP1 may be an indoor space or an outdoor space. The space SP1 is, for example, a store, a warehouse, a parking lot, or the like. Also, the camera device 20 shown in FIG. 3 faces the measurement area plane SF so as to be able to image it. The imaging area 20a of the camera device 20 shown in FIG. 3 extends from the camera device 20 to the side surface of the space SP1. The imaging area 20a includes the entire measurement area plane SF. Also, the imaging area 20a may include the range in which the terminal device 30 can move within the space SP1. The viewing angle α of the camera device 20 may have a size such that the camera device 20 can image an image including the measurement area plane SF and the terminal device 30. The camera device 20 images the measurement area plane SF and generates, for example, the image IM shown in FIG. 4.

[0020] The terminal device 30 is a terminal device that can be carried by the user US. The terminal device 30 is held by the user US and may be movable to a predetermined height from the measurement area surface SF. The terminal device 30 can display the visual information 30a shown in FIG. 4. The terminal device 30 may display the visual information 30a on a display unit such as a display. The visual information 30a is, for example, an identification code, a barcode, a symbol, characters, etc. The identification code may be a code that can be identified in the image captured by the camera device 20 by the server 10, and is, for example, a QR code (registered trademark). When determining the orientation of the terminal device 30, it is preferable to use asymmetrical characters as the visual information. The asymmetrical characters may be any non-symmetrical characters, not a single symmetrical character or a combination of centrally symmetrical or line-symmetrical characters.

[0021] The terminal device 30 receives operation inputs from the user US. The terminal device 30 requests the server 10 in response to the operation inputs from the user US. The terminal device 30 acquires various information from the server 10 in response to the request.

[0022] The terminal device 30 is a widely used computer device, such as a smartphone or a tablet PC. The terminal device 30 includes a central processing unit, a memory, various interfaces, a communication module, a storage, etc. The storage stores various programs. The processor reads and executes the program loaded on the memory to provide the processing and functions of the terminal device 30. The terminal device 30 may further include a depth sensor and an acceleration sensor.

[0023] The database 40 holds a table list. The table list includes user ID (identification), camera ID, floor height, floor height, field of view angle, camera-floor area coordinates, detection area coordinates, shelf number, etc. Examples of each table list held by the database 40 are shown in FIGS. 5 to 9. An example of the table list shown in FIG. 5 shows the camera ID corresponding to each user ID. An example of the table list shown in FIG. 6 shows the floor height corresponding to each user ID. An example of the table list shown in FIG. 7 shows the floor height and field of view angle corresponding to each camera ID. An example of the table list shown in FIG. 8 shows the camera-floor area coordinates corresponding to each camera ID. An example of the table list shown in FIG. 9 shows the target areas corresponding to each detection area coordinate.

[0024] Here, the camera device 20 images the measurement area surface SF. The image captured by the camera device 20 includes visual information 30a. The acquisition unit 1 shown in FIG. 1 can acquire the image captured by the camera device 20. The position identification unit 2 obtains the coordinates (X, Y) indicating the position of the terminal device 30 using the coordinates (x, y) in the image IM.

[0025] As described above, according to the configuration of the server 10, the position of the terminal device 30 can be measured based on the image including the visual information 30a. Since there is no need to use radio waves, the expansion of the measurement error ME of the position of the terminal device 30 caused by radio wave reflection and radio wave attenuation does not occur. Therefore, it is possible to suppress the possibility that the measurement accuracy of the position of the terminal device 30 decreases. Also, since there is no need to use radio waves, there is no need to install a base station in the space SP1. Therefore, the installation cost of the base station can be suppressed.

[0026] <Process> Next, with reference to FIGS. 10 to 12, an example of the process of the position identification system 100 will be described.

[0027] The location-specific system 100 measures the measurement area surface SF2 shown in FIG. 11. The terminal device 30 is located on the measurement area surface SF2. Shelves A1 to A5, shelves B1 to B5, and a package LG1 are arranged on the measurement area surface SF2. Detection areas A1A to A5A are adjacent to shelves A1 to A5 respectively. Detection areas B1A to B5A are adjacent to shelves B1 to B5 respectively. Detection area LGA1 extends around the package LG1 that is separated from shelf A1 in the positive Y-axis direction on the measurement area surface SF2. Detection area LGA2 extends in the negative Y-axis direction from shelf B5 on the measurement area surface SF2. The measurement area surface SF2 is provided with shelves A1 to A5, shelves B1 to B5, package LG1, and detection area LGA as a plurality of target areas. Note that the detection area LGA is both a detection area and a target area.

[0028] The terminal device 30 receives an operation input from the user US (step S1). The operation input may be performed by the user US using an application installed in the terminal device 30. The operation input may be a query about a target area. While the user US is operating and inputting the terminal device 30 according to their own position, an event that requests the acquisition of the target area occurs.

[0029] The terminal device 30 requests an identification code from the server 10 (step S2). The server 10 generates an identification code (step S3). The server 10 transmits the generated identification code to the terminal device 30. The terminal device 30 acquires the transmitted identification code (step S4). In the example shown in FIG. 10, the terminal device 30 acquires an identification code C1 which is an example of the visual information 30a.

[0030] The terminal device 30 displays the identification code C1 (step S5). The position and orientation of the terminal device 30 may be adjusted by the user US so that the displayed identification code can be imaged by the camera device 20. The terminal device 30 requests the server 10 for the floor coordinates indicating the position of the terminal device 30 (step S6). In an example shown in FIG. 10, the terminal device 30 notifies the server 10 of the identification code C1. The server 10 requests the image captured by the camera device 20 (step S7). The camera device 20 captures an image (step S8). The server 10 acquires the image captured by the camera device 20 (step S9).

[0031] The server 10 recognizes the identification code from the image captured by the camera device 20 (step S10). The server 10 converts it into the floor coordinates (X, Y) indicating the position of the terminal device 30 based on the recognized identification code (step S11). In an example shown in FIG. 10, the server 10 recognizes the identification code C1 from the image captured by the camera device 20. Further, the server 10 converts it into the floor coordinates (280, 375) indicating the position of the terminal device 30 based on the identification code C1.

[0032] The terminal device 30 acquires the converted floor coordinates from the server 10 (step S12). In an example shown in FIG. 10, the terminal device 30 acquires the floor coordinates (280, 375) from the server 10.

[0033] The terminal device 30 requests the server 10 for the target area (step S13). The server 10 searches for the target area from the detection area. The terminal device 30 acquires the searched target area from the server 10 (step S14). The terminal device 30 can acquire the target area from the server 10 (step S15). In a specific example shown in FIG. 12, in step S14, the server 10 can search for the detection area coordinates (250, 350)-(300, 380) and shelf A5 corresponding to the floor coordinates (280, 375) by referring to the table list shown in FIG. 9. Thereby, the terminal device 30 can acquire shelf A5 as the target area.

[0034] As described above, the terminal device 30 can acquire the target area. Accordingly, when the user US wants to perform an operation input on the terminal device 30 according to his / her own position, the user can acquire the target area corresponding to his / her own position only by causing the camera device 20 to image the visual information 30a of the terminal device 30. That is, the input procedure for the user's own position can be made more efficient.

[0035] In addition, unique visual information 30a may be assigned to the terminal device 30 in advance. That is, it is preferable that the terminal device 30 can display the unique visual information 30a without inquiring the server 10 about the visual information 30a. Thereby, the implementation of steps S2 to S4 can be omitted.

[0036] In step S6, the terminal device 30 may request the server 10 for the floor coordinates indicating the position of the terminal device 30 and the target area. Thereby, the implementation of step S13 can be omitted.

[0037] <Embodiment 2> Next, a configuration example of the server 210 will be described with reference to FIGS. 13 to 15. Similar to the server 10, the server 210 can be incorporated into the position identification system 100 shown in FIG. 2 and used.

[0038] As shown in FIG. 12, the server 210 has the same configuration as the server 10, except that it includes a target area specifying unit 23 and a height specifying unit 4.

[0039] The height specifying unit 4 specifies the terminal device height h u The terminal device height h u is the height from the measurement area surface SF of the terminal device 30. The terminal device height h u is equal to the distance from the measurement area surface SF of the terminal device 30 to the terminal device 30 in the vertical direction. Specifically, the height specifying unit 4 may specify the terminal device height h u based on the height information acquired from the terminal device 30. As shown in FIG. 14, the user US stands on the seat surface CH1 of the chair CH and lifts it to the terminal device height h u The terminal device 30 uses the depth sensor 30b and an acceleration sensor (not shown) to obtain a depth value d uand the terminal angle θ u and obtain them. Specifically, the depth value d u is the distance from the depth sensor 30b of the terminal device 30 to the measurement area surface SF in the depth direction of the depth sensor 30b. The terminal angle θ u is the straight line L along the depth direction of the depth sensor 30b of the terminal device 30 30 and the vertical line Z 30 is the magnitude of the angle formed by the intersection of the two. The terminal device 30 can calculate the terminal device height h u using the following formula (1).

Equation

[0040] The target area specifying unit 23 specifies one target area from a plurality of target areas based on the position of the terminal device 30 on the measurement area surface SF and the height of the terminal device 30 from the measurement area surface SF.

[0041] <Processing> Next, with reference to FIG. 15, an example of the processing of the position specifying system 100 in which the server 210 is incorporated will be described.

[0042] First, similar to the processing shown in FIG. 10, steps S1 to S5 are performed.

[0043] The terminal device 30 displays an identification code which is an example of the visual information 30a (step S5). The terminal device 30 measures the depth value d u and the terminal angle θ u (steps S51, S52). The terminal device 30 calculates the terminal device height h u (step S53). The terminal device 30 requests the server 10 for the floor coordinates indicating the position of the terminal device 30 (step S6). In the example shown in FIG. 15, the terminal device 30 notifies the server 10 of the identification code C1 and the terminal device height h u . Similar to the processing shown in FIG. 10, steps S7 to S15 are performed.

[0044] As described above, in the process shown in FIG. 15, similar to the process shown in FIG. 10, the terminal device 30 can acquire the target area. Thus, when the user US wants to perform an operation input on the terminal device 30 according to his / her own position, the user only needs to cause the camera device 20 to image the terminal device 30 showing the visual information 30a, and can acquire the target area corresponding to his / her own position. Furthermore, the height h of the terminal device u can be specified.

[0045] Note that in step S14 of the process shown in FIG. 15, the server 210 may search for the target area using the floor coordinates indicating the position of the terminal device 30 and the height h of the terminal device u . The terminal device 30 acquires the searched target area from the server 10. When the built-in position specifying system 100 of the server 210 measures a measurement area surface on which a plurality of target areas are provided at the same position and different heights on the measurement area surface, it may be possible to accurately specify the target areas with different heights respectively.

[0046] Also, the height specifying unit 4 may specify the height h of the terminal device based on the size of the visual information 30a in the image acquired by the acquisition unit 1 u . Specifically, the value of the height h of the terminal device corresponding to the size of the visual information 30a is measured in advance, and a table list showing the value of the height h of the terminal device corresponding to the size of the visual information 30a is stored in the database 40 or the like. The terminal device 30 refers to the correspondence between the size of the visual information 30a and the height h of the terminal device u and specifies the height h of the terminal device from the size of the visual information 30a u . u u u

[0047] Also, the height specifying unit 4 may specify the height h of the terminal device based on the height information acquired in advance u . Specifically, as shown in FIG. 16, the user height h uc and the chair height h c are measured in advance. The user height h uc is equal to the distance from the seat surface CH1 of the chair CH to the terminal device 30. Specifically, the user height h ucis equal to the distance from the seat surface CH1 of the chair CH to the terminal device 30 in the vertical direction (Z-axis direction) when the user US lifts the terminal device 30. User height h uc may be the same length as the height of the user US. Chair height h c is the height from the measurement area surface SF of the seat surface CH1 of the chair CH. Chair height h c is equal to the distance from the measurement area surface SF to the seat surface CH1 of the chair CH. Predetermined measured user height h uc and chair height h c The sum with is the terminal device height h u is equal. The terminal device 30 stores in advance the measured and calculated user height h uc and chair height h c It is advisable to remember the sum of.

[0048] Furthermore, the position specifying unit 2 may correct the position of the terminal device 30 on the measurement area surface SF using the height specified by the height specifying unit 4. In an example shown in FIGS. 17 and 18, the camera height h cc from the measurement area surface SF to the camera device 20, and the terminal device height h u Due to the difference from, the server 10 may be converted into coordinates indicating the position of the apparent terminal device 130. FIG. 18 shows an image IM2 captured by the camera device 20 shown in FIG. 17. The coordinates (x, y) indicating the position of the apparent terminal device 130 may be corrected to the coordinates (X, Y) indicating the position of the terminal device 30. Using the following formula (2), the coordinates (X, Y) indicating the position of the terminal device 30 can be obtained.

Equation

[0049] <Embodiment 3> Next, a configuration example of the server 310 will be described with reference to FIGS. 19 to 21. Similar to the server 10, the server 310 can be incorporated into the position identification system 100 shown in FIG. 2 and used.

[0050] As shown in FIG. 19, the server 310 has the same configuration as the server 10, except that it includes an orientation identification unit 5 and a target area identification unit 33.

[0051] The orientation identification unit 5 identifies the orientation on the measurement area plane SF of the terminal device 30 based on the image acquired by the acquisition unit 1. In an example shown in FIG. 20, the orientation identification unit 5 identifies the orientation on the measurement area plane SF of the terminal device 30 based on the image IM3. Specifically, the orientation of the terminal device 30 is along, for example, the longitudinal direction LD of the terminal device 30. On the measurement area plane SF, a straight line LD extending along the orientation of the terminal device 30 30 and an LX substantially parallel to the X-axis intersect to form an angle θ.

[0052] The target area identification unit 33 identifies one target area from a plurality of target areas based on the position of the terminal device 30 on the measurement area plane SF identified by the position identification unit 2 and the orientation of the terminal device 30 on the measurement area plane SF of the terminal device 30. In an example shown in FIG. 21, the target area identification unit 33 identifies shelf A5 from shelves A1 to A5, B1 to B5, and the package LG based on the coordinates indicating the position of the terminal device 30 on the measurement area plane SF identified by the position identification unit 2 and the orientation of the terminal device 30 on the measurement area plane SF of the terminal device 30. Specifically, on the measurement area plane SF, the target area identification unit 33 extends a straight line LD along the orientation of the terminal device 30 from the position of the terminal device 30 30 and selects the first hit shelf A5. More specifically, the target area identification unit 33 selects shelves A4, A5, B3, and B4 arranged on the straight line LD 30 from shelves A1 to A5 and B1 to B5. Further, the target area identification unit 33 selects shelf A5, which is the closest to the terminal device 30, from the selected shelves A4, A5, B3, and B4.

[0053] As described above, similar to Embodiment 1, the terminal device 30 can acquire the target area. As a result, when the user US wants to perform an operation input on the terminal device 30 according to their own position, the input procedure for their own position can be streamlined.

[0054] Note that the floor coordinates may be converted into a coordinate system defined using units other than the pixel units of the camera device 20. The other units are, for example, cm (centimeter) and m (meter). The coordinate system defined using other units is, for example, the WGS (World Geodetic System) 84 geodetic system. The WGS84 geodetic system is defined by latitude, longitude, and altitude.

[0055] <Embodiment 4> A configuration example of the server 110 will be described with reference to FIG. 22. Similar to the server 10, the server 110 can be incorporated into the position identification system 100 shown in FIG. 2 and utilized.

[0056] As shown in FIG. 22, the server 110 includes an acquisition unit 1 and a position identification unit 2, similar to the server 10 shown in FIG. 1. Note that the server 110 does not necessarily need to include the target area identification unit 3 shown in FIG. 1.

[0057] Based on the configuration of the server 110 described above, similar to the server 10, the position of the terminal device 30 can be measured based on the image including the visual information 30a. Since there is no need to use radio waves, the measurement error ME of the position of the terminal device 30 caused by radio wave reflection and radio wave attenuation does not occur. Therefore, it is possible to suppress the risk of a decrease in the measurement accuracy of the position of the terminal device 30. Also, since there is no need to use radio waves, there is no need to install a base station in the space SP1. Therefore, the installation cost of the base station can be suppressed.

[0058] <Other Embodiments, etc.> Note that the server according to the above embodiment can have the following hardware configuration. FIG. 23 is a diagram showing a hardware configuration example included in the server. As described in the procedures of the control method in the server in various embodiments described above, the present disclosure can also take the form of a control method.

[0059] The server 400 shown in FIG. 23 includes a processor 401 and a memory 402, along with an interface 403. Each configuration of the servers 10, 110, 210, 310 described in the above-described embodiments is realized by the processor 401 reading and executing a program stored in the memory 402. That is, this program is a control program for causing the processor 401 to function as the server 10, 110, 210, 310, or a part thereof.

[0060] The above-described program includes a set of instructions (or software code) for causing a computer to perform one or more functions described in the embodiments when loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, a computer-readable medium or a tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, a transitory computer-readable medium or a communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0061] Also, it can be said that the above-described program is a control program for causing the servers 10, 110, 210, 310 to execute such a control method.

[0062] The present disclosure has been described with reference to the embodiments above, but the present disclosure is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure. And each embodiment can be combined with other embodiments as appropriate.

[0063] Each drawing is merely an illustration for explaining one or more embodiments. Each drawing is not associated with only one specific embodiment, but may be associated with one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with the features or steps shown in one or more other drawings to create, for example, embodiments that are not explicitly illustrated or described. Not all of the features or steps shown in any one drawing for explaining exemplary embodiments are necessarily essential, and some features or steps may be omitted. The order of the steps described in any drawing may be changed as appropriate.

[0064] Some or all of the above embodiments can be described as follows in the appended claims, but are not limited thereto. (Appendix 1) An acquisition unit that acquires an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located; A position specifying unit that specifies the position of the terminal device on the terminal device and the measurement area surface based on the acquired image, A server. (Appendix 2) Further comprising a height specifying unit that specifies the height of the terminal device from the measurement area surface, The server according to Appendix 1. (Appendix 3) Comprising a target area specifying unit that specifies one target area from a plurality of target areas provided on the measurement area surface based on the position of the terminal device on the measurement area surface, The server according to Appendix 1 or 2. (Appendix 4) The height specifying unit specifies the height of the terminal device from the measurement area surface based on the height information acquired in advance. The server according to Supplementary Note 2. (Supplementary Note 5) The height specifying unit specifies the height of the terminal device from the measurement area surface based on the height information acquired from the terminal device. The server according to Supplementary Note 2. (Supplementary Note 6) The height specifying unit specifies the height of the terminal device from the measurement area surface based on the size of the visual information of the acquired image. The server according to Supplementary Note 2. (Supplementary Note 7) The position specifying unit corrects the position of the terminal device on the specified measurement area surface using the height specified by the height specifying unit. The server according to Supplementary Note 2. (Supplementary Note 8) The position specifying unit corrects the position of the terminal device on the specified measurement area surface using the height specified by the height specifying unit and the height from the measurement area surface measured in advance to the camera device that captured the acquired image. The server according to Supplementary Note 2. (Supplementary Note 9) Further comprising an orientation specifying unit that specifies the orientation of the terminal device on the measurement area surface based on the acquired image. The server according to Supplementary Note 1 or 2. (Supplementary Note 10) Comprising a target area specifying unit that specifies one target area from a plurality of target areas based on the position of the terminal device on the measurement area surface and the orientation of the terminal device on the measurement area surface. The server according to Supplementary Note 8. (Supplementary Note 11) The acquisition unit acquires an image captured by a camera device provided so as to be able to image the measurement area surface above the measurement area surface. The server according to Supplementary Note 1 or 2. (Supplementary Note 12) The computer An image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located is acquired. Based on the acquired image, the position of the terminal device on the terminal device and the measurement area surface is specified. Control method. (Appendix 13) An image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located is acquired. Based on the acquired image, the position of the terminal device on the terminal device and the measurement area surface is specified. A program for causing a computer to execute.

[0065] Some or all of the elements (for example, configurations and functions) described in Appendices 2 to 11 that are subordinate to Appendix 1 may also be subordinate to Appendices 12 and 13 in the same subordinate relationship as Appendices 2 to 11. Some or all of the elements described in any appendix may be applied to various hardware, software, recording means for recording software, systems, and methods.

Explanation of Signs

[0066] 10, 110, 210, 310, 400 Server 1 Acquisition unit 2 Position specifying unit 3, 23, 33 Target area specifying unit 4 Height specifying unit 5 Orientation specifying unit 20 Camera device 20a Imaging area 30 Terminal device 30a Visual information 30b Depth sensor 40 Database 100 Position specifying system 401 Processor 402 Memory 403 Interface A1 - A5, B1 - B5 Shelves A1A - A5A, B1A - B5A, LGA1, LGA2 Detection areas C1 Identification code CH Chair CH1 Seat surface IM, IM2, IM3 Images LG1 Luggage ME Measurement error SF, SF2 Measurement area surface SP1 Space SP1a Ceiling surface d u Depth value α Picture angle θ u Terminal angle

Claims

1. An acquisition unit that acquires an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located; A position identification unit that identifies the terminal device and the position of the terminal device on the measurement area surface based on the acquired image, A server.

2. The server according to claim 1, further comprising a height identification unit that identifies the height of the terminal device from the measurement area surface. The server according to claim 1.

3. The server according to claim 1 or 2, comprising a target area identification unit that identifies one target area from a plurality of target areas provided on the measurement area surface based on the position of the terminal device on the measurement area surface. The server according to claim 1 or 2.

4. The height identification unit identifies the height of the terminal device from the measurement area surface based on at least any one of pre-acquired height information, height information acquired from the terminal device, and the size of the visual information of the acquired image. The server according to claim 2.

5. The position identification unit corrects the position of the terminal device on the identified measurement area surface using the height identified by the height identification unit. The server according to claim 2.

6. The server according to claim 1 or 2, further comprising an orientation identification unit that identifies the orientation of the terminal device on the measurement area surface based on the acquired image. The server according to claim 1 or 2.

7. The server according to claim 6, comprising a target area identification unit that identifies one target area from a plurality of target areas based on the position of the terminal device on the measurement area surface and the orientation of the terminal device on the measurement area surface. The server according to claim 6.

8. The acquisition unit acquires an image captured by a camera device provided so as to be able to image the measurement area surface above the measurement area surface. The server according to claim 1 or 2.

9. A computer acquires an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located, and identifies the terminal device and the position of the terminal device on the measurement area surface based on the acquired image. A control method.

10. A program that causes a computer to acquire an image including a terminal device that displays visual information and a measurement area surface on which the terminal device is located, and identify the terminal device and the position of the terminal device on the measurement area surface based on the acquired image. A program.

Images