Software program, information device and information system and processing method

Abstract

To provide an application for a three-dimensional information device that uses a resource for a two-dimensional information device.SOLUTION: A system has a first application program that executes non-three-dimensional processing that is processing that is not related to three-dimensional space, a second application program that executes three-dimensional processing that is processing that is related to three-dimensional space, and a linkage interface that coordinates these two programs, the first application program executes the non-three-dimensional processing and, based on the processing results, starts the three-dimensional processing of the second application program via the linkage interface, the second application program executes the three-dimensional processing and notifies the first application program of the processing results via the linkage interface, and the first application program executes the non-three-dimensional processing based on the processing results of the three-dimensional processing.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a technique for providing applications that can be used on a three-dimensional information device that can display objects overlaid on the physical world. [Background technology]

[0002] Information processing devices equipped with HMDs (head mounted displays) that display images and objects superimposed on the physical world are beginning to be used for various purposes using augmented reality and mixed reality. This type of information processing device is sometimes called smart glasses. Unlike conventional information processing devices equipped with two-dimensional display devices such as personal computers, smartphones, and tablet terminals, smart glasses are capable of displaying three-dimensional objects and accepting operations on the objects. Hereinafter, conventional information processing devices equipped with two-dimensional display devices may be called two-dimensional information devices.

[0003] Smart glasses are expected to contribute to digital transformation (DX) of work in various fields due to advantages that two-dimensional information devices do not have. For example, Patent Document 1 discloses a smart glasses system used in the field of collaborative work between humans and robots. The smart glasses system of Patent Document 1 enables the operation of selecting a robot by an AR icon displayed on the smart glasses.

[0004] As with two-dimensional information devices, smart glasses are equipped with various functions through application software program products. Hereinafter, application software programs may simply be referred to as applications. Application products may also be referred to as program products. Program products for smart glasses will be referred to as three-dimensional program products. Three-dimensional program products may also be abbreviated as 3D-PP. Program products for two-dimensional information devices will be referred to as two-dimensional program products. Two-dimensional program products may also be abbreviated as 2D-PP. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2023-74136 A Summary of the Invention [Problem to be solved by the invention]

[0006] In order to expand the use of smart glasses to various applications, it is necessary to provide 3D-PP with various functions. In addition, it is also desirable to be able to use not only applications specialized for smart glasses, but also applications with the same functions as applications for two-dimensional information devices on smart glasses.

[0007] However, because smart glasses and two-dimensional information devices use different hardware, the implementation methods for applications in 2D-PP and 3D-PP are significantly different. For this reason, 3D-PP is usually developed separately from 2D-PP. Furthermore, when developing 3D-PP, the software programs, development processes, human resources, and other assets used in developing existing 2D-PP are not reused. For this reason, the cost of developing 3D-PP is high, which is a factor that hinders the spread of smart glasses.

[0008] One objective of the present disclosure is to provide an application for a three-dimensional information device that utilizes resources for a two-dimensional information device. [Means for solving the problem]

[0009] A software program according to one embodiment included in the present disclosure is a software program executable by a three-dimensional information device having a processor capable of executing program processing and a three-dimensional display device capable of displaying objects overlaid on the physical world, the software program having a first application program that executes non-three-dimensional processing, which is processing not related to three-dimensional space, a second application program that executes three-dimensional processing, which is processing related to three-dimensional space, and an interaction interface that links the first application program and the second application program to each other, wherein the first application program executes the non-three-dimensional processing and launches the three-dimensional processing of the second application program via the interaction interface based on the processing results, the second application program executes the three-dimensional processing and notifies the first application program of the processing results via the interaction interface, and the first application program executes the non-three-dimensional processing based on the processing results of the three-dimensional processing. Effect of the Invention

[0010] According to one aspect of the present disclosure, it is possible to provide an application for a three-dimensional information device that utilizes resources for a two-dimensional information device. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a block diagram of a business application system. [Diagram 2] This is a block diagram common to a web server for two-dimensional applications, an access point server for two-dimensional applications, and a database server for two-dimensional applications. [Diagram 3] FIG. 1 is a block diagram of a user terminal device 14. [Figure 4] 11 is a table showing user agent information of the user terminal device 14. [Diagram 5] FIG. 2 is a block diagram of a user terminal device 15. [Figure 6] 11 is a table showing user agent information of a user terminal device 15. [Figure 7] 10 is a flowchart showing a process performed when a common software program is started. [Figure 8] 13 is a flowchart of a process for linking a two-dimensional application and a three-dimensional application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0013] <System Overview> FIG. 1 is a block diagram of a business application system according to this embodiment.

[0014] The business application system 10 includes a two-dimensional application web server 11, a two-dimensional application access point server 12, a two-dimensional application database server 13, a user terminal device 14, and a user terminal device 15. Hereinafter, the two-dimensional application web server may be abbreviated as a 2D application WEB server. The two-dimensional application server may be abbreviated as a 2D application AP server. The two-dimensional application database server may be abbreviated as a 2D application DB server. The 2D application WEB server 11, the 2D application AP server 12, the 2D application DB server 13, the user terminal device 14, and the user terminal device 15 are connected to each other via a communication network 19. The communication network 19 is a WAN (Wide Area Network) and / or a LAN (Local Area Network), etc., and enables data transmission via wired lines and / or wireless lines.

[0015] The user terminal device 14 is an information device equipped with a two-dimensional display device, such as a personal computer, a smartphone, or a tablet terminal. The user terminal device 14 is equipped with a memory, a processor, and a two-dimensional display device, which are not shown. The memory stores a two-dimensional application 16, which is a software program for a two-dimensional information device to perform a predetermined task. The processing of a task for a two-dimensional information device is processing that is not related to a three-dimensional space. The processor executes the two-dimensional application 16 to execute a non-three-dimensional process that is processing that is not related to a three-dimensional space, and displays the processing results, etc., on the two-dimensional display device. The user terminal device 14 will be described in detail later.

[0016] The user terminal device 15 is an information device called smart glasses or the like, and has a memory, a processor, and a three-dimensional display device (not shown). The three-dimensional display device is a transmissive display device that allows the user to view the physical world on the opposite side of a display screen that displays objects, etc., and is a transmissive display device that allows the user to display objects superimposed on the physical world. This enables the user to experience augmented reality or mixed reality. The memory stores a software program for the three-dimensional information device. The software program includes a two-dimensional application 16, a two-dimensional / three-dimensional collaboration interface 17, and a three-dimensional application 18. The two-dimensional application 16 is shared with the one installed in the user terminal device 14. The three-dimensional application 18 is a software program that executes three-dimensional processing, which is processing that takes into account three-dimensional space, such as displaying an object superimposed on the physical world and accepting gesture operations on the object. As an example, as a non-three-dimensional process, an application for managing the entry and exit of items into a storage location can be realized by the two-dimensional application 16, and an application for indicating the storage location by an object displayed superimposed on the physical world and detecting when an item has been stored in the storage location or removed from the storage location can be realized by the three-dimensional application 18. The two-dimensional / three-dimensional linking interface 17 is a software program that provides an interface for linking the two-dimensional application 16 and the three-dimensional application 18 with each other. Details of the user terminal device 15 will be described later.

[0017] The 2D application WEB server 11 is an information processing device that returns web page information to a two-dimensional application 16 on a user terminal device 14 or 15 in response to a request from the two-dimensional application 16 .

[0018] The 2D application AP server 12 is an information processing device that executes a web application upon receiving a request from the 2D application WEB server 11 and returns a processing result to the 2D application WEB server 11. In addition, in conjunction with the execution of the web application, the 2D application AP server 12 queries and writes data to the 2D application DB server 13 as necessary.

[0019] The 2D application DB server 13 is an information processing device that manages a database in which searchable data is stored, and searches for and updates data in the database in response to requests from the 2D application AP server 12.

[0020] The hierarchical structure of 2D application WEB server 11, 2D application AP server 12, and 2D application DB server 13 has a general configuration and operation that can be used from a two-dimensional application 16.

[0021] <Server device configuration> 2 is a block diagram common to the two-dimensional application web server, the two-dimensional application access point server, and the two-dimensional application database server. Here, the two-dimensional application web server 11, the two-dimensional application access point server 12, and the two-dimensional application database server 13 are collectively referred to as server device 20.

[0022] The server device 20 includes an input device 21, an output device 22, a communication device 23, a CPU 24, a memory device 25, and a storage device 26.

[0023] Storage device 26 is a device that stores data in a writable and readable manner. Storage device 26 stores server-side business logic 27, which is a software program that realizes the functions of server device 20 as two-dimensional application web server 11, two-dimensional application access point server 12, and two-dimensional application database server 13, and business data 28, which is data used in processing server-side business logic 27.

[0024] The CPU (Central Processing Unit) 24 is a processor that reads out the business data 28 and / or the server-side business logic 27 stored in the storage device 26 into the memory device 25 and executes the processing of the server-side business logic 27 using the business data 28.

[0025] The communication device 23 is a device that receives information to be processed by the CPU 24 via the communication network 19 and transmits information on the results of processing by the CPU 24 via the communication network 19 .

[0026] The input device 21 is a device through which a user inputs information to be processed by the CPU 24, and is, for example, a keyboard, a mouse, or the like.

[0027] The output device 22 is a device for presenting information on the results of processing by the CPU 24 to a user, and is, for example, a display device such as a liquid crystal or organic electroluminescence (EL) display device.

[0028] <Configuration of the three-dimensional information device (user terminal device 15)> 3 is a block diagram of the user terminal device 14. As described above, the user terminal device 14 is an information device equipped with a two-dimensional display device, such as a personal computer, a smartphone, or a tablet terminal. The user terminal device 14 has an input device 31, an output device 32, a communication device 33, a CPU 34, a memory device 35, and a storage device 36.

[0029] The storage device 36 is a device that stores data in a writable and readable manner. The storage device 36 stores the two-dimensional application 16, a style sheet 51 for a two-dimensional information device, and business data 52 that is data used in the processing of the two-dimensional application 16. The style sheet 51 for a two-dimensional information device is information that specifies the display format suitable for a two-dimensional display device.

[0030] The CPU 34 is a processor that reads out the business data 52 and / or the two-dimensional application 16 stored in the storage device 36 into the memory device 35, and executes the processing of the two-dimensional application 16 using the business data 52. The CPU 34 also displays the results of the processing of the two-dimensional application 16 on the output device 32 in a layout according to the style sheet 51 for the two-dimensional information device.

[0031] The communication device 33 is a device that receives information to be processed by the CPU 34 via the communication network 19 and transmits information on the results of processing by the CPU 34 via the communication network 19 .

[0032] The input device 31 is a device through which a user inputs information to be processed by the CPU 34, and is, for example, a keyboard, a mouse, or the like.

[0033] The output device 32 is a device for presenting information resulting from processing by the CPU 34 to the user, and is, for example, a two-dimensional display device having a flat screen such as a liquid crystal or organic electroluminescence (EL) display.

[0034] FIG. 4 is a table showing user agent information of the user terminal device 14. As shown in FIG.

[0035] User agent information 61 of user terminal device 14, which is a two-dimensional information device, indicates OS information, browser information, and screen resolution. OS information indicates the operating system used in user terminal device 14. Browser information indicates the browser used in user terminal device 14. Screen resolution indicates the display resolution of user terminal device 14. In the example of FIG. 4, the operating system used in user terminal device 14 is OS version ** for PC clients. The browser used in user terminal device 14 is browser version ** for PC clients. The display resolution of user terminal device 14 is 1920 x 1200.

[0036] <Configuration of the three-dimensional information device (user terminal device 15)> 5 is a block diagram of the user terminal device 15. As described above, the user terminal device 15 is an information device equipped with a three-dimensional display device capable of displaying objects superimposed on the physical world, such as called smart glasses. The user terminal device 15 has an input device 41, an output device 42, a communication device 43, a CPU 44, a memory device 45, and a storage device 46.

[0037] The storage device 46 is a device that stores data in a writable and readable manner. The storage device 46 stores the two-dimensional application 16, the three-dimensional information device style sheet 53, the two-dimensional / three-dimensional linking interface 17, the three-dimensional application 18, and business data 54 that is data used in processing the two-dimensional application 16 and the three-dimensional application 18. The three-dimensional information device style sheet 53 is information that specifies the display format suitable for a three-dimensional display device.

[0038] The CPU 44 is a processor that reads the two-dimensional application 16, the three-dimensional application 18 and / or the business data 54 stored in the storage device 46 into the memory device 45, and executes the processing of the two-dimensional application 16 and the three-dimensional application 18 using the business data 54. The CPU 44 also displays the results of the processing of the two-dimensional application 16 and the three-dimensional application 18 on the output device 42 in a layout according to a style sheet 53 for a three-dimensional information device.

[0039] The communication device 43 is a device that receives information to be processed by the CPU 44 via the communication network 19 and transmits information on the results of processing by the CPU 44 via the communication network 19 .

[0040] The input device 41 is a device through which a user inputs information to be processed by the CPU 44, such as a camera. The input information can be determined from a user's gesture detected from an image captured by the camera. The input device 41 may also include a touch sensor.

[0041] The output device 42 is a device for presenting information resulting from processing by the CPU 44 to the user, and is a see-through head-mounted display device capable of displaying objects superimposed on the physical world.

[0042] The software program installed in user terminal device 14, which is a two-dimensional information device, and the software program installed in user terminal device 15, which is a three-dimensional information device, can be made common. That is, a software program having two-dimensional application 16, two-dimensional / three-dimensional collaborative interface 17, three-dimensional application 18, two-dimensional information device style sheet 51, and three-dimensional information device style sheet 53 can be installed in both user terminal device 14 and user terminal device 15.

[0043] The software program installed in user terminal device 14, which is a two-dimensional information device, the software program installed in user terminal device 15, which is a three-dimensional information device, and the software program that can be installed in both user terminal device 14 and user terminal device 15 can all be provided as program products, recorded on a recording medium or provided via a communications network.

[0044] FIG. 6 is a table showing user agent information of user terminal device 15. As shown in FIG.

[0045] The user agent information 62 of the user terminal device 15, which is a three-dimensional information device, indicates OS information, browser information, and screen resolution. The OS information indicates the operating system used in the user terminal device 15. The browser information indicates the browser used in the user terminal device 15. The screen resolution indicates the display resolution of the user terminal device 15. In the example of FIG. 6, the operating system used in the user terminal device 15 is OS version ** for smart glasses. The browser used in the user terminal device 15 is browser version ** for smart glasses. The display resolution of the user terminal device 15 is 1280×1000.

[0046] <Common software programs> Common software programs that can be installed in both user terminal device 14 and user terminal device 15 are described below.

[0047] 7 is a flow chart showing the start-up process of a common software program included in the two-dimensional application 16.

[0048] Referring to FIG. 7, when first launched, the two-dimensional application 16 determines whether the user terminal device on which the common software program is being executed is a two-dimensional information device or a three-dimensional information device (step S101).

[0049] If it is determined in step S101 that the user terminal device on which the common software program is being executed is a two-dimensional information device, the two-dimensional application 16 employs the style sheet 51 for the two-dimensional information device (step S102). Then, the two-dimensional application 16 disables the two-dimensional / three-dimensional collaborative interface (step S103).

[0050] On the other hand, if it is determined in step S101 that the user terminal device on which the common software program is being executed is a three-dimensional information device, the two-dimensional application 16 adopts the style sheet 53 for three-dimensional information devices (step S104). Next, the two-dimensional application 16 activates a two-dimensional / three-dimensional linking interface (step S105). This enables the two-dimensional application 16 and the three-dimensional application 18 to link together on the user terminal device 15, which is a three-dimensional information device, and also results in a state in which a display format suitable for a three-dimensional information device is performed. The link between the two-dimensional application 16 and the three-dimensional application 18 is performed in such a way that the two-dimensional application 16, which performs non-three-dimensional processing, utilizes the three-dimensional processing by the three-dimensional application 18.

[0051] FIG. 8 is a flowchart of a process for linking a two-dimensional application with a three-dimensional application.

[0052] In a three-dimensional processing utilization process (step S201) that utilizes three-dimensional processing, the two-dimensional application 16 sends a process start to the two-dimensional / three-dimensional cooperative interface 17 to start three-dimensional processing by the three-dimensional application 18 (step S202). At that time, the two-dimensional application 16 passes an argument corresponding to the three-dimensional processing to be started to the two-dimensional / three-dimensional cooperative interface 17.

[0053] The 2D / 3D cooperative interface 17, which has received the process invocation accompanied by the argument, starts cooperative processing (step S203), and during the cooperative processing, sends the process invocation accompanied by the argument to the 3D application 18 (step S204).

[0054] The three-dimensional application 18, which has received the process start accompanied by the arguments, executes the desired three-dimensional process in accordance with the process start and the arguments (step S205), and returns the process result as a return value to the two-dimensional / three-dimensional cooperative interface 17 (step S206). The two-dimensional / three-dimensional cooperative interface 17, which has received the return value of the process result, transmits the return value of the process result to the two-dimensional application 16 (step S207), and ends the cooperative process of S203.

[0055] The two-dimensional application 16 receives the return value of the processing result, confirms from the processing result that the desired three-dimensional processing has been performed, and ends the three-dimensional processing utilization process of S201.

[0056] For example, data is handed over from the two-dimensional application 16 to the three-dimensional application 18 via the two-dimensional / three-dimensional collaborative interface 17 by passing arguments to a method of unity (registered trademark) using Javascript (registered trademark) and calling it to operate it. The return value is output from unity to a URL or in the form of a csv or txt file, and is acquired by the two-dimensional application 16 via the two-dimensional / three-dimensional collaborative interface 17.

[0057] According to the present embodiment described above, an application for smart glasses using resources for two-dimensional information devices is provided. For example, by separating a two-dimensional application 16 that uses existing software assets to realize non-three-dimensional processing from a three-dimensional application 18 that realizes newly developed three-dimensional processing, and designing and manufacturing them so that they are linked by arguments and return values, it becomes possible to utilize software assets. In addition, by assigning processing other than three-dimensional processing to the two-dimensional application 16, which has a relatively large number of engineers with development skills, it becomes possible to efficiently utilize human resources. In addition, by constructing software that can be implemented not only on three-dimensional information devices but also on two-dimensional information devices, it becomes possible to realize the operation of business using both three-dimensional information devices and two-dimensional information devices. In addition, as a result of these, it is expected that the DX (digital transformation) of business will be advanced and accelerated.

[0058] Furthermore, with three-dimensional information devices such as smart glasses, it is difficult to use a GUI that is suitable for two-dimensional information devices such as a PC display and mouse or keyboard, or a touch-operable display such as a smartphone or tablet terminal. However, in this embodiment, the three-dimensional information device can improve user convenience by automatically selecting and using a style sheet for three-dimensional information devices that, for example, increases font size and button size.

[0059] The above-described embodiments are illustrative examples of the present invention, and are not intended to limit the scope of the present invention to these embodiments. Those skilled in the art can implement the present invention in various other forms without departing from the scope of the present invention.

[0060] The above-described embodiment includes the following features, but is not limited to the features included in the embodiment.

[0061] (Item 1) a software program executable by a three-dimensional information device having a processor capable of executing program processing and a three-dimensional display device capable of displaying objects superimposed on a physical world, the software program comprising: a first application program that executes non-three-dimensional processing that is processing not related to three-dimensional space; a second application program that executes three-dimensional processing that is processing related to three-dimensional space; and an interface that links the first application program and the second application program to each other, the first application program executes the non-three-dimensional processing and launches the three-dimensional processing of the second application program via the interface based on a result of the processing, the second application program executes the three-dimensional processing and notifies the first application program of the result of the processing via the interface, and the first application program executes the non-three-dimensional processing based on the result of the three-dimensional processing. A software program that makes it possible to provide an application for a three-dimensional information device that utilizes resources for a two-dimensional information device.

[0062] (Item 2) In the software program described in item 1, the first application program, when started, determines whether the implemented information device is a three-dimensional information device or a two-dimensional information device capable of displaying two-dimensional objects, and if the information device is a three-dimensional information device, enables the linking interface to execute the non-three-dimensional processing, and if the information device is a two-dimensional information device, disables the linking interface to execute the non-three-dimensional processing. This allows the software program to be executable on both three-dimensional information devices and two-dimensional information devices.

[0063] (Item 3) The software program according to item 2 further includes a first style sheet that defines a display format suitable for a two-dimensional display device and a second style sheet that defines a display format suitable for the three-dimensional display device, and the first application program enables the second style sheet to execute the non-three-dimensional processing if the information device is a three-dimensional information device, and enables the first style sheet to execute the non-three-dimensional processing if the information device is a two-dimensional information device. This allows the display of a style suitable for the three-dimensional display device of the smart device when the first application program is executed on the smart device.

[0064] (Item 4) In the software program described in item 2, the first application program acquires user agent information of the information device when started, and determines whether the information device is a three-dimensional information device or a two-dimensional information device based on the user agent information. This makes it possible to identify the type of information device without the user being aware of it and perform an operation appropriate to the type.

[0065] (Item 5) 2. The software program according to claim 1, wherein the first application program calls the second application program via the link interface using display data related to the object as an argument; The second application program notifies the first application program via the link interface of operation data related to the gesture operation on the object as a return value, whereby the first application program can treat the second application program as a function and link with the second application program using arguments and return values.

[0066] (Item 6) In the software program described in item 1, the first application program is an application program that manages the entry and exit of an item into a storage location, and the second application program is an application program that indicates the storage location by an object displayed by being superimposed on the physical world, and detects that the item has been put into the storage location or taken out from the storage location. This makes it possible to provide a business application that combines the management of entry and exit and guidance of entry and exit work using augmented reality.

[0067] (Item 7) A three-dimensional information device having a memory, a processor capable of executing program processing, and a three-dimensional display device capable of displaying objects superimposed on a physical world, wherein the memory stores software programs having a first application program that executes non-three-dimensional processing, which is processing not related to three-dimensional space, a second application program that executes three-dimensional processing, which is processing related to three-dimensional space, and an linkage interface that links the first application program and the second application program to each other, wherein the processor executes the non-three-dimensional processing using the first application program and launches the three-dimensional processing of the second application program via the linkage interface based on the processing results, executes the three-dimensional processing using the second application program and notifies the first application program of the processing results via the linkage interface, and executes the non-three-dimensional processing using the first application program based on the processing results of the three-dimensional processing.

[0068] (Item 8) 8. An information system comprising: a three-dimensional information device as described in item 7; and a two-dimensional information device capable of displaying two-dimensional objects and storing the software program in an executable manner, wherein the first application program determines, at startup, whether the implemented information device is a three-dimensional information device or a two-dimensional information device, and if the information device is a three-dimensional information device, enables the collaborative interface and executes the non-three-dimensional processing, and if the information device is a two-dimensional information device, disables the collaborative interface and executes the non-three-dimensional processing.

[0069] (Item 9) A processing method executed by a three-dimensional information device having a memory, a processor capable of executing program processing, and a three-dimensional display device capable of displaying objects superimposed on a physical world, wherein the memory stores a software program having a first application program that executes non-three-dimensional processing that is processing not related to three-dimensional space, a second application program that executes three-dimensional processing that is processing related to three-dimensional space, and an linkage interface that links the first application program and the second application program to each other, and the processor executes the non-three-dimensional processing using the first application program and launches the three-dimensional processing of the second application program via the linkage interface based on a result of the processing, executes the three-dimensional processing using the second application program and notifies the first application program of the result of the processing via the linkage interface, and executes the non-three-dimensional processing using the first application program based on the result of the three-dimensional processing. [Explanation of symbols]

[0070] 10...Business application system, 11...Web server for two-dimensional application, 12...Access point server for two-dimensional application, 13...Database server for two-dimensional application, 14...User terminal device, 15...User terminal device, 16...Two-dimensional application, 17...Two-dimensional / three-dimensional collaboration interface, 18...Three-dimensional application, 19...Communication network, 20...Server device, 21...Input device, 22...Output device, 23...Communication device, 24...CPU, 25...Memory device, 26...storage device, 27...server side business logic, 28...business data, 31...input device, 32...output device, 33...communication device, 34...CPU, 35...memory device, 36...storage device, 41...input device, 42...output device, 43...communication device, 44...CPU, 45...memory device, 46...storage device, 51...style sheet for two-dimensional information device, 52...business data, 53...style sheet for three-dimensional information device, 54...business data, 61...user agent information, 62...user agent information

Claims

1. A software program executable by a three-dimensional information device having a processor capable of executing the processing of the program and a three-dimensional display device capable of displaying an object superimposed on a physical world, a first application program for executing a non-three-dimensional process that is a process not related to a three-dimensional space; a second application program for executing three-dimensional processing, which is processing related to a three-dimensional space; a link interface that allows the first application program and the second application program to link with each other; having the first application program executes the non-three-dimensional processing, and based on a result of the non-three-dimensional processing, starts the three-dimensional processing of the second application program via the link interface; the second application program executes the three-dimensional processing and notifies the first application program of a processing result via the link interface; the first application program executes the non-three-dimensional processing based on a processing result of the three-dimensional processing. Software program.

2. the first application program determines, at the time of startup, whether the implemented information device is a three-dimensional information device or a two-dimensional information device capable of displaying two-dimensional objects; if the information device is a three-dimensional information device, activating the collaborative interface to execute the non-three-dimensional processing; if the information device is a two-dimensional information device, then disabling the link interface and executing the non-three-dimensional processing.

2. The software program of claim 1.

3. a first stylesheet that defines a display format suitable for a two-dimensional display device; a second stylesheet that defines a display format suitable for the three-dimensional display device; Further comprising: The first application program if the information device is a three-dimensional information device, activating the second stylesheet to perform the non-three-dimensional processing; if the information device is a two-dimensional information device, activating the first stylesheet to perform the non-three-dimensional processing; 3. The software program of claim 2.

4. the first application program acquires user agent information of the information device when started, and determines whether the information device is a three-dimensional information device or a two-dimensional information device based on the user agent information; 3. The software program of claim 2.

5. the first application program calls the second application program via the link interface using display data related to the object as an argument; the second application program notifies the first application program via the collaboration interface of operation data related to the gesture operation on the object as a return value.

2. The software program of claim 1.

6. the first application program is an application program for managing the entry and exit of an article into a storage location, the second application program is an application program that indicates the storage location by an object displayed superimposed on a physical world, and detects that the item has been stored in the storage location or that the item has been removed from the storage location.

2. The software program of claim 1.

7. A three-dimensional information device having a memory, a processor capable of executing program processing, and a three-dimensional display device capable of displaying an object superimposed on a physical world, The memory includes: a first application program for executing a non-three-dimensional process that is a process not related to a three-dimensional space; a second application program for executing three-dimensional processing, which is processing related to a three-dimensional space; a link interface that allows the first application program and the second application program to link with each other; storing a software program having The processor, executing the non-three-dimensional processing by the first application program, and initiating the three-dimensional processing of the second application program via the link interface based on a result of the non-three-dimensional processing; executing the three-dimensional processing by the second application program and notifying the first application program of the processing result via the link interface; executing the non-three-dimensional processing based on a processing result of the three-dimensional processing by the first application program; Information device.

8. The three-dimensional information device according to claim 7 ; a two-dimensional information device capable of displaying a two-dimensional object and having the software program executable thereon; the first application program determines, at the time of startup, whether the installed information device is a three-dimensional information device or a two-dimensional information device; if the information device is a three-dimensional information device, activating the collaborative interface to execute the non-three-dimensional processing; if the information device is a two-dimensional information device, then disabling the link interface and executing the non-three-dimensional processing. Information systems.

9. A processing method executed by a three-dimensional information device having a memory, a processor capable of executing program processing, and a three-dimensional display device capable of displaying an object superimposed on a physical world, comprising: The memory includes: storing a software program including a first application program for executing a non-three-dimensional process that is a process not related to a three-dimensional space, a second application program for executing a three-dimensional process that is a process related to a three-dimensional space, and a linking interface that links the first application program and the second application program with each other; The processor, executing the non-three-dimensional processing by the first application program, and initiating the three-dimensional processing of the second application program via the link interface based on a result of the non-three-dimensional processing; executing the three-dimensional processing by the second application program and notifying the first application program of the processing result via the link interface; executing the non-three-dimensional processing based on a processing result of the three-dimensional processing by the first application program; Processing methods.

Images